-- Logs begin at Thu 2022-05-19 07:20:55 UTC, end at Thu 2022-05-19 09:54:53 UTC. -- May 19 08:03:49.724969 chdv-842464-2 systemd[1]: Starting Devstack devstack@n-api.service... May 19 08:03:49.732370 chdv-842464-2 devstack@n-api.service[103838]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 08:03:49 2022] *** May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: nodename: chdv-842464-2 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: machine: x86_64 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: clock source: unix May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: pcre jit disabled May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: detected number of CPU cores: 4 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: current working directory: / May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: detected binary path: /usr/bin/uwsgi-core May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: your processes number limit is 47680 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: your memory page size is 4096 bytes May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: detected max file descriptor number: 2048 May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: lock engine: pthread robust mutexes May 19 08:03:49.735893 chdv-842464-2 devstack@n-api.service[103838]: thunder lock: enabled May 19 08:03:49.743077 chdv-842464-2 devstack@n-api.service[103838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 08:03:49.743077 chdv-842464-2 devstack@n-api.service[103838]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 08:03:49.780648 chdv-842464-2 devstack@n-api.service[103838]: Python main interpreter initialized at 0x55fc39ffe9c0 May 19 08:03:49.780648 chdv-842464-2 devstack@n-api.service[103838]: python threads support enabled May 19 08:03:49.780648 chdv-842464-2 devstack@n-api.service[103838]: your server socket listen backlog is limited to 100 connections May 19 08:03:49.780648 chdv-842464-2 devstack@n-api.service[103838]: your mercy for graceful operations on workers is 90 seconds May 19 08:03:49.781095 chdv-842464-2 devstack@n-api.service[103838]: mapped 403077 bytes (393 KB) for 2 cores May 19 08:03:49.781095 chdv-842464-2 devstack@n-api.service[103838]: *** Operational MODE: preforking *** May 19 08:03:49.781345 chdv-842464-2 devstack@n-api.service[103838]: *** uWSGI is running in multiple interpreter mode *** May 19 08:03:49.781345 chdv-842464-2 devstack@n-api.service[103838]: spawned uWSGI master process (pid: 103838) May 19 08:03:49.781564 chdv-842464-2 systemd[1]: Started Devstack devstack@n-api.service. May 19 08:03:49.789332 chdv-842464-2 devstack@n-api.service[103838]: spawned uWSGI worker 1 (pid: 103839, cores: 1) May 19 08:03:49.789332 chdv-842464-2 devstack@n-api.service[103838]: spawned uWSGI worker 2 (pid: 103840, cores: 1) May 19 08:03:49.789332 chdv-842464-2 devstack@n-api.service[103838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 08:03:50.993597 chdv-842464-2 devstack@n-api.service[103840]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 08:03:51.000868 chdv-842464-2 devstack@n-api.service[103839]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 08:03:51.742932 chdv-842464-2 devstack@n-api.service[103840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:03:51.742932 chdv-842464-2 devstack@n-api.service[103840]: from cryptography.utils import int_from_bytes May 19 08:03:51.743283 chdv-842464-2 devstack@n-api.service[103840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:03:51.743283 chdv-842464-2 devstack@n-api.service[103840]: from cryptography.utils import int_from_bytes May 19 08:03:51.743445 chdv-842464-2 devstack@n-api.service[103839]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:03:51.743445 chdv-842464-2 devstack@n-api.service[103839]: from cryptography.utils import int_from_bytes May 19 08:03:51.743660 chdv-842464-2 devstack@n-api.service[103839]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:03:51.743660 chdv-842464-2 devstack@n-api.service[103839]: from cryptography.utils import int_from_bytes May 19 08:03:54.416548 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 08:03:54.417210 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 08:03:54.417600 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 08:03:54.417709 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 08:03:54.417795 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 08:03:54.417884 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 08:03:54.417966 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 08:03:54.418058 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 08:03:54.418129 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 08:03:54.418195 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 08:03:54.418341 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.418447 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.418645 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.418737 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.418956 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.419044 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.419269 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.419368 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.419593 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.419684 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.419900 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420008 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420214 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420320 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420527 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420624 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420846 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.420935 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.421100 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.421198 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.421436 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.421548 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.421761 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-842464-2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.421849 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-842464-2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.422085 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.422225 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.422393 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.422498 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.422685 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.422784 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423015 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423112 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423288 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423390 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423603 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423705 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423900 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.423992 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.424390 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.424510 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.424869 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.424980 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.425169 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.425269 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.425509 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.425605 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.425851 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.425957 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.426167 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.426258 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.426511 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.426609 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.426826 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.426978 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.427146 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.427291 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.427433 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.427622 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.427727 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.427936 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.428118 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-842464-2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.428341 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-842464-2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.428437 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.428659 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.428763 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.428975 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.429080 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.429292 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.429427 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.429727 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.429849 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430032 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430125 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430344 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430435 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430655 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430753 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.430954 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431054 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431272 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431370 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431588 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431679 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431897 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.431997 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.432211 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.432314 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.432530 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.432681 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.432844 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.432997 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.433140 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.433299 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.433486 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.433640 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.433787 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.433933 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434073 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434229 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434388 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434542 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434682 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434844 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.434990 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.435142 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.435290 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.435683 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.435823 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.435961 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436119 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436260 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436414 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436555 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436555 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436838 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.436994 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.437147 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.437147 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.437449 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.437603 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.437753 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.437893 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.438038 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.438189 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.438327 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.438600 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.438757 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.438897 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439036 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439180 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439320 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439457 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439614 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439761 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.439908 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440048 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440204 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440353 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440493 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440633 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440781 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.440920 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441059 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441059 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441385 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441385 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441656 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441795 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.441951 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.442723 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.442897 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443039 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443179 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443326 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443467 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443620 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443768 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.443914 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444053 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444192 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444337 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444497 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444638 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444785 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.444924 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445067 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445215 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445373 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445517 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445656 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445806 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.445954 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446102 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446240 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446397 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446544 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446690 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446833 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.446981 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447127 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447267 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447405 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447544 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447682 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447838 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.447979 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.448118 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.448338 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.448482 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.448727 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.448872 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.449067 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.449218 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.449396 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.449541 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.449762 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.449904 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450043 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450190 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450352 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450492 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450639 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450639 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.450904 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451054 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451194 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451194 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451469 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451469 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451733 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.451872 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452018 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452177 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452318 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452465 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452613 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452753 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.452893 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453040 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453189 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453365 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453516 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453664 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453804 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.453944 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454103 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454244 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454383 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454529 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454677 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454817 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.454966 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455106 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455246 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455396 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455536 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455683 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455824 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.455974 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.456120 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.456280 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.456428 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.456581 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.456742 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.456883 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.457023 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.457161 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.457360 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.457523 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.458273 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.458436 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.458589 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.458746 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.458966 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459121 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459262 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459262 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459532 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459673 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459821 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.459960 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460099 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460238 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460397 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460538 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460692 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460832 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.460978 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.461117 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.461255 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.461422 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.461575 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.461716 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.461855 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.461994 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:03:54.462140 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.462291 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.462440 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.462581 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.462726 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.462866 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463012 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463167 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463307 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463453 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463594 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463773 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.463917 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464075 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464216 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464362 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464507 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464655 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464802 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.464959 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.465107 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.465246 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.465437 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.465578 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.465739 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.465888 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466042 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466182 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466341 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466497 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466644 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466802 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.466946 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.467086 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.467225 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.467225 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.467525 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.467675 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.467824 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468000 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468153 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468294 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468443 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468584 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468723 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.468863 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.469103 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.469103 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.469437 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.469580 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.469727 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.469878 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470027 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470168 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470385 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470528 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470668 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470668 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.470939 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471089 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471243 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471385 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471523 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471523 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471797 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.471797 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472076 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472215 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472355 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472493 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472632 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472780 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.472929 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.473071 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.473221 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.473415 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.473558 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.473721 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.473863 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474011 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474152 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474298 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474439 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474588 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474729 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.474875 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475039 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475183 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475333 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475474 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475624 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475763 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.475902 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476056 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476213 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476367 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476521 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476666 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476820 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.476976 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.477131 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.477278 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.477479 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.477639 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.477786 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.477938 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478093 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478239 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478385 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478539 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478686 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478839 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.478995 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.479230 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.479384 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.479547 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.479695 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.479855 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480002 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480148 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480293 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480439 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480585 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480743 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.480891 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481044 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481191 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481368 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481533 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481689 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481844 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.481991 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.482137 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.482283 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.482429 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.482584 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.482731 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.482884 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483032 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483184 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483340 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483507 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483656 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483802 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.483948 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484094 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484094 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484381 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484526 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484688 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484688 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.484979 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.485147 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.485366 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.485524 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.485683 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.485830 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.485984 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.486131 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.486284 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.486430 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.486575 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.486721 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.486886 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487041 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487188 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487344 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487490 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487635 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487790 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.487936 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488081 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488233 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488386 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488533 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488692 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488692 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.488991 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.489139 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.489437 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.489595 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.489760 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490057 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490057 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490341 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490495 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490651 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490807 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.490955 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.491100 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.491246 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.491392 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.491576 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.491764 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.491922 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.492079 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.492234 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.492389 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.492546 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.492701 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.492856 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.493011 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.493159 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.493159 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.493564 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.493721 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.493868 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494014 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494014 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494300 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494446 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494599 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494745 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.494897 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495044 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495199 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495345 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495501 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495648 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495801 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.495947 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.496105 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.496253 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.496398 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.496551 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.496697 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.496842 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497010 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497157 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497338 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497503 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497661 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497817 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.497964 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.498110 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.498256 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.498402 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.498546 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.498771 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.498920 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.499066 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.499210 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.499356 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.499624 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.499822 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.499974 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.500120 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.500273 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.500420 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.500578 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.500742 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.500896 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.501042 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.501195 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.501401 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.501565 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.501737 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.501885 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502040 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502188 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502335 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502518 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502666 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502812 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.502958 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.503110 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.503257 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.503411 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.503567 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.503723 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.503870 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.504025 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.504172 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.504326 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.504473 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.505174 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.505392 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.505549 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.505696 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.505916 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.506450 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.506623 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.506772 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.506917 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507088 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507237 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507384 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507529 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507685 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507839 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.507998 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.508153 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.508307 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.508455 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.508612 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.508759 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.508918 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.509075 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.509223 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.509398 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.509549 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.509785 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.509952 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.510100 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.510254 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.510400 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.510547 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.510720 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.510870 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511025 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511181 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511328 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511482 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511642 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511789 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.511936 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512083 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512228 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512374 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512528 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512686 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512832 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.512987 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.513142 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.513335 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.513505 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.513653 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.513800 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.513947 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.514103 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.514263 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.514411 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.514564 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.514721 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.514875 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515023 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515023 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515315 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515461 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515607 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515752 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.515905 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516061 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516208 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516361 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516518 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516664 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516818 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.516974 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.517122 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.517279 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.517532 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.517683 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.517845 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.517995 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.518143 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.518289 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.518441 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.518603 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.518758 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.518905 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.519051 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.519198 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.519351 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.519498 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.519657 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.519822 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.520039 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.520271 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.520428 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.520575 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.520746 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.520894 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521042 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521188 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521377 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521531 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521696 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521844 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.521991 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.522144 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.522291 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.522447 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.522602 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.522760 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.522906 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523059 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523205 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523205 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523502 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523650 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523802 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.523956 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.524101 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.524101 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.524388 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.524545 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.524729 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.524878 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525034 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525181 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525350 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525503 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525649 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525795 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.525957 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.526113 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.526337 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.526531 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.526694 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.526840 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.526840 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.527131 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.527287 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.527446 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.527601 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.527755 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.527919 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.528087 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.528293 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.528452 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.528613 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.528772 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.528919 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.529065 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.529220 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.529430 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.529590 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.529739 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.529884 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.530049 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.530276 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.530429 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.530574 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.530732 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.530877 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531024 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531179 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531333 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531480 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531626 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531772 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.531925 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.532081 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.532237 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.532383 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.532530 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.532686 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.532847 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533003 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533149 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533294 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533470 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533628 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533785 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.533940 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534087 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534233 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534387 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534533 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534699 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534846 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.534993 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.535139 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.535284 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.535443 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.535590 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.536284 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.536505 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.536666 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.536825 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.536996 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.537167 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.537377 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.537536 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.537695 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.537843 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538007 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538156 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538302 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538459 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538606 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538752 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538911 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.538911 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.539200 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.539355 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.539503 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.539659 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.539845 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.539996 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.540143 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.540310 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.540548 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.540715 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.540865 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541012 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541158 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541342 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541508 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541665 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541813 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.541958 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.542104 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.542259 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.542413 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.542569 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.542771 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.542918 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543066 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543212 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543383 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543530 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543676 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543821 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.543968 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.544122 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.544281 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.544430 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.544576 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.544728 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.544875 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545020 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545179 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545375 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545541 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545689 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545835 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.545980 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.546135 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.546290 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.546437 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.546583 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.546729 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.546884 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547032 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547189 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547336 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547489 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547636 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547790 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.547938 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548083 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548229 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548385 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548533 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548699 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548848 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.548994 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.549196 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.549369 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.549523 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.549688 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.549836 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.549982 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.550128 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.550273 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.550427 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.550688 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.550688 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.550975 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.551121 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.551285 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.551993 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.552155 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.552155 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.552441 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.552588 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.552734 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.552734 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.553022 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.553177 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.553343 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.553343 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.553649 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.553883 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554033 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554179 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554324 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554470 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554624 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554771 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.554917 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555062 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555215 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555361 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555516 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555516 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555516 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555516 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.555516 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.556207 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.556362 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.556509 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.556654 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.556800 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.556946 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.557093 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.557247 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.557460 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.557630 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.557777 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.557923 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558070 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558224 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558378 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558527 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558674 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558819 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.558974 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.559129 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.559283 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.559437 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.559594 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.559748 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.559903 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.560058 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.560205 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.560599 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.560840 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.560994 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.561151 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.561327 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.561482 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.561629 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.561775 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.561932 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562095 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562251 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562398 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562544 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562691 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562845 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.562993 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.563138 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.563285 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.563430 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.563584 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.563744 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.563938 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564095 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564242 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564396 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564542 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564697 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564843 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.564988 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.565134 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.565279 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.565501 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.565662 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.565810 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.565967 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.566113 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.566270 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.566428 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.566576 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.566722 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.566867 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567039 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567193 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567348 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567496 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567643 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567800 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.567946 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.568092 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.568247 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.568404 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.568552 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.568698 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.568852 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569006 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569163 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569332 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569485 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569642 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569804 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.569958 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570106 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570251 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570396 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570540 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570686 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570857 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.570857 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.571210 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.571357 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.571502 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.571648 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.571818 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.571966 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.572112 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.572257 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.572403 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.572556 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.572719 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.572866 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573012 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573164 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573350 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573350 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573662 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573811 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.573957 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.574103 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.574248 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.574402 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.574555 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.574702 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.574848 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575001 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575148 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575306 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575452 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575608 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575761 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.575916 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576069 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576230 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576376 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576529 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576683 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576830 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.576985 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.577133 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.577287 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.577287 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.577603 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.577750 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.577931 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578089 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578245 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578402 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578549 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578694 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578842 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.578989 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.579144 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.579290 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.579448 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.579602 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.579750 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.579896 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580056 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580203 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580349 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580495 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580640 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580786 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.580941 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.581105 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.581359 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.581527 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.581675 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.581834 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.581989 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.582138 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.582284 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.582437 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.582592 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.582795 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.582944 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583091 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583239 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583386 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583543 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583699 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583699 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.583977 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.584132 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.584281 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.584427 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.584587 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.584734 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.584882 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585027 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585173 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585353 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585518 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585678 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585826 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585973 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.585973 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.586270 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.586418 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.586564 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.586725 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.586892 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.587090 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.587250 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.587411 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.587558 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.587712 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.587860 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588006 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588171 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588326 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588477 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588632 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588781 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.588944 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.589094 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.589243 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.589438 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.589601 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.589756 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.589912 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590060 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590216 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590371 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590519 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590674 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590830 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.590977 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.591131 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.591277 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.591722 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.591880 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592037 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592185 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592332 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592489 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592638 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592835 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.592986 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.593141 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.593289 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.593468 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.593627 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.593796 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.593945 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594099 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594254 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594402 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594558 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594727 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594876 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.594876 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.595164 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.595311 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.595463 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.595629 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.595778 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.595925 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596072 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596224 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596387 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596549 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596697 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596845 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.596999 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.597147 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.597414 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.597572 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.597736 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.597895 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.598042 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.598188 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.598964 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599203 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599359 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599514 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599662 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599662 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599950 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.599950 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.600229 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.600229 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.600520 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.600520 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.600885 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.601034 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.601181 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.601352 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.601505 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.601778 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.601934 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602082 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602229 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602375 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602533 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602689 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602837 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.602983 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.603129 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.603275 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.603422 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.603577 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.603733 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.603881 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604035 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604035 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604344 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604493 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604640 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604786 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.604932 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605078 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605233 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605410 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605559 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605705 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605851 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.605997 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.606161 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.606328 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.606483 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.606632 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.606785 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.606934 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.607089 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.607244 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.607392 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.607539 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.607686 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.607904 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608053 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608053 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608344 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608491 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608637 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608800 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.608951 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.609105 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.609252 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.609469 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.609618 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.609777 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.609925 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610078 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610241 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610387 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610548 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610695 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610848 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.610995 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.611141 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.611286 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.611446 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.611594 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.611758 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.611975 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.612139 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.612295 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.612442 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.612589 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.612589 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.612874 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.613022 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.613178 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.613349 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.613503 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.613659 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.613813 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.614518 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.614685 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.614834 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615046 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615214 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615371 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615528 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615684 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615684 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.615963 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.616109 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.616266 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.616422 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.616577 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.616726 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.616872 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.617028 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.617175 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.617356 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.617356 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.617735 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.617886 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618033 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618192 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618358 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618513 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618661 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618817 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.618973 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.619130 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.619278 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.619424 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.619570 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.619724 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.619883 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620038 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620186 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620345 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620491 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620638 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620793 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.620793 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.621080 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.621226 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.621410 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.621560 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.621716 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.621862 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622093 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622093 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622390 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622537 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622537 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622826 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.622973 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.623121 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.623275 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.623422 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.623578 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.623726 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.623873 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624027 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624185 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624341 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624488 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624644 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624792 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.624938 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.625084 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.625239 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.625448 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.625597 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.625754 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.625902 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626048 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626217 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626217 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626496 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626643 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626789 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.626935 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627090 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627246 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627393 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627539 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627685 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627840 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.627997 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628144 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628291 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628436 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628598 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628724 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628816 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628909 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.628998 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629080 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629169 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629431 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629557 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629651 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629736 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629817 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629817 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.629975 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630059 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630140 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630220 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630300 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630396 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630479 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630584 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630669 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630759 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630848 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.630944 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631028 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631028 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631173 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631254 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631333 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631423 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631505 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631589 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631677 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631759 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631847 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.631938 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632029 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632133 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632206 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632274 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632367 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632452 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632534 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632654 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.632842 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633005 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633161 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633369 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633524 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633671 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633817 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.633974 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.634199 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.634347 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.634531 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.634686 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.634860 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635013 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635169 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635328 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635476 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635623 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635770 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.635925 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636073 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636219 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636373 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636520 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636667 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636822 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.636970 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.637117 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.637328 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.637498 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.637646 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.637807 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.637955 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.638162 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.638326 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.638501 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.638662 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.638812 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.638959 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.639113 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.639270 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.639424 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.639580 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.639727 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.639875 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640021 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640167 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640313 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640484 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640668 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640824 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.640985 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.641135 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.641299 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.641490 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.641639 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.641795 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.641951 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.642098 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.642367 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.642522 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.642710 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.642863 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643027 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643176 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643342 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643490 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643645 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643793 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.643948 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.644114 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.644404 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.644559 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.644718 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.644867 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.645016 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.645241 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.645544 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.645777 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.645958 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.646140 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.646342 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.646502 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.646651 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.646805 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.646952 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.647098 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.647247 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.647407 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.647556 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.647721 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.647870 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648016 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648174 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648322 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648476 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648624 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648773 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.648921 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.649082 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.649272 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.649448 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.649607 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.649767 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.649916 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650073 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650223 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650387 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650545 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650545 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650834 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.650991 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.651147 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.651295 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.651450 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.651610 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.651768 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.651917 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.652071 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.652219 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.652386 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.652590 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.652754 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.652911 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.653066 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.653226 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.653401 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.653553 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.653728 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.653876 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.654023 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.654178 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.654326 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.654582 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.654743 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.654891 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655045 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655193 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655340 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655500 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655660 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655807 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.655807 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656093 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656239 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656400 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656549 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656695 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656842 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.656988 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.657142 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.657289 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.657461 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.657631 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.657779 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.657927 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658085 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658234 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658381 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658527 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658674 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658820 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.658979 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.659127 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.659273 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.659426 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.659426 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.659725 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.659881 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.660028 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.660174 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.660329 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.660476 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.660631 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.661361 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.661525 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.661729 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.661906 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662067 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662223 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662371 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662518 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662665 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662810 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.662958 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.663118 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.663118 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.663397 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.663545 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.663545 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.663825 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.664110 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.664265 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.664413 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.664413 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.664786 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.664949 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.665099 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.665246 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.665246 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.665618 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.665778 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.665943 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.666105 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.666105 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.666395 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.666542 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.666542 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.666873 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667032 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667182 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667336 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667336 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667634 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667781 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.667928 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668092 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668092 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668382 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668537 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668692 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668837 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.668983 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.669192 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.669387 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.669550 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.669776 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.669931 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.670182 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.670346 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.670506 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.670826 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.670980 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.671238 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.671398 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.671553 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.671777 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 08:03:54.671984 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.672608 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.673213 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.673858 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.674464 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.675068 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.675693 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.676291 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.677459 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.678075 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.678678 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.679284 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.679891 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.680504 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.681133 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.681788 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.682390 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.683020 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.683647 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.684305 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.684943 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.685845 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.686458 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.687066 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.687666 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.688254 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:03:54.688726 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 08:03:54.732960 chdv-842464-2 devstack@n-api.service[103840]: INFO dbcounter [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Registered counter for database nova_api May 19 08:03:54.755599 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:54.762359 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writer thread running {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:54.791954 chdv-842464-2 devstack@n-api.service[103839]: INFO dbcounter [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Registered counter for database nova_api May 19 08:03:54.813407 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:54.820320 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.context [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=103840) load_cells /opt/stack/nova/nova/context.py:464}} May 19 08:03:54.822320 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writer thread running {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:54.825932 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:03:54.827499 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:03:54.828280 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:03:54.830243 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:03:54.832217 chdv-842464-2 devstack@n-api.service[103840]: INFO dbcounter [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Registered counter for database nova_cell0 May 19 08:03:54.836937 chdv-842464-2 devstack@n-api.service[103840]: INFO dbcounter [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Registered counter for database nova_cell1 May 19 08:03:54.844221 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:54.845408 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:54.853756 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writer thread running {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:54.854094 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writer thread running {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:54.880326 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.context [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=103839) load_cells /opt/stack/nova/nova/context.py:464}} May 19 08:03:54.885919 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_concurrency.lockutils [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:03:54.887498 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_concurrency.lockutils [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:03:54.888338 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_concurrency.lockutils [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:03:54.890338 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_concurrency.lockutils [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103839) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:03:54.892311 chdv-842464-2 devstack@n-api.service[103839]: INFO dbcounter [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Registered counter for database nova_cell0 May 19 08:03:54.897157 chdv-842464-2 devstack@n-api.service[103839]: INFO dbcounter [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Registered counter for database nova_cell1 May 19 08:03:54.904491 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:54.906216 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:54.912488 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writer thread running {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:55.005261 chdv-842464-2 devstack@n-api.service[103840]: INFO dbcounter [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Registered counter for database nova_cell0 May 19 08:03:55.015394 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:55.021296 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writer thread running {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:55.057597 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writer thread running {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:55.069024 chdv-842464-2 devstack@n-api.service[103839]: INFO dbcounter [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Registered counter for database nova_cell0 May 19 08:03:55.078453 chdv-842464-2 devstack@n-api.service[103839]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:03:55.083474 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writer thread running {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:03:55.365979 chdv-842464-2 devstack@n-api.service[103840]: WARNING keystonemiddleware.auth_token [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:03:55.373229 chdv-842464-2 devstack@n-api.service[103840]: WARNING keystonemiddleware.auth_token [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:03:55.397472 chdv-842464-2 devstack@n-api.service[103839]: WARNING keystonemiddleware.auth_token [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:03:55.405134 chdv-842464-2 devstack@n-api.service[103839]: WARNING keystonemiddleware.auth_token [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:03:55.720730 chdv-842464-2 devstack@n-api.service[103840]: WARNING keystonemiddleware.auth_token [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:03:55.727273 chdv-842464-2 devstack@n-api.service[103840]: WARNING keystonemiddleware.auth_token [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:03:55.732484 chdv-842464-2 devstack@n-api.service[103840]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc39ffe9c0 pid: 103840 (default app) May 19 08:03:55.734543 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:03:55.735702 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 May 19 08:03:55.736112 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Thu May 19 08:03:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:03:55.748377 chdv-842464-2 devstack@n-api.service[103839]: WARNING keystonemiddleware.auth_token [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:03:55.754755 chdv-842464-2 devstack@n-api.service[103839]: WARNING keystonemiddleware.auth_token [None req-eb3889a6-33f9-48c6-822a-0e5955e1d004 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:03:55.759980 chdv-842464-2 devstack@n-api.service[103839]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc39ffe9c0 pid: 103839 (default app) May 19 08:05:17.596798 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:17.597942 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 May 19 08:05:17.598356 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:17.616084 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writing DB stats nova_api:SELECT=3 {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:17.616970 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writing DB stats nova_cell1:SELECT=3 {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:17.617828 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writing DB stats nova_cell0:SELECT=3 {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:17.618682 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writing DB stats nova_cell0:SELECT=3 {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:18.083282 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-18e714a6-e155-4378-9eb7-fafe1aed07da admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:18.114465 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-18e714a6-e155-4378-9eb7-fafe1aed07da admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.508460 May 19 08:05:18.115267 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:05:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:05:20.473214 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:20.475564 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-7ee559a8-ef80-4c2b-bbe3-9aec81fe5604 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 May 19 08:05:20.476924 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:20.551503 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-04571159-b6e8-4c6d-8239-d9261cc0f8dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:20.571253 chdv-842464-2 devstack@n-api.service[103839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:05:20.571253 chdv-842464-2 devstack@n-api.service[103839]: warnings.warn(msg) May 19 08:05:20.604798 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-04571159-b6e8-4c6d-8239-d9261cc0f8dc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.121344 May 19 08:05:20.605720 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:05:20.621751 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_api:SELECT=3 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:20.623199 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_cell1:SELECT=3 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:20.624499 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_cell0:SELECT=3 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:20.625420 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:05:20.830310 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-e382b9c5-1d64-4f53-8cb6-f3f2be1e288f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:20.833164 chdv-842464-2 devstack@n-api.service[103840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:05:20.833164 chdv-842464-2 devstack@n-api.service[103840]: warnings.warn(msg) May 19 08:05:20.896105 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-e382b9c5-1d64-4f53-8cb6-f3f2be1e288f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280826 May 19 08:05:20.896689 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1335 bytes} [Thu May 19 08:05:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:23.306308 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-04571159-b6e8-4c6d-8239-d9261cc0f8dc admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:23.307333 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-04571159-b6e8-4c6d-8239-d9261cc0f8dc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 19 08:05:23.308332 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:23.419121 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-52ec2b18-45c0-47e5-97d6-59fd770fe674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:23.437513 chdv-842464-2 devstack@n-api.service[103840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:05:23.437513 chdv-842464-2 devstack@n-api.service[103840]: warnings.warn(msg) May 19 08:05:23.456793 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-52ec2b18-45c0-47e5-97d6-59fd770fe674 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139944 May 19 08:05:23.457363 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:23.468841 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-4d6424de-9c6d-443d-b089-c521c2a69c98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:23.471246 chdv-842464-2 devstack@n-api.service[103839]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:05:23.471246 chdv-842464-2 devstack@n-api.service[103839]: warnings.warn(msg) May 19 08:05:23.507071 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-4d6424de-9c6d-443d-b089-c521c2a69c98 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041834 May 19 08:05:23.521394 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1335 bytes} [Thu May 19 08:05:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:25.889173 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-52ec2b18-45c0-47e5-97d6-59fd770fe674 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:25.892038 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-52ec2b18-45c0-47e5-97d6-59fd770fe674 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003094 May 19 08:05:25.897377 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:25 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:25.994196 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-a56c4c8c-3bb4-48ec-a292-5c892dab0f0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:26.019264 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-a56c4c8c-3bb4-48ec-a292-5c892dab0f0d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.119583 May 19 08:05:26.028514 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:26.034148 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-76b441f8-47fb-4883-8365-245aeebd04a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:26.070308 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-76b441f8-47fb-4883-8365-245aeebd04a2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040411 May 19 08:05:26.070840 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1335 bytes} [Thu May 19 08:05:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:05:28.710153 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-a56c4c8c-3bb4-48ec-a292-5c892dab0f0d admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:28.711171 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-a56c4c8c-3bb4-48ec-a292-5c892dab0f0d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 May 19 08:05:28.727422 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:28.782772 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-ed04f130-c074-490a-910a-e15de5f47229 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:28.817070 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-ed04f130-c074-490a-910a-e15de5f47229 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098935 May 19 08:05:28.818350 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:28.831075 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-e3fc9e75-e70f-44da-bd63-6a7b81b1e7c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:28.858804 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-e3fc9e75-e70f-44da-bd63-6a7b81b1e7c5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032201 May 19 08:05:28.869221 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1335 bytes} [Thu May 19 08:05:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:31.293625 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-ed04f130-c074-490a-910a-e15de5f47229 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:31.294642 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-ed04f130-c074-490a-910a-e15de5f47229 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 May 19 08:05:31.295057 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:31.362649 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-9401089b-fb53-4ee5-9918-ea739a19653f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:31.395663 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-9401089b-fb53-4ee5-9918-ea739a19653f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093210 May 19 08:05:31.396560 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:31.408886 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-b092b423-b8ca-43ba-baa2-e5a922b15556 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:31.442952 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-b092b423-b8ca-43ba-baa2-e5a922b15556 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038760 May 19 08:05:31.443725 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1335 bytes} [Thu May 19 08:05:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:05:33.839727 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-9401089b-fb53-4ee5-9918-ea739a19653f admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:33.841411 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-9401089b-fb53-4ee5-9918-ea739a19653f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 May 19 08:05:33.842073 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:33.908316 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-617773ee-86b2-4ba7-b966-8adc2a1fcc00 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:33.932354 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-617773ee-86b2-4ba7-b966-8adc2a1fcc00 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081583 May 19 08:05:33.933240 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:05:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:05:36.332695 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-9401089b-fb53-4ee5-9918-ea739a19653f admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:36.334370 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-9401089b-fb53-4ee5-9918-ea739a19653f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002104 May 19 08:05:36.339676 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:36.399541 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-c04bc0b1-983b-4642-96a3-10e27d67393a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "1", "disk": 1, "name": "m1.tiny"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:36.421155 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-c04bc0b1-983b-4642-96a3-10e27d67393a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079519 May 19 08:05:36.431619 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:36.436735 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-b803f935-de9f-4f92-a235-35327a3e242c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:36.461658 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-b803f935-de9f-4f92-a235-35327a3e242c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030196 May 19 08:05:36.478640 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1332 bytes} [Thu May 19 08:05:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:38.817985 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-c04bc0b1-983b-4642-96a3-10e27d67393a admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:38.819180 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-c04bc0b1-983b-4642-96a3-10e27d67393a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 19 08:05:38.819609 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:38.886068 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-3e085660-7b2e-4e90-a0d4-ba6aae1f5767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "m1.small", "disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:38.906590 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-3e085660-7b2e-4e90-a0d4-ba6aae1f5767 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079953 May 19 08:05:38.908768 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:38.922986 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-2eca6fb3-d21e-4610-94f9-d0be640b2e8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:38.954872 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-2eca6fb3-d21e-4610-94f9-d0be640b2e8f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035485 May 19 08:05:38.971241 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1332 bytes} [Thu May 19 08:05:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:41.351206 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-3e085660-7b2e-4e90-a0d4-ba6aae1f5767 admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:41.352577 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-3e085660-7b2e-4e90-a0d4-ba6aae1f5767 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 May 19 08:05:41.353068 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:41.432639 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-3e2e58dc-d493-4a61-8b0d-1db9cb4f4a19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:41.453448 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-3e2e58dc-d493-4a61-8b0d-1db9cb4f4a19 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.094067 May 19 08:05:41.454815 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:41.467189 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-a7b9fe5c-a3af-4b06-81f9-1ac37c4c50b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:41.491274 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-a7b9fe5c-a3af-4b06-81f9-1ac37c4c50b6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027444 May 19 08:05:41.491906 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1332 bytes} [Thu May 19 08:05:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:43.921714 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-3e2e58dc-d493-4a61-8b0d-1db9cb4f4a19 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:43.922847 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-3e2e58dc-d493-4a61-8b0d-1db9cb4f4a19 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001715 May 19 08:05:43.923263 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:43.990364 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-63ee79ca-449a-4ce3-b4c4-dca4e9c4b33b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "vcpus": 4, "id": "4"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:44.011744 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-63ee79ca-449a-4ce3-b4c4-dca4e9c4b33b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082040 May 19 08:05:44.012191 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:05:44.024561 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-9f6b6fa3-5f8c-4cbb-9a11-3d68de4e2645 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:44.049090 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-9f6b6fa3-5f8c-4cbb-9a11-3d68de4e2645 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027891 May 19 08:05:44.049569 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1332 bytes} [Thu May 19 08:05:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:05:46.404159 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-63ee79ca-449a-4ce3-b4c4-dca4e9c4b33b admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:05:46.405293 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-63ee79ca-449a-4ce3-b4c4-dca4e9c4b33b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 May 19 08:05:46.405806 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:05:46.472746 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-b72ea4bf-d345-4c52-b739-24da94a9842c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:46.502453 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-b72ea4bf-d345-4c52-b739-24da94a9842c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089935 May 19 08:05:46.503033 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1282 bytes} [Thu May 19 08:05:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:05:46.515100 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-255d8748-1680-459d-86ca-a96d0058b095 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:05:46.538275 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-255d8748-1680-459d-86ca-a96d0058b095 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027075 May 19 08:05:46.547039 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1332 bytes} [Thu May 19 08:05:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:06:17.128392 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-b72ea4bf-d345-4c52-b739-24da94a9842c admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:17.129471 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-b72ea4bf-d345-4c52-b739-24da94a9842c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 19 08:06:17.129869 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:17.142209 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:06:17.191240 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-db947923-faf5-431f-8074-7023291b7e6b admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:17.208737 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-db947923-faf5-431f-8074-7023291b7e6b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072072 May 19 08:06:17.209282 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:06:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:06:18.242643 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-b72ea4bf-d345-4c52-b739-24da94a9842c admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:18.243673 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-b72ea4bf-d345-4c52-b739-24da94a9842c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 19 08:06:18.244072 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:18.471720 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-ddc8684a-ed29-48ec-a551-645ceadd77f2 admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:18.477539 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.wsgi [None req-ddc8684a-ed29-48ec-a551-645ceadd77f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-ddc8684a-ed29-48ec-a551-645ceadd77f2 admin admin] Request method failure captured: May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Accept: application/json May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Accept-Encoding: gzip, deflate May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Connection: keep-alive May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Content-Length: 0 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Host: 10.222.0.78 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Openstack-Api-Version: compute 2.90 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: Openstack-System-Scope: None May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: User-Agent: python-novaclient May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Auth-Token: gAAAAABihfp6kxf2B1RA5SzPCGtzPZIc-ZxZ8tjZ8Jsr-n0_V5WA9sb3S5cRyTOI1ykQ1fXwIimmhBSFZJ6iDkxESE7jv6J2VNhimT-qz6BvOz-dvFDzOyZc9kRMWbvidGM-m5ajgtQfCrjfCAeYGdEmfrTCcjfhwP2Xv2r-KRJ6vIGOYQmTqd4 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Domain-Id: None May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Domain-Name: None May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Identity-Status: Confirmed May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Is-Admin-Project: True May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Openstack-Nova-Api-Version: 2.90 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Domain-Id: default May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Domain-Name: Default May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Name: admin May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Role: reader,member,admin May 19 08:06:18.480747 chdv-842464-2 devstack@n-api.service[103839]: X-Roles: reader,member,admin May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant: admin May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant-Name: admin May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-User: admin May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-User-Domain-Id: default May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-User-Domain-Name: Default May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-User-Id: 3ec1949212ef4fa9977a282b1f616663 May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: X-User-Name: admin May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: method: > May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: exception: Flavor 42 could not be found. May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: action_args: {'id': '42'} May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:06:18.482622 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:18.485229 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:18.487324 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-ddc8684a-ed29-48ec-a551-645ceadd77f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:06:18.489228 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-ddc8684a-ed29-48ec-a551-645ceadd77f2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068900 May 19 08:06:18.489228 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:06:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 08:06:18.496276 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-2381136d-a2ba-474f-a4bc-8b9236339978 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:18.499382 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:06:18.519926 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-2381136d-a2ba-474f-a4bc-8b9236339978 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028216 May 19 08:06:18.520496 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:06:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:06:18.535276 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-94513c98-4227-4ce2-8ba6-2b926593c99b admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:18.557676 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-94513c98-4227-4ce2-8ba6-2b926593c99b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025957 May 19 08:06:18.558255 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:06:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:06:18.569453 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-650fa0b8-bf48-4443-9f68-c569621dd403 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:18.575908 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.wsgi [None req-650fa0b8-bf48-4443-9f68-c569621dd403 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-650fa0b8-bf48-4443-9f68-c569621dd403 admin admin] Request method failure captured: May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Accept: application/json May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Accept-Encoding: gzip, deflate May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Connection: keep-alive May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Content-Length: 0 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Host: 10.222.0.78 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Openstack-Api-Version: compute 2.90 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: Openstack-System-Scope: None May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: User-Agent: python-novaclient May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Auth-Token: gAAAAABihfp6kxf2B1RA5SzPCGtzPZIc-ZxZ8tjZ8Jsr-n0_V5WA9sb3S5cRyTOI1ykQ1fXwIimmhBSFZJ6iDkxESE7jv6J2VNhimT-qz6BvOz-dvFDzOyZc9kRMWbvidGM-m5ajgtQfCrjfCAeYGdEmfrTCcjfhwP2Xv2r-KRJ6vIGOYQmTqd4 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Domain-Id: None May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Domain-Name: None May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Identity-Status: Confirmed May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Is-Admin-Project: True May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Openstack-Nova-Api-Version: 2.90 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Domain-Id: default May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Domain-Name: Default May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Name: admin May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Role: reader,member,admin May 19 08:06:18.579117 chdv-842464-2 devstack@n-api.service[103840]: X-Roles: reader,member,admin May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant: admin May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant-Name: admin May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-User: admin May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-User-Domain-Id: default May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-User-Domain-Name: Default May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-User-Id: 3ec1949212ef4fa9977a282b1f616663 May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: X-User-Name: admin May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: method: > May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: exception: Flavor 42 could not be found. May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: action_args: {'id': '42'} May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:06:18.580682 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:18.581758 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:18.583060 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-650fa0b8-bf48-4443-9f68-c569621dd403 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:06:18.584307 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-650fa0b8-bf48-4443-9f68-c569621dd403 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015374 May 19 08:06:18.584307 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:06:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 08:06:19.502092 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-94513c98-4227-4ce2-8ba6-2b926593c99b admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:19.503092 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-94513c98-4227-4ce2-8ba6-2b926593c99b admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 19 08:06:19.503513 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:19.697998 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-14792544-1dbf-4f8f-9cf9-309df1fa6a0f admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:19.703568 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.wsgi [None req-14792544-1dbf-4f8f-9cf9-309df1fa6a0f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-14792544-1dbf-4f8f-9cf9-309df1fa6a0f admin admin] Request method failure captured: May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Accept: application/json May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Accept-Encoding: gzip, deflate May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Connection: keep-alive May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Content-Length: 0 May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Host: 10.222.0.78 May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Openstack-Api-Version: compute 2.90 May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: Openstack-System-Scope: None May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: User-Agent: python-novaclient May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Auth-Token: gAAAAABihfp75uQSvNZLn5hWgaA7XzZ1SKFLALk88aV51Hjz8H6gB5HWRmILyGViqrjJ3yk1epo87HMPiemJGHf_uzIYRpYi23ekzX8IRkSr7RiIT6Rte4CMab0rOJs0zjJbaSSYJkZkfYA78Td_-rDuKBlJ_KDfMUfPtLpCye6Hfyb_wCJ9JgY May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Domain-Id: None May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Domain-Name: None May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Identity-Status: Confirmed May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Is-Admin-Project: True May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Openstack-Nova-Api-Version: 2.90 May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Domain-Id: default May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Domain-Name: Default May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Name: admin May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Role: reader,member,admin May 19 08:06:19.705070 chdv-842464-2 devstack@n-api.service[103840]: X-Roles: reader,member,admin May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant: admin May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant-Name: admin May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-User: admin May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-User-Domain-Id: default May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-User-Domain-Name: Default May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-User-Id: 3ec1949212ef4fa9977a282b1f616663 May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: X-User-Name: admin May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: method: > May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: exception: Flavor 84 could not be found. May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: action_args: {'id': '84'} May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:06:19.706742 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:19.707607 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:19.708728 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-14792544-1dbf-4f8f-9cf9-309df1fa6a0f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:06:19.710047 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-14792544-1dbf-4f8f-9cf9-309df1fa6a0f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064368 May 19 08:06:19.710047 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:06:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 08:06:19.716247 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-d20d829e-26a7-46b4-a372-85223adbb01b admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:19.730935 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-d20d829e-26a7-46b4-a372-85223adbb01b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018190 May 19 08:06:19.731522 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:06:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:06:19.742106 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-128ef4a5-c168-43d9-a4b1-0133d5dfeb59 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:19.756021 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-128ef4a5-c168-43d9-a4b1-0133d5dfeb59 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017591 May 19 08:06:19.756572 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:06:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:06:19.765996 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-7c541a98-61e9-47ff-8caa-731b0f2c2710 admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:19.771438 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.wsgi [None req-7c541a98-61e9-47ff-8caa-731b0f2c2710 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-7c541a98-61e9-47ff-8caa-731b0f2c2710 admin admin] Request method failure captured: May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Accept: application/json May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Accept-Encoding: gzip, deflate May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Connection: keep-alive May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Content-Length: 0 May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Host: 10.222.0.78 May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Openstack-Api-Version: compute 2.90 May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: Openstack-System-Scope: None May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: User-Agent: python-novaclient May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Auth-Token: gAAAAABihfp75uQSvNZLn5hWgaA7XzZ1SKFLALk88aV51Hjz8H6gB5HWRmILyGViqrjJ3yk1epo87HMPiemJGHf_uzIYRpYi23ekzX8IRkSr7RiIT6Rte4CMab0rOJs0zjJbaSSYJkZkfYA78Td_-rDuKBlJ_KDfMUfPtLpCye6Hfyb_wCJ9JgY May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Domain-Id: None May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Domain-Name: None May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Identity-Status: Confirmed May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Is-Admin-Project: True May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Openstack-Nova-Api-Version: 2.90 May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Domain-Id: default May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Domain-Name: Default May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Name: admin May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Role: reader,member,admin May 19 08:06:19.772931 chdv-842464-2 devstack@n-api.service[103839]: X-Roles: reader,member,admin May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant: admin May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant-Name: admin May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-User: admin May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-User-Domain-Id: default May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-User-Domain-Name: Default May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-User-Id: 3ec1949212ef4fa9977a282b1f616663 May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: X-User-Name: admin May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: method: > May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: exception: Flavor 84 could not be found. May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: action_args: {'id': '84'} May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:06:19.774463 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:19.775375 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:19.776443 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-7c541a98-61e9-47ff-8caa-731b0f2c2710 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:06:19.777572 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-7c541a98-61e9-47ff-8caa-731b0f2c2710 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011956 May 19 08:06:19.777572 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:06:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 19 08:06:20.705206 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-128ef4a5-c168-43d9-a4b1-0133d5dfeb59 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:20.706230 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-128ef4a5-c168-43d9-a4b1-0133d5dfeb59 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 19 08:06:20.706625 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:20.903132 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-719442d1-acd0-4cfa-96b5-132030e2f266 admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:20.909237 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.wsgi [None req-719442d1-acd0-4cfa-96b5-132030e2f266 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-719442d1-acd0-4cfa-96b5-132030e2f266 admin admin] Request method failure captured: May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Accept: application/json May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Accept-Encoding: gzip, deflate May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Connection: keep-alive May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Content-Length: 0 May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Host: 10.222.0.78 May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Openstack-Api-Version: compute 2.90 May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: Openstack-System-Scope: None May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: User-Agent: python-novaclient May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Auth-Token: gAAAAABihfp8OtQGniyB-Ig0wUdI1kZXBZWCFrtLX5v0A00ptNzWAUiBNFDF0pUlV_pBahxCS_Nb_cMkW0kf4ZV0rGA5LM_r5foYNM6aOh-k0q42v40waDGlrxFT-O8zO6P6PJ_iqOf_HLduI8k1pSCjh9hj0AehcU6L0XvCBdp6w8nntPvzwBA May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Domain-Id: None May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Domain-Name: None May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Identity-Status: Confirmed May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Is-Admin-Project: True May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Openstack-Nova-Api-Version: 2.90 May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Domain-Id: default May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Domain-Name: Default May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Project-Name: admin May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Role: reader,member,admin May 19 08:06:20.910770 chdv-842464-2 devstack@n-api.service[103839]: X-Roles: reader,member,admin May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant: admin May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-Tenant-Name: admin May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-User: admin May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-User-Domain-Id: default May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-User-Domain-Name: Default May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-User-Id: 3ec1949212ef4fa9977a282b1f616663 May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: X-User-Name: admin May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: method: > May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: exception: Flavor 451 could not be found. May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: action_args: {'id': '451'} May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:06:20.912339 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:20.913406 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: ERROR nova.api.openstack.wsgi May 19 08:06:20.914625 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-719442d1-acd0-4cfa-96b5-132030e2f266 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:06:20.915611 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-719442d1-acd0-4cfa-96b5-132030e2f266 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066658 May 19 08:06:20.915611 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:06:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 08:06:20.922248 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-f58f5df1-7064-4fd5-ae9b-4e73d788474f admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:20.936261 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-f58f5df1-7064-4fd5-ae9b-4e73d788474f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017951 May 19 08:06:20.937459 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:06:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:06:20.947440 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:20.963129 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019369 May 19 08:06:20.963673 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:06:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:06:20.973178 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-86a3cbd1-4289-4e4a-b2bb-89a71ebb7c2b admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:20.978516 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.wsgi [None req-86a3cbd1-4289-4e4a-b2bb-89a71ebb7c2b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-86a3cbd1-4289-4e4a-b2bb-89a71ebb7c2b admin admin] Request method failure captured: May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Accept: application/json May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Accept-Encoding: gzip, deflate May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Connection: keep-alive May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Content-Length: 0 May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Host: 10.222.0.78 May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Openstack-Api-Version: compute 2.90 May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: Openstack-System-Scope: None May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: User-Agent: python-novaclient May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Auth-Token: gAAAAABihfp8OtQGniyB-Ig0wUdI1kZXBZWCFrtLX5v0A00ptNzWAUiBNFDF0pUlV_pBahxCS_Nb_cMkW0kf4ZV0rGA5LM_r5foYNM6aOh-k0q42v40waDGlrxFT-O8zO6P6PJ_iqOf_HLduI8k1pSCjh9hj0AehcU6L0XvCBdp6w8nntPvzwBA May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Domain-Id: None May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Domain-Name: None May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Identity-Status: Confirmed May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Is-Admin-Project: True May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Openstack-Nova-Api-Version: 2.90 May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Domain-Id: default May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Domain-Name: Default May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Project-Name: admin May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Role: reader,member,admin May 19 08:06:20.979987 chdv-842464-2 devstack@n-api.service[103840]: X-Roles: reader,member,admin May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f70cff7a6ada421ebbdb76cd096dc2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant: admin May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant-Id: f70cff7a6ada421ebbdb76cd096dc2b9 May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-Tenant-Name: admin May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-User: admin May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-User-Domain-Id: default May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-User-Domain-Name: Default May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-User-Id: 3ec1949212ef4fa9977a282b1f616663 May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: X-User-Name: admin May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: method: > May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: exception: Flavor 451 could not be found. May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: action_args: {'id': '451'} May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:06:20.981552 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:20.986416 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: ERROR nova.api.openstack.wsgi May 19 08:06:20.987891 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-86a3cbd1-4289-4e4a-b2bb-89a71ebb7c2b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:06:20.989259 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-86a3cbd1-4289-4e4a-b2bb-89a71ebb7c2b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011753 May 19 08:06:20.989259 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:06:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 08:06:21.907204 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:21.908206 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 19 08:06:21.908604 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:22.111485 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-acdd53a9-3a85-4d57-9859-b07ef3595218 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:06:22.133039 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-acdd53a9-3a85-4d57-9859-b07ef3595218 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075707 May 19 08:06:22.133624 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Thu May 19 08:06:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:06:23.054313 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:23.055360 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 19 08:06:23.055745 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:23.247926 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-8c6b4032-603a-4059-b52d-a37745a71e6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:06:23.266177 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-8c6b4032-603a-4059-b52d-a37745a71e6e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072153 May 19 08:06:23.266752 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Thu May 19 08:06:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:06:24.191622 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:24.192623 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 19 08:06:24.193020 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:24.384979 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-7016edb7-baa0-4c2c-a705-14f5907c07b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:06:24.402435 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-7016edb7-baa0-4c2c-a705-14f5907c07b9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071606 May 19 08:06:24.402912 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Thu May 19 08:06:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:06:25.333089 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:25.334153 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 19 08:06:25.334584 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:25.535436 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-2af2f983-ce31-4a8d-b85e-3cfdc248e4dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:06:25.554048 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-2af2f983-ce31-4a8d-b85e-3cfdc248e4dc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072591 May 19 08:06:25.554588 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Thu May 19 08:06:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:06:26.518632 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:26.519679 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 19 08:06:26.520113 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:06:26.718163 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-ea5df7ef-f0ee-4726-ac32-c221122a8789 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:06:26.738879 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-ea5df7ef-f0ee-4726-ac32-c221122a8789 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078468 May 19 08:06:26.739435 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Thu May 19 08:06:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:07:30.891253 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:07:30.892388 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-0a095e87-74c1-431b-b1e9-3f6b19f3134c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 19 08:07:30.892770 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 930 bytes} [Thu May 19 08:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:07:30.899860 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:07:30.953036 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-964bdab9-cb89-4308-9971-c5178c03fe02 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:07:30.973368 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-964bdab9-cb89-4308-9971-c5178c03fe02 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074784 May 19 08:07:30.973916 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:07:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:07:30.993507 chdv-842464-2 devstack@n-api.service[103839]: DEBUG dbcounter [-] [103839] Writing DB stats nova_api:SELECT=14 {{(pid=103839) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:07:30.997710 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-71c0fc20-9e74-4f0c-8f4e-59817c1db6e7 admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:07:31.005576 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-71c0fc20-9e74-4f0c-8f4e-59817c1db6e7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013551 May 19 08:07:31.006116 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1282 bytes} [Thu May 19 08:07:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:07:31.018028 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-405f13e6-451d-46ae-88b9-116d798e416f admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:07:31.025687 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-405f13e6-451d-46ae-88b9-116d798e416f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011290 May 19 08:07:31.026226 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1285 bytes} [Thu May 19 08:07:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:07:31.038079 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-55a0a7d0-5ac8-4f24-8a16-9dc73ad2543c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:07:31.046286 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-55a0a7d0-5ac8-4f24-8a16-9dc73ad2543c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011726 May 19 08:07:31.046748 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1285 bytes} [Thu May 19 08:07:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:07:31.057851 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-acc47cf9-7762-469b-838a-a247590eeaa1 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:07:31.066862 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-acc47cf9-7762-469b-838a-a247590eeaa1 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012510 May 19 08:07:31.067436 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1282 bytes} [Thu May 19 08:07:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:13:19.192602 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-55a0a7d0-5ac8-4f24-8a16-9dc73ad2543c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:13:19.193697 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-55a0a7d0-5ac8-4f24-8a16-9dc73ad2543c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 May 19 08:13:19.194116 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:13:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:13:19.351909 chdv-842464-2 devstack@n-api.service[103840]: DEBUG dbcounter [-] [103840] Writing DB stats nova_api:SELECT=6 {{(pid=103840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:13:19.468768 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-9dc2e210-0816-4d17-b9d5-9613d747eeb6 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:13:19.469959 chdv-842464-2 devstack@n-api.service[103840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:13:19.469959 chdv-842464-2 devstack@n-api.service[103840]: warnings.warn(msg) May 19 08:13:19.471142 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-9dc2e210-0816-4d17-b9d5-9613d747eeb6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:13:19.471597 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-9dc2e210-0816-4d17-b9d5-9613d747eeb6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:13:19.473024 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-9dc2e210-0816-4d17-b9d5-9613d747eeb6 admin admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:13:19.473497 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-9dc2e210-0816-4d17-b9d5-9613d747eeb6 admin admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:13:19.513134 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-9dc2e210-0816-4d17-b9d5-9613d747eeb6 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.162687 May 19 08:13:19.513745 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:13:19 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:13:20.438849 chdv-842464-2 devstack@n-api.service[103839]: DEBUG nova.api.openstack.wsgi [None req-55a0a7d0-5ac8-4f24-8a16-9dc73ad2543c admin admin] Calling method '>' {{(pid=103839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:13:20.439847 chdv-842464-2 devstack@n-api.service[103839]: INFO nova.api.openstack.requestlog [None req-55a0a7d0-5ac8-4f24-8a16-9dc73ad2543c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 19 08:13:20.441590 chdv-842464-2 devstack@n-api.service[103839]: [pid: 103839|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Thu May 19 08:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:13:20.643405 chdv-842464-2 devstack@n-api.service[103840]: DEBUG nova.api.openstack.wsgi [None req-6d7cda20-6fc7-476c-b3c9-933f384cf131 admin admin] Calling method '>' {{(pid=103840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:13:20.645419 chdv-842464-2 devstack@n-api.service[103840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:13:20.645419 chdv-842464-2 devstack@n-api.service[103840]: warnings.warn(msg) May 19 08:13:20.646658 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-6d7cda20-6fc7-476c-b3c9-933f384cf131 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:13:20.647094 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-6d7cda20-6fc7-476c-b3c9-933f384cf131 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:13:20.647881 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-6d7cda20-6fc7-476c-b3c9-933f384cf131 admin admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:13:20.648307 chdv-842464-2 devstack@n-api.service[103840]: DEBUG oslo_concurrency.lockutils [None req-6d7cda20-6fc7-476c-b3c9-933f384cf131 admin admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:13:20.672019 chdv-842464-2 devstack@n-api.service[103840]: INFO nova.api.openstack.requestlog [None req-6d7cda20-6fc7-476c-b3c9-933f384cf131 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.081258 May 19 08:13:20.672602 chdv-842464-2 devstack@n-api.service[103840]: [pid: 103840|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:13:20 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:14:08.361874 chdv-842464-2 devstack@n-api.service[103838]: Thu May 19 08:14:08 2022 - graceful shutdown triggered... May 19 08:14:08.362096 chdv-842464-2 systemd[1]: Stopping Devstack devstack@n-api.service... May 19 08:14:08.363417 chdv-842464-2 devstack@n-api.service[103840]: Gracefully killing worker 2 (pid: 103840)... May 19 08:14:08.363864 chdv-842464-2 devstack@n-api.service[103839]: Gracefully killing worker 1 (pid: 103839)... May 19 08:14:09.364512 chdv-842464-2 devstack@n-api.service[103838]: worker 1 buried after 1 seconds May 19 08:14:09.364512 chdv-842464-2 devstack@n-api.service[103838]: worker 2 buried after 1 seconds May 19 08:14:09.364512 chdv-842464-2 devstack@n-api.service[103838]: goodbye to uWSGI. May 19 08:14:09.365979 chdv-842464-2 systemd[1]: devstack@n-api.service: Succeeded. May 19 08:14:09.366572 chdv-842464-2 systemd[1]: Stopped Devstack devstack@n-api.service. May 19 08:14:09.369501 chdv-842464-2 systemd[1]: Starting Devstack devstack@n-api.service... May 19 08:14:09.389215 chdv-842464-2 devstack@n-api.service[119040]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 08:14:09 2022] *** May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: nodename: chdv-842464-2 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: machine: x86_64 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: clock source: unix May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: pcre jit disabled May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: detected number of CPU cores: 4 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: current working directory: / May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: detected binary path: /usr/bin/uwsgi-core May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: your processes number limit is 47680 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: your memory page size is 4096 bytes May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: detected max file descriptor number: 2048 May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: lock engine: pthread robust mutexes May 19 08:14:09.411454 chdv-842464-2 devstack@n-api.service[119040]: thunder lock: enabled May 19 08:14:09.412494 chdv-842464-2 devstack@n-api.service[119040]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 08:14:09.412494 chdv-842464-2 devstack@n-api.service[119040]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 08:14:09.475929 chdv-842464-2 devstack@n-api.service[119040]: Python main interpreter initialized at 0x55744c8649c0 May 19 08:14:09.475929 chdv-842464-2 devstack@n-api.service[119040]: python threads support enabled May 19 08:14:09.475929 chdv-842464-2 devstack@n-api.service[119040]: your server socket listen backlog is limited to 100 connections May 19 08:14:09.475929 chdv-842464-2 devstack@n-api.service[119040]: your mercy for graceful operations on workers is 90 seconds May 19 08:14:09.476715 chdv-842464-2 devstack@n-api.service[119040]: mapped 403077 bytes (393 KB) for 2 cores May 19 08:14:09.476867 chdv-842464-2 devstack@n-api.service[119040]: *** Operational MODE: preforking *** May 19 08:14:09.477297 chdv-842464-2 devstack@n-api.service[119040]: *** uWSGI is running in multiple interpreter mode *** May 19 08:14:09.477297 chdv-842464-2 devstack@n-api.service[119040]: spawned uWSGI master process (pid: 119040) May 19 08:14:09.477541 chdv-842464-2 systemd[1]: Started Devstack devstack@n-api.service. May 19 08:14:09.481508 chdv-842464-2 devstack@n-api.service[119040]: spawned uWSGI worker 1 (pid: 119072, cores: 1) May 19 08:14:09.482045 chdv-842464-2 devstack@n-api.service[119040]: spawned uWSGI worker 2 (pid: 119073, cores: 1) May 19 08:14:09.482530 chdv-842464-2 devstack@n-api.service[119040]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 08:14:10.729722 chdv-842464-2 devstack@n-api.service[119073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 08:14:10.788426 chdv-842464-2 devstack@n-api.service[119072]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 08:14:11.555159 chdv-842464-2 devstack@n-api.service[119073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:14:11.555159 chdv-842464-2 devstack@n-api.service[119073]: from cryptography.utils import int_from_bytes May 19 08:14:11.555495 chdv-842464-2 devstack@n-api.service[119073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:14:11.555495 chdv-842464-2 devstack@n-api.service[119073]: from cryptography.utils import int_from_bytes May 19 08:14:11.592147 chdv-842464-2 devstack@n-api.service[119072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:14:11.592147 chdv-842464-2 devstack@n-api.service[119072]: from cryptography.utils import int_from_bytes May 19 08:14:11.592460 chdv-842464-2 devstack@n-api.service[119072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 08:14:11.592460 chdv-842464-2 devstack@n-api.service[119072]: from cryptography.utils import int_from_bytes May 19 08:14:14.052981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 08:14:14.053677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 08:14:14.053784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 08:14:14.054145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 08:14:14.054526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 08:14:14.054849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.055182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.055777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.055916 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.056192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.056509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.056842 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.057164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.058247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.058521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.058632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 08:14:14.059000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 08:14:14.059080 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.059165 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-842464-2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.059370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 08:14:14.059485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.061924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 08:14:14.062066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 08:14:14.062240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.062983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.063944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = chdv-842464-2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064649 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.064781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.065058 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.065194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.066426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.066565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-842464-2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.066656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.066737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.066970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.067095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.067287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.067415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.067571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.067815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.067938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.068166 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.068293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.068490 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.068597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.068782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.068986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.069183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.069430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.069633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.069834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.070031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.070240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.070410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.070618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.070618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.070940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] host = chdv-842464-2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071080 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071400 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.071995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.072137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.072289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.072429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.072573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.072716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.072859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.073004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.073145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.073478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.073642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.073783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.073924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074218 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.074926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.075925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.076059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.076174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.076311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.077420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.077589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.077735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.077881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.078884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.079972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.080113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.080255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.080389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.080534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.080668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.080810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.081003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.081680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.081817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.081972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.082966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083816 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.083955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.084096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.084236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.084440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.084582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.084723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.084953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.085861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.086917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.087041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.087556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.087680 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.087809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.087932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.088791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.089988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.090962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091106 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.091986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.092220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.092342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.092464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.092589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.092703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.092897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.093912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094542 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.094991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.095175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.095318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.095477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.095620 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.095783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.095917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.096085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.096220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.096390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.096565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.096756 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.096905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.097053 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.097193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.097822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.097964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.098928 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.099925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.100065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.100206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.100347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.100488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.100488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.100754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.100895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.101027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.101167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.101299 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.101469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.101611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.101752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.101886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.102019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.102186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.102323 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.102460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.102597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.102782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.102927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.103091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.103242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.103411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 08:14:14.103555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.103748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.103886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.104129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.104282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.104417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.104556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.104697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.104839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.105018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.105162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.105369 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.105508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.105687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.105834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.106955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.107108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.107265 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.107409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.107648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108004 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.108868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.109162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.109621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.109761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.109907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.110879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.111852 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.112002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.112146 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.113055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.113339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.113489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.113635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.113777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.113906 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.114038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.114187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.114397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.114686 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.114824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.114966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.115950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116434 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.116993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.117136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.117277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.117480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.117640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.117967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.118215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.118362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.118510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.118644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.118784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.118917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.119910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120183 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.120899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121665 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.121941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.122073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.122221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.122447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.122598 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.122739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.122882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123717 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.123859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124663 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.124939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.125086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.125232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.125408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.125551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.125707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.125895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.126905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.127040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.127173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.127173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.127436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.127567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.127713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.128855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.128997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129265 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.129980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130695 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.130962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131527 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.131953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.132941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133216 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133820 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.133954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.134200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.134338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.134501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.134636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.134782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.134922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135605 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.135887 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.136979 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.137120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.137267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.137416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.137574 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.137710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.137853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.138013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.138330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.138469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.138691 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.139879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140279 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.140966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.141100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.141250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.141476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.141613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.141756 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.141890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142302 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.142854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143755 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.143890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144276 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.144911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.145962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.146104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.146251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.146395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.146535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.146709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.146846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147045 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.147896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.148040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.148186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.148538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.148677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.148811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.148975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.149399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.149539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.149672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.149818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.149964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.150933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151460 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.151880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.152989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.153984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.154924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155354 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155678 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.155989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.156139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.156288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.156561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.156714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.156849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.156991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.157124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.157265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.157452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.157601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.157750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.157892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.158032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.158173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.158321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.158476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.158735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.158868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.159018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.159202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.159496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.159496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.159755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.159896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160302 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.160984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.161126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.161259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.161423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.161556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.161802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.161948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.162111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.162249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.162432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.162571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.162742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.162894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.163946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.164087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.164261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.164407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.164615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.164832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.164969 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.165168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.165447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.166125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.166269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.166412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.166563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.166563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.166899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.167929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168210 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.168988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.169131 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.169265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.169443 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.169641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.169777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.169934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.170077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.170310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.170455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.170597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.170597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.170867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.171957 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172835 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.172975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.173110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.173262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.173492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.173627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.173768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.173901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.174034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.174183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.174317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.174450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.174572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.175374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.175900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.176976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177413 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.177986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.178128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.178278 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.178414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.178563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.178698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.179101 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.179252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.179398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.179533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.179694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.179901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.180968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.181105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.181246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.181466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.181617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.181759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.181902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.182044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.182326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.182474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.182633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.183339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.183489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.183635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.183770 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.183913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.184916 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.185868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.186986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.187332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.187467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.187608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.187742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.187876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.188960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.189178 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.189332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.189513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.189654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.189843 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.190073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.190220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.191676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.191973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.192803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193698 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.193934 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.194947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.195921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196385 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196820 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.196912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.197947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198123 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.198969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.199153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.199420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.199420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.199697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.199840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.199989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.200245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.200390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.200523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.200654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.200654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.200915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.201048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.201186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.201359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.201498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.201620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.201898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.202929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.203920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.204922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.205065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.205200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.205358 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.205495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.205759 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.205964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.206937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.207081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.207215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.207364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.207584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.207730 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.207882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.208900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209820 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.209953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.210999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.211140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.211288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.211422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.211556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.211696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.211952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.212973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.213137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.213260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.213476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.213617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.213877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.214024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.214167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.214307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.214472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.214617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215408 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.215988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.216139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.216328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.216464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.216606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.216754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.216897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217172 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217462 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.217983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218793 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.218924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219658 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.219938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.220991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.221125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.221257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.221435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.221639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.221794 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.221937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.222181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.222321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.222445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.222587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.222732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.222868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.223009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.223167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.223381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.223527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.223740 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.223884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.224863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225146 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.225893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.226873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.227952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228090 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.228919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.229059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.229200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.229377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.229529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.229678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.229882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.230940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.231910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.232092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.232230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.232378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.232599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.232744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.232880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.233888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234306 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.234881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.235007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.235153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.235307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.235460 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.235609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.235872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.236951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.237113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.237976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.238202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.238342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.238476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.238609 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.238741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.238882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.239024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.239160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.239347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.239476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.239669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.239816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240183 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240770 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.240976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241433 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.241998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.242120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.242259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.242432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.242742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.242888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.243992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.244238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.244377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.244568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.244714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.244880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.245969 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.246111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.246246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.246416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.246564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.246713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.246848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247166 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.247957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.248110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.248363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.248501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.248644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.248779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.248926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.249061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.249194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.249358 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.249613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.249746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.249894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250037 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250419 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.250990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.251223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.251367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.251499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.251644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.251778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.251920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.252053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.252188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.252319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.252535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.252676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.252922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.253754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.253901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.253901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.254172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.254315 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.254457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.254599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.254740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.254890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.255025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.255159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.255304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.255551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.255697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.255874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256657 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.256973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.257197 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.257397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.257549 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.257715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.257865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258566 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.258979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.259123 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.259293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.259439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.259619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.259845 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.259984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.260126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.260283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.260501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.260639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.260780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.260921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.261066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.261227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.261496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.261634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.261776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.261910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262454 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.262933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.263111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.263261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.263459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.263646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.263887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.264859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.265941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.266985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.267126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.267260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.267434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.267582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.267723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.267858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.268027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.268174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.268336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.268533 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.268744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.268879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.269013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.269145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.269375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.269537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.269690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.269837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.270971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.271114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.271257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.271391 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.271602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.271745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.271878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.272978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.273111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.273241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.273387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.273532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.273671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.273813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.274056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.274192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.274428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.274729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.274882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.275045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.275183 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.275353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.275503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.275674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.275910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.276060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.276281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.276466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.276625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.276808 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.276961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.277135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.277488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.277630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.277819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.277975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.278132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.278270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.278430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.278565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.278722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.278939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.279077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.279218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.279352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.279484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.279625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.279769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.280956 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.281096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.281230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.281389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.281534 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.281748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.281885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.282978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283118 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.283939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.284139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.284375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.284514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.284668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.284804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.284945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.285998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.286143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.286278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.286462 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.286610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.286780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.286957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.287107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.287241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.287485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.287624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.287799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.287945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.288087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.288229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.288424 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.288560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.288722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.289427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.289736 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.289849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.289952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.290920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291350 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.291966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.292177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.292279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.292483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.292593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.292872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.293114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.293294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.293481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.293481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.293774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.293925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.294074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.294243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.294411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.294684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.294848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.294997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.295153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.295328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.295478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.295628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.295777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.295933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.296098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.296255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.296411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.296559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.296715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.296874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.297040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.297202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.297399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.297567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.297717 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.297876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298665 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.298987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.299137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.299297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.299454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.299603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.300631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.300803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.300973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.301877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.302900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.303089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.303182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.303411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.303524 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.303728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.303826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.304045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.304149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.304361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.304466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.304694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.304787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.305949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.306050 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.306258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.306361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.306565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.306668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.306890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.307014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.307210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.307311 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.307514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.307616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.307839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.308949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.309063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.309152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.309406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.309504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.309714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.309810 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.310946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.311042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.311262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.311363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.311622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.311803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.311953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.312184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.312344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.312502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.312502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.312783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.312931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.313096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.313263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.313486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.313581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.313712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.313859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.314003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.314156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.314313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.314465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.314616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.314769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.315009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.315009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 08:14:14.315427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.315427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 08:14:14.316493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 08:14:14.379437 chdv-842464-2 devstack@n-api.service[119073]: INFO dbcounter [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Registered counter for database nova_api May 19 08:14:14.380105 chdv-842464-2 devstack@n-api.service[119072]: INFO dbcounter [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Registered counter for database nova_api May 19 08:14:14.401040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.420822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_db.sqlalchemy.engines [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.421008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writer thread running {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.421757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writer thread running {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.480791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.context [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=119072) load_cells /opt/stack/nova/nova/context.py:464}} May 19 08:14:14.484241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.context [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=119073) load_cells /opt/stack/nova/nova/context.py:464}} May 19 08:14:14.485210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:14:14.486807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:14:14.487661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:14:14.488889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:14:14.489643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:14:14.490501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:14:14.491301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:14:14.491659 chdv-842464-2 devstack@n-api.service[119072]: INFO dbcounter [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Registered counter for database nova_cell0 May 19 08:14:14.493255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:14:14.495308 chdv-842464-2 devstack@n-api.service[119073]: INFO dbcounter [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Registered counter for database nova_cell0 May 19 08:14:14.496387 chdv-842464-2 devstack@n-api.service[119072]: INFO dbcounter [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Registered counter for database nova_cell1 May 19 08:14:14.499466 chdv-842464-2 devstack@n-api.service[119073]: INFO dbcounter [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Registered counter for database nova_cell1 May 19 08:14:14.504106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_db.sqlalchemy.engines [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.506396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_db.sqlalchemy.engines [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.508584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.511259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writer thread running {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.511600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.516012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writer thread running {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.522882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writer thread running {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.656873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writer thread running {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.670620 chdv-842464-2 devstack@n-api.service[119072]: INFO dbcounter [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Registered counter for database nova_cell0 May 19 08:14:14.675869 chdv-842464-2 devstack@n-api.service[119073]: INFO dbcounter [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Registered counter for database nova_cell0 May 19 08:14:14.678536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_db.sqlalchemy.engines [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.682823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_db.sqlalchemy.engines [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 08:14:14.683631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writer thread running {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:14.687671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writer thread running {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 08:14:15.014331 chdv-842464-2 devstack@n-api.service[119072]: WARNING keystonemiddleware.auth_token [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:14:15.029248 chdv-842464-2 devstack@n-api.service[119072]: WARNING keystonemiddleware.auth_token [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:14:15.035599 chdv-842464-2 devstack@n-api.service[119073]: WARNING keystonemiddleware.auth_token [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:14:15.043924 chdv-842464-2 devstack@n-api.service[119073]: WARNING keystonemiddleware.auth_token [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:14:15.404013 chdv-842464-2 devstack@n-api.service[119073]: WARNING keystonemiddleware.auth_token [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:14:15.410739 chdv-842464-2 devstack@n-api.service[119073]: WARNING keystonemiddleware.auth_token [None req-0f1c745f-2dc9-421a-b7b4-1762c669c5d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:14:15.416000 chdv-842464-2 devstack@n-api.service[119073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55744c8649c0 pid: 119073 (default app) May 19 08:14:15.418302 chdv-842464-2 devstack@n-api.service[119072]: WARNING keystonemiddleware.auth_token [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 08:14:15.424478 chdv-842464-2 devstack@n-api.service[119072]: WARNING keystonemiddleware.auth_token [None req-bb192e2e-e11b-4825-8028-6e3cd8ddf012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 08:14:15.430633 chdv-842464-2 devstack@n-api.service[119072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55744c8649c0 pid: 119072 (default app) May 19 08:15:02.564335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:02.568210 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:02.569583 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:02.570499 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:04.326658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:04.332520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:04.334785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:04.336335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:04.437707 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a9ec1279-ce46-4e6a-953c-2f6d85e666ba tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f32149994c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:04.441278 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:04.441278 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:04.444557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9ec1279-ce46-4e6a-953c-2f6d85e666ba tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:04.445024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9ec1279-ce46-4e6a-953c-2f6d85e666ba tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:04.447600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9ec1279-ce46-4e6a-953c-2f6d85e666ba tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:04.448430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9ec1279-ce46-4e6a-953c-2f6d85e666ba tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:04.576076 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a9ec1279-ce46-4e6a-953c-2f6d85e666ba tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 2.022123 May 19 08:15:04.578075 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1/1] 10.222.0.78 () {58 vars in 1127 bytes} [Thu May 19 08:15:02 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:05.226211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-32cf1203-34cc-4326-b4ab-c44b82b70790 tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-719920564", "id": 215304065, "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:05.264041 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:05.264041 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:05.329583 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-32cf1203-34cc-4326-b4ab-c44b82b70790 tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.749885 May 19 08:15:05.330245 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 2/2] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:15:04 2022] POST /compute/v2.1/flavors => generated 464 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:05.339232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0b05ff5a-597c-4e3a-be1b-4a17894a4238 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f321485f310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:05.342132 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:05.342132 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:05.345743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b05ff5a-597c-4e3a-be1b-4a17894a4238 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.346226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b05ff5a-597c-4e3a-be1b-4a17894a4238 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.347996 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b05ff5a-597c-4e3a-be1b-4a17894a4238 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.350518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b05ff5a-597c-4e3a-be1b-4a17894a4238 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.416539 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0b05ff5a-597c-4e3a-be1b-4a17894a4238 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.084627 May 19 08:15:05.417151 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 3/3] 10.222.0.78 () {58 vars in 1138 bytes} [Thu May 19 08:15:05 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:05.593345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e501173-aedc-4be6-b603-ed0428c59f74 tempest-AZAdminNegativeTestJSON-149444427 tempest-AZAdminNegativeTestJSON-149444427-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:05.595218 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:05.595218 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:05.600703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8e501173-aedc-4be6-b603-ed0428c59f74 tempest-AZAdminNegativeTestJSON-149444427 tempest-AZAdminNegativeTestJSON-149444427-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'bf6e45739b4b424fb1e38e84bda4123f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d02cc372ea145c3aa7733fad6c44bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e501173-aedc-4be6-b603-ed0428c59f74 tempest-AZAdminNegativeTestJSON-149444427 tempest-AZAdminNegativeTestJSON-149444427-project] Request method failure captured: May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyF-mVxDL_eTQ-UuZC9V-MUB6yHsJcQ3TSMRE-8oTIhJ99XZPIMnvHO0vF2aLVhnWBGmiAJ6c_dWuV0H5XeG0qhcTXKBCbRjsISFvZFJqBaGkTV3nYE-lVamta2NpSXQzJZ5kkYUGW2X6RjN0jFarL1e-2oYqgporLAQO2br8z4JSo May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 8d02cc372ea145c3aa7733fad6c44bd7 May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AZAdminNegativeTestJSON-149444427 May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:15:05.621059 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8d02cc372ea145c3aa7733fad6c44bd7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d02cc372ea145c3aa7733fad6c44bd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8d02cc372ea145c3aa7733fad6c44bd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8d02cc372ea145c3aa7733fad6c44bd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AZAdminNegativeTestJSON-149444427 May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 8d02cc372ea145c3aa7733fad6c44bd7 May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-149444427 May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AZAdminNegativeTestJSON-149444427-project May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: bf6e45739b4b424fb1e38e84bda4123f May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AZAdminNegativeTestJSON-149444427-project May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 19 08:15:05.622328 chdv-842464-2 devstack@n-api.service[119073]: action_args: {} May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:05.622933 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:05.623893 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e501173-aedc-4be6-b603-ed0428c59f74 tempest-AZAdminNegativeTestJSON-149444427 tempest-AZAdminNegativeTestJSON-149444427-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:05.625378 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8e501173-aedc-4be6-b603-ed0428c59f74 tempest-AZAdminNegativeTestJSON-149444427 tempest-AZAdminNegativeTestJSON-149444427-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.204539 May 19 08:15:05.625378 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 4/4] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:15:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:05.736240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Calling method '.version_select at 0x7f32147d18b0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:05.738688 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:05.738688 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:05.749076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=119073) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 19 08:15:05.750948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.751632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.789920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.790924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.825053 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.826211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.836227 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-395f6c8f-a61d-4c6b-9bad-ba0d91eb1be2 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.211137 May 19 08:15:05.838200 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 5/5] 10.222.0.78 () {60 vars in 1207 bytes} [Thu May 19 08:15:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:05.854367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a92cb9f-6029-4f50-9c20-2b20922313f5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:05.856562 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:05.856562 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:05.858267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a92cb9f-6029-4f50-9c20-2b20922313f5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.858918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a92cb9f-6029-4f50-9c20-2b20922313f5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.867092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a92cb9f-6029-4f50-9c20-2b20922313f5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:05.867603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a92cb9f-6029-4f50-9c20-2b20922313f5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:05.918345 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a92cb9f-6029-4f50-9c20-2b20922313f5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.607434 May 19 08:15:05.918968 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1/6] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:15:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:15:06.087704 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ed5d2a7f-d57c-4a08-8ed4-8be6e138a296 tempest-FlavorsV261TestJSON-927032106 tempest-FlavorsV261TestJSON-927032106-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:06.132157 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ed5d2a7f-d57c-4a08-8ed4-8be6e138a296 tempest-FlavorsV261TestJSON-927032106 tempest-FlavorsV261TestJSON-927032106-project] 10.222.0.78 "GET /compute/v2.1/flavors/215304065" status: 200 len: 464 microversion: 2.61 time: 0.278434 May 19 08:15:06.141122 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 6/7] 10.222.0.78 () {60 vars in 1195 bytes} [Thu May 19 08:15:05 2022] GET /compute/v2.1/flavors/215304065 => generated 464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:06.149459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-efc127ef-75eb-4cdc-ace8-23c47b3cb256 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f32147d1ee0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:06.155428 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:06.155428 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:06.157633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-efc127ef-75eb-4cdc-ace8-23c47b3cb256 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.163512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-efc127ef-75eb-4cdc-ace8-23c47b3cb256 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.165205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-efc127ef-75eb-4cdc-ace8-23c47b3cb256 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.166537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-efc127ef-75eb-4cdc-ace8-23c47b3cb256 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.225365 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-efc127ef-75eb-4cdc-ace8-23c47b3cb256 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.082097 May 19 08:15:06.230722 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 7/8] 10.222.0.78 () {58 vars in 1144 bytes} [Thu May 19 08:15:06 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:06.339916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '.version_select at 0x7f321485ee50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:06.343399 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:06.343399 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:06.364233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=119072) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 19 08:15:06.365068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.366834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.431471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.433068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.469610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.473880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.484625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-805d4eb3-4277-4bbf-9592-0c14e5babb2a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.563984 May 19 08:15:06.489091 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2/9] 10.222.0.78 () {58 vars in 1166 bytes} [Thu May 19 08:15:05 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:06.501596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e23ab822-5095-499e-9b25-6f910b5704c9 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-353588543"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:06.527929 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:06.527929 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:06.529800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-e23ab822-5095-499e-9b25-6f910b5704c9 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Generated uuid d6015079-3501-4a26-a82e-2d3ec1b6252e for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:06.573642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-32cb76a9-bf95-4275-9c79-bb5086fb947f tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:06.576064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32cb76a9-bf95-4275-9c79-bb5086fb947f tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.576628 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32cb76a9-bf95-4275-9c79-bb5086fb947f tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.579202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32cb76a9-bf95-4275-9c79-bb5086fb947f tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.579631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32cb76a9-bf95-4275-9c79-bb5086fb947f tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.635620 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-32cb76a9-bf95-4275-9c79-bb5086fb947f tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.403993 May 19 08:15:06.636602 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 8/10] 10.222.0.78 () {58 vars in 1163 bytes} [Thu May 19 08:15:06 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:06.641701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b955d55f-f734-4ffd-84d2-4de7677f81bf tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] Action: 'update', calling method: .version_select at 0x7f32151a1dc0>, body: {"flavor": {"description": "new"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:06.678993 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:06.678993 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:06.709695 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e23ab822-5095-499e-9b25-6f910b5704c9 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.218920 May 19 08:15:06.710680 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3/11] 10.222.0.78 () {62 vars in 1204 bytes} [Thu May 19 08:15:06 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:06.716719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d48642f-9793-4f14-96a1-582904fe827a tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:06.717907 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:06.717907 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:06.721381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d48642f-9793-4f14-96a1-582904fe827a tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.724919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d48642f-9793-4f14-96a1-582904fe827a tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.728135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d48642f-9793-4f14-96a1-582904fe827a tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:06.728567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d48642f-9793-4f14-96a1-582904fe827a tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:06.761560 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b955d55f-f734-4ffd-84d2-4de7677f81bf tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/215304065" status: 200 len: 465 microversion: 2.61 time: 0.123573 May 19 08:15:06.762194 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 9/12] 10.222.0.78 () {62 vars in 1215 bytes} [Thu May 19 08:15:06 2022] PUT /compute/v2.1/flavors/215304065 => generated 465 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:06.771572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-baeb574d-bdcf-4a69-a675-330a3beb20b8 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1501059526"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:06.816441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d48642f-9793-4f14-96a1-582904fe827a tempest-AZAdminV2TestJSON-667997164 tempest-AZAdminV2TestJSON-667997164-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.104456 May 19 08:15:06.823968 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4/13] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:15:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:06.834968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71da8586-d644-44c6-a30a-01b80c136828 tempest-FlavorsV261TestJSON-927032106 tempest-FlavorsV261TestJSON-927032106-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:06.921807 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:06.921807 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:06.948983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71da8586-d644-44c6-a30a-01b80c136828 tempest-FlavorsV261TestJSON-927032106 tempest-FlavorsV261TestJSON-927032106-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.123576 May 19 08:15:06.950669 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5/14] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:15:06 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:06.975808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a863b20-6865-4eb1-ac82-3120c4d59813 tempest-FlavorsV261TestJSON-927032106 tempest-FlavorsV261TestJSON-927032106-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:07.015626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a863b20-6865-4eb1-ac82-3120c4d59813 tempest-FlavorsV261TestJSON-927032106 tempest-FlavorsV261TestJSON-927032106-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.051127 May 19 08:15:07.017184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 6/15] 10.222.0.78 () {60 vars in 1165 bytes} [Thu May 19 08:15:06 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:07.037296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe84d58f-417b-4da6-b926-835cd1d33acb tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:07.038503 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:07.038503 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:07.080403 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe84d58f-417b-4da6-b926-835cd1d33acb tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/215304065" status: 202 len: 0 microversion: 2.61 time: 0.052393 May 19 08:15:07.081911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 7/16] 10.222.0.78 () {60 vars in 1198 bytes} [Thu May 19 08:15:07 2022] DELETE /compute/v2.1/flavors/215304065 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:15:07.095335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4b2a9d3-1e94-4a6a-b8d6-070bd7077623 tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:07.111882 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-baeb574d-bdcf-4a69-a675-330a3beb20b8 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.344127 May 19 08:15:07.112813 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 10/17] 10.222.0.78 () {62 vars in 1209 bytes} [Thu May 19 08:15:06 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:07.126787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ef049335-8faf-4ac0-8095-0e2468bfdb3c tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:07.130209 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:07.130209 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:07.138635 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4b2a9d3-1e94-4a6a-b8d6-070bd7077623 tempest-FlavorsV261TestJSON-932400540 tempest-FlavorsV261TestJSON-932400540-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.052335 May 19 08:15:07.139603 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 8/18] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:15:07 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:07.151667 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ef049335-8faf-4ac0-8095-0e2468bfdb3c tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.027380 May 19 08:15:07.153347 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 11/19] 10.222.0.78 () {60 vars in 1189 bytes} [Thu May 19 08:15:07 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:07.164344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4afcd38c-3843-4dea-8ef4-110cb2928a88 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:07.166240 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:07.166240 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:07.182388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4afcd38c-3843-4dea-8ef4-110cb2928a88 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:07.183143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4afcd38c-3843-4dea-8ef4-110cb2928a88 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:08.360993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4afcd38c-3843-4dea-8ef4-110cb2928a88 tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.200614 May 19 08:15:08.362852 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 9/20] 10.222.0.78 () {62 vars in 1231 bytes} [Thu May 19 08:15:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:08.379502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2e4899aa-4cca-4115-9b67-d7f606ff9faa tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:08.383976 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:08.383976 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:08.399629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2e4899aa-4cca-4115-9b67-d7f606ff9faa tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:08.400544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2e4899aa-4cca-4115-9b67-d7f606ff9faa tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:09.063225 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2e4899aa-4cca-4115-9b67-d7f606ff9faa tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.692024 May 19 08:15:09.069929 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 12/21] 10.222.0.78 () {62 vars in 1231 bytes} [Thu May 19 08:15:08 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:09.074947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3e5a286-1313-4da4-aa9a-f6ff55b9daea tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:09.077041 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:09.077041 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:09.120649 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3e5a286-1313-4da4-aa9a-f6ff55b9daea tempest-AggregatesAdminTestV241-155911078 tempest-AggregatesAdminTestV241-155911078-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.049549 May 19 08:15:09.122161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 10/22] 10.222.0.78 () {60 vars in 1192 bytes} [Thu May 19 08:15:09 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:09.162865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f2c8ff06-5a03-4d07-b05b-1c0152b21246 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-303055145", "name": "tempest-test_aggregate-932497604"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:09.191218 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:09.191218 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:09.196923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-f2c8ff06-5a03-4d07-b05b-1c0152b21246 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid c62b16a7-18be-4ad6-b143-9c29313fdf51 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:09.237859 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f2c8ff06-5a03-4d07-b05b-1c0152b21246 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.080098 May 19 08:15:09.241009 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 13/23] 10.222.0.78 () {60 vars in 1164 bytes} [Thu May 19 08:15:09 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:09.250770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29240cb7-d1f9-4c66-ba4a-d348087daded tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:09.251808 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:09.251808 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:09.267131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-29240cb7-d1f9-4c66-ba4a-d348087daded tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.019942 May 19 08:15:09.269021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 11/24] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:15:09 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:09.279434 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c3148f8-2fd4-47fa-a68c-2bacc237b5af tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:09.280938 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:09.280938 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:09.294173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c3148f8-2fd4-47fa-a68c-2bacc237b5af tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:09.294621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c3148f8-2fd4-47fa-a68c-2bacc237b5af tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:09.535745 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1c3148f8-2fd4-47fa-a68c-2bacc237b5af tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 312 microversion: 2.1 time: 0.259957 May 19 08:15:09.537386 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 14/25] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:09 2022] POST /compute/v2.1/os-aggregates/2/action => generated 312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:10.786966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-633789330", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "availability_zone": "tempest-test_az-303055145"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:10.843262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:10.845402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:10.848706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:10.851903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:12.156307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:15:13.051614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:15:13.052232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:15:13.052859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:15:13.053456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:15:13.054033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:15:13.090244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:13.090793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:13.091730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:13.094288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:13.185412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Getting quotas for project acb1e52b508c47bcae75440631533855. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:13.197572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Getting quotas for user f2e46ef724cd43729e57ab4142ad1351 and project acb1e52b508c47bcae75440631533855. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:13.213698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:15:13.217251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:15:13.308814 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5ed5035-6a1a-4d6f-9132-da6aaf745ee2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.131384 May 19 08:15:13.313417 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 12/26] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:15:13.328452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2a3a9d50-8724-4e22-80f7-c496957e404d tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:13.332067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2a3a9d50-8724-4e22-80f7-c496957e404d tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:15.142487 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2a3a9d50-8724-4e22-80f7-c496957e404d tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:15.168937 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2a3a9d50-8724-4e22-80f7-c496957e404d tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1241 microversion: 2.1 time: 1.847542 May 19 08:15:15.172605 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 15/27] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:13 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1241 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:15.978395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-902780349", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:16.159581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:15:16.201404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:16.202150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:16.232325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:16.232786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:16.245512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:16.246775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:16.608322 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=8 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:16.641446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:16.670455 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-007216d8-bf8b-4999-a3f3-4fbe622ad72b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1289 microversion: 2.1 time: 0.484035 May 19 08:15:16.677530 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 16/28] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:16 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1289 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:16.701388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:15:16.702031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:15:16.702626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:15:16.703366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:15:16.704291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:15:16.739106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:16.740674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:16.741838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:16.743366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:16.790920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Getting quotas for project 6d6f85a12d6d4ee9ba2950f2ca028e21. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:16.807072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Getting quotas for user ce6e8adf2d4c4413965e77e5ab9359d4 and project 6d6f85a12d6d4ee9ba2950f2ca028e21. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:16.838487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:15:16.844686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:15:16.933157 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a33f638a-3152-475e-87ae-a481a7c9f8c9 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331478 May 19 08:15:16.934535 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 13/29] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:15:16.960618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-deeee8e7-c9b0-4f2b-b602-7bda68b6c47c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:16.961561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-deeee8e7-c9b0-4f2b-b602-7bda68b6c47c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:17.210207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-deeee8e7-c9b0-4f2b-b602-7bda68b6c47c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:17.243345 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-deeee8e7-c9b0-4f2b-b602-7bda68b6c47c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1219 microversion: 2.1 time: 0.301688 May 19 08:15:17.255724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 14/30] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:16 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:17.669627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Calling method '.version_select at 0x7f3212e2d5e0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:17.672375 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:17.672375 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:17.673911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.678456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.688515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:17.689331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:17.702556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.703013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.703821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.704268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.719176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.720129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.864368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.865861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.888063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.889247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.925185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:17.926940 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:17.943296 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c379e311-7920-4ab9-b020-c5968243f0ff tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 1.035963 May 19 08:15:17.945136 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 17/31] 10.222.0.78 () {60 vars in 1242 bytes} [Thu May 19 08:15:16 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:18.058023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:18.082033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e925398-157f-4d2f-a02e-67930bbba9b4 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1295 microversion: 2.1 time: 0.395774 May 19 08:15:18.092522 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 15/32] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:17 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1295 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:18.098044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Calling method '.version_select at 0x7f3212de0d30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:18.100890 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:18.100890 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:18.103442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.106544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.163888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.164470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.254357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.255493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.286725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.287661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.314202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.326465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.339495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef9f47ff-e730-438a-9c6f-a21b682ce597 tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.254551 May 19 08:15:18.346143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 16/33] 10.222.0.78 () {60 vars in 1221 bytes} [Thu May 19 08:15:18 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:18.757474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc6269ab-030b-4d15-8f0d-a29cf2651be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:18.783430 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc6269ab-030b-4d15-8f0d-a29cf2651be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.826209 May 19 08:15:18.793006 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 18/34] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:15:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:18.804860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:18.805626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:18.845113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.853016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.853974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:18.854423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:18.898525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-310d7b89-3a2f-42ea-b37b-ea8af2515448 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-576469487", "ram": 512, "vcpus": 1, "disk": 10, "id": 817695027, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:18.902657 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:18.902657 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:19.016824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:19.019680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:DELETE=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:19.025676 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-310d7b89-3a2f-42ea-b37b-ea8af2515448 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.677491 May 19 08:15:19.030214 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1341f2c2-a27b-4c38-a905-48a8c420e347 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1215 microversion: 2.1 time: 0.235793 May 19 08:15:19.032873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 17/35] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:18 2022] POST /compute/v2.1/flavors => generated 412 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:19.040513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10cf0478-22b2-42d9-8708-be7f2281733c tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Calling method '.version_select at 0x7f3212e03670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:19.042221 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:19.042221 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:19.043019 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 19/36] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:18 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:19.047149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10cf0478-22b2-42d9-8708-be7f2281733c tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:19.052049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10cf0478-22b2-42d9-8708-be7f2281733c tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:19.112781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10cf0478-22b2-42d9-8708-be7f2281733c tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:19.113677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10cf0478-22b2-42d9-8708-be7f2281733c tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:19.121600 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10cf0478-22b2-42d9-8708-be7f2281733c tempest-HypervisorAdminV253TestBase-1907221616 tempest-HypervisorAdminV253TestBase-1907221616-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/84bf7389-5832-48c2-b103-1f71c0b208fd" status: 200 len: 792 microversion: 2.53 time: 0.086353 May 19 08:15:19.127782 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1297 bytes} [Thu May 19 08:15:19 2022] GET /compute/v2.1/os-hypervisors/84bf7389-5832-48c2-b103-1f71c0b208fd => generated 792 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:19.147165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-baba2f63-a8b8-4f11-ae07-832a320f8110 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:19.149211 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:19.149211 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:19.272063 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-baba2f63-a8b8-4f11-ae07-832a320f8110 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.135590 May 19 08:15:19.277636 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 19/38] 10.222.0.78 () {60 vars in 1220 bytes} [Thu May 19 08:15:19 2022] POST /compute/v2.1/flavors/817695027/os-extra_specs => generated 66 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:19.282725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:19.283405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:19.313561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:19.313982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:19.314770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:19.329584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:19.556542 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-553d850d-0848-4ce7-ad5c-dbe4a25cec3d tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-299729972", "id": 1407221823, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:19.558174 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:19.558174 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:19.618657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-553d850d-0848-4ce7-ad5c-dbe4a25cec3d tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.563171 May 19 08:15:19.623509 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:19 2022] POST /compute/v2.1/flavors => generated 424 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:19.682416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:19.734257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7358e638-9538-43a6-a018-1ca7207eff5f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.455167 May 19 08:15:19.734938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 20/40] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:19 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:19.932045 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c822a144-f5f8-43a8-9a63-7b7b179c3637 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-333432151", "id": 1652052044, "os-flavor-access:is_public": "False"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:19.999878 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c822a144-f5f8-43a8-9a63-7b7b179c3637 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.371803 May 19 08:15:20.006384 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 21/41] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:19 2022] POST /compute/v2.1/flavors => generated 430 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:20.020701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fb594ea3-cd97-4054-8dd4-ea91f8b57edc tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:20.054986 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fb594ea3-cd97-4054-8dd4-ea91f8b57edc tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.046972 May 19 08:15:20.068526 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 22/42] 10.222.0.78 () {58 vars in 1181 bytes} [Thu May 19 08:15:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:20.096886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-203a1800-bbc2-432b-9b34-7794901f1e77 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7eaf9f0e7bae40409775a5be5a94ce89"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:20.099966 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:20.099966 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:20.379364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66c998c4-d9d0-4c58-856d-9caaa6cfa010 tempest-FlavorsExtraSpecsTestJSON-436860950 tempest-FlavorsExtraSpecsTestJSON-436860950-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:20.423289 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66c998c4-d9d0-4c58-856d-9caaa6cfa010 tempest-FlavorsExtraSpecsTestJSON-436860950 tempest-FlavorsExtraSpecsTestJSON-436860950-project] 10.222.0.78 "GET /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.687207 May 19 08:15:20.433837 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 21/43] 10.222.0.78 () {58 vars in 1199 bytes} [Thu May 19 08:15:19 2022] GET /compute/v2.1/flavors/817695027/os-extra_specs => generated 66 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:20.449502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:20.454377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:20.480602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:20.481133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:20.490455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:20.491106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:20.714425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:20.742388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef337398-b116-4248-9b52-df221243e9c3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1277 microversion: 2.1 time: 0.307011 May 19 08:15:20.749665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 22/44] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:20 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:20.765141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ee4e1d7-20d5-4169-a6ef-401d7457dc9e tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-969952235", "id": 1256612231, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:20.769486 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:20.769486 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:20.828260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ee4e1d7-20d5-4169-a6ef-401d7457dc9e tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.074805 May 19 08:15:20.832624 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 23/45] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:20 2022] POST /compute/v2.1/flavors => generated 424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:20.849106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-012bf09c-766f-419e-888a-743ef3933273 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:20.850546 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:20.850546 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:20.925013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-012bf09c-766f-419e-888a-743ef3933273 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090668 May 19 08:15:20.929008 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1220 bytes} [Thu May 19 08:15:20 2022] POST /compute/v2.1/flavors/817695027/os-extra_specs => generated 66 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:20.944356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:20.950937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:20.968274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:20.968727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:20.969543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:20.970100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:21.272961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:21.306770 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-203a1800-bbc2-432b-9b34-7794901f1e77 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1652052044/action" status: 200 len: 97 microversion: 2.1 time: 1.240943 May 19 08:15:21.314680 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:15:20 2022] POST /compute/v2.1/flavors/1652052044/action => generated 97 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:21.340379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4b06addd-49aa-4001-97f0-b2a64949bd00 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:21.375918 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4b06addd-49aa-4001-97f0-b2a64949bd00 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.056344 May 19 08:15:21.378329 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 24/48] 10.222.0.78 () {58 vars in 1181 bytes} [Thu May 19 08:15:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:21.405922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e19c37b3-2a30-4a3d-883f-6dc39b11205f tempest-FlavorsExtraSpecsTestJSON-436860950 tempest-FlavorsExtraSpecsTestJSON-436860950-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:21.438140 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e19c37b3-2a30-4a3d-883f-6dc39b11205f tempest-FlavorsExtraSpecsTestJSON-436860950 tempest-FlavorsExtraSpecsTestJSON-436860950-project] 10.222.0.78 "GET /compute/v2.1/flavors/817695027/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.057272 May 19 08:15:21.449578 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 25/49] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:15:21 2022] GET /compute/v2.1/flavors/817695027/os-extra_specs/hw:numa_nodes => generated 22 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:21.760883 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e65991ab-0100-4acf-965d-b9c361970f21 tempest-FlavorsAccessTestJSON-1482976813 tempest-FlavorsAccessTestJSON-1482976813-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:21.872517 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e65991ab-0100-4acf-965d-b9c361970f21 tempest-FlavorsAccessTestJSON-1482976813 tempest-FlavorsAccessTestJSON-1482976813-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6641 microversion: 2.1 time: 0.419870 May 19 08:15:21.875154 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 26/50] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:21 2022] GET /compute/v2.1/flavors/detail => generated 6641 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:21.891493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3846d452-f018-4379-982d-31659c27bc87 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Action: 'create', calling method: .version_select at 0x7f3212e2dc10>, body: {"keypair": {"name": "tempest-keypair-1865817268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnV0WDZEqMVaRcf1axbgqzsKzYF6iL50i8xUvMBLXJetHDuVs25oNQS5OCJoeEbnlfnMZ84D6Zqr6c3rvA+tq7avx5LfWaIKH0LqY3W4ou7zE5XgR2bO9QRVueDHYYVsQ=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:21.940688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:21.954619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28b29146-d847-40c2-84a1-f0a3c79f890c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 1.024655 May 19 08:15:21.957810 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 25/51] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:20 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:21.967585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e7ef563-3c70-4453-a4f0-a64c9c362745 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:21.974410 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:21.974410 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:21.983277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-3846d452-f018-4379-982d-31659c27bc87 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Getting quotas for project 5ab46fa809fe4a9bb8ad076da226b643. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:22.012106 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-3846d452-f018-4379-982d-31659c27bc87 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Getting quotas for user 83555ee44aaf44b5aec6a2afe7f43d46 and project 5ab46fa809fe4a9bb8ad076da226b643. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:22.045835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e7ef563-3c70-4453-a4f0-a64c9c362745 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.086459 May 19 08:15:22.061351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 26/52] 10.222.0.78 () {60 vars in 1220 bytes} [Thu May 19 08:15:21 2022] POST /compute/v2.1/flavors/817695027/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:22.077151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.082424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:22.108190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:22.109011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:22.110037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:22.116365 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3846d452-f018-4379-982d-31659c27bc87 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238543 May 19 08:15:22.117380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:22.125790 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 27/53] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:15:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:22.143977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cd258797-978e-40e2-bd00-1c3113b992b8 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7eaf9f0e7bae40409775a5be5a94ce89"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:22.148017 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:22.148017 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:22.347833 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cd258797-978e-40e2-bd00-1c3113b992b8 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1652052044/action" status: 200 len: 21 microversion: 2.1 time: 0.215845 May 19 08:15:22.350151 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 28/54] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:15:22 2022] POST /compute/v2.1/flavors/1652052044/action => generated 21 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:22.357389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:22.364476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5baeb0b8-ac28-4714-a08d-be78cd2746de tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.367531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfdd329d-a3b0-4ab8-9d1a-abaf96800a1d tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1277 microversion: 2.1 time: 0.304468 May 19 08:15:22.372243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 27/55] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:22.382949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b1301cf-59d3-4d7b-bf2a-abd1e6c96d71 tempest-FlavorsAccessTestJSON-1482976813 tempest-FlavorsAccessTestJSON-1482976813-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.388052 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5baeb0b8-ac28-4714-a08d-be78cd2746de tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036254 May 19 08:15:22.397672 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 29/56] 10.222.0.78 () {58 vars in 1199 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/flavors/817695027/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:22.414902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7689b14f-11de-49a1-9fd1-b1ceb07dc071 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:22.423126 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:22.423126 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:22.446654 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b1301cf-59d3-4d7b-bf2a-abd1e6c96d71 tempest-FlavorsAccessTestJSON-1482976813 tempest-FlavorsAccessTestJSON-1482976813-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.073088 May 19 08:15:22.457773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 28/57] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:22.466806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b24ebb19-5235-47cb-be96-35263b9a592c tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.468538 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:22.468538 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:22.495277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b24ebb19-5235-47cb-be96-35263b9a592c tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1652052044" status: 202 len: 0 microversion: 2.1 time: 0.033856 May 19 08:15:22.500006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 29/58] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:15:22 2022] DELETE /compute/v2.1/flavors/1652052044 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:15:22.509099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb713364-653d-4952-a39d-4f78a3b8f805 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.532762 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7689b14f-11de-49a1-9fd1-b1ceb07dc071 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/817695027/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.127821 May 19 08:15:22.540405 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 30/59] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:15:22 2022] PUT /compute/v2.1/flavors/817695027/os-extra_specs/hw:numa_nodes => generated 22 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:22.547730 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b1ad5649-4f2b-4502-b888-0059ae858c51 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.562566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb713364-653d-4952-a39d-4f78a3b8f805 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.061054 May 19 08:15:22.577980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 30/60] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:22.588974 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b1ad5649-4f2b-4502-b888-0059ae858c51 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042934 May 19 08:15:22.593522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e07b0ed5-a43a-438a-9f1f-8f37f39b55d6 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-243430699", "id": 630835740, "os-flavor-access:is_public": "False"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:22.597881 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:22.597881 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:22.600229 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 31/61] 10.222.0.78 () {58 vars in 1199 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/flavors/817695027/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:22.612934 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-49c04722-e8f0-4133-a34a-49d6c6e34f37 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.614050 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:22.614050 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:22.628414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e07b0ed5-a43a-438a-9f1f-8f37f39b55d6 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.044625 May 19 08:15:22.641229 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 31/62] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:22 2022] POST /compute/v2.1/flavors => generated 427 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:22.654098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4fbf700-02b8-47ca-8065-4704fa99cf8a tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.654994 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:22.654994 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:22.684355 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-49c04722-e8f0-4133-a34a-49d6c6e34f37 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/817695027/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.082238 May 19 08:15:22.688335 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 32/63] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:15:22 2022] DELETE /compute/v2.1/flavors/817695027/os-extra_specs/hw:numa_nodes => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:22.690460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4fbf700-02b8-47ca-8065-4704fa99cf8a tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/630835740/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.045551 May 19 08:15:22.700465 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 32/64] 10.222.0.78 () {58 vars in 1205 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/flavors/630835740/os-flavor-access => generated 21 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:22.701198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-276eaf5f-715c-4735-b7f7-d3edb53e8f6b tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.710074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4172f3b-5c42-45db-90bf-41940af4b0ea tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.773400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4172f3b-5c42-45db-90bf-41940af4b0ea tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/630835740" status: 202 len: 0 microversion: 2.1 time: 0.070678 May 19 08:15:22.779300 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 33/65] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:15:22 2022] DELETE /compute/v2.1/flavors/630835740 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:15:22.802230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d69762e-0487-4188-bc50-2ce1924ee5d4 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.857103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d69762e-0487-4188-bc50-2ce1924ee5d4 tempest-FlavorsAccessTestJSON-690550874 tempest-FlavorsAccessTestJSON-690550874-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.071907 May 19 08:15:22.874216 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 34/66] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:22.975193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:22.978695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:22.991089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:22.996559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:22.999887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:23.002388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:23.046332 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-276eaf5f-715c-4735-b7f7-d3edb53e8f6b tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/817695027/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.356174 May 19 08:15:23.048999 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:15:22 2022] DELETE /compute/v2.1/flavors/817695027/os-extra_specs/hw:cpu_policy => generated 0 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:23.079076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e1bbb5b5-26d4-4221-9d44-4f8a8db445c9 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:23.109188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e1bbb5b5-26d4-4221-9d44-4f8a8db445c9 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/817695027/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047549 May 19 08:15:23.109188 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 34/68] 10.222.0.78 () {58 vars in 1199 bytes} [Thu May 19 08:15:23 2022] GET /compute/v2.1/flavors/817695027/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:15:23.116640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-33fb23d7-4f20-4b16-9796-20bf2584813b tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:23.117745 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:23.117745 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:23.200503 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-33fb23d7-4f20-4b16-9796-20bf2584813b tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/817695027" status: 202 len: 0 microversion: 2.1 time: 0.088434 May 19 08:15:23.203658 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 35/69] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:15:23 2022] DELETE /compute/v2.1/flavors/817695027 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:15:23.214049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d839d31b-9343-4164-9a52-ee3f25f7aee6 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:23.287778 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d839d31b-9343-4164-9a52-ee3f25f7aee6 tempest-FlavorsExtraSpecsTestJSON-68633753 tempest-FlavorsExtraSpecsTestJSON-68633753-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.073451 May 19 08:15:23.289016 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 36/70] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:23 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:23.411078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:23.411078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:23.428145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:23.430317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:23.435680 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:23.437026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:23.844875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:23.864129 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a163f89-10ae-4030-85ca-cb4da9149e9e tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.890899 May 19 08:15:23.866730 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:22 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:23.983257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:24.004287 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-34941ee5-f96d-4603-9bea-f2fceb56879f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1277 microversion: 2.1 time: 0.605436 May 19 08:15:24.004883 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 37/72] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:23 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1277 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:24.884952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:24.885615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:24.900125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:24.903015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:24.904726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:24.908071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:25.022022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:25.022672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:25.032674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:25.034120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:25.035192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:25.035848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:25.314357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:25.328911 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bfada133-9dd0-4a82-bd2c-19a55dfa430f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1277 microversion: 2.1 time: 0.310970 May 19 08:15:25.331180 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 38/73] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:25 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1277 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:25.959703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-0cc0dc22-0fc6-4fbf-8d0c-68b223937b02 req-3065b657-1595-443e-8c6a-9f4dea067a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e309c9d-b16f-4600-95cc-b00aa3df59f5", "tag": "8dffb35d-bd1b-42d3-a04a-3a68b6757e0f"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:25.977195 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0cc0dc22-0fc6-4fbf-8d0c-68b223937b02 req-3065b657-1595-443e-8c6a-9f4dea067a9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:25.978243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0cc0dc22-0fc6-4fbf-8d0c-68b223937b02 req-3065b657-1595-443e-8c6a-9f4dea067a9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:26.032329 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-0cc0dc22-0fc6-4fbf-8d0c-68b223937b02 req-3065b657-1595-443e-8c6a-9f4dea067a9e service nova] Creating event network-changed:8dffb35d-bd1b-42d3-a04a-3a68b6757e0f for instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 on chh1-842464-2 May 19 08:15:26.032993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0cc0dc22-0fc6-4fbf-8d0c-68b223937b02 req-3065b657-1595-443e-8c6a-9f4dea067a9e service nova] Acquired lock "compute-rpcapi-router" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:15:26.035193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:26.035776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:26.036812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:26.038622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:26.051634 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.compute.rpcapi [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 08:15:26.053411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] Releasing lock "compute-rpcapi-router" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:15:26.056196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:26.070168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a431e7d2-2f84-4ab6-b992-318cf9e8a2a5 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 1.186797 May 19 08:15:26.085987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 36/74] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:24 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:26.094678 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-616c9e52-eb56-4226-b9db-8fb5373e88d7 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249754 May 19 08:15:26.098820 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 39/75] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:26.348562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:26.349404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:26.367940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:26.372704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:26.376559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:26.382523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:26.768744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=10 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:27.094311 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:27.095799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:27.114035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:27.116095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:27.120008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:27.120687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:27.243324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:27.497126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:27.550068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b398cad4-f76d-441c-ba18-899f53adecf6 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 1.203364 May 19 08:15:27.552406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 37/76] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:26 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:27.865661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:27.880900 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-03ca1d07-558a-4431-8444-6cf41ba6dd2b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.792499 May 19 08:15:27.882016 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 40/77] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:27 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:28.573095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:28.573964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:28.589789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:28.590568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:28.591558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:28.592267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:28.899393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:28.900038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:28.915290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:28.916087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:28.916915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:28.917374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:29.883685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:29.892797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0bf061e-d2f3-4fc2-8428-1f812a6f47b4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 1.325954 May 19 08:15:29.898678 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 38/78] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:28 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:29.926715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:29.937253 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0f041ef8-339f-440b-81eb-a1a208cec766 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 1.042353 May 19 08:15:29.938613 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 41/79] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:28 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:30.115571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-18686289-742e-4766-85cb-a68b8271caa9 req-90f9b359-bc94-42ec-ba86-dcb0e1dfc8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c568ec3-f550-4f88-a7de-c2a2225800e2", "tag": "ea68c491-7ccf-4e2f-b8c7-18181ce9d605"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:30.161770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18686289-742e-4766-85cb-a68b8271caa9 req-90f9b359-bc94-42ec-ba86-dcb0e1dfc8a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.163232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18686289-742e-4766-85cb-a68b8271caa9 req-90f9b359-bc94-42ec-ba86-dcb0e1dfc8a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.182092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Calling method '.version_select at 0x7f3212ce1700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:30.183254 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:30.183254 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:30.184797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.185432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.237297 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-18686289-742e-4766-85cb-a68b8271caa9 req-90f9b359-bc94-42ec-ba86-dcb0e1dfc8a1 service nova] Creating event network-changed:ea68c491-7ccf-4e2f-b8c7-18181ce9d605 for instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 on chh2-842464-2 May 19 08:15:30.238881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.239550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.242579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18686289-742e-4766-85cb-a68b8271caa9 req-90f9b359-bc94-42ec-ba86-dcb0e1dfc8a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:15:30.244785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.246383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.249037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.250108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.279136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.280909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.287955 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.rpcapi [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 08:15:30.291041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] Releasing lock "compute-rpcapi-router" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:15:30.297078 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dc67b488-f6c0-4daa-ac80-b2aa32ea5d79 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.357005 May 19 08:15:30.303044 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 42/80] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:30.332757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bbe1493-6c1f-4d52-b92b-012d7e5eba9a None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432135 May 19 08:15:30.334112 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 39/81] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:30.829389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a12d6df9-bef3-4ff0-b241-b78078c1dcf8 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Calling method '.version_select at 0x7f3212ce1670>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:30.830234 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:30.830234 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:30.831967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a12d6df9-bef3-4ff0-b241-b78078c1dcf8 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1b81668bdbc145d2a86a26d45cf4ef75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53a7ba6f963546959e6bcda017594c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a12d6df9-bef3-4ff0-b241-b78078c1dcf8 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Request method failure captured: May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hypervisors/chh1-842464-2/search HTTP/1.1 May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfygms5_M5OOFj2XKCjXPKZ2NGhXM5QI-K7YQcdWwwVdpOGRv0ubuc77Ycj108Xj9p3ZFXnyE63YONd_VXu_GQ6FqJoURjOTOohWwAnmdcVOmqxxKagiJb_8hejIlWxnDlG10MMWUr4eMg1uMdwn7kjCXJYYRqiUlEfHJSA4fIf2SnA May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 53a7ba6f963546959e6bcda017594c75 May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-487132624 May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:15:30.837906 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/53a7ba6f963546959e6bcda017594c75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/53a7ba6f963546959e6bcda017594c75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_53a7ba6f963546959e6bcda017594c75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/53a7ba6f963546959e6bcda017594c75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-487132624 May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 53a7ba6f963546959e6bcda017594c75 May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-487132624 May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-487132624-project May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 1b81668bdbc145d2a86a26d45cf4ef75 May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-487132624-project May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 19 08:15:30.839204 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'chh1-842464-2'} May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:30.839854 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 19 08:15:30.840783 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:30.843015 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a12d6df9-bef3-4ff0-b241-b78078c1dcf8 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:30.844076 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a12d6df9-bef3-4ff0-b241-b78078c1dcf8 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/chh1-842464-2/search" status: 403 len: 117 microversion: 2.1 time: 0.533537 May 19 08:15:30.845233 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 43/82] 10.222.0.78 () {58 vars in 1208 bytes} [Thu May 19 08:15:30 2022] GET /compute/v2.1/os-hypervisors/chh1-842464-2/search => generated 117 bytes in 536 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:30.855544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Calling method '.version_select at 0x7f3212d331f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:30.856745 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:30.856745 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:30.858415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.859138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.878458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-530345900", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "1256612231", "adminPass": "***", "networks": [{"uuid": "cd02c628-7eca-4237-a4fb-a4ce5e196d97"}], "security_groups": [{"name": "tempest-securitygroup--936821863"}], "key_name": "tempest-keypair-1865817268", "user_data": "}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:30.890578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Request method failure captured: May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyhLqJx7KQ46wUb-lAVf41i6vuJpwBoRBOq7re08ju9INPZZNfKR_6tUAXIj0ZoxqR9c0c6Qs6w9yDTHcnH8Ss9aibI3Bq-7UPd9hZLESNvD3hsO7MJFVpodhnbOz_RVGIjoy3PKOZPEZCRNQzEXlQSYjnLPWyhLA7BK2hW_bghSnU May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d93a6d6ce8ee465686c2f09152c715c0 May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-904929393 May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:15:30.898501 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-904929393 May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d93a6d6ce8ee465686c2f09152c715c0 May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-904929393 May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8b4af2ab9773476f914ea667989609db May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 08:15:30.899597 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'nonexistent_hypervisor_name'} May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:30.900242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:30.901221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:30.901221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:30.901221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:30.901221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 19 08:15:30.901221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:30.904020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:30.905137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4714f58a-95ad-435c-9085-993f7bba7882 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.054219 May 19 08:15:30.907392 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 40/83] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:15:30 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:30.920733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:30.923099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:30.935436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.936245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.937881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:30.938526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:30.966176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:31.288427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:31.298775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3dc232c0-c741-4ae6-9824-0c80443b6863 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.387127 May 19 08:15:31.301081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 41/84] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:30 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:31.306704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Calling method '.version_select at 0x7f3212d33f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:31.307927 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:31.307927 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:31.309582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:31.310325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:31.328436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:31.329273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:31.344258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:31.345105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:31.358118 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e117013b-13cb-4abc-b6e7-edc439e1d336 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055547 May 19 08:15:31.359877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 42/85] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:15:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:31.365813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:31.366773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:31.375981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:31.376976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:31.378709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:31.379383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:31.659319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:31.671597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9588c9ac-b298-48d9-9424-0c0c66df651b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.310054 May 19 08:15:31.684066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 43/86] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:31 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:31.702424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f26ffed-7065-40db-9b17-052eae2c5d60 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Calling method '.version_select at 0x7f3212d33280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:31.711811 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:31.711811 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:31.714963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0f26ffed-7065-40db-9b17-052eae2c5d60 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1b81668bdbc145d2a86a26d45cf4ef75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53a7ba6f963546959e6bcda017594c75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f26ffed-7065-40db-9b17-052eae2c5d60 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Request method failure captured: May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfygms5_M5OOFj2XKCjXPKZ2NGhXM5QI-K7YQcdWwwVdpOGRv0ubuc77Ycj108Xj9p3ZFXnyE63YONd_VXu_GQ6FqJoURjOTOohWwAnmdcVOmqxxKagiJb_8hejIlWxnDlG10MMWUr4eMg1uMdwn7kjCXJYYRqiUlEfHJSA4fIf2SnA May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 53a7ba6f963546959e6bcda017594c75 May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-487132624 May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:15:31.728684 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/53a7ba6f963546959e6bcda017594c75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/53a7ba6f963546959e6bcda017594c75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_53a7ba6f963546959e6bcda017594c75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/53a7ba6f963546959e6bcda017594c75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-487132624 May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 53a7ba6f963546959e6bcda017594c75 May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-487132624 May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-487132624-project May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1b81668bdbc145d2a86a26d45cf4ef75 May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-487132624-project May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1'} May 19 08:15:31.730630 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:31.731840 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 19 08:15:31.733038 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:31.737209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f26ffed-7065-40db-9b17-052eae2c5d60 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:31.738790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f26ffed-7065-40db-9b17-052eae2c5d60 tempest-HypervisorAdminNegativeUnderV252Test-487132624 tempest-HypervisorAdminNegativeUnderV252Test-487132624-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.053011 May 19 08:15:31.740087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 44/87] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:15:31 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:31.754815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Calling method '.version_select at 0x7f3212c7c4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:31.758375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:31.759159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:31.804295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] HTTP exception thrown: No hypervisor matching 'a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20' could be found. May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Request method failure captured: May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20/servers HTTP/1.1 May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyhLqJx7KQ46wUb-lAVf41i6vuJpwBoRBOq7re08ju9INPZZNfKR_6tUAXIj0ZoxqR9c0c6Qs6w9yDTHcnH8Ss9aibI3Bq-7UPd9hZLESNvD3hsO7MJFVpodhnbOz_RVGIjoy3PKOZPEZCRNQzEXlQSYjnLPWyhLA7BK2hW_bghSnU May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d93a6d6ce8ee465686c2f09152c715c0 May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-904929393 May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:15:31.807126 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d93a6d6ce8ee465686c2f09152c715c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-904929393 May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d93a6d6ce8ee465686c2f09152c715c0 May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-904929393 May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8b4af2ab9773476f914ea667989609db May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: exception: No hypervisor matching 'a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20' could be found. May 19 08:15:31.809590 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20'} May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20' could be found. May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:31.810500 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20' could be found. May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:31.811441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] Returning 404 to user: No hypervisor matching 'a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20' could be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:31.817319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26e372e1-0f44-452d-8a2a-d9be055a37e7 tempest-HypervisorAdminNegativeUnderV252Test-904929393 tempest-HypervisorAdminNegativeUnderV252Test-904929393-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20/servers" status: 404 len: 123 microversion: 2.1 time: 0.071298 May 19 08:15:31.823580 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 45/88] 10.222.0.78 () {58 vars in 1280 bytes} [Thu May 19 08:15:31 2022] GET /compute/v2.1/os-hypervisors/a45bbd63-1ad2-45c5-bf4c-eec2c9c6bc20/servers => generated 123 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:32.058819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:32.320337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:32.322141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:32.329554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:32.336782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:32.338133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:32.338824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:32.649580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:32.682158 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ea9e252-7ec4-4239-b2cb-0cfc4c94dac4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.367517 May 19 08:15:32.700635 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 46/89] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:32 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:32.727085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:32.730208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:32.749502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:32.757498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:32.758882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:32.760736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:33.055379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:33.078926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-278ad8a8-ca23-4dfc-a05f-ed2b51e35e0a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.375158 May 19 08:15:33.079955 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 47/90] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:32 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:33.703514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:33.704114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:33.707715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=78,nova_api:SAVEPOINT=6,nova_api:INSERT=4,nova_api:RELEASE=6,nova_api:DELETE=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:33.742145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:33.744598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:33.746339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:33.747802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:34.018071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:34.028073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b19f8200-c2d6-4e05-bf29-6e83f24b13ff tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.329320 May 19 08:15:34.029271 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 48/91] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:33 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:34.526747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-022919e0-64fe-49b7-87e9-5cdb6999a161 tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-85777443", "id": 1714885926, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:34.530320 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:34.530320 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:34.553101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-022919e0-64fe-49b7-87e9-5cdb6999a161 tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 447 microversion: 2.55 time: 0.522443 May 19 08:15:34.554322 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 49/92] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:15:34 2022] POST /compute/v2.1/flavors => generated 447 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:34.585270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] validate_networks() for [('cd02c628-7eca-4237-a4fb-a4ce5e196d97', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:15:34.649049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffe629b6-7e71-4511-a14c-5327db91c179 tempest-NetworksTest-2060057190 tempest-NetworksTest-2060057190-project-admin] Calling method '.version_select at 0x7f3212c7c3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:34.961267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffe629b6-7e71-4511-a14c-5327db91c179 tempest-NetworksTest-2060057190 tempest-NetworksTest-2060057190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.405496 May 19 08:15:34.962598 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 50/93] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:15:34 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:34.967346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:34.968243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:34.979261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:34.980899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:34.982497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:34.983271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:35.229817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:35.246542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b705e185-c92e-4f56-8971-9f4ba84922b7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.282288 May 19 08:15:35.247553 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 51/94] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:34 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:35.499713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94db6c9b-ab3d-445a-bb4c-5114ca053a66 tempest-FlavorsV255TestJSON-202644574 tempest-FlavorsV255TestJSON-202644574-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:35.509687 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94db6c9b-ab3d-445a-bb4c-5114ca053a66 tempest-FlavorsV255TestJSON-202644574 tempest-FlavorsV255TestJSON-202644574-project] 10.222.0.78 "GET /compute/v2.1/flavors/1714885926" status: 200 len: 447 microversion: 2.55 time: 0.260524 May 19 08:15:35.510338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 52/95] 10.222.0.78 () {60 vars in 1198 bytes} [Thu May 19 08:15:35 2022] GET /compute/v2.1/flavors/1714885926 => generated 447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:35.515983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62fb6961-d63f-464b-9469-ec1c9329cc52 tempest-NetworksTest-2060057190 tempest-NetworksTest-2060057190-project-admin] Calling method '.version_select at 0x7f3212c7ce50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:35.863178 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62fb6961-d63f-464b-9469-ec1c9329cc52 tempest-NetworksTest-2060057190 tempest-NetworksTest-2060057190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks/9f3c70ce-fbff-47a9-b500-e2e998efb9cd" status: 200 len: 652 microversion: 2.1 time: 0.350702 May 19 08:15:35.863778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 53/96] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:15:35 2022] GET /compute/v2.1/os-networks/9f3c70ce-fbff-47a9-b500-e2e998efb9cd => generated 652 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:35.871427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:35.872117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:35.884623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:35.885072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:35.885869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:35.890286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:35.898928 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:15:35.899438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:15:35.900130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:15:35.900553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:15:35.901174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:15:35.911659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:35.912172 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:35.913095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:35.913673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:35.928658 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=81 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:35.942518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Getting quotas for project 5ab46fa809fe4a9bb8ad076da226b643. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:35.947473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Getting quotas for user 83555ee44aaf44b5aec6a2afe7f43d46 and project 5ab46fa809fe4a9bb8ad076da226b643. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:35.960368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:15:35.963515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:15:35.993198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=83,nova_api:DELETE=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:36.026092 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf37020e-8458-464a-b91c-9a3a0b0f043c tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.152822 May 19 08:15:36.030857 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 44/97] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 5154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:15:36.037198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-790239b6-ac12-44a6-9450-bfdcb1a0c83b tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:36.038883 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:36.038883 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:36.046020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:36.056121 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3727946-fdd0-4843-87eb-58afdded7108 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.190952 May 19 08:15:36.057125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 54/98] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:35 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:36.062735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5cbc84e-16b3-49e9-8cee-191bea3c4922 tempest-NetworksTest-2060057190 tempest-NetworksTest-2060057190-project-admin] Calling method '.version_select at 0x7f3212c9a8b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.072840 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-790239b6-ac12-44a6-9450-bfdcb1a0c83b tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1714885926" status: 200 len: 448 microversion: 2.55 time: 0.044593 May 19 08:15:36.073722 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 45/99] 10.222.0.78 () {62 vars in 1218 bytes} [Thu May 19 08:15:36 2022] PUT /compute/v2.1/flavors/1714885926 => generated 448 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:36.078741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69a6651d-6faf-419d-bf67-ff68cfa99926 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.079804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-69a6651d-6faf-419d-bf67-ff68cfa99926 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:36.176251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-69a6651d-6faf-419d-bf67-ff68cfa99926 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:36.184132 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-69a6651d-6faf-419d-bf67-ff68cfa99926 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1264 microversion: 2.1 time: 0.109190 May 19 08:15:36.185531 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 46/100] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:36 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1264 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:36.190621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-554f652a-5211-46db-bd58-608681e7942f tempest-FlavorsV255TestJSON-202644574 tempest-FlavorsV255TestJSON-202644574-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.213549 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-554f652a-5211-46db-bd58-608681e7942f tempest-FlavorsV255TestJSON-202644574 tempest-FlavorsV255TestJSON-202644574-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.026819 May 19 08:15:36.215260 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 47/101] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:15:36 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:36.239641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3c932671-afa4-4d65-9b1a-a71d0b4a6d7b tempest-FlavorsV255TestJSON-202644574 tempest-FlavorsV255TestJSON-202644574-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.239876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5cbc84e-16b3-49e9-8cee-191bea3c4922 tempest-NetworksTest-2060057190 tempest-NetworksTest-2060057190-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 3328 microversion: 2.1 time: 0.181536 May 19 08:15:36.241092 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 55/102] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:15:36 2022] GET /compute/v2.1/os-networks => generated 3328 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:36.270485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.273178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:36.277769 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3c932671-afa4-4d65-9b1a-a71d0b4a6d7b tempest-FlavorsV255TestJSON-202644574 tempest-FlavorsV255TestJSON-202644574-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.042410 May 19 08:15:36.278488 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 48/103] 10.222.0.78 () {60 vars in 1165 bytes} [Thu May 19 08:15:36 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:36.287810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:36.293161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9fd84dcc-2f25-4ae1-bde1-86c379429d4e tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.294616 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:36.294616 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:36.297589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:36.298428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:36.298867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:36.336937 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9fd84dcc-2f25-4ae1-bde1-86c379429d4e tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1714885926" status: 202 len: 0 microversion: 2.55 time: 0.047421 May 19 08:15:36.337619 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 49/104] 10.222.0.78 () {60 vars in 1201 bytes} [Thu May 19 08:15:36 2022] DELETE /compute/v2.1/flavors/1714885926 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:15:36.348543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf9643f6-4502-4c37-83b7-50642900e2c4 tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:36.375471 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf9643f6-4502-4c37-83b7-50642900e2c4 tempest-FlavorsV255TestJSON-1686524928 tempest-FlavorsV255TestJSON-1686524928-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.030923 May 19 08:15:36.376787 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 50/105] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:15:36 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:15:36.518977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:36.527793 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f2470bc-d391-495b-a41b-288e95cf207a tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.266285 May 19 08:15:36.534842 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 56/106] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:36 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:37.078466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:37.080360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:37.092451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:37.095590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:37.098057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:37.102496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:37.203916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:37.204549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:37.212081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:37.212525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:37.213320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:37.213752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:37.317429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:37.330228 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7290f712-3ae4-42af-9f8f-c196543c6a7a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.253026 May 19 08:15:37.333208 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 51/107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:37 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:37.357777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:37.372019 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf6c17f2-3416-4066-b89e-c380d406957b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1337 microversion: 2.1 time: 0.173395 May 19 08:15:37.372698 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 57/108] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:37 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1337 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:37.548383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:37.550016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:37.561188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:37.563040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:37.572362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:37.573911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:37.976622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:37.993942 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-97698fdf-1553-4546-9dd0-cd3e510f5f9b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.451321 May 19 08:15:38.005241 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 52/109] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:37 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:38.141493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0aac8c23-33fe-4743-9452-7ad71839aa05 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Action: 'create', calling method: .version_select at 0x7f3212cff040>, body: {"keypair": {"name": "tempest-keypair-300006669", "type": "ssh", "user_id": "46ed275b7c0e4affa85326235e9d6e1b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa+k4BC7+EzzwFJpnR4u8CbKPXzafuQ9F85GONEw6fDAux09MtsY5/7XMHU7k8ZW2NM2FW3TapiFX8nMrFSd0roizXWDoDK9PGbpJj2jJ6PmzYAboOV+6oPiTWQVg3gWw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:38.178528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-0aac8c23-33fe-4743-9452-7ad71839aa05 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Getting quotas for project 3e2506f60d6c499a9fc2714b595357e5. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:38.186656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-0aac8c23-33fe-4743-9452-7ad71839aa05 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Getting quotas for user 6f20020664fe4b7fa95c01ebac2da399 and project 3e2506f60d6c499a9fc2714b595357e5. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:38.224247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0aac8c23-33fe-4743-9452-7ad71839aa05 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.301713 May 19 08:15:38.235363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 58/110] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:15:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 313 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 19 08:15:38.240479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ab2cca2-a714-4f32-992d-700b020cda27 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Action: 'create', calling method: .version_select at 0x7f3212c3fee0>, body: {"keypair": {"name": "tempest-keypair-796579568", "type": "ssh", "user_id": "46ed275b7c0e4affa85326235e9d6e1b", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4wzgRHlntZ/rX0xxHarc+6XvjeeB3lloDHb1pzP9Vbt+p8gEDO1UV5WQTfFQfcp92aki6046Rc5h2uXmT9HbtYxXqHXBy5JotJK9Se2K/9YNgWlTL3f4CZdvtdpYzXHg=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:38.266994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-9ab2cca2-a714-4f32-992d-700b020cda27 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Getting quotas for project 3e2506f60d6c499a9fc2714b595357e5. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:38.275147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-9ab2cca2-a714-4f32-992d-700b020cda27 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Getting quotas for user 6f20020664fe4b7fa95c01ebac2da399 and project 3e2506f60d6c499a9fc2714b595357e5. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:38.308354 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9ab2cca2-a714-4f32-992d-700b020cda27 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.072623 May 19 08:15:38.309581 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 53/111] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:15:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 19 08:15:38.321727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-544fb37c-6db7-4f59-862a-1b7a32296a84 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Calling method '.version_select at 0x7f3212d33700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.346433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-544fb37c-6db7-4f59-862a-1b7a32296a84 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-300006669?user_id=46ed275b7c0e4affa85326235e9d6e1b" status: 200 len: 511 microversion: 2.10 time: 0.030182 May 19 08:15:38.353290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.353980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:38.355059 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 59/112] 10.222.0.78 () {60 vars in 1336 bytes} [Thu May 19 08:15:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-300006669?user_id=46ed275b7c0e4affa85326235e9d6e1b => generated 511 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:38.367752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-005eaf35-8784-421c-bfe1-65f6f98d5289 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Action: 'create', calling method: .version_select at 0x7f3212f4b8b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1715969603", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtOJMNMN5ziE59iV33ifr8UA3SJpI8DozmWZ+J+kxwJZb3B4J9SxUyJ970UQXx7j994kKrSMwicyPPFLgrODxuyA7BZuVCySaR9LZyqMy5tguX91eCaczLcN4Vfm57XrQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:38.379690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:38.380158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:38.382275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:38.383046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:38.384474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-005eaf35-8784-421c-bfe1-65f6f98d5289 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Getting quotas for project 3e2506f60d6c499a9fc2714b595357e5. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:38.388973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-005eaf35-8784-421c-bfe1-65f6f98d5289 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Getting quotas for user 6f20020664fe4b7fa95c01ebac2da399 and project 3e2506f60d6c499a9fc2714b595357e5. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:38.422943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-005eaf35-8784-421c-bfe1-65f6f98d5289 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.063018 May 19 08:15:38.426961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 60/113] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:15:38 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 08:15:38.438334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.438960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:38.448850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:38.449608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:38.450709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:38.451300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:38.568347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:38.578354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d528c15e-d6f2-4012-9035-cc968c53d823 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1343 microversion: 2.1 time: 0.148942 May 19 08:15:38.578967 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 61/114] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:38 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1343 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:38.585181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13423e21-9367-4c64-87df-7c73ca73da71 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Calling method '.version_select at 0x7f32153f0af0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.588993 chdv-842464-2 devstack@n-api.service[119072]: WARNING oslo_db.sqlalchemy.utils [None req-13423e21-9367-4c64-87df-7c73ca73da71 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 19 08:15:38.598617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13423e21-9367-4c64-87df-7c73ca73da71 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs?user_id=46ed275b7c0e4affa85326235e9d6e1b" status: 200 len: 724 microversion: 2.10 time: 0.017874 May 19 08:15:38.599583 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 62/115] 10.222.0.78 () {60 vars in 1258 bytes} [Thu May 19 08:15:38 2022] GET /compute/v2.1/os-keypairs?user_id=46ed275b7c0e4affa85326235e9d6e1b => generated 724 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:38.610900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1783567f-f2ff-4dcd-b661-9385751f9891 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Calling method '.version_select at 0x7f3212c7c8b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.632317 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1783567f-f2ff-4dcd-b661-9385751f9891 tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1715969603" status: 204 len: 0 microversion: 2.10 time: 0.025841 May 19 08:15:38.632969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 63/116] 10.222.0.78 () {60 vars in 1324 bytes} [Thu May 19 08:15:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1715969603 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:15:38.641443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9accc87c-614a-4ac8-900b-040593cd263f tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Calling method '.version_select at 0x7f3212d33f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.657043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:38.671449 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2eb26456-491e-4227-b8f8-4d69080c5ab7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.323959 May 19 08:15:38.672134 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 54/117] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:38 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:38.679202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9accc87c-614a-4ac8-900b-040593cd263f tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796579568?user_id=46ed275b7c0e4affa85326235e9d6e1b" status: 204 len: 0 microversion: 2.10 time: 0.041090 May 19 08:15:38.681053 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 64/118] 10.222.0.78 () {60 vars in 1339 bytes} [Thu May 19 08:15:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796579568?user_id=46ed275b7c0e4affa85326235e9d6e1b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:15:38.691453 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a39a265a-8174-4759-bad4-b7273b7e8e8a tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] Calling method '.version_select at 0x7f3212d2e5e0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:38.723464 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a39a265a-8174-4759-bad4-b7273b7e8e8a tempest-KeyPairsV210TestJSON-1524418183 tempest-KeyPairsV210TestJSON-1524418183-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300006669?user_id=46ed275b7c0e4affa85326235e9d6e1b" status: 204 len: 0 microversion: 2.10 time: 0.037409 May 19 08:15:38.724945 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 55/119] 10.222.0.78 () {60 vars in 1339 bytes} [Thu May 19 08:15:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300006669?user_id=46ed275b7c0e4affa85326235e9d6e1b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:15:39.021581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:39.022268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:39.033031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:39.034415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:39.035473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:39.035923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:39.451192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:39.469929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-521026c5-e515-4516-a804-019f548270a7 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.453460 May 19 08:15:39.471175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 65/120] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:39 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:39.598262 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:39.599955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:39.612062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:39.612791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:39.614616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:39.615650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:39.692457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:39.693565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:39.701477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:39.702711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:39.704154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:39.705930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:40.128345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:40.149134 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5e8001bf-bc14-48de-ba3b-b20780024b8a tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.557011 May 19 08:15:40.150775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:40.151274 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 56/121] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:39 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:40.170893 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4acc1ff-58f4-4ba0-99f9-a7765ef8b6f7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.482469 May 19 08:15:40.171532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 66/122] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:39 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:40.490586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:40.491194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:40.517071 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:40.518284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:40.538515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:40.539223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:40.550467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dc54b97b-f9b8-489c-956f-0144f5545f38 req-908ea805-cdd0-4f55-8a22-a5cc8d171a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ebe82b-7784-4409-942a-d691ed1937d1", "tag": "9f49cf5c-fad7-4a96-a537-884a26eee24b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:40.558236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:40.567546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc54b97b-f9b8-489c-956f-0144f5545f38 req-908ea805-cdd0-4f55-8a22-a5cc8d171a80 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:40.574912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc54b97b-f9b8-489c-956f-0144f5545f38 req-908ea805-cdd0-4f55-8a22-a5cc8d171a80 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:40.601579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dc54b97b-f9b8-489c-956f-0144f5545f38 req-908ea805-cdd0-4f55-8a22-a5cc8d171a80 service nova] Creating event network-changed:9f49cf5c-fad7-4a96-a537-884a26eee24b for instance d2ebe82b-7784-4409-942a-d691ed1937d1 on chh1-842464-2 May 19 08:15:40.618847 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dc54b97b-f9b8-489c-956f-0144f5545f38 req-908ea805-cdd0-4f55-8a22-a5cc8d171a80 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070772 May 19 08:15:40.623227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 67/123] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:15:40.870286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:40.881920 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5afcd9cf-10a0-4ec9-9fdb-2a6ccf3588e3 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.396253 May 19 08:15:40.882527 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 57/124] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:40 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:41.178777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:41.179495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:41.193409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:41.193879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:41.195284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:41.195718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:41.364742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a7d3062-7ccf-4d2e-8c5a-0d8424ddbb30 tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] Calling method '.version_select at 0x7f3212c1d8b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:41.365648 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:41.365648 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:41.405042 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a7d3062-7ccf-4d2e-8c5a-0d8424ddbb30 tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.644197 May 19 08:15:41.412396 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 68/125] 10.222.0.78 () {60 vars in 1225 bytes} [Thu May 19 08:15:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:41.422218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:41.423893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:41.433721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:41.434253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:41.435124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:41.435788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:42.017752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:42.029401 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-96baacbb-9e34-4071-b234-c3276c0bd873 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.859339 May 19 08:15:42.030384 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 58/126] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:41 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:42.035489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ce6d1c59-3264-4d2c-92f7-e32c954ca603 tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] Action: 'update', calling method: .version_select at 0x7f3212d40550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:42.037329 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:42.037329 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:42.055460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:42.066658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17de3597-b7f2-4474-a52f-7739344ffeca tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.652906 May 19 08:15:42.067978 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 69/127] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:41 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:42.279233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cca8c2bf-add8-49bd-8647-ddd18ac996dd req-9d280656-8d30-4fe3-85f0-04a812e9f6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c568ec3-f550-4f88-a7de-c2a2225800e2", "name": "network-vif-plugged", "status": "completed", "tag": "ea68c491-7ccf-4e2f-b8c7-18181ce9d605"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:42.301009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cca8c2bf-add8-49bd-8647-ddd18ac996dd req-9d280656-8d30-4fe3-85f0-04a812e9f6b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:42.301530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cca8c2bf-add8-49bd-8647-ddd18ac996dd req-9d280656-8d30-4fe3-85f0-04a812e9f6b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:42.319533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cca8c2bf-add8-49bd-8647-ddd18ac996dd req-9d280656-8d30-4fe3-85f0-04a812e9f6b7 service nova] Creating event network-vif-plugged:ea68c491-7ccf-4e2f-b8c7-18181ce9d605 for instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 on chh2-842464-2 May 19 08:15:42.326077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cca8c2bf-add8-49bd-8647-ddd18ac996dd req-9d280656-8d30-4fe3-85f0-04a812e9f6b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255962 May 19 08:15:42.327306 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 70/128] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:42.334589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:42.336005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:42.341206 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ce6d1c59-3264-4d2c-92f7-e32c954ca603 tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.309486 May 19 08:15:42.342017 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 59/129] 10.222.0.78 () {62 vars in 1246 bytes} [Thu May 19 08:15:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:42.351648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:42.352130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:42.355059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:42.355508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:42.356063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2a5344b2-870c-45bd-8538-79a65b89359e tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] Calling method '.version_select at 0x7f3212c3f160>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:42.356972 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:42.356972 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:42.385293 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2a5344b2-870c-45bd-8538-79a65b89359e tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.034677 May 19 08:15:42.392648 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 60/130] 10.222.0.78 () {60 vars in 1225 bytes} [Thu May 19 08:15:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:42.399983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e4a14a01-7861-43a9-b007-4af2a96cf9c6 tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] Action: 'update', calling method: .version_select at 0x7f3212d40ca0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:42.441773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=75,nova_api:UPDATE=12,nova_api:DELETE=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:42.525057 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e4a14a01-7861-43a9-b007-4af2a96cf9c6 tempest-QuotaClassesAdmin257Test-816351760 tempest-QuotaClassesAdmin257Test-816351760-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.130370 May 19 08:15:42.526546 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 61/131] 10.222.0.78 () {62 vars in 1246 bytes} [Thu May 19 08:15:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:42.605206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:42.615629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb3876e4-fb8f-42cd-a632-9e0ae45ebf66 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.286440 May 19 08:15:42.616737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 71/132] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:42 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:43.048208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:43.049707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:43.057699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:43.058346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:43.061681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:43.065712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:43.295751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-548032166", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:43.387009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:15:43.592746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:43.616783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd08ab0d-2ffd-402c-a1c0-45813f1e5119 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.573757 May 19 08:15:43.622513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 72/133] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:43 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:43.629734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:43.630748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:43.638586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:43.639856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:43.640862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:43.641568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:43.647158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:43.974086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:43.983109 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e90445b9-1002-4528-91f4-389c2f80ef85 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1319 microversion: 2.1 time: 0.357856 May 19 08:15:43.985027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 73/134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:43 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:43.992898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:43.999661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:44.006841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.007588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.008592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.009240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.016577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:15:44.016995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:15:44.017493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:15:44.018032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:15:44.018441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:15:44.029399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.029811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.031443 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.031879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.057859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Getting quotas for project 2498755892a5447c9103cc54e740dfbd. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:44.067356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Getting quotas for user 4c2650c1e71d41a5ac2412eda518ee1e and project 2498755892a5447c9103cc54e740dfbd. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:44.087202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:15:44.089450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:15:44.141999 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fe738e93-696e-4f22-a1d7-658be5f6e780 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249746 May 19 08:15:44.147571 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 62/135] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:15:44.155421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-417ab6da-6605-4e39-8e27-173c1af95215 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:44.159533 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-417ab6da-6605-4e39-8e27-173c1af95215 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:44.186915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:44.197990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a745412-0dde-4578-b9df-a55256fe857f tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.211603 May 19 08:15:44.199783 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 74/136] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:43 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:44.246003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-417ab6da-6605-4e39-8e27-173c1af95215 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:44.257550 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-417ab6da-6605-4e39-8e27-173c1af95215 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1218 microversion: 2.1 time: 0.107154 May 19 08:15:44.258289 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 63/137] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:44 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:44.343480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-59057def-78c7-49c9-be46-2fe96bd8b8bd req-b3f9f695-8278-44fa-b424-7f5a636d1358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e309c9d-b16f-4600-95cc-b00aa3df59f5", "name": "network-vif-plugged", "status": "completed", "tag": "8dffb35d-bd1b-42d3-a04a-3a68b6757e0f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:44.357764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-59057def-78c7-49c9-be46-2fe96bd8b8bd req-b3f9f695-8278-44fa-b424-7f5a636d1358 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.365055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-59057def-78c7-49c9-be46-2fe96bd8b8bd req-b3f9f695-8278-44fa-b424-7f5a636d1358 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.388477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-59057def-78c7-49c9-be46-2fe96bd8b8bd req-b3f9f695-8278-44fa-b424-7f5a636d1358 service nova] Creating event network-vif-plugged:8dffb35d-bd1b-42d3-a04a-3a68b6757e0f for instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 on chh1-842464-2 May 19 08:15:44.395008 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-59057def-78c7-49c9-be46-2fe96bd8b8bd req-b3f9f695-8278-44fa-b424-7f5a636d1358 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055077 May 19 08:15:44.395625 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 75/138] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:44.638782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:44.640513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:44.648388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.649162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.650166 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:44.650806 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:44.873711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:44.882852 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1fec8e02-6900-4744-847a-b1a2880a0783 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.247972 May 19 08:15:44.893079 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 64/139] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:44 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:45.004463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:45.005187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:45.012001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.012453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.013447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.013896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.183265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:45.203025 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dce1808a-11ae-4519-a389-96485768e87c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1469 microversion: 2.1 time: 0.204563 May 19 08:15:45.217038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 76/140] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:44 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:45.224169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:45.224795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:45.231142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.231592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.232361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.232791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.391277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:45.399765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3328e7b-8654-454c-885b-8d77edfc415c tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.181100 May 19 08:15:45.400787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 77/141] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:45 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:45.455282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d71c0973-4a1d-468f-b58e-14ffccf09737 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '.version_select at 0x7f3212c38550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:45.578080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:45.578863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:45.591235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.591702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.592498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.592935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.698170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:15:45.767117 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d71c0973-4a1d-468f-b58e-14ffccf09737 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871" status: 200 len: 371 microversion: 2.1 time: 0.631768 May 19 08:15:45.768271 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 65/142] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:15:45 2022] GET /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871 => generated 371 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:45.774097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:45.775169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:45.799818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.800266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.803421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.805679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.887768 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-942ed1ff-a4fa-4537-b0bc-5406664283d4 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 204 len: 0 microversion: 2.1 time: 0.485468 May 19 08:15:45.889973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 78/143] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:15:45 2022] DELETE /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:15:45.898212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0770cdb2-33a7-4716-8b0d-d6d3c7cac78f tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Action: 'update', calling method: .version_select at 0x7f3212c9a4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:45.931207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:45.944647 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a3cf66a-9497-4875-901e-ccc815c09c7f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1276 microversion: 2.1 time: 0.174878 May 19 08:15:45.945272 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 66/144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:45 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:45.953502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:45.954390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:45.963274 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.964027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:45.964937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:45.966569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.203442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:46.213114 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-66b4a5d2-f1ee-4549-9c57-287b0e326f4a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1475 microversion: 2.1 time: 0.266447 May 19 08:15:46.213789 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 67/145] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:45 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:46.218935 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:46.219717 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:46.239641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0770cdb2-33a7-4716-8b0d-d6d3c7cac78f tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.241513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.241689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0770cdb2-33a7-4716-8b0d-d6d3c7cac78f tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.242303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.243587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0770cdb2-33a7-4716-8b0d-d6d3c7cac78f tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.244490 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.245444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0770cdb2-33a7-4716-8b0d-d6d3c7cac78f tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.247687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.340573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:46.345670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0770cdb2-33a7-4716-8b0d-d6d3c7cac78f tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871" status: 200 len: 328 microversion: 2.1 time: 0.454431 May 19 08:15:46.346767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 79/146] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:15:45 2022] PUT /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871 => generated 328 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:46.363982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-825eeda5-cc03-4158-8679-c9bc2e2710aa tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:46.381097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-825eeda5-cc03-4158-8679-c9bc2e2710aa tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871" status: 202 len: 0 microversion: 2.1 time: 0.022427 May 19 08:15:46.385382 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 80/147] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:15:46 2022] DELETE /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:15:46.391524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4711120d-3742-447d-b378-9d72a1115308 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '.version_select at 0x7f3212ac74c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:46.448692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:46.465245 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e9c4a303-53f3-467e-94bb-8f40a826f1ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.250113 May 19 08:15:46.476761 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 68/148] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:46 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:46.506823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:46.508303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:46.524806 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.526719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.529412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.529870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.806754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4711120d-3742-447d-b378-9d72a1115308 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871" status: 200 len: 371 microversion: 2.1 time: 0.420012 May 19 08:15:46.812877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 81/149] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:15:46 2022] GET /compute/v2.1/os-quota-sets/b660a591aa9645c5b440306de65ce871 => generated 371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:46.844497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:46.862520 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-187dde59-2325-4d36-9d6e-8cd5b3cd7bb2 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1337 microversion: 2.1 time: 0.378746 May 19 08:15:46.870549 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 69/150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:46 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1337 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:46.965168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:46.966506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:46.981165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.981888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:46.982972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:46.983528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:47.030928 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8dd5aeb3-281b-41b8-86d9-556f17fe655e tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '.version_select at 0x7f3212c38c10>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:47.204983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:47.215885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d1dd791-3653-4229-96db-8508fc452b6e tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.257475 May 19 08:15:47.218290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 82/151] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:46 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:47.236227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:47.238176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:47.250738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:47.254097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:47.255269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:47.257246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:47.339311 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8dd5aeb3-281b-41b8-86d9-556f17fe655e tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.311970 May 19 08:15:47.340518 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 70/152] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:15:47 2022] GET /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c/defaults => generated 371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:47.472930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:47.485459 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df23dd0d-43e5-4a0d-8e65-3904f0df0218 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1475 microversion: 2.1 time: 0.257765 May 19 08:15:47.497366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:47.497366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:47.498346 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 83/153] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:47 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:47.504044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:47.504587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:47.506074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:47.506737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:47.832001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:47.833636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2809c48-c8a9-4f0c-93a7-bfd72171f20c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Action: 'update', calling method: .version_select at 0x7f3212c084c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:47.843919 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a95121f0-1131-49f7-9fd1-e6066892a9a6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.361656 May 19 08:15:47.846232 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 71/154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:47 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:47.880744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:47.881409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:47.899313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:47.899762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:47.900544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:47.900978 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.076810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2809c48-c8a9-4f0c-93a7-bfd72171f20c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.077594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2809c48-c8a9-4f0c-93a7-bfd72171f20c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.079020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2809c48-c8a9-4f0c-93a7-bfd72171f20c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.079939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2809c48-c8a9-4f0c-93a7-bfd72171f20c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.187864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2809c48-c8a9-4f0c-93a7-bfd72171f20c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31" status: 200 len: 328 microversion: 2.1 time: 0.359748 May 19 08:15:48.197488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 84/155] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:15:47 2022] PUT /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31 => generated 328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:48.203466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9b688579-0a4c-43ee-96f5-ec0d18eff2a8 req-62d57f11-1525-4048-9ff2-86ab1e5d9963 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717491f6-c7fd-430d-bd7c-361f49bdc7d9", "tag": "40a7c23b-46ec-4dd5-aadb-2351c464f618"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:48.212918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9b688579-0a4c-43ee-96f5-ec0d18eff2a8 req-62d57f11-1525-4048-9ff2-86ab1e5d9963 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.213387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9b688579-0a4c-43ee-96f5-ec0d18eff2a8 req-62d57f11-1525-4048-9ff2-86ab1e5d9963 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.228521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9b688579-0a4c-43ee-96f5-ec0d18eff2a8 req-62d57f11-1525-4048-9ff2-86ab1e5d9963 service nova] Creating event network-changed:40a7c23b-46ec-4dd5-aadb-2351c464f618 for instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 on chh2-842464-2 May 19 08:15:48.242695 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9b688579-0a4c-43ee-96f5-ec0d18eff2a8 req-62d57f11-1525-4048-9ff2-86ab1e5d9963 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039165 May 19 08:15:48.244198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 85/156] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:48.249853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a2c8309d-f40e-45a2-9a67-407a98ea59d0 req-c927610f-2e6c-4202-82b6-f5eea3f5e191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ebe82b-7784-4409-942a-d691ed1937d1", "name": "network-vif-plugged", "status": "completed", "tag": "9f49cf5c-fad7-4a96-a537-884a26eee24b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:48.274713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2c8309d-f40e-45a2-9a67-407a98ea59d0 req-c927610f-2e6c-4202-82b6-f5eea3f5e191 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.276469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2c8309d-f40e-45a2-9a67-407a98ea59d0 req-c927610f-2e6c-4202-82b6-f5eea3f5e191 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.281708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:48.292417 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8136c087-b179-4f95-a426-b4314f834550 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1487 microversion: 2.1 time: 0.416334 May 19 08:15:48.293691 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 72/157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:47 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1487 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:48.305524 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a2c8309d-f40e-45a2-9a67-407a98ea59d0 req-c927610f-2e6c-4202-82b6-f5eea3f5e191 service nova] Creating event network-vif-plugged:9f49cf5c-fad7-4a96-a537-884a26eee24b for instance d2ebe82b-7784-4409-942a-d691ed1937d1 on chh1-842464-2 May 19 08:15:48.306572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a2c8309d-f40e-45a2-9a67-407a98ea59d0 req-c927610f-2e6c-4202-82b6-f5eea3f5e191 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058979 May 19 08:15:48.308681 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 86/158] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:48.313917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0d26fec6-e8e3-4a85-be82-8b32efccd37c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '.version_select at 0x7f3212d40940>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:48.320004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:48.321068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:48.337433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.337883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.339334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.340516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.461904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0d26fec6-e8e3-4a85-be82-8b32efccd37c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.462351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0d26fec6-e8e3-4a85-be82-8b32efccd37c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.463165 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0d26fec6-e8e3-4a85-be82-8b32efccd37c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.463887 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0d26fec6-e8e3-4a85-be82-8b32efccd37c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.472247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:48.514333 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0d26fec6-e8e3-4a85-be82-8b32efccd37c tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31/detail" status: 200 len: 916 microversion: 2.1 time: 0.203977 May 19 08:15:48.516513 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 73/159] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:15:48 2022] GET /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31/detail => generated 916 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:48.522471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:48.523266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:48.531378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.531837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.532933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.533824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.930784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:48.954075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4dc5305-bad4-4de9-bad2-5160ae2c6ab6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.641691 May 19 08:15:48.957746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 87/160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:48 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:48.964885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:48.965646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:48.980805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.981466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:48.982472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:48.983291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.091851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:49.102170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2163292-2fd5-4678-842d-11f5c72d2932 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1304 microversion: 2.1 time: 0.142919 May 19 08:15:49.103309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 88/161] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:48 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:49.108773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Action: 'update', calling method: .version_select at 0x7f3212aecc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:49.185670 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ff72c1a2-ce5b-4073-9a25-0ba3414a5774 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1638 microversion: 2.1 time: 0.667767 May 19 08:15:49.187093 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 74/162] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:48 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1638 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:49.193100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:49.194171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:49.202972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.203425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.204194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.205064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.405747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.406255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.407128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.407622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.422213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:49.433054 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1c76958e-bda3-4a50-8e4f-2a1218389af0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.244466 May 19 08:15:49.434915 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 75/163] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:49 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:49.441206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-ee95f428-50b3-4a76-913a-b020201e9323 req-58caaf81-425c-440b-bef6-4d4319df5c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c568ec3-f550-4f88-a7de-c2a2225800e2", "name": "network-vif-deleted", "tag": "ea68c491-7ccf-4e2f-b8c7-18181ce9d605"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:49.445185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.445682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.446478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.446907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.450676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-ee95f428-50b3-4a76-913a-b020201e9323 req-58caaf81-425c-440b-bef6-4d4319df5c6a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.451220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-ee95f428-50b3-4a76-913a-b020201e9323 req-58caaf81-425c-440b-bef6-4d4319df5c6a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.463294 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-ee95f428-50b3-4a76-913a-b020201e9323 req-58caaf81-425c-440b-bef6-4d4319df5c6a service nova] Creating event network-vif-deleted:ea68c491-7ccf-4e2f-b8c7-18181ce9d605 for instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 on chh2-842464-2 May 19 08:15:49.469260 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-ee95f428-50b3-4a76-913a-b020201e9323 req-58caaf81-425c-440b-bef6-4d4319df5c6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032771 May 19 08:15:49.470098 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 76/164] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:49.476676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:49.477278 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:49.485513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.485952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.487031 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.487565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.505613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:49.518346 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:15:49.522754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1059981-b395-4096-a65f-a2316343646b tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31?user_id=ed8a4a8e17484485a60f3079e225b7fa" status: 200 len: 328 microversion: 2.1 time: 0.418090 May 19 08:15:49.523933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 89/165] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:15:49 2022] PUT /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31?user_id=ed8a4a8e17484485a60f3079e225b7fa => generated 328 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:49.536491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ac8c7d9-31aa-4a5c-909c-bbbbe409eb4e tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '.version_select at 0x7f3212aecdc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:49.676800 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c89bbd7a-307e-4425-83d2-b47399147e11 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 204 len: 0 microversion: 2.1 time: 0.205170 May 19 08:15:49.677415 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 77/166] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:15:49 2022] DELETE /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:15:49.688424 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:49.689677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:49.708490 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.709332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.710504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.711433 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.761641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ac8c7d9-31aa-4a5c-909c-bbbbe409eb4e tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31?user_id=ed8a4a8e17484485a60f3079e225b7fa" status: 200 len: 370 microversion: 2.1 time: 0.231106 May 19 08:15:49.762835 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 90/167] 10.222.0.78 () {58 vars in 1322 bytes} [Thu May 19 08:15:49 2022] GET /compute/v2.1/os-quota-sets/7c7012ca78fa4aa88f24502a23703d31?user_id=ed8a4a8e17484485a60f3079e225b7fa => generated 370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:49.871300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:49.880239 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2421f854-d7b0-404c-8bce-d2043e2c5475 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1493 microversion: 2.1 time: 0.197208 May 19 08:15:49.890859 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 78/168] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:49 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:49.974491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:49.975106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:49.981651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.982456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:49.983429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:49.983863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.120594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:50.121568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:50.132564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.133266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.134153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.134590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.174800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.175529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.176248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lazy-loading 'fault' on Instance uuid 0c568ec3-f550-4f88-a7de-c2a2225800e2 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:15:50.184699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:50.193991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0911bfd4-2d91-4c09-a927-f7672d831ac4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.223516 May 19 08:15:50.194570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 91/169] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:49 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:50.202819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5185e19-9db8-40a2-82fd-22b06a6973bf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Calling method '.version_select at 0x7f3212ad20d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:50.228296 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:50.237074 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cf8c0cfd-7a43-4bb0-a49a-3e8850054ad3 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 200 len: 1309 microversion: 2.1 time: 0.120207 May 19 08:15:50.237705 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 79/170] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:50 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:50.452253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:50.453129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:50.462464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.463603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.464945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.465574 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.499049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5185e19-9db8-40a2-82fd-22b06a6973bf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.303027 May 19 08:15:50.499639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 92/171] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:15:50 2022] GET /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c/defaults => generated 371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:50.511781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54f718b7-e57f-46a1-b65c-83c91ebd78d4 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Action: 'update', calling method: .version_select at 0x7f3212ac7160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:50.680786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:50.690407 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-062c208d-06b6-4cfe-bec2-c1b4cd6fbfae tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1410 microversion: 2.1 time: 0.241644 May 19 08:15:50.691555 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 80/172] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:50 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1410 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:50.825206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54f718b7-e57f-46a1-b65c-83c91ebd78d4 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.825685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54f718b7-e57f-46a1-b65c-83c91ebd78d4 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.826483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54f718b7-e57f-46a1-b65c-83c91ebd78d4 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.826934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54f718b7-e57f-46a1-b65c-83c91ebd78d4 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.900371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:50.901253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:50.913472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.913924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:50.919255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:50.919923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.066865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=15 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:51.126824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54f718b7-e57f-46a1-b65c-83c91ebd78d4 tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c" status: 200 len: 329 microversion: 2.1 time: 0.619081 May 19 08:15:51.133503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 93/173] 10.222.0.78 () {60 vars in 1262 bytes} [Thu May 19 08:15:50 2022] PUT /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c => generated 329 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:15:51.145536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4aeb496a-9afd-4988-83be-3d9d2c44d0cf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Action: 'update', calling method: .version_select at 0x7f3212c3d3a0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:51.184705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e46ef724cd43729e57ab4142ad1351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb1e52b508c47bcae75440631533855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:51.198995 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4db8acbf-a540-431f-91f9-71a90c8d26bd tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 200 len: 1493 microversion: 2.1 time: 0.299466 May 19 08:15:51.198995 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 81/174] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:50 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 1493 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:51.215294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:51.216074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:51.223581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.224162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.225091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.225907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.491135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4aeb496a-9afd-4988-83be-3d9d2c44d0cf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.492370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4aeb496a-9afd-4988-83be-3d9d2c44d0cf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.492555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4aeb496a-9afd-4988-83be-3d9d2c44d0cf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.493078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4aeb496a-9afd-4988-83be-3d9d2c44d0cf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.548744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:51.559102 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3492329a-feff-4bfb-bc31-a6db8fefe7fb tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.348667 May 19 08:15:51.559719 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 82/175] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:51 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:15:51.565442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:51.566295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:51.574180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.575156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.575937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.576513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.592791 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] HTTP exception thrown: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Request method failure captured: May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 HTTP/1.1 May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyQelHVgmh3o0SjXoNG79UFaDJWaBdnRgmhB4beHFp7f_RrTwVCMMuchs-HNgdipUcac84Kz9Q2HdpezCuhWTb6s2k7N5aD72ftZRd9TqTnt4PNT3tsL3k9v5bZkjBFpLxcIyBvRSC-fyAL__ly95__HkMA7VNjqGutoC8pcZuYnnw May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:15:51.599005 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ce6e8adf2d4c4413965e77e5ab9359d4 May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:15:51.600299 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '0c568ec3-f550-4f88-a7de-c2a2225800e2'} May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:51.600942 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:15:51.602033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:51.603189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Returning 404 to user: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:51.603189 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-83e94927-7169-4709-8eac-3e7a3bec0773 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 404 len: 111 microversion: 2.1 time: 0.039661 May 19 08:15:51.613443 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 83/176] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:51 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:51.712291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:51.713582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:51.724414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.725138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.726328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:51.727083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:51.754765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:51.904482 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4aeb496a-9afd-4988-83be-3d9d2c44d0cf tempest-QuotasAdminTestJSON-536300077 tempest-QuotasAdminTestJSON-536300077-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c" status: 200 len: 329 microversion: 2.1 time: 0.767036 May 19 08:15:51.905239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 94/177] 10.222.0.78 () {60 vars in 1262 bytes} [Thu May 19 08:15:51 2022] PUT /compute/v2.1/os-quota-sets/3fd362b5d1c6414e98c7ae50fe2d160c => generated 329 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:52.043212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:52.054145 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d9d01c3d-f3d2-4ce8-95c3-a55f751817f0 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1610 microversion: 2.1 time: 0.346941 May 19 08:15:52.055392 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 84/178] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:51 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1610 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:52.062235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1386284202", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:52.111964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-23579557", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:52.131228 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:15:52.200130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:15:52.493924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:15:52.495227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:15:52.497758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:15:52.499065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:15:52.500391 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:15:52.507540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:15:52.507973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:15:52.508425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:15:52.508828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:15:52.509241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:15:52.514832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.516005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.519280 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.520242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.520538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.521112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.522091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.522524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.550617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Getting quotas for project 6d6f85a12d6d4ee9ba2950f2ca028e21. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:52.552937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Getting quotas for project ba7ec07150584e2782994ccd2f717547. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:15:52.559104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Getting quotas for user ce6e8adf2d4c4413965e77e5ab9359d4 and project 6d6f85a12d6d4ee9ba2950f2ca028e21. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:52.559330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Getting quotas for user f17de9a8121442b79cca9a9f3221e08a and project ba7ec07150584e2782994ccd2f717547. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:15:52.574255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:15:52.577063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:15:52.577220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:15:52.581089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:15:52.639923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:52.645206 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5bdd9dcd-86c6-45e0-bafa-6c259964f2f6 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738503 May 19 08:15:52.645835 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 95/179] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:15:52.652268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6c30b8fd-a1c6-4b75-bfb4-f80b8ea44e61 req-369ddb83-1bbb-4747-b6fc-4b3371bc3337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e309c9d-b16f-4600-95cc-b00aa3df59f5", "name": "network-vif-deleted", "tag": "8dffb35d-bd1b-42d3-a04a-3a68b6757e0f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:52.689105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6c30b8fd-a1c6-4b75-bfb4-f80b8ea44e61 req-369ddb83-1bbb-4747-b6fc-4b3371bc3337 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.690189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6c30b8fd-a1c6-4b75-bfb4-f80b8ea44e61 req-369ddb83-1bbb-4747-b6fc-4b3371bc3337 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.694229 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ddfde937-7816-45da-ae8e-3347dd55ffbf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636306 May 19 08:15:52.695339 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 85/180] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:15:52.703086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6c30b8fd-a1c6-4b75-bfb4-f80b8ea44e61 req-369ddb83-1bbb-4747-b6fc-4b3371bc3337 service nova] Creating event network-vif-deleted:8dffb35d-bd1b-42d3-a04a-3a68b6757e0f for instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 on chh1-842464-2 May 19 08:15:52.704589 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:52.706883 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:52.710642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6c30b8fd-a1c6-4b75-bfb4-f80b8ea44e61 req-369ddb83-1bbb-4747-b6fc-4b3371bc3337 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061837 May 19 08:15:52.711982 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 96/181] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:52.718119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.718573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.719803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:52.720685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:52.720985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.721830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.729856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.730533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.731520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.732127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.747496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] HTTP exception thrown: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Request method failure captured: May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 HTTP/1.1 May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyFUOWDKKrdC48F3iXSFmONOu31f4GfULEe93GlisBm9vZzQ45_WXgZeuLL6OB9u8jBuJJwJNLTh6TqM3kAasl-81m1r0dmQ4Bj4SAtuLeOxdTlilSGLukFh8lz9hxaZpyuANSfNFfmPfj6-eD5kDwLsjJL2tD9thwdqonWQKKhrqE May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: acb1e52b508c47bcae75440631533855 May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:15:52.754484 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acb1e52b508c47bcae75440631533855"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acb1e52b508c47bcae75440631533855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acb1e52b508c47bcae75440631533855"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acb1e52b508c47bcae75440631533855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: acb1e52b508c47bcae75440631533855 May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminTestJSON-1849055230-project May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f2e46ef724cd43729e57ab4142ad1351 May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminTestJSON-1849055230-project May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:15:52.756108 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4e309c9d-b16f-4600-95cc-b00aa3df59f5'} May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:52.756745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:15:52.757854 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:52.760676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Returning 404 to user: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:52.761769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f913ab2e-1ae5-4256-a38d-1bf15f4aae8b tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 404 len: 111 microversion: 2.1 time: 0.048515 May 19 08:15:52.762838 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 97/182] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:52 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:52.767925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:52.768880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:52.776191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.776812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.777813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:52.778387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:52.946865 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-215aef4b-43ed-43ca-aeba-fe779ac7f4d9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248242 May 19 08:15:52.946865 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 86/183] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:15:52 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1/os-interface => generated 285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:52.953443 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-05df2f85-7b9f-4a96-ae58-89231ffec698 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:52.954741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-05df2f85-7b9f-4a96-ae58-89231ffec698 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:53.009629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:53.033857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a339a855-418b-45e0-84a9-832848d06350 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.257529 May 19 08:15:53.034624 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 98/184] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:52 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:53.049423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7a254d3-9bd1-4247-9d8b-c6cd0c2d6919 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:53.050134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7a254d3-9bd1-4247-9d8b-c6cd0c2d6919 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:53.059690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=18,nova_api:UPDATE=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:53.095201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-05df2f85-7b9f-4a96-ae58-89231ffec698 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:53.107456 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-05df2f85-7b9f-4a96-ae58-89231ffec698 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1220 microversion: 2.1 time: 0.158298 May 19 08:15:53.109600 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 87/185] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:52 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:53.118709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3b2f8af9-2863-4fa0-a4cb-d11ddf63060c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:53.122358 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:53.122358 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:53.141427 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3b2f8af9-2863-4fa0-a4cb-d11ddf63060c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:53.141888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3b2f8af9-2863-4fa0-a4cb-d11ddf63060c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:53.157821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7a254d3-9bd1-4247-9d8b-c6cd0c2d6919 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:53.170494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7a254d3-9bd1-4247-9d8b-c6cd0c2d6919 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1220 microversion: 2.1 time: 0.125588 May 19 08:15:53.172101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 99/186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:53 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:53.381639 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3b2f8af9-2863-4fa0-a4cb-d11ddf63060c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 297 microversion: 2.1 time: 0.269352 May 19 08:15:53.388229 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 88/187] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:53 2022] POST /compute/v2.1/os-aggregates/2/action => generated 297 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:53.393613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a06f956-c02e-42e3-bc53-bf18de0adff7 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:53.394927 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:53.394927 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:53.453577 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a06f956-c02e-42e3-bc53-bf18de0adff7 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.059813 May 19 08:15:53.458969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 100/188] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:53 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:53.478752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e023e19a-1e06-44c3-a69d-6e475442e228 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-982069184"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:53.481247 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:53.481247 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:53.482766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-e023e19a-1e06-44c3-a69d-6e475442e228 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid 6e2960b2-5bb0-49b2-a897-e31c4a67ca93 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:53.519461 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e023e19a-1e06-44c3-a69d-6e475442e228 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044142 May 19 08:15:53.520813 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 89/189] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:53.531979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3d99ac7-302a-43f7-b925-6094c100fdc4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:53.533507 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:53.533507 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:53.557884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3d99ac7-302a-43f7-b925-6094c100fdc4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:53.558596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3d99ac7-302a-43f7-b925-6094c100fdc4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:53.563154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:53.801727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3d99ac7-302a-43f7-b925-6094c100fdc4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.273751 May 19 08:15:53.804325 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 101/190] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:53 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:53.815507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-baa5f3e1-197f-47a4-9ae6-7afdeb5a71c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:53.817092 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:53.817092 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:53.826368 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-baa5f3e1-197f-47a4-9ae6-7afdeb5a71c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.014800 May 19 08:15:53.831857 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 90/191] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:15:53 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:53.839260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc9eede9-a9e6-413a-b37b-0377ac6e73a2 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:53.840566 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:53.840566 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:53.859316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc9eede9-a9e6-413a-b37b-0377ac6e73a2 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:53.859766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc9eede9-a9e6-413a-b37b-0377ac6e73a2 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.041904 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc9eede9-a9e6-413a-b37b-0377ac6e73a2 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.206906 May 19 08:15:54.042870 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 102/192] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:53 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:54.056649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74e1ccd2-0f13-4dfa-8e25-25204f1e2ce2 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:54.057650 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:54.057650 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:54.058892 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:54.060401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:54.079428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.079884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.080753 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.081281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.102432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74e1ccd2-0f13-4dfa-8e25-25204f1e2ce2 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.049576 May 19 08:15:54.107173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 103/193] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:54 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:54.121268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee09bc87-3d55-43f6-b5ed-b97f323758ac tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1896395597"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:54.122611 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:54.122611 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:54.139091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-ee09bc87-3d55-43f6-b5ed-b97f323758ac tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid 6204f413-d109-41e6-aeaf-1a7bceb477df for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:54.211466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee09bc87-3d55-43f6-b5ed-b97f323758ac tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.096323 May 19 08:15:54.213632 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 104/194] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:54.224405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:54.226753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:54.243593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.244310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.246921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.248028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.381679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:54.386275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:54.390446 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4143aff1-a7b6-4c6e-83f7-f3645f2d5a74 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1272 microversion: 2.1 time: 0.175311 May 19 08:15:54.400572 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 105/195] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:54 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:54.400849 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4ab46aca-00d5-49a6-9494-fac9095c32c6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.342646 May 19 08:15:54.400849 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 91/196] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:54 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:54.400987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:54.400987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:54.409505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e031c85c-4052-47bd-ad99-4876fce15011 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:54.410660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.411114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.412157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.412306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.412968 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:54.412968 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:54.425200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e031c85c-4052-47bd-ad99-4876fce15011 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.425923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e031c85c-4052-47bd-ad99-4876fce15011 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.565935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:54.594229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80881aaa-b029-4022-8a69-f6d9d8d78a71 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1272 microversion: 2.1 time: 0.189357 May 19 08:15:54.614555 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 106/197] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:54 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:54.668704 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e031c85c-4052-47bd-ad99-4876fce15011 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.272264 May 19 08:15:54.669493 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 92/198] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:54.682020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a089e1be-54c1-4bf8-a9d4-cc68f4f40b75 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:54.683478 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:54.683478 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:54.700970 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a089e1be-54c1-4bf8-a9d4-cc68f4f40b75 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.024581 May 19 08:15:54.702425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 107/199] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:15:54 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:54.715994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc296943-63e2-4596-9955-0502298d14a4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:54.717758 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:54.717758 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:54.733766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc296943-63e2-4596-9955-0502298d14a4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:54.734412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc296943-63e2-4596-9955-0502298d14a4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:54.929745 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc296943-63e2-4596-9955-0502298d14a4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.219916 May 19 08:15:54.931429 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 93/200] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:54 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:54.943832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb254593-b7f0-4909-87ef-40bdf72d30a3 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:54.944877 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:54.944877 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:54.984982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb254593-b7f0-4909-87ef-40bdf72d30a3 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.046297 May 19 08:15:54.988284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 108/201] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:54 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:55.001151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-edf1a430-2f0c-447d-802b-0745cb64c844 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f32129e0d30>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:55.003075 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:55.003075 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:55.005758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-edf1a430-2f0c-447d-802b-0745cb64c844 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.006424 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-edf1a430-2f0c-447d-802b-0745cb64c844 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.007436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-edf1a430-2f0c-447d-802b-0745cb64c844 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.008060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-edf1a430-2f0c-447d-802b-0745cb64c844 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.051917 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-edf1a430-2f0c-447d-802b-0745cb64c844 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.055531 May 19 08:15:55.053320 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 94/202] 10.222.0.78 () {58 vars in 1127 bytes} [Thu May 19 08:15:54 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:55.077975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2edc1d64-ce22-4011-ab07-58b0645a77e5 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f32129c2040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:55.079927 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:55.079927 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:55.082078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2edc1d64-ce22-4011-ab07-58b0645a77e5 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.082686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2edc1d64-ce22-4011-ab07-58b0645a77e5 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.084000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2edc1d64-ce22-4011-ab07-58b0645a77e5 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.084749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2edc1d64-ce22-4011-ab07-58b0645a77e5 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.119595 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2edc1d64-ce22-4011-ab07-58b0645a77e5 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.059340 May 19 08:15:55.120859 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 109/203] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:15:55 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:55.136164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8981e233-3704-455b-ab04-9f7fc684f49f tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f321299c1f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:55.139713 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:55.139713 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:55.156685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8981e233-3704-455b-ab04-9f7fc684f49f tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.157702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8981e233-3704-455b-ab04-9f7fc684f49f tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.158714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8981e233-3704-455b-ab04-9f7fc684f49f tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.160688 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8981e233-3704-455b-ab04-9f7fc684f49f tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.188923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93e0379c-3f61-4b71-b702-1b2e3307b97f tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-626919610"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:55.196130 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:55.196130 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:55.200956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-93e0379c-3f61-4b71-b702-1b2e3307b97f tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid f13a2099-46f3-44fd-bef7-7d0295ee32c9 for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:55.254081 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8981e233-3704-455b-ab04-9f7fc684f49f tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.120478 May 19 08:15:55.255079 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 95/204] 10.222.0.78 () {58 vars in 1127 bytes} [Thu May 19 08:15:55 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:55.270947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:55.271580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:55.276187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93e0379c-3f61-4b71-b702-1b2e3307b97f tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.128073 May 19 08:15:55.281739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 110/205] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:15:55.284402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.287833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.290495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.291116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.293127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-39da3e1c-6917-4f1e-b35a-941226647249 req-6f9c800f-5d71-4b29-876a-fa215dddca9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ebe82b-7784-4409-942a-d691ed1937d1", "tag": "9f49cf5c-fad7-4a96-a537-884a26eee24b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:55.323603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-39da3e1c-6917-4f1e-b35a-941226647249 req-6f9c800f-5d71-4b29-876a-fa215dddca9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.325795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-39da3e1c-6917-4f1e-b35a-941226647249 req-6f9c800f-5d71-4b29-876a-fa215dddca9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.359289 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-39da3e1c-6917-4f1e-b35a-941226647249 req-6f9c800f-5d71-4b29-876a-fa215dddca9e service nova] Creating event network-changed:9f49cf5c-fad7-4a96-a537-884a26eee24b for instance d2ebe82b-7784-4409-942a-d691ed1937d1 on chh1-842464-2 May 19 08:15:55.376897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-39da3e1c-6917-4f1e-b35a-941226647249 req-6f9c800f-5d71-4b29-876a-fa215dddca9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093617 May 19 08:15:55.382813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 111/206] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:55.400648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91763344-6094-426f-877b-ea438f2751d8 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f3212baeee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:55.404438 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:55.404438 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:55.426022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91763344-6094-426f-877b-ea438f2751d8 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.428538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91763344-6094-426f-877b-ea438f2751d8 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.461412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91763344-6094-426f-877b-ea438f2751d8 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.461864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91763344-6094-426f-877b-ea438f2751d8 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.551312 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91763344-6094-426f-877b-ea438f2751d8 tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/chh1-842464-2" status: 200 len: 729 microversion: 2.1 time: 0.162427 May 19 08:15:55.553689 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 112/207] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:15:55 2022] GET /compute/v2.1/os-hosts/chh1-842464-2 => generated 729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:55.571072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a73af3d-bf17-462e-b96a-c6ddbae61a5c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:55.574335 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:55.574335 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:55.619907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a73af3d-bf17-462e-b96a-c6ddbae61a5c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.620362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a73af3d-bf17-462e-b96a-c6ddbae61a5c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.866272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a73af3d-bf17-462e-b96a-c6ddbae61a5c tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.311462 May 19 08:15:55.866882 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 113/208] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:55 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:55.873100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:55.878374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:55.894428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.895071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:55.896281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:55.896872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.104443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:56.114983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6b827e7-fdbf-4e6e-b64f-7711a1952a83 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1278 microversion: 2.1 time: 0.246848 May 19 08:15:56.120530 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 114/209] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:55 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1278 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:56.130535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:56.135069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.135981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:56.142463 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-decb3bc7-6122-4e1f-81d6-888054d06be6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 200 len: 1589 microversion: 2.1 time: 0.880359 May 19 08:15:56.143557 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 96/210] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:55 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 1589 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:56.152742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.153665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.154597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.154806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.157518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-144e6ae9-604b-4595-a7b2-5aa78fb82936 req-e74e733c-3170-4ec9-a212-8ddfbc25f871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717491f6-c7fd-430d-bd7c-361f49bdc7d9", "name": "network-vif-plugged", "status": "completed", "tag": "40a7c23b-46ec-4dd5-aadb-2351c464f618"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:56.178914 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-144e6ae9-604b-4595-a7b2-5aa78fb82936 req-e74e733c-3170-4ec9-a212-8ddfbc25f871 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.183344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-144e6ae9-604b-4595-a7b2-5aa78fb82936 req-e74e733c-3170-4ec9-a212-8ddfbc25f871 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.211339 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-144e6ae9-604b-4595-a7b2-5aa78fb82936 req-e74e733c-3170-4ec9-a212-8ddfbc25f871 service nova] Creating event network-vif-plugged:40a7c23b-46ec-4dd5-aadb-2351c464f618 for instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 on chh2-842464-2 May 19 08:15:56.217377 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-144e6ae9-604b-4595-a7b2-5aa78fb82936 req-e74e733c-3170-4ec9-a212-8ddfbc25f871 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066570 May 19 08:15:56.219034 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 97/211] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:56.226679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0e76eb2f-49fb-496d-99c1-cc558b4e689b tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Calling method '.version_select at 0x7f32129e0b80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.227935 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.227935 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:56.235722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e76eb2f-49fb-496d-99c1-cc558b4e689b tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.237202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e76eb2f-49fb-496d-99c1-cc558b4e689b tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.253134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e76eb2f-49fb-496d-99c1-cc558b4e689b tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.268264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e76eb2f-49fb-496d-99c1-cc558b4e689b tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.298549 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0e76eb2f-49fb-496d-99c1-cc558b4e689b tempest-HostsAdminTestJSON-2080796582 tempest-HostsAdminTestJSON-2080796582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/chh2-842464-2" status: 200 len: 467 microversion: 2.1 time: 0.076501 May 19 08:15:56.301380 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 98/212] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:15:56 2022] GET /compute/v2.1/os-hosts/chh2-842464-2 => generated 467 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:56.323854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.326450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:56.336853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.337731 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.338804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.339550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.424406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:56.437112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b02117e0-7775-4ce9-bfa9-1492d70f493f tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.315409 May 19 08:15:56.448880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 115/213] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:56 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:56.456366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92612afc-e501-4ea4-8ce0-2e7fc6bf9494 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:56.457969 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.457969 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:56.473332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92612afc-e501-4ea4-8ce0-2e7fc6bf9494 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.473332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92612afc-e501-4ea4-8ce0-2e7fc6bf9494 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.565673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:56.570353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:56.590517 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-66e51549-c1b4-4e4f-96e1-d01ea625c742 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1278 microversion: 2.1 time: 0.286405 May 19 08:15:56.591464 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 99/214] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:56 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:56.677234 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92612afc-e501-4ea4-8ce0-2e7fc6bf9494 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.235619 May 19 08:15:56.677890 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 116/215] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:56 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:56.692544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d21fb83e-9864-49b8-9db4-8273c1370923 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.693395 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.693395 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:56.746245 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d21fb83e-9864-49b8-9db4-8273c1370923 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.057992 May 19 08:15:56.747085 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 100/216] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:56 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 19 08:15:56.761349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f338bb8-e32b-4991-8701-bd5dd66672d1 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1161885254"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:56.765408 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.765408 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:56.766929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-1f338bb8-e32b-4991-8701-bd5dd66672d1 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid cca4be45-cc94-4b84-9823-20a79f196492 for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:56.804970 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f338bb8-e32b-4991-8701-bd5dd66672d1 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049526 May 19 08:15:56.805715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 117/217] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:56.822380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-097c621b-6c68-40d3-8607-9e5771b8e7a7 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2042934193"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:56.824710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0bdf5e48-d759-4a14-a3bd-b3566703a6f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.828238 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.828238 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:56.834573 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.834573 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:56.836012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-097c621b-6c68-40d3-8607-9e5771b8e7a7 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid 05de2443-f766-4a9b-8690-f8a473aaebb2 for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:56.864086 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0bdf5e48-d759-4a14-a3bd-b3566703a6f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.050890 May 19 08:15:56.864778 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 101/218] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:56.873339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ffa486a1-ee8a-4b7a-ab2e-864a31ecffbe tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.875210 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.875210 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:56.890183 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-ffa486a1-ee8a-4b7a-ab2e-864a31ecffbe tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 19 08:15:56.894553 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-097c621b-6c68-40d3-8607-9e5771b8e7a7 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076021 May 19 08:15:56.895176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 118/219] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ffa486a1-ee8a-4b7a-ab2e-864a31ecffbe tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Request method failure captured: May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyJ-8Nw9Xa_j86DE09ti8e0sS8Vry7ZKDN-kWJ5_uS5G9_oCq83QvnnfvF6QJZHQSOj7e5vRUClQh-pP7t8-FXgMFgZGSucPO9WHBjPg_mHqOt_MVBjqEbga1o7QJ2GDukkZYnF7aGIYonh2vKnX4XpKqNOp5aYOjy8GXqLNYgEuBM May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:15:56.907502 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32608c45940741ffa203a01a28c95295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32608c45940741ffa203a01a28c95295"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 968736e799314c9799e8053041e9e804 May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: exception: Aggregate 6 could not be found. May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '6'} May 19 08:15:56.908934 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:56.909805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 19 08:15:56.910899 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.913580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f292fb34-36aa-4ca9-8224-a4541820ef07 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:56.913580 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.913580 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:56.919009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f292fb34-36aa-4ca9-8224-a4541820ef07 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:56.919170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ffa486a1-ee8a-4b7a-ab2e-864a31ecffbe tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:56.919620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f292fb34-36aa-4ca9-8224-a4541820ef07 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:56.921452 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ffa486a1-ee8a-4b7a-ab2e-864a31ecffbe tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.050953 May 19 08:15:56.923966 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 102/220] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:15:56 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:15:56.940541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6b4931bf-0556-4126-b42b-12fa4a9b36f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:56.943729 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:56.943729 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:56.987672 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-6b4931bf-0556-4126-b42b-12fa4a9b36f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6b4931bf-0556-4126-b42b-12fa4a9b36f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Request method failure captured: May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyJ-8Nw9Xa_j86DE09ti8e0sS8Vry7ZKDN-kWJ5_uS5G9_oCq83QvnnfvF6QJZHQSOj7e5vRUClQh-pP7t8-FXgMFgZGSucPO9WHBjPg_mHqOt_MVBjqEbga1o7QJ2GDukkZYnF7aGIYonh2vKnX4XpKqNOp5aYOjy8GXqLNYgEuBM May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:15:56.995897 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32608c45940741ffa203a01a28c95295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32608c45940741ffa203a01a28c95295"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 968736e799314c9799e8053041e9e804 May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: exception: Aggregate 6 could not be found. May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '6'} May 19 08:15:56.997246 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:15:56.998002 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:56.999040 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6b4931bf-0556-4126-b42b-12fa4a9b36f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:57.000092 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6b4931bf-0556-4126-b42b-12fa4a9b36f8 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.068539 May 19 08:15:57.007136 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 103/221] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:15:57.029783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-302da092-c82c-49cc-b6b1-515d70ac1a5e tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1612921782", "name": "tempest-test_aggregate-89217240"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:57.031745 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:57.031745 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:57.038964 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-302da092-c82c-49cc-b6b1-515d70ac1a5e tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid ba2dab3d-735f-4ca1-b6e3-d7746d04f472 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:57.102664 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-302da092-c82c-49cc-b6b1-515d70ac1a5e tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.083079 May 19 08:15:57.108402 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 104/222] 10.222.0.78 () {60 vars in 1164 bytes} [Thu May 19 08:15:57 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:57.120006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-96d14978-7120-4ee5-b532-bed3624d4ea6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.120959 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:57.120959 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:57.131017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f292fb34-36aa-4ca9-8224-a4541820ef07 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.226183 May 19 08:15:57.131666 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 119/223] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:56 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:57.171250 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-96d14978-7120-4ee5-b532-bed3624d4ea6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.060332 May 19 08:15:57.172951 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 105/224] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:57 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 19 08:15:57.191632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.193408 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:57.219831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.220436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.222196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.230730 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.329039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28356a0e-b7d4-4ea4-a0f1-81ce274e10fc tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Action: 'update', calling method: .version_select at 0x7f3212ab6ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:57.401213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:57.415082 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-99478782-47cc-4b95-a240-2fbe8bda848a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1278 microversion: 2.1 time: 0.239392 May 19 08:15:57.415219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28356a0e-b7d4-4ea4-a0f1-81ce274e10fc tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.415659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28356a0e-b7d4-4ea4-a0f1-81ce274e10fc tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.415794 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 106/225] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:57 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:57.416912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28356a0e-b7d4-4ea4-a0f1-81ce274e10fc tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.417554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28356a0e-b7d4-4ea4-a0f1-81ce274e10fc tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.430096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:57.434799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:57.437260 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:57.437260 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:57.455354 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.459629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.501912 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28356a0e-b7d4-4ea4-a0f1-81ce274e10fc tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a" status: 200 len: 148 microversion: 2.57 time: 0.369169 May 19 08:15:57.503351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 120/226] 10.222.0.78 () {62 vars in 1302 bytes} [Thu May 19 08:15:57 2022] PUT /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a => generated 148 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:57.509964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11e79eed-b34a-4507-9f2d-fe08703587c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.514138 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:57.514138 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:57.514369 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] HTTP exception thrown: Aggregate 7 already has host chh1-842464-2. May 19 08:15:57.523432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-11e79eed-b34a-4507-9f2d-fe08703587c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] HTTP exception thrown: Aggregate 8 could not be found. May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11e79eed-b34a-4507-9f2d-fe08703587c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Request method failure captured: May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyJ-8Nw9Xa_j86DE09ti8e0sS8Vry7ZKDN-kWJ5_uS5G9_oCq83QvnnfvF6QJZHQSOj7e5vRUClQh-pP7t8-FXgMFgZGSucPO9WHBjPg_mHqOt_MVBjqEbga1o7QJ2GDukkZYnF7aGIYonh2vKnX4XpKqNOp5aYOjy8GXqLNYgEuBM May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:15:57.526961 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32608c45940741ffa203a01a28c95295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32608c45940741ffa203a01a28c95295"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 968736e799314c9799e8053041e9e804 May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: exception: Aggregate 8 could not be found. May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8'} May 19 08:15:57.528156 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.528860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. May 19 08:15:57.529888 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:57.530862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11e79eed-b34a-4507-9f2d-fe08703587c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:57.530862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11e79eed-b34a-4507-9f2d-fe08703587c5 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.023891 May 19 08:15:57.530862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 121/227] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:15:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:15:57.536163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.537048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:57.546014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.546589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.548024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.548806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 39 May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:15:57.591073 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: {"add_host": {"host": "chh1-842464-2"}} May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:15:57.592820 chdv-842464-2 devstack@n-api.service[119073]: exception: Aggregate 7 already has host chh1-842464-2. May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '7', 'body': {'add_host': {'host': 'chh1-842464-2'}}} May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result.read() May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 08:15:57.593599 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'chh1-842464-2-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi session.flush() May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._flush(objects) May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 08:15:57.594616 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi compat.raise_( May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi flush_context.execute() May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi rec.execute(self) May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 08:15:57.595643 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 08:15:57.598655 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result.read() May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'chh1-842464-2-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 19, 8, 15, 57, 492677), 'updated_at': None, 'host': 'chh1-842464-2', 'aggregate_id': 7}] May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.602001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host chh1-842464-2. May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.605373 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host chh1-842464-2. May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:57.608996 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:57.612953 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host chh1-842464-2. May 19 08:15:57.612953 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.612953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 409 to user: Aggregate 7 already has host chh1-842464-2. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:57.612953 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6c09533b-e7e6-4df4-8a5f-9aea413ef497 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.169663 May 19 08:15:57.612953 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 107/228] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 19 08:15:57.613750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-abc89779-8e23-4677-b96a-b6b9bcbeec6e tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Calling method '.version_select at 0x7f32127be1f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.711586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:15:57.720433 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abc89779-8e23-4677-b96a-b6b9bcbeec6e tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.721496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abc89779-8e23-4677-b96a-b6b9bcbeec6e tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.722768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abc89779-8e23-4677-b96a-b6b9bcbeec6e tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.723427 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abc89779-8e23-4677-b96a-b6b9bcbeec6e tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.747516 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-abc89779-8e23-4677-b96a-b6b9bcbeec6e tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a/detail" status: 200 len: 463 microversion: 2.57 time: 0.143114 May 19 08:15:57.748037 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 108/229] 10.222.0.78 () {60 vars in 1303 bytes} [Thu May 19 08:15:57 2022] GET /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a/detail => generated 463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:57.768382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-452448b1-2be5-4903-8322-de4b356996d6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.769216 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:57.769216 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:57.780693 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-452448b1-2be5-4903-8322-de4b356996d6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] HTTP exception thrown: Aggregate 8 could not be found. May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-452448b1-2be5-4903-8322-de4b356996d6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Request method failure captured: May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyJ-8Nw9Xa_j86DE09ti8e0sS8Vry7ZKDN-kWJ5_uS5G9_oCq83QvnnfvF6QJZHQSOj7e5vRUClQh-pP7t8-FXgMFgZGSucPO9WHBjPg_mHqOt_MVBjqEbga1o7QJ2GDukkZYnF7aGIYonh2vKnX4XpKqNOp5aYOjy8GXqLNYgEuBM May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:15:57.782132 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32608c45940741ffa203a01a28c95295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32608c45940741ffa203a01a28c95295"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32608c45940741ffa203a01a28c95295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 32608c45940741ffa203a01a28c95295 May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1960362642 May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 968736e799314c9799e8053041e9e804 May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminTestJSON-1960362642-project-admin May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: exception: Aggregate 8 could not be found. May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '8'} May 19 08:15:57.784078 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:15:57.784759 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:57.785746 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:57.786835 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:57.786835 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:57.786835 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:57.786835 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. May 19 08:15:57.786835 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:15:57.788470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-452448b1-2be5-4903-8322-de4b356996d6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:57.789421 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-452448b1-2be5-4903-8322-de4b356996d6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.040163 May 19 08:15:57.790454 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 109/230] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:57 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:15:57.798386 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7a6ce8de-685a-413e-8069-d072bb7977bc tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:57.801465 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:57.801465 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:57.811163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8de-685a-413e-8069-d072bb7977bc tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.811612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8de-685a-413e-8069-d072bb7977bc tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.932007 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7a6ce8de-685a-413e-8069-d072bb7977bc tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.140309 May 19 08:15:57.933078 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 110/231] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:57.942488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:57.943152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:57.950150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.950589 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:57.951377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:57.952164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.067461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:58.076667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a1b300c-67dc-48c4-89ba-ef771b4eeb47 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1318 microversion: 2.1 time: 0.546297 May 19 08:15:58.077259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 122/232] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:57 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1318 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:58.083693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84a4f0bc-2677-4f3f-840c-ee54040250bd tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-913309610"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:58.085766 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.085766 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:58.086184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-84a4f0bc-2677-4f3f-840c-ee54040250bd tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid a41e3417-282a-4499-a575-f33a89f2cdd8 for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:58.116118 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84a4f0bc-2677-4f3f-840c-ee54040250bd tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037296 May 19 08:15:58.121591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 123/233] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:58.122704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Action: 'update', calling method: .version_select at 0x7f3212905790>, body: {"quota_set": {"ram": "2048"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:58.225193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:58.226675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.227662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:58.229126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.248739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:58.264264 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-37c72cf5-5fcf-4178-a194-732d0385501c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.330003 May 19 08:15:58.264856 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 111/234] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:57 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:58.274052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:58.274493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.276577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:58.277950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.279596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fb0f9f82-c3f8-4bff-905e-fd318be0e767 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:58.280892 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.280892 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:58.312071 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fb0f9f82-c3f8-4bff-905e-fd318be0e767 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036264 May 19 08:15:58.313040 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 112/235] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:58 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:58.321214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10c56122-306c-431d-b9ee-e09f0c1d1f91 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:58.322449 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.322449 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:58.334875 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-10c56122-306c-431d-b9ee-e09f0c1d1f91 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 226 microversion: 2.1 time: 0.020544 May 19 08:15:58.335669 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 113/236] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:15:58 2022] GET /compute/v2.1/os-aggregates/9 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:58.340909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8aff86be-6085-4102-b316-f0277d49ebe1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1391200355"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:58.343726 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.343726 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:58.345030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-8aff86be-6085-4102-b316-f0277d49ebe1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid d0f5fc55-93f7-4a7c-8e32-7ee0edd8adb9 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:58.368930 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8aff86be-6085-4102-b316-f0277d49ebe1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.031764 May 19 08:15:58.369737 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 114/237] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:58.374877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7c8760fa-8c3b-4a20-8f29-36d169b75d50 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:58.376700 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.376700 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:58.400159 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c3d0960-e888-4d36-bea1-bbcaa70b484a tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a?user_id=d2c33d5749c444d3a38b52d7dbb9c4a7" status: 200 len: 148 microversion: 2.57 time: 0.281740 May 19 08:15:58.404485 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 124/238] 10.222.0.78 () {62 vars in 1383 bytes} [Thu May 19 08:15:58 2022] PUT /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a?user_id=d2c33d5749c444d3a38b52d7dbb9c4a7 => generated 148 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:58.415799 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7c8760fa-8c3b-4a20-8f29-36d169b75d50 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 264 microversion: 2.1 time: 0.044603 May 19 08:15:58.418249 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 115/239] 10.222.0.78 () {60 vars in 1190 bytes} [Thu May 19 08:15:58 2022] POST /compute/v2.1/os-aggregates/9/action => generated 264 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:58.427295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-628ceee4-18df-44cc-81af-a3c13b96f50f tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] Calling method '.version_select at 0x7f3212756550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:58.742146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbbb3de3-4062-4b15-b320-a95e7a4b5744 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:58.743451 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.743451 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:58.744513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbbb3de3-4062-4b15-b320-a95e7a4b5744 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'a425f9eec24f443db73e52ff0db7e503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ff4c1be3b1488f971e519c5a520cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbbb3de3-4062-4b15-b320-a95e7a4b5744 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Request method failure captured: May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 39 May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyEHVDVf4iL04djId9HOkWxraJKIoE0FhdMoJLF90pvIC5rrLY3S5SzNysn2pHtpmPNtT72NwCJ_2QUr5Ty0WLJsekNFQ5oxnzCh_nhAaMSVtT0VwdEkmKbOXUjrKHWtPfn6NRolmN-6_ZEP6InM0s_ILjc57QqdNyMGcfvLTjNPas May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:15:58.747412 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: a425f9eec24f443db73e52ff0db7e503 May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: {"add_host": {"host": "chh1-842464-2"}} May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:15:58.748588 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '10', 'body': {'add_host': {'host': 'chh1-842464-2'}}} May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:58.749285 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 19 08:15:58.750309 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:58.754951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbbb3de3-4062-4b15-b320-a95e7a4b5744 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:58.758731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbbb3de3-4062-4b15-b320-a95e7a4b5744 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.349542 May 19 08:15:58.762172 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 125/240] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:15:58 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 357 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:58.769194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5e457a0-5095-4060-97ca-b54702a555d1 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:58.770573 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.770573 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:58.790882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5e457a0-5095-4060-97ca-b54702a555d1 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 240 microversion: 2.1 time: 0.027249 May 19 08:15:58.792385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 126/241] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:15:58 2022] GET /compute/v2.1/os-aggregates/9 => generated 240 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:58.804424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:58.805450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:58.818120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:58.819214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.821187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:58.821811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:58.978539 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-628ceee4-18df-44cc-81af-a3c13b96f50f tempest-QuotasAdminTestV257-1717309740 tempest-QuotasAdminTestV257-1717309740-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a?user_id=d2c33d5749c444d3a38b52d7dbb9c4a7" status: 200 len: 190 microversion: 2.57 time: 0.551656 May 19 08:15:58.978539 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 116/242] 10.222.0.78 () {60 vars in 1363 bytes} [Thu May 19 08:15:58 2022] GET /compute/v2.1/os-quota-sets/89ea45963f6541948cfebf2cfa876e9a?user_id=d2c33d5749c444d3a38b52d7dbb9c4a7 => generated 190 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:15:58.978539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a76e6af2-4106-4d8f-a286-099553229c5c tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:58.979599 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:58.979599 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:59.018592 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a76e6af2-4106-4d8f-a286-099553229c5c tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.044035 May 19 08:15:59.020003 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 117/243] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:15:58 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:59.027520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-19a0f79e-f160-4d76-8871-cb4e2cc2f09e tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:59.028618 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.028618 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:59.073038 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-19a0f79e-f160-4d76-8871-cb4e2cc2f09e tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.050857 May 19 08:15:59.074340 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 118/244] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:15:59 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:59.083732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6cdc125e-c57c-4c65-a4af-63b9cfea81f9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1390230610"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:59.087285 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.087285 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:59.088953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-6cdc125e-c57c-4c65-a4af-63b9cfea81f9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid 5b5514f0-d84c-4e9b-b31d-67b2cd323b75 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:59.135842 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6cdc125e-c57c-4c65-a4af-63b9cfea81f9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056825 May 19 08:15:59.142142 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 119/245] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:15:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:59.155635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ce0758c2-c02f-4d3b-8616-ddd84e441097 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-82077542", "availability_zone": "tempest-test_az-1648147861"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:59.160927 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.160927 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:59.162239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-ce0758c2-c02f-4d3b-8616-ddd84e441097 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid 4f7da58e-01c6-4d05-b38b-a8657983dccb for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:15:59.214878 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ce0758c2-c02f-4d3b-8616-ddd84e441097 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.071838 May 19 08:15:59.226210 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 120/246] 10.222.0.78 () {60 vars in 1164 bytes} [Thu May 19 08:15:59 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:59.240456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:59.240456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:59.240456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.240456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.244585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.244585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.247064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:59.273082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef2dcffe-7bc9-4110-b53e-9ea62b80b5ac tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.476535 May 19 08:15:59.274169 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 127/247] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:58 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:59.291544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-942591790"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:59.293085 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.293085 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:59.314089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.316183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.341161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.343919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.374195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-942591790 could not be found. May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 57 May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:15:59.378277 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: {"add_host": {"host": "tempest-nonexist_host-942591790"}} May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:15:59.379499 chdv-842464-2 devstack@n-api.service[119072]: exception: Compute host tempest-nonexist_host-942591790 could not be found. May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-942591790'}}} May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-942591790' is not mapped to any cell May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:59.380206 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 19 08:15:59.381195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-942591790 could not be found. May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-942591790 could not be found. May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:15:59.394944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-942591790 could not be found. May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-942591790 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c39f5749-c04c-4bce-8156-7490cf980f24 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.094352 May 19 08:15:59.398227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 128/248] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:15:59 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:15:59.399788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4b6ddfa-248f-45dc-a02a-e526792b9737 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-82077542_new", "availability_zone": "tempest-test_az-1648147861_new"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:59.540301 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.540301 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:15:59.590676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4b6ddfa-248f-45dc-a02a-e526792b9737 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.591506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4b6ddfa-248f-45dc-a02a-e526792b9737 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.662718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4b6ddfa-248f-45dc-a02a-e526792b9737 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.278867 May 19 08:15:59.665524 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 129/249] 10.222.0.78 () {60 vars in 1172 bytes} [Thu May 19 08:15:59 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:59.675333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:59.675881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:15:59.682433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.682560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.683342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.683779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.813406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:15:59.827783 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d4044558-7216-4890-a1b3-390f31829ad4 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1467 microversion: 2.1 time: 0.604825 May 19 08:15:59.828635 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 121/250] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:59 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1467 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:15:59.847273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-4c7e8f4d-48cb-4afd-95f8-8cc06810aafd req-9fdd664f-070c-44bd-824c-479028c966d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52db3ef4-a451-42e4-b057-c74dc0d51aa2", "tag": "0ee7d153-5924-4b1f-ae67-ab3ff794b077"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:15:59.858741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4c7e8f4d-48cb-4afd-95f8-8cc06810aafd req-9fdd664f-070c-44bd-824c-479028c966d2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:15:59.859851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4c7e8f4d-48cb-4afd-95f8-8cc06810aafd req-9fdd664f-070c-44bd-824c-479028c966d2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:15:59.885742 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-4c7e8f4d-48cb-4afd-95f8-8cc06810aafd req-9fdd664f-070c-44bd-824c-479028c966d2 service nova] Creating event network-changed:0ee7d153-5924-4b1f-ae67-ab3ff794b077 for instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 on chh1-842464-2 May 19 08:15:59.890985 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-4c7e8f4d-48cb-4afd-95f8-8cc06810aafd req-9fdd664f-070c-44bd-824c-479028c966d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060396 May 19 08:15:59.891585 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 122/251] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:15:59.901082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-87e9ad4b-a28f-4243-a584-ec38177ef31d tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:59.912860 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.912860 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:59.940370 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-87e9ad4b-a28f-4243-a584-ec38177ef31d tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.044239 May 19 08:15:59.942832 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 123/252] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:15:59 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:15:59.958120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6d03ff71-6d72-49bc-aae3-1d73917ba1bc tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:15:59.960349 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:15:59.960349 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:15:59.984276 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6d03ff71-6d72-49bc-aae3-1d73917ba1bc tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.039385 May 19 08:15:59.985198 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 124/253] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:15:59 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:00.149003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:00.157754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71b41108-4605-4493-b5e6-66413d7821af tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.491061 May 19 08:16:00.160041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 130/254] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:15:59 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:00.182816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea4b618b-b002-467e-9ad4-fee3c15ce9bb tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea4b618b-b002-467e-9ad4-fee3c15ce9bb tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 283 May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:00.203431 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:00.204950 chdv-842464-2 devstack@n-api.service[119072]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:16:00.205787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:00.206418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:00.207561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:00.208440 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:16:00.208440 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.213050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea4b618b-b002-467e-9ad4-fee3c15ce9bb tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:00.215200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea4b618b-b002-467e-9ad4-fee3c15ce9bb tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.053768 May 19 08:16:00.216047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 131/255] 10.222.0.78 () {60 vars in 1164 bytes} [Thu May 19 08:16:00 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:00.227924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e59ea707-f5f1-4d4e-be7b-230cd032f056 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:00.229225 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:00.229225 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:00.267203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e59ea707-f5f1-4d4e-be7b-230cd032f056 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.049869 May 19 08:16:00.269149 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 132/256] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:00 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:16:00.288556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1938959042", "block_migration": true, "disk_over_commit": false}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:00.290464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:00.294659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca8b8fd8-2565-4181-b83c-c8db067122b1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca8b8fd8-2565-4181-b83c-c8db067122b1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 27 May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:00.302567 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: {"aggregate": {"name": ""}} May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:00.303762 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'aggregate': {'name': ''}}} May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '' May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:00.304454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 08:16:00.306549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:00.309275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca8b8fd8-2565-4181-b83c-c8db067122b1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:00.309448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:00.309638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca8b8fd8-2565-4181-b83c-c8db067122b1 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.035089 May 19 08:16:00.309796 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:00.309796 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:00.310095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 133/257] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:00 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:00.310271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:00.322439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d761655-7554-47c6-864a-071113840c8a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-862506682"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:00.326192 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:00.326192 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:00.329537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-3d761655-7554-47c6-864a-071113840c8a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Generated uuid ec4fd10f-0ff8-4f63-ad5c-ee16e7d73ce0 for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:00.371778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d761655-7554-47c6-864a-071113840c8a tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059116 May 19 08:16:00.381668 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 134/258] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:00.391654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:00.395482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:00.408178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:00.413494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:00.414462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:00.414916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:00.460506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lazy-loading 'flavor' on Instance uuid 717491f6-c7fd-430d-bd7c-361f49bdc7d9 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:00.535875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Going to try to live migrate instance to tempest-host-1938959042 {{(pid=119073) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:16:00.545243 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] HTTP exception thrown: Compute host tempest-host-1938959042 could not be found. May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Request method failure captured: May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9/action HTTP/1.1 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 107 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyuM6hfkRel1fz-DyPG1Mrdj1Da_Yju29HBX3m4mjV9afj_lgol2I2g8JOrE6Ww2p_Q-x6rSP3C1wvx4js5RQERUD6y_dqsIJR5_lbqGwtSojUsHICKZO__0kC1y9kKaT2VUUyrquVOb1924k0p2_Ni22rrdXEIzj85CicYaqcwnB4 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 99d3faef55b547f49ad4d1d690997987 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-LiveMigrationNegativeTest-1134612278 May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:00.552673 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99d3faef55b547f49ad4d1d690997987"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99d3faef55b547f49ad4d1d690997987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99d3faef55b547f49ad4d1d690997987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99d3faef55b547f49ad4d1d690997987"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-LiveMigrationNegativeTest-1134612278 May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 99d3faef55b547f49ad4d1d690997987 May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1134612278 May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-LiveMigrationNegativeTest-1134612278-project-admin May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5f16fe52dcbe478c88abc302cacb93d1 May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-LiveMigrationNegativeTest-1134612278-project-admin May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: {"os-migrateLive": {"host": "tempest-host-1938959042", "block_migration": true, "disk_over_commit": false}} May 19 08:16:00.554767 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: exception: Compute host tempest-host-1938959042 could not be found. May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '717491f6-c7fd-430d-bd7c-361f49bdc7d9', 'body': {'os-migrateLive': {'host': 'tempest-host-1938959042', 'block_migration': True, 'disk_over_commit': False}}} May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:00.555973 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1938959042 could not be found. May 19 08:16:00.557372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1938959042 could not be found. May 19 08:16:00.560170 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1938959042 could not be found. May 19 08:16:00.562057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.563767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Returning 400 to user: Compute host tempest-host-1938959042 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:00.565282 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-889f1812-5f50-48a1-ac93-03ed7316fc24 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9/action" status: 400 len: 100 microversion: 2.1 time: 0.579119 May 19 08:16:00.566799 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 125/259] 10.222.0.78 () {60 vars in 1278 bytes} [Thu May 19 08:15:59 2022] POST /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9/action => generated 100 bytes in 580 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:00.572988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3d3ea058-f331-4d86-a854-6f752d216bf4 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1588747304"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:00.575358 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:00.575358 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:00.576861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3d3ea058-f331-4d86-a854-6f752d216bf4 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'a425f9eec24f443db73e52ff0db7e503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ff4c1be3b1488f971e519c5a520cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3d3ea058-f331-4d86-a854-6f752d216bf4 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Request method failure captured: May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 60 May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyEHVDVf4iL04djId9HOkWxraJKIoE0FhdMoJLF90pvIC5rrLY3S5SzNysn2pHtpmPNtT72NwCJ_2QUr5Ty0WLJsekNFQ5oxnzCh_nhAaMSVtT0VwdEkmKbOXUjrKHWtPfn6NRolmN-6_ZEP6InM0s_ILjc57QqdNyMGcfvLTjNPas May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:00.584432 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a425f9eec24f443db73e52ff0db7e503 May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: {"aggregate": {"name": "tempest-test_aggregate-1588747304"}} May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:00.585667 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1588747304'}}} May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:00.586387 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:00.587562 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 19 08:16:00.588642 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:00.588642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3d3ea058-f331-4d86-a854-6f752d216bf4 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:00.588642 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3d3ea058-f331-4d86-a854-6f752d216bf4 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.019717 May 19 08:16:00.589540 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 126/260] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:00 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:00.600139 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-396e0b01-fc85-48a6-8d4d-50397eb0a3b6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:00.600902 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:00.600902 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:00.610705 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-396e0b01-fc85-48a6-8d4d-50397eb0a3b6 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.020627 May 19 08:16:00.620020 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 127/261] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:16:00 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:00.625779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:00.626601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:00.635731 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:00.636191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:00.637254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:00.638260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:00.945011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:00.953560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-959239c8-b673-4b33-9015-47d6f79a228b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.570296 May 19 08:16:00.955128 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 135/262] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:00 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:00.960154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4566e37e-9cd8-4778-9a7c-ca80740ae2ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1503907641"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:00.961467 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:00.961467 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:00.962327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-4566e37e-9cd8-4778-9a7c-ca80740ae2ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid 1001d87c-d145-49aa-8599-61f9c8f14d6e for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:00.992094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4566e37e-9cd8-4778-9a7c-ca80740ae2ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.035476 May 19 08:16:00.992871 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 136/263] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:01.003986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd1ef3de-b3c9-41cc-9ed5-8da73ca9a9e4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.004829 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.004829 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:01.043284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd1ef3de-b3c9-41cc-9ed5-8da73ca9a9e4 tempest-AggregatesAdminTestJSON-1960362642 tempest-AggregatesAdminTestJSON-1960362642-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.043882 May 19 08:16:01.044680 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 137/264] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:00 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:16:01.052669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63ae3ca5-a93e-4057-88d3-9c8266fae0c9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1503907641"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:01.055532 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.055532 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:01.057614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-63ae3ca5-a93e-4057-88d3-9c8266fae0c9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid b0f21555-65a7-4bf3-97f3-3a845a54ef4d for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:01.069168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-63ae3ca5-a93e-4057-88d3-9c8266fae0c9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1503907641 already exists. May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63ae3ca5-a93e-4057-88d3-9c8266fae0c9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 60 May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:01.071014 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: {"aggregate": {"name": "tempest-test_aggregate-1503907641"}} May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:01.072369 chdv-842464-2 devstack@n-api.service[119072]: exception: Aggregate tempest-test_aggregate-1503907641 already exists. May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1503907641'}}} May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi aggregate.create() May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 19 08:16:01.073104 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1503907641 already exists. May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:01.078875 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1503907641 already exists. May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1503907641 already exists. May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63ae3ca5-a93e-4057-88d3-9c8266fae0c9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1503907641 already exists. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:01.081943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63ae3ca5-a93e-4057-88d3-9c8266fae0c9 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.026327 May 19 08:16:01.083905 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 138/265] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:01 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:01.084046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:01.085511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.085511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:01.094131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.094555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.095561 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-37760082-43f3-4b25-90ed-086b337490b7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1467 microversion: 2.1 time: 0.474212 May 19 08:16:01.096498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.109967 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 128/266] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:00 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1467 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:01.110065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.110155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4c3a2381-84d4-4da2-8861-6a25f0f409a5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.110155 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.110155 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:01.134944 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] HTTP exception thrown: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Request method failure captured: May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 HTTP/1.1 May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyFUOWDKKrdC48F3iXSFmONOu31f4GfULEe93GlisBm9vZzQ45_WXgZeuLL6OB9u8jBuJJwJNLTh6TqM3kAasl-81m1r0dmQ4Bj4SAtuLeOxdTlilSGLukFh8lz9hxaZpyuANSfNFfmPfj6-eD5kDwLsjJL2tD9thwdqonWQKKhrqE May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: acb1e52b508c47bcae75440631533855 May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:01.147213 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acb1e52b508c47bcae75440631533855"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acb1e52b508c47bcae75440631533855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acb1e52b508c47bcae75440631533855"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acb1e52b508c47bcae75440631533855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: acb1e52b508c47bcae75440631533855 May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminTestJSON-1849055230-project May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f2e46ef724cd43729e57ab4142ad1351 May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminTestJSON-1849055230-project May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.148666 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4e309c9d-b16f-4600-95cc-b00aa3df59f5'} May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:01.149489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.150824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.156170 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4c3a2381-84d4-4da2-8861-6a25f0f409a5 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.056260 May 19 08:16:01.156811 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 129/267] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:01 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:16:01.157443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Returning 404 to user: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:01.158951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa106331-036e-408a-a21f-615dc19a0090 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 404 len: 111 microversion: 2.1 time: 0.084052 May 19 08:16:01.161369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 139/268] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:01 2022] DELETE /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:01.170227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-44524dba-fc25-4b68-bf6d-5506333ff793 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-832234487"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:01.171440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.172139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] [instance: 4e309c9d-b16f-4600-95cc-b00aa3df59f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:01.172992 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.172992 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:01.175132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-44524dba-fc25-4b68-bf6d-5506333ff793 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid ff8a684b-c48d-409a-9e64-753f5a7b9244 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:01.179996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.180689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.181578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.182078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.201095 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] HTTP exception thrown: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Request method failure captured: May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 HTTP/1.1 May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyFUOWDKKrdC48F3iXSFmONOu31f4GfULEe93GlisBm9vZzQ45_WXgZeuLL6OB9u8jBuJJwJNLTh6TqM3kAasl-81m1r0dmQ4Bj4SAtuLeOxdTlilSGLukFh8lz9hxaZpyuANSfNFfmPfj6-eD5kDwLsjJL2tD9thwdqonWQKKhrqE May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: acb1e52b508c47bcae75440631533855 May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:01.203342 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/acb1e52b508c47bcae75440631533855"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acb1e52b508c47bcae75440631533855"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_acb1e52b508c47bcae75440631533855"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/acb1e52b508c47bcae75440631533855"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: acb1e52b508c47bcae75440631533855 May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1849055230 May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminTestJSON-1849055230-project May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f2e46ef724cd43729e57ab4142ad1351 May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminTestJSON-1849055230-project May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.204594 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4e309c9d-b16f-4600-95cc-b00aa3df59f5'} May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:01.205944 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. May 19 08:16:01.206999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.209992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] Returning 404 to user: Instance 4e309c9d-b16f-4600-95cc-b00aa3df59f5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:01.211698 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-44524dba-fc25-4b68-bf6d-5506333ff793 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047696 May 19 08:16:01.212423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b452dfde-f9aa-487e-b0e5-4bcbd9f39352 tempest-AggregatesAdminTestJSON-1849055230 tempest-AggregatesAdminTestJSON-1849055230-project] 10.222.0.78 "GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5" status: 404 len: 111 microversion: 2.1 time: 0.045966 May 19 08:16:01.213082 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 140/269] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:01 2022] GET /compute/v2.1/servers/4e309c9d-b16f-4600-95cc-b00aa3df59f5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:01.214712 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 130/270] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:01.222484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.223104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:01.230184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0c6d97e-2fc5-4c96-ae91-76b5e3810179 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.231211 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.231211 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:01.231583 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.232029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.232956 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.233581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.233725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0c6d97e-2fc5-4c96-ae91-76b5e3810179 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'a425f9eec24f443db73e52ff0db7e503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ff4c1be3b1488f971e519c5a520cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0c6d97e-2fc5-4c96-ae91-76b5e3810179 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Request method failure captured: May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyEHVDVf4iL04djId9HOkWxraJKIoE0FhdMoJLF90pvIC5rrLY3S5SzNysn2pHtpmPNtT72NwCJ_2QUr5Ty0WLJsekNFQ5oxnzCh_nhAaMSVtT0VwdEkmKbOXUjrKHWtPfn6NRolmN-6_ZEP6InM0s_ILjc57QqdNyMGcfvLTjNPas May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:01.237588 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: a425f9eec24f443db73e52ff0db7e503 May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 19 08:16:01.239106 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '15'} May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:01.239833 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 19 08:16:01.240858 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:01.243584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0c6d97e-2fc5-4c96-ae91-76b5e3810179 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:01.244943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0c6d97e-2fc5-4c96-ae91-76b5e3810179 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.024553 May 19 08:16:01.246166 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 141/271] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:01.255427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8e2ca05-57f3-4091-8773-bf304598d6f4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.280157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:01.320682 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8e2ca05-57f3-4091-8773-bf304598d6f4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.070535 May 19 08:16:01.322014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 142/272] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 19 08:16:01.329406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-231618660", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:01.410191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:16:01.805182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:01.819509 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ded0f86a-8b4d-4647-b3ba-09cccb39868f tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.597448 May 19 08:16:01.820229 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 131/273] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:01 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:01.824656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2d555953-1b6f-4099-a92a-ef6407805101 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:01.825429 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.825429 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:01.851677 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-2d555953-1b6f-4099-a92a-ef6407805101 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2d555953-1b6f-4099-a92a-ef6407805101 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:01.855295 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: exception: Aggregate -1 could not be found. May 19 08:16:01.856636 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '-1'} May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 08:16:01.857545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:01.858830 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:01.860872 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:01.860872 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:01.860872 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:01.860872 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:01.860872 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 19 08:16:01.860872 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:01.865033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2d555953-1b6f-4099-a92a-ef6407805101 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:01.866097 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2d555953-1b6f-4099-a92a-ef6407805101 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.044992 May 19 08:16:01.868377 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 132/274] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:01 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:01.886528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8c675e1d-d4be-4965-8903-07d672cce2df tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-712258699"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:01.889562 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:01.889562 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:01.891633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-8c675e1d-d4be-4965-8903-07d672cce2df tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid 5db25f85-8b77-4fbc-8fbd-a27331517be3 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:01.912405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=11,nova_api:INSERT=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:01.948264 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8c675e1d-d4be-4965-8903-07d672cce2df tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075298 May 19 08:16:01.949665 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 133/275] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:01.958036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-86f38507-e9a9-48da-a1a0-3637b6f40c69 req-b3a87121-333e-4c68-837a-885d04cde84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a31cad69-9458-48a2-b3d5-85288d047792", "tag": "db19370b-0509-4a3d-82c6-489e570e7238"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:01.971342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-86f38507-e9a9-48da-a1a0-3637b6f40c69 req-b3a87121-333e-4c68-837a-885d04cde84c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:01.971780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-86f38507-e9a9-48da-a1a0-3637b6f40c69 req-b3a87121-333e-4c68-837a-885d04cde84c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:01.984901 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-86f38507-e9a9-48da-a1a0-3637b6f40c69 req-b3a87121-333e-4c68-837a-885d04cde84c service nova] Creating event network-changed:db19370b-0509-4a3d-82c6-489e570e7238 for instance a31cad69-9458-48a2-b3d5-85288d047792 on chh1-842464-2 May 19 08:16:01.992619 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-86f38507-e9a9-48da-a1a0-3637b6f40c69 req-b3a87121-333e-4c68-837a-885d04cde84c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040925 May 19 08:16:01.993776 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 134/276] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:02.000211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1297194a-fea4-4d91-bd13-26236ee4e8bf tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.001837 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.001837 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:02.003481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1297194a-fea4-4d91-bd13-26236ee4e8bf tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'a425f9eec24f443db73e52ff0db7e503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ff4c1be3b1488f971e519c5a520cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1297194a-fea4-4d91-bd13-26236ee4e8bf tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Request method failure captured: May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyEHVDVf4iL04djId9HOkWxraJKIoE0FhdMoJLF90pvIC5rrLY3S5SzNysn2pHtpmPNtT72NwCJ_2QUr5Ty0WLJsekNFQ5oxnzCh_nhAaMSVtT0VwdEkmKbOXUjrKHWtPfn6NRolmN-6_ZEP6InM0s_ILjc57QqdNyMGcfvLTjNPas May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:02.005387 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a425f9eec24f443db73e52ff0db7e503 May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 19 08:16:02.006633 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '16'} May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:02.007311 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.008377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1297194a-fea4-4d91-bd13-26236ee4e8bf tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:02.011285 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1297194a-fea4-4d91-bd13-26236ee4e8bf tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.011819 May 19 08:16:02.011285 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 135/277] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:16:01 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:02.012905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.014074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:02.021578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.022017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.023200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.023828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.071004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:16:02.071505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:16:02.072125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:16:02.072769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:16:02.073210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:16:02.085872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.086370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.087198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.087652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.149671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Getting quotas for project 2498755892a5447c9103cc54e740dfbd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:02.155013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Getting quotas for user 4c2650c1e71d41a5ac2412eda518ee1e and project 2498755892a5447c9103cc54e740dfbd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:02.188308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:16:02.199369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:16:02.300709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa59a298-8693-4ec7-8a5a-ca0865312729 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976882 May 19 08:16:02.309559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 143/278] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:16:02.320291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-35e7deea-bdcb-4c25-9c3c-c023129dedac tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.321065 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.321065 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:02.385375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-35e7deea-bdcb-4c25-9c3c-c023129dedac tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.072324 May 19 08:16:02.402858 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 144/279] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:02 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:16:02.428331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1a53c00-1947-4eed-8396-ce231401ddbd tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.429404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1a53c00-1947-4eed-8396-ce231401ddbd tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:02.545422 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:02.565164 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aee61f2a-c680-4760-b68b-2d893427298a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.555210 May 19 08:16:02.566281 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 136/280] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:02 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:02.572480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d06b3ec1-c5a4-4082-b97e-deb872dfa523 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.573661 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.573661 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:02.583046 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-d06b3ec1-c5a4-4082-b97e-deb872dfa523 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d06b3ec1-c5a4-4082-b97e-deb872dfa523 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:02.587039 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: exception: Aggregate -1 could not be found. May 19 08:16:02.588501 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '-1'} May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.589675 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 19 08:16:02.591010 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.592188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1a53c00-1947-4eed-8396-ce231401ddbd tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:02.592506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d06b3ec1-c5a4-4082-b97e-deb872dfa523 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:02.594066 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d06b3ec1-c5a4-4082-b97e-deb872dfa523 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026042 May 19 08:16:02.595477 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 137/281] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:16:02 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:02.604359 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1a53c00-1947-4eed-8396-ce231401ddbd tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1218 microversion: 2.1 time: 0.184920 May 19 08:16:02.604943 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 145/282] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:02 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:02.607296 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-58915f66-9cd4-4d24-9de4-54fb5de04abb tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.608224 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.608224 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:02.609137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58915f66-9cd4-4d24-9de4-54fb5de04abb tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'a425f9eec24f443db73e52ff0db7e503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ff4c1be3b1488f971e519c5a520cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-58915f66-9cd4-4d24-9de4-54fb5de04abb tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Request method failure captured: May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyEHVDVf4iL04djId9HOkWxraJKIoE0FhdMoJLF90pvIC5rrLY3S5SzNysn2pHtpmPNtT72NwCJ_2QUr5Ty0WLJsekNFQ5oxnzCh_nhAaMSVtT0VwdEkmKbOXUjrKHWtPfn6NRolmN-6_ZEP6InM0s_ILjc57QqdNyMGcfvLTjNPas May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:02.611034 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a425f9eec24f443db73e52ff0db7e503 May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 19 08:16:02.612845 chdv-842464-2 devstack@n-api.service[119073]: action_args: {} May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:02.619199 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.620457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-58915f66-9cd4-4d24-9de4-54fb5de04abb tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:02.621624 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-58915f66-9cd4-4d24-9de4-54fb5de04abb tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.012931 May 19 08:16:02.621624 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 138/283] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:16:02 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:02.623577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a966aebf-dcb9-4f4e-904c-47796b6ba5b4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1813891662"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:02.624905 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.624905 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:02.625817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-a966aebf-dcb9-4f4e-904c-47796b6ba5b4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid f38f565a-a222-4f0d-a189-b23f44f4cc28 for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:02.678167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a966aebf-dcb9-4f4e-904c-47796b6ba5b4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.057366 May 19 08:16:02.686816 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 146/284] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:02.693932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc3ccfdf-bf56-4e9c-879e-d545773eb09c tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:02.695997 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.695997 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:02.719255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc3ccfdf-bf56-4e9c-879e-d545773eb09c tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.721475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc3ccfdf-bf56-4e9c-879e-d545773eb09c tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.839883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:02.842958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:02.862351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.863570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.865728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:02.875518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:02.971895 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc3ccfdf-bf56-4e9c-879e-d545773eb09c tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.284806 May 19 08:16:02.979191 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 139/285] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:16:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:02.989204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-63fb8150-9247-4906-a967-9da550af8076 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:02.990766 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:02.990766 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:02.992226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-63fb8150-9247-4906-a967-9da550af8076 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'a425f9eec24f443db73e52ff0db7e503', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73ff4c1be3b1488f971e519c5a520cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-63fb8150-9247-4906-a967-9da550af8076 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Request method failure captured: May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 42 May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyEHVDVf4iL04djId9HOkWxraJKIoE0FhdMoJLF90pvIC5rrLY3S5SzNysn2pHtpmPNtT72NwCJ_2QUr5Ty0WLJsekNFQ5oxnzCh_nhAaMSVtT0VwdEkmKbOXUjrKHWtPfn6NRolmN-6_ZEP6InM0s_ILjc57QqdNyMGcfvLTjNPas May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:02.993876 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73ff4c1be3b1488f971e519c5a520cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 73ff4c1be3b1488f971e519c5a520cdc May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-89865016 May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a425f9eec24f443db73e52ff0db7e503 May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-89865016-project May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: {"remove_host": {"host": "chh1-842464-2"}} May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:02.995073 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'chh1-842464-2'}}} May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:02.995928 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 19 08:16:02.997663 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:02.999442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-63fb8150-9247-4906-a967-9da550af8076 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:02.999442 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-63fb8150-9247-4906-a967-9da550af8076 tempest-AggregatesAdminNegativeTestJSON-89865016 tempest-AggregatesAdminNegativeTestJSON-89865016-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014868 May 19 08:16:02.999742 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 140/286] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:16:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:03.006235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6280ab78-3628-4f80-9db0-970315e2d9ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:03.018720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6280ab78-3628-4f80-9db0-970315e2d9ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.019175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6280ab78-3628-4f80-9db0-970315e2d9ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.167575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:03.171310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:03.176801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e03b459b-4060-48a2-8901-12c14e8f20bc tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.343758 May 19 08:16:03.182123 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 147/287] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:02 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:03.221957 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6280ab78-3628-4f80-9db0-970315e2d9ed tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.219867 May 19 08:16:03.225810 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 141/288] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:16:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:03.233777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08023dc7-8925-4485-b165-9a2a5193c888 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:03.234910 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:03.234910 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:03.264881 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08023dc7-8925-4485-b165-9a2a5193c888 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.034731 May 19 08:16:03.266027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 148/289] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:03 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:16:03.277045 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cad28e8c-d2f6-461d-a581-189e5aad2eb4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1691597178"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:03.278376 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:03.278376 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:03.279243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.aggregate [None req-cad28e8c-d2f6-461d-a581-189e5aad2eb4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Generated uuid c92a6378-2fb1-4dbd-aa69-86e0f28b1967 for aggregate {{(pid=119073) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:16:03.311154 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cad28e8c-d2f6-461d-a581-189e5aad2eb4 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039345 May 19 08:16:03.311805 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 142/290] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:16:03 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:03.322830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:03.324062 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:03.324062 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:03.344461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.345419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.356794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.357447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.369556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.compute.aggregates [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 19 08:16:03.370224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Request method failure captured: May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 42 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyIMNgkETAeGF-sy5RAqqYFit16SrZSY8s017R-AB3sWgYk5ivbkk6zaP8x89Wy1CI63srD-L1vvqT0cMSrsKfuvSfJU9pZW5zlnsM_d6YC4-kt38d4-V4pmkduHt8VAYvY1ZCojvtR6tgNYCCKGMr_E5LYl-toM296Yl7e9iUG190 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:03.372353 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ff1a26f006d457caa099471cee8c91d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1ff1a26f006d457caa099471cee8c91d May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188 May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 094f727c388045c0a6ec3fb2003975c0 May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: {"remove_host": {"host": "nonexist_host"}} May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:03.374407 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot remove host nonexist_host in aggregate 18 May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 19 08:16:03.375142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 19 08:16:03.376281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.378227 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:03.379342 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:03.379342 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:03.379342 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:03.379342 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:03.379342 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 May 19 08:16:03.379342 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:03.381633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:03.382910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4eb2bfbe-5287-4b19-a727-78790bd25f20 tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.063984 May 19 08:16:03.384004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 149/291] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:16:03 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:03.391792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92d0008b-336c-401b-bc08-0889ab510bae tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:03.392656 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:03.392656 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:03.425420 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-92d0008b-336c-401b-bc08-0889ab510bae tempest-AggregatesAdminNegativeTestJSON-1413435188 tempest-AggregatesAdminNegativeTestJSON-1413435188-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.037228 May 19 08:16:03.426049 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 143/292] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:03 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:16:03.584352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:03.586491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:03.596316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.597009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.597827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.598293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.624215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:03.625835 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:03.646484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.647313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.648376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:03.649018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:03.760655 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:03.772258 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3e0a6ffe-5c90-4f88-855e-462e0e43f9fe tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1270 microversion: 2.1 time: 0.151752 May 19 08:16:03.774089 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 144/293] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:03 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:03.967863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:03.977286 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1443b56a-bbd3-443c-8bf1-214d82269e76 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.398988 May 19 08:16:03.992884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 150/294] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:03 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:04.201978 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:04.202601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:04.220558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:04.221049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:04.221900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:04.225273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:04.772910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:04.812680 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ec7903b5-0977-4761-ba8c-b1a44bec104e tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.598017 May 19 08:16:04.813801 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 145/295] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:04 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:04.834027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:04.836239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:04.853652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:04.857405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:04.858652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:04.864425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:05.013264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:05.023762 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-82962046-78bc-49f1-85ef-d6a0c2879324 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1276 microversion: 2.1 time: 0.202647 May 19 08:16:05.026652 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 146/296] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:04 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:05.036884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.037541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:05.050718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:05.051191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:05.052035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:05.052477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:05.331905 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-181ca43c-bf02-4bcb-879c-c67ad6c24392 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] 10.222.0.78 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.581586 May 19 08:16:05.332813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 151/297] 10.222.0.78 () {58 vars in 1127 bytes} [Thu May 19 08:16:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 585 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 08:16:05.343967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-904336f0-5aa7-4370-94e2-3cb6f0948307 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Calling method '.version_select at 0x7f32129054c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.399500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-904336f0-5aa7-4370-94e2-3cb6f0948307 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] HTTP exception thrown: Image not found. May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-904336f0-5aa7-4370-94e2-3cb6f0948307 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Request method failure captured: May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzEo5_2yWlfNJP34H8U5Jm-Gnq0h53mIBb_w00LpLdXUHKjZLRE0UUF9COCNp6piKwWncxEzwD6nSIDxj-12q_iwlf5-jKa7DEjuV5V6WbijBCG2I0FAAqRkuZpk7SNjEIm5HL0eIVKAAGKTyrqdrgD1dswmdsoGcewZh8_TumPRuA May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:05.413525 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f8fafcf3987345e682ae105651903355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f8fafcf3987345e682ae105651903355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 65b1fc0936664ad98e4924ddc79dbe39 May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '-1'} May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:05.415204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.416204 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:05.421927 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-904336f0-5aa7-4370-94e2-3cb6f0948307 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-904336f0-5aa7-4370-94e2-3cb6f0948307 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] 10.222.0.78 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.078088 May 19 08:16:05.423366 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 152/298] 10.222.0.78 () {58 vars in 1133 bytes} [Thu May 19 08:16:05 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:05.428034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19f847d1-9da3-499a-acd5-01f816e11767 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Calling method '.version_select at 0x7f3212871670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.448360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:05.463922 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4bf39619-c589-41aa-b72c-a9341c9d4d0b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.427378 May 19 08:16:05.467147 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 147/299] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:05 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:05.489657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-19f847d1-9da3-499a-acd5-01f816e11767 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] HTTP exception thrown: Image not found. May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19f847d1-9da3-499a-acd5-01f816e11767 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Request method failure captured: May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/3fa7d178-7fc6-4cfa-ac24-c409998be3fj HTTP/1.1 May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzEo5_2yWlfNJP34H8U5Jm-Gnq0h53mIBb_w00LpLdXUHKjZLRE0UUF9COCNp6piKwWncxEzwD6nSIDxj-12q_iwlf5-jKa7DEjuV5V6WbijBCG2I0FAAqRkuZpk7SNjEIm5HL0eIVKAAGKTyrqdrgD1dswmdsoGcewZh8_TumPRuA May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:05.491983 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f8fafcf3987345e682ae105651903355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f8fafcf3987345e682ae105651903355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 65b1fc0936664ad98e4924ddc79dbe39 May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3fa7d178-7fc6-4cfa-ac24-c409998be3fj'} May 19 08:16:05.493486 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3fa7d178-7fc6-4cfa-ac24-c409998be3fj to delete May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.494467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3fa7d178-7fc6-4cfa-ac24-c409998be3fj could not be found. May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:05.495725 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19f847d1-9da3-499a-acd5-01f816e11767 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:05.498538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19f847d1-9da3-499a-acd5-01f816e11767 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] 10.222.0.78 "DELETE /compute/v2.1/images/3fa7d178-7fc6-4cfa-ac24-c409998be3fj" status: 404 len: 62 microversion: 2.1 time: 0.072403 May 19 08:16:05.499822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 153/300] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:05 2022] DELETE /compute/v2.1/images/3fa7d178-7fc6-4cfa-ac24-c409998be3fj => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 08:16:05.511763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5068d9f2-8c6d-4b93-a243-dbbfffee3792 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Calling method '.version_select at 0x7f3212615e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.547604 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-5068d9f2-8c6d-4b93-a243-dbbfffee3792 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] HTTP exception thrown: Image not found. May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5068d9f2-8c6d-4b93-a243-dbbfffee3792 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Request method failure captured: May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/images/9c7575a2-5d3b-406c-a699-d48c957737f31 HTTP/1.1 May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzEo5_2yWlfNJP34H8U5Jm-Gnq0h53mIBb_w00LpLdXUHKjZLRE0UUF9COCNp6piKwWncxEzwD6nSIDxj-12q_iwlf5-jKa7DEjuV5V6WbijBCG2I0FAAqRkuZpk7SNjEIm5HL0eIVKAAGKTyrqdrgD1dswmdsoGcewZh8_TumPRuA May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:05.555582 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f8fafcf3987345e682ae105651903355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f8fafcf3987345e682ae105651903355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 65b1fc0936664ad98e4924ddc79dbe39 May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: exception: Image not found. May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '9c7575a2-5d3b-406c-a699-d48c957737f31'} May 19 08:16:05.557095 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9c7575a2-5d3b-406c-a699-d48c957737f31 to delete May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.558034 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9c7575a2-5d3b-406c-a699-d48c957737f31 could not be found. May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:05.559436 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.560824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5068d9f2-8c6d-4b93-a243-dbbfffee3792 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Returning 404 to user: Image not found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:05.562188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5068d9f2-8c6d-4b93-a243-dbbfffee3792 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] 10.222.0.78 "DELETE /compute/v2.1/images/9c7575a2-5d3b-406c-a699-d48c957737f31" status: 404 len: 62 microversion: 2.1 time: 0.055024 May 19 08:16:05.563825 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 148/301] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:05 2022] DELETE /compute/v2.1/images/9c7575a2-5d3b-406c-a699-d48c957737f31 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:05.574753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed140440-2983-49e6-8d90-8ffe1ab45324 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Calling method '.version_select at 0x7f32129051f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.620921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ed140440-2983-49e6-8d90-8ffe1ab45324 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] HTTP exception thrown: Image not found. May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed140440-2983-49e6-8d90-8ffe1ab45324 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Request method failure captured: May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/tempest-invalid-1052040659 HTTP/1.1 May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzEo5_2yWlfNJP34H8U5Jm-Gnq0h53mIBb_w00LpLdXUHKjZLRE0UUF9COCNp6piKwWncxEzwD6nSIDxj-12q_iwlf5-jKa7DEjuV5V6WbijBCG2I0FAAqRkuZpk7SNjEIm5HL0eIVKAAGKTyrqdrgD1dswmdsoGcewZh8_TumPRuA May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:05.622966 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f8fafcf3987345e682ae105651903355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f8fafcf3987345e682ae105651903355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 65b1fc0936664ad98e4924ddc79dbe39 May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'tempest-invalid-1052040659'} May 19 08:16:05.624437 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1052040659 to delete May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.625356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1052040659 could not be found. May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:05.626670 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed140440-2983-49e6-8d90-8ffe1ab45324 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:05.628973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed140440-2983-49e6-8d90-8ffe1ab45324 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] 10.222.0.78 "DELETE /compute/v2.1/images/tempest-invalid-1052040659" status: 404 len: 62 microversion: 2.1 time: 0.055777 May 19 08:16:05.630044 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 154/302] 10.222.0.78 () {58 vars in 1205 bytes} [Thu May 19 08:16:05 2022] DELETE /compute/v2.1/images/tempest-invalid-1052040659 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 08:16:05.640899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b29ee7ed-709c-486c-adcc-0a156f767fd6 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Calling method '.version_select at 0x7f3212661790>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.679655 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-b29ee7ed-709c-486c-adcc-0a156f767fd6 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] HTTP exception thrown: Image not found. May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b29ee7ed-709c-486c-adcc-0a156f767fd6 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Request method failure captured: May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/images/b45724ea-d0bc-4636-9a91-f54245d753eb HTTP/1.1 May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzEo5_2yWlfNJP34H8U5Jm-Gnq0h53mIBb_w00LpLdXUHKjZLRE0UUF9COCNp6piKwWncxEzwD6nSIDxj-12q_iwlf5-jKa7DEjuV5V6WbijBCG2I0FAAqRkuZpk7SNjEIm5HL0eIVKAAGKTyrqdrgD1dswmdsoGcewZh8_TumPRuA May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:05.682631 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f8fafcf3987345e682ae105651903355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f8fafcf3987345e682ae105651903355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f8fafcf3987345e682ae105651903355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: f8fafcf3987345e682ae105651903355 May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282 May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 65b1fc0936664ad98e4924ddc79dbe39 May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1648867282-project May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: exception: Image not found. May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'b45724ea-d0bc-4636-9a91-f54245d753eb'} May 19 08:16:05.685099 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b45724ea-d0bc-4636-9a91-f54245d753eb to delete May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.686120 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b45724ea-d0bc-4636-9a91-f54245d753eb could not be found. May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:05.688561 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b29ee7ed-709c-486c-adcc-0a156f767fd6 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] Returning 404 to user: Image not found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:05.690782 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b29ee7ed-709c-486c-adcc-0a156f767fd6 tempest-ImagesDeleteNegativeTestJSON-1648867282 tempest-ImagesDeleteNegativeTestJSON-1648867282-project] 10.222.0.78 "DELETE /compute/v2.1/images/b45724ea-d0bc-4636-9a91-f54245d753eb" status: 404 len: 62 microversion: 2.1 time: 0.047265 May 19 08:16:05.691795 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 149/303] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:05 2022] DELETE /compute/v2.1/images/b45724ea-d0bc-4636-9a91-f54245d753eb => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:05.831982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:05.833099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:05.858188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:05.858955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:05.859910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:05.860537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:06.044828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:06.045586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:06.059087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:06.060618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:06.063126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:06.063815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:06.536085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:06.551350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aebc4ce1-8d60-4e5d-a54b-a89a3396ecd7 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.723741 May 19 08:16:06.554012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 155/304] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:05 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:06.569199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:06.571403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:06.583598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:06.584482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:06.585616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:06.586314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:06.831699 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:06.852882 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b9e36ae9-c808-43f1-b1ac-558e1889f09c tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1318 microversion: 2.1 time: 0.812870 May 19 08:16:06.867138 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 150/305] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:06 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:06.925133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-1510cfd1-ec0c-4b78-a181-1cbbc1787820 req-e9afc30b-3928-40da-8b4c-16bedb46edcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52db3ef4-a451-42e4-b057-c74dc0d51aa2", "name": "network-vif-plugged", "status": "completed", "tag": "0ee7d153-5924-4b1f-ae67-ab3ff794b077"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:06.966781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1510cfd1-ec0c-4b78-a181-1cbbc1787820 req-e9afc30b-3928-40da-8b4c-16bedb46edcf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:06.968483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1510cfd1-ec0c-4b78-a181-1cbbc1787820 req-e9afc30b-3928-40da-8b4c-16bedb46edcf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:07.001701 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-1510cfd1-ec0c-4b78-a181-1cbbc1787820 req-e9afc30b-3928-40da-8b4c-16bedb46edcf service nova] Creating event network-vif-plugged:0ee7d153-5924-4b1f-ae67-ab3ff794b077 for instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 on chh1-842464-2 May 19 08:16:07.008567 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-1510cfd1-ec0c-4b78-a181-1cbbc1787820 req-e9afc30b-3928-40da-8b4c-16bedb46edcf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087198 May 19 08:16:07.012109 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 151/306] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:07.019515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:07.045291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b288a21b-2daf-45c7-b850-4d171cce896a tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.489186 May 19 08:16:07.051831 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 156/307] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:06 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:07.383713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-7b0e3313-6810-4dac-b85a-423b5cf124be req-6b24d4c3-ca05-47af-817b-b7f22b2a5754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eb48504-a486-455f-99b7-463da687fa80", "tag": "8605f768-c0f6-405f-a304-18ef4a72dca7"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:07.443033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-7b0e3313-6810-4dac-b85a-423b5cf124be req-6b24d4c3-ca05-47af-817b-b7f22b2a5754 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:07.444173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-7b0e3313-6810-4dac-b85a-423b5cf124be req-6b24d4c3-ca05-47af-817b-b7f22b2a5754 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:07.494123 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-7b0e3313-6810-4dac-b85a-423b5cf124be req-6b24d4c3-ca05-47af-817b-b7f22b2a5754 service nova] Creating event network-changed:8605f768-c0f6-405f-a304-18ef4a72dca7 for instance 1eb48504-a486-455f-99b7-463da687fa80 on chh2-842464-2 May 19 08:16:07.518448 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-7b0e3313-6810-4dac-b85a-423b5cf124be req-6b24d4c3-ca05-47af-817b-b7f22b2a5754 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143248 May 19 08:16:07.524558 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 152/308] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:07.572857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:07.573637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:07.586505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:07.587052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:07.593654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:07.594480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:07.881023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=9 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:07.886869 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:07.890253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:07.938586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:07.939049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:07.941728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:07.942177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:07.949010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:08.123331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:08.132958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-553df680-ee13-47df-b734-f461f3bba925 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1320 microversion: 2.1 time: 0.564468 May 19 08:16:08.133593 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 157/309] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:07 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1320 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:08.147635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:08.148205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:08.170788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:08.170960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:08.171780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:08.172221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:08.479827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:08.488733 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-62f83931-27be-4bde-b208-eaf8261134ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1318 microversion: 2.1 time: 0.608461 May 19 08:16:08.489252 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 153/310] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:07 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:08.573925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:08.589360 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58708906-8605-47f0-89d0-1c685fac185b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.452630 May 19 08:16:08.591082 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 158/311] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:08 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:08.893695 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9022f0d-68c7-4bb0-b6b9-a3a219f54e1f tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-331276790", "id": 1556131831, "os-flavor-access:is_public": "False"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:08.895359 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:08.895359 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:08.914942 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d9022f0d-68c7-4bb0-b6b9-a3a219f54e1f tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.326635 May 19 08:16:08.916530 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 154/312] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:08 2022] POST /compute/v2.1/flavors => generated 438 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:08.927122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5702cf10-6a57-434b-9e44-27eb8dd5fced tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:08.928416 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:08.928416 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:09.047834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-e6f9d31d-4ecc-4a7f-92d1-20991efc023f req-bd4ff6bc-5042-441a-a7db-d94e9e647755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a31cad69-9458-48a2-b3d5-85288d047792", "name": "network-vif-plugged", "status": "completed", "tag": "db19370b-0509-4a3d-82c6-489e570e7238"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:09.054778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=65,nova_cell0:UPDATE=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:09.061960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-e6f9d31d-4ecc-4a7f-92d1-20991efc023f req-bd4ff6bc-5042-441a-a7db-d94e9e647755 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.062643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-e6f9d31d-4ecc-4a7f-92d1-20991efc023f req-bd4ff6bc-5042-441a-a7db-d94e9e647755 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.067258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5702cf10-6a57-434b-9e44-27eb8dd5fced tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1556131831/action" status: 200 len: 97 microversion: 2.1 time: 0.143754 May 19 08:16:09.067972 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 159/313] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:08 2022] POST /compute/v2.1/flavors/1556131831/action => generated 97 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:16:09.079904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64e6dd37-c02d-4cb6-8146-e2a961708ceb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:09.082262 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-e6f9d31d-4ecc-4a7f-92d1-20991efc023f req-bd4ff6bc-5042-441a-a7db-d94e9e647755 service nova] Creating event network-vif-plugged:db19370b-0509-4a3d-82c6-489e570e7238 for instance a31cad69-9458-48a2-b3d5-85288d047792 on chh1-842464-2 May 19 08:16:09.088311 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-e6f9d31d-4ecc-4a7f-92d1-20991efc023f req-bd4ff6bc-5042-441a-a7db-d94e9e647755 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048184 May 19 08:16:09.089698 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 155/314] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:09.154074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:09.155289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:09.184066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.184785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.186087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.186726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.385552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:09.395742 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-579d0c90-a6c4-4cda-a30c-f66bdb841d03 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1470 microversion: 2.1 time: 0.249233 May 19 08:16:09.404279 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 156/315] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:09 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:09.552709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-64e6dd37-c02d-4cb6-8146-e2a961708ceb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] HTTP exception thrown: Flavor access already exists for flavor 22 and project 73d588fde472479792172e42e2271c6c combination. May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64e6dd37-c02d-4cb6-8146-e2a961708ceb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Request method failure captured: May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/flavors/1556131831/action HTTP/1.1 May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 67 May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzHm45Ah02hzYGdh4eX1zcG9tXoVRL9i9Ct24wq3CHrsSTqllrVNF6Q46Jn_DbqJQrKYweRxVV0AHoiKDhnPV4HY0ZnHJcUSgRy47n3q-2qA5ZRUqyPqtiB15mN9fR15VfMYFAs4A2AGvqmt4OWwVrHiiqGo2si_00UAyeosYNE-pQ May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 456bb5a259854bf6a6b563109b4ea672 May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:09.573921 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 456bb5a259854bf6a6b563109b4ea672 May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ee38d79377284ed4a334aa3c75f2722f May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: {"addTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} May 19 08:16:09.576006 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: exception: Flavor access already exists for flavor 22 and project 73d588fde472479792172e42e2271c6c combination. May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1556131831', 'body': {'addTenantAccess': {'tenant': '73d588fde472479792172e42e2271c6c'}}} May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result.read() May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 08:16:09.576864 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '22-73d588fde472479792172e42e2271c6c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi project.save(context.session) May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi session.flush() May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._flush(objects) May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 08:16:09.578745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi compat.raise_( May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi flush_context.execute() May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi rec.execute(self) May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 08:16:09.581631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 08:16:09.584173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result.read() May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '22-73d588fde472479792172e42e2271c6c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 19, 8, 16, 9, 544320), 'updated_at': None, 'flavor_id': 22, 'project_id': '73d588fde472479792172e42e2271c6c'}] May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:09.586733 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 22 and project 73d588fde472479792172e42e2271c6c combination. May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:09.589430 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 22 and project 73d588fde472479792172e42e2271c6c combination. May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:09.591317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:09.593238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 22 and project 73d588fde472479792172e42e2271c6c combination. May 19 08:16:09.593238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:09.593238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64e6dd37-c02d-4cb6-8146-e2a961708ceb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Returning 409 to user: Flavor access already exists for flavor 22 and project 73d588fde472479792172e42e2271c6c combination. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:09.593238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64e6dd37-c02d-4cb6-8146-e2a961708ceb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1556131831/action" status: 409 len: 152 microversion: 2.1 time: 0.499558 May 19 08:16:09.593238 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 160/316] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:09 2022] POST /compute/v2.1/flavors/1556131831/action => generated 152 bytes in 501 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 19 08:16:09.594128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:09.595121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:09.610914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.613664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.614524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.614960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.764801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3465eba8-d3fa-45fe-abeb-a21c7c016b28 tempest-DeleteServersAdminTestJSON-364204559 tempest-DeleteServersAdminTestJSON-364204559-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2/action" status: 202 len: 0 microversion: 2.1 time: 0.176018 May 19 08:16:09.766298 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 161/317] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:09 2022] POST /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:09.772207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:09.773054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:09.781920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.782774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.784448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:09.785097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:09.855806 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3ff0f34b-8191-4881-9a39-5fc578669f01 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f321270c1f0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl0E+9QmoWQ0VTiY7F8KueWAsdbo+eoveao2zjrPgAC72bKmsESQCwFokSxIXri/WaYqK19IAfaeXYA7RywUNPVlhkenwBLdRB15f3MMZAU3hXJHkyRqIqErsVj7Ca5dA=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:09.863052 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-3ff0f34b-8191-4881-9a39-5fc578669f01 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3ff0f34b-8191-4881-9a39-5fc578669f01 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 257 May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:09.867604 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl0E+9QmoWQ0VTiY7F8KueWAsdbo+eoveao2zjrPgAC72bKmsESQCwFokSxIXri/WaYqK19IAfaeXYA7RywUNPVlhkenwBLdRB15f3MMZAU3hXJHkyRqIqErsVj7Ca5dA=="}} May 19 08:16:09.868760 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl0E+9QmoWQ0VTiY7F8KueWAsdbo+eoveao2zjrPgAC72bKmsESQCwFokSxIXri/WaYqK19IAfaeXYA7RywUNPVlhkenwBLdRB15f3MMZAU3hXJHkyRqIqErsVj7Ca5dA=='}}} May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 19 08:16:09.869715 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 08:16:09.870735 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 19 08:16:09.871823 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:09.874841 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3ff0f34b-8191-4881-9a39-5fc578669f01 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:09.876517 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3ff0f34b-8191-4881-9a39-5fc578669f01 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.471032 May 19 08:16:09.882385 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 157/318] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:16:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 477 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:09.888173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4fc5fbd9-dd8b-4957-89a6-0cba3d1ac1e0 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:09.890347 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:09.890347 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:10.027052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:10.036147 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12c6d6ba-2f9f-4c24-af49-014664845888 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1318 microversion: 2.1 time: 0.268207 May 19 08:16:10.037290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 162/319] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:09 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:10.042241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.043301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:10.050620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.051375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.052244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.052744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.216825 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4fc5fbd9-dd8b-4957-89a6-0cba3d1ac1e0 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1556131831/action" status: 200 len: 21 microversion: 2.1 time: 0.332572 May 19 08:16:10.217804 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 158/320] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:09 2022] POST /compute/v2.1/flavors/1556131831/action => generated 21 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:16:10.224246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.225633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:10.233714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.234250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.235250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.235911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.294277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.294719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.295990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lazy-loading 'fault' on Instance uuid 52db3ef4-a451-42e4-b057-c74dc0d51aa2 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:10.380173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:10.391195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad02ff0f-2afc-444a-9087-8c45ce9f1390 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1320 microversion: 2.1 time: 0.352599 May 19 08:16:10.393601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 163/321] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:10 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:10.406267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f3212627f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1630322530", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:10.432840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:10.438578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for user 76179b2310c74db49a6679570ec8648f and project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:10.460011 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 2167 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1630322530", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:10.475942 chdv-842464-2 devstack@n-api.service[119072]: exception: Keypair data is invalid: failed to generate fingerprint May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1630322530', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:10.478197 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 19 08:16:10.482694 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.491507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:10.492583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2d93460-7016-4083-971d-f645e3013095 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.096642 May 19 08:16:10.493081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 164/322] 10.222.0.78 () {60 vars in 1159 bytes} [Thu May 19 08:16:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:16:10.499471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea5bc7a1-7344-4ede-a8c2-47f1f286ad5c tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.500468 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:10.500468 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:10.529032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:10.536093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea5bc7a1-7344-4ede-a8c2-47f1f286ad5c tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1556131831" status: 202 len: 0 microversion: 2.1 time: 0.041427 May 19 08:16:10.537764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 165/323] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:10 2022] DELETE /compute/v2.1/flavors/1556131831 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:10.541636 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-15664cce-96ab-4efe-8230-cbb718b3d105 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1453 microversion: 2.1 time: 0.322600 May 19 08:16:10.542531 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 159/324] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:10 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1453 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:10.562550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cfcb905-6787-4b5b-920d-33331e6b9db0 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f3212607f70>, body: {"keypair": {"name": "tempest-keypair-1308566499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwIwNQ9oyvSlBhzRS2/ES42Klr0PA8KjKhHebYjz3k1X1no3mhfS3D5igmtVLdTTA6xKyYDTA8y3Pwp3Za+Vn8jznukgL0WGfhNxZk8397NjaPVBoYvzQVeQEFFH1/nKg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:10.562952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d5c61ccb-7a32-4580-9143-cfa3008964eb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.581246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:10.592268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1cfcb905-6787-4b5b-920d-33331e6b9db0 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:10.604272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1cfcb905-6787-4b5b-920d-33331e6b9db0 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for user 76179b2310c74db49a6679570ec8648f and project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:10.614532 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d5c61ccb-7a32-4580-9143-cfa3008964eb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.070576 May 19 08:16:10.616269 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 160/325] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:10 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:10.620994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.621769 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:10.630306 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.631092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.632102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.632785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.662945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:16:10.689060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1cfcb905-6787-4b5b-920d-33331e6b9db0 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141534 May 19 08:16:10.690311 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 166/326] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:16:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:10.703305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e6ffc11-57f4-4edc-b07c-681fb445828f tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1821637327", "id": 1423065008, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:10.714401 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:10.714401 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:10.747505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e6ffc11-57f4-4edc-b07c-681fb445828f tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.048009 May 19 08:16:10.748207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 167/327] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:10 2022] POST /compute/v2.1/flavors => generated 438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:10.770693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f321262f040>, body: {"keypair": {"name": "tempest-keypair-1308566499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrPNhLbr8MlPMdYkR4nUNUMIbUyvhqVJATQdzeNFaHXTYZwGtpItnNPc/mx1NcMP81MBa5h+ZAl5wL0bFR2b9+8ZNgXxB/XpGx7pdFU0B9kk8PgGsK4O4r+/AddwBonA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:10.791849 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf5322b5-4ea7-46a2-97e9-7ff72a1c789c tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "DELETE /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 204 len: 0 microversion: 2.1 time: 0.171091 May 19 08:16:10.791849 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 161/328] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:10 2022] DELETE /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:10.805641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-08ec2c69-db44-4203-92df-2f5fd9ff5119 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.806810 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:10.806810 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:10.812523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:10.818708 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-08ec2c69-db44-4203-92df-2f5fd9ff5119 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] HTTP exception thrown: Access list not available for public flavors. May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-08ec2c69-db44-4203-92df-2f5fd9ff5119 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Request method failure captured: May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/flavors/1423065008/os-flavor-access HTTP/1.1 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzHm45Ah02hzYGdh4eX1zcG9tXoVRL9i9Ct24wq3CHrsSTqllrVNF6Q46Jn_DbqJQrKYweRxVV0AHoiKDhnPV4HY0ZnHJcUSgRy47n3q-2qA5ZRUqyPqtiB15mN9fR15VfMYFAs4A2AGvqmt4OWwVrHiiqGo2si_00UAyeosYNE-pQ May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 456bb5a259854bf6a6b563109b4ea672 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 456bb5a259854bf6a6b563109b4ea672 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ee38d79377284ed4a334aa3c75f2722f May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: exception: Access list not available for public flavors. May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '1423065008'} May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 19 08:16:10.822067 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:10.825780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for user 76179b2310c74db49a6679570ec8648f and project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:10.827059 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-08ec2c69-db44-4203-92df-2f5fd9ff5119 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:10.828270 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-08ec2c69-db44-4203-92df-2f5fd9ff5119 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1423065008/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033751 May 19 08:16:10.829024 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 162/329] 10.222.0.78 () {58 vars in 1208 bytes} [Thu May 19 08:16:10 2022] GET /compute/v2.1/flavors/1423065008/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:10.837372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.837372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:10.843952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.844699 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.845662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.846133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.879411 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] HTTP exception thrown: Key pair 'tempest-keypair-1308566499' already exists. May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 273 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: {"keypair": {"name": "tempest-keypair-1308566499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrPNhLbr8MlPMdYkR4nUNUMIbUyvhqVJATQdzeNFaHXTYZwGtpItnNPc/mx1NcMP81MBa5h+ZAl5wL0bFR2b9+8ZNgXxB/XpGx7pdFU0B9kk8PgGsK4O4r+/AddwBonA=="}} May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: exception: Key pair 'tempest-keypair-1308566499' already exists. May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1308566499', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrPNhLbr8MlPMdYkR4nUNUMIbUyvhqVJATQdzeNFaHXTYZwGtpItnNPc/mx1NcMP81MBa5h+ZAl5wL0bFR2b9+8ZNgXxB/XpGx7pdFU0B9kk8PgGsK4O4r+/AddwBonA=='}}} May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result.read() May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '76179b2310c74db49a6679570ec8648f-tempest-keypair-1308566499' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 19 08:16:10.885338 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi session.flush() May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._flush(objects) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi compat.raise_( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi flush_context.execute() May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi rec.execute(self) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self._query(query) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi conn.query(q) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result.read() May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 19 08:16:10.889238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '76179b2310c74db49a6679570ec8648f-tempest-keypair-1308566499' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 19, 8, 16, 10, 869343), 'updated_at': None, 'name': 'tempest-keypair-1308566499', 'user_id': '76179b2310c74db49a6679570ec8648f', 'fingerprint': 'db:0f:79:17:7f:99:24:95:01:19:a8:44:48:11:61:4c', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrPNhLbr8MlPMdYkR4nUNUMIbUyvhqVJATQdzeNFaHXTYZwGtpItnNPc/mx1NcMP81MBa5h+ZAl5wL0bFR2b9+8ZNgXxB/XpGx7pdFU0B9kk8PgGsK4O4r+/AddwBonA==', 'type': 'ssh'}] May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi keypair.create() May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._create() May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1308566499' already exists. May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 19 08:16:10.893422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1308566499' already exists. May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1308566499' already exists. May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 409 to user: Key pair 'tempest-keypair-1308566499' already exists. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f18cdf42-266d-4547-b767-9b8c8e8f5fd7 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.137857 May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 168/330] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:16:10 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:10.900364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e772dc2-0875-46e8-81c5-25b427491df3 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.903007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:10.903512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:10.903909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lazy-loading 'fault' on Instance uuid 52db3ef4-a451-42e4-b057-c74dc0d51aa2 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:10.921628 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e772dc2-0875-46e8-81c5-25b427491df3 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1423065008" status: 202 len: 0 microversion: 2.1 time: 0.028660 May 19 08:16:10.922869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 169/331] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:10 2022] DELETE /compute/v2.1/flavors/1423065008 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:10.931288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ee52b1b-44b0-4c9e-ac86-0d349314d5b0 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Calling method '.version_select at 0x7f321262fdc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:10.961740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ee52b1b-44b0-4c9e-ac86-0d349314d5b0 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308566499" status: 202 len: 0 microversion: 2.1 time: 0.034441 May 19 08:16:10.973421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 170/332] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308566499 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:10.981111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b768de5d-8728-4892-bdb3-00933488d64c tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:11.008633 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b768de5d-8728-4892-bdb3-00933488d64c tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.033447 May 19 08:16:11.009232 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 171/333] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:10 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:11.024230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22dca7d2-7fe6-4e94-b222-8867b0f3ffd1 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f3212627310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/W+yo9yFBNKGB2CLXaHlGLWsziT90GTh7Ak4zt0nwEhTfJD0aPlKOpO+mKO2lu5eKe7yq5RQurUSIhzS++hzVJ5b4NEVwomtaH7k7WIjKriu8OwWM2L4BDfe+fUNLUiw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22dca7d2-7fe6-4e94-b222-8867b0f3ffd1 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 247 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/W+yo9yFBNKGB2CLXaHlGLWsziT90GTh7Ak4zt0nwEhTfJD0aPlKOpO+mKO2lu5eKe7yq5RQurUSIhzS++hzVJ5b4NEVwomtaH7k7WIjKriu8OwWM2L4BDfe+fUNLUiw=="}} May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/W+yo9yFBNKGB2CLXaHlGLWsziT90GTh7Ak4zt0nwEhTfJD0aPlKOpO+mKO2lu5eKe7yq5RQurUSIhzS++hzVJ5b4NEVwomtaH7k7WIjKriu8OwWM2L4BDfe+fUNLUiw=='}}} May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '' May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:11.026980 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22dca7d2-7fe6-4e94-b222-8867b0f3ffd1 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22dca7d2-7fe6-4e94-b222-8867b0f3ffd1 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.018385 May 19 08:16:11.035397 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 172/334] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:11.036677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c66748e7-780e-4702-8d2b-1723f87b776e tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-798028241", "id": 527844245, "os-flavor-access:is_public": "False"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.059994 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c66748e7-780e-4702-8d2b-1723f87b776e tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.028424 May 19 08:16:11.060930 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 173/335] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/flavors => generated 435 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:11.071970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f321262f5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-559139299", "public_key": " "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.087218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:11.090825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:11.100283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for user 76179b2310c74db49a6679570ec8648f and project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:11.100606 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3822591c-c6e7-455f-9414-4ffc7ed082bf tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1459 microversion: 2.1 time: 0.270354 May 19 08:16:11.101215 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 163/336] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:10 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1459 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:11.106262 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:11.106877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:11.114451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:11.114901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:11.115676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:11.116110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:11.131769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 94 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-559139299", "public_key": " "}} May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: exception: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-559139299', 'public_key': ' '}}} May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.133814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:11.138739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5401143e-4f06-4103-892c-9af1dfc24b98 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073138 May 19 08:16:11.143578 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 174/337] 10.222.0.78 () {60 vars in 1157 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:16:11.311207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:11.324515 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f7b33225-925c-49f7-9b79-62f94aeb2417 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1318 microversion: 2.1 time: 0.220763 May 19 08:16:11.327538 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 164/338] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:11 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:11.339103 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-16e5bc76-d107-445a-9594-665b00a0e982 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f321270cf70>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0eN0M3NHfS49W5IERnBEZ4jGMHr93nAyiWwJ5VD0/aNXYflPSTz2ptvHIyDF5aYcbQg8bM1PUe/i518W9+xFcdvaKOOI3XB36H5juHOIHYIyjI52taesjb/Ves0jaGwg=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-16e5bc76-d107-445a-9594-665b00a0e982 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 507 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0eN0M3NHfS49W5IERnBEZ4jGMHr93nAyiWwJ5VD0/aNXYflPSTz2ptvHIyDF5aYcbQg8bM1PUe/i518W9+xFcdvaKOOI3XB36H5juHOIHYIyjI52taesjb/Ves0jaGwg=="}} May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0eN0M3NHfS49W5IERnBEZ4jGMHr93nAyiWwJ5VD0/aNXYflPSTz2ptvHIyDF5aYcbQg8bM1PUe/i518W9+xFcdvaKOOI3XB36H5juHOIHYIyjI52taesjb/Ves0jaGwg=='}}} May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 19 08:16:11.345587 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 19 08:16:11.348965 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.352314 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-16e5bc76-d107-445a-9594-665b00a0e982 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:11.353817 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-16e5bc76-d107-445a-9594-665b00a0e982 tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.024722 May 19 08:16:11.355388 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 165/339] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:11.366837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Action: 'create', calling method: .version_select at 0x7f3212661b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1659188529", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.383929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:11.386541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:11.390219 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Getting quotas for user 76179b2310c74db49a6679570ec8648f and project b7fd2d052889499780625a57c2c75b2e. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:11.411479 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 118 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1659188529", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: exception: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1659188529', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 19 08:16:11.414281 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0510dc65-1545-4016-885b-05bcb588f64c tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.055217 May 19 08:16:11.423061 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 166/340] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:16:11.426525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:11.427387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:11.433544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:11.433998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:11.434812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:11.435250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:11.603407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef593655-a855-4b06-bead-4b9d90f83ec1 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.605567 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:11.605567 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:11.606945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef593655-a855-4b06-bead-4b9d90f83ec1 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f4b23f5b1ab74f7fa71198332272371e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d588fde472479792172e42e2271c6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef593655-a855-4b06-bead-4b9d90f83ec1 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Request method failure captured: May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/flavors/527844245/action HTTP/1.1 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 67 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzFFC6FBfeAxwvXFW5ipBI8eH8b0xz31mc8lGWDitkYr7ZuihyWVtjiIAewcAEVZNnOPyi4VoXT6NvBhhoOi6PWmUcWh9g0nOhI8B9NT9Jg8xmovyP8SwCKQf0Dk-yIKue7_9_iQJJR3Pfz2nklwzZIH9FRE4_PszLQk2E1jyl510Q May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 73d588fde472479792172e42e2271c6c May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-323257077 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73d588fde472479792172e42e2271c6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73d588fde472479792172e42e2271c6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73d588fde472479792172e42e2271c6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73d588fde472479792172e42e2271c6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-323257077 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 73d588fde472479792172e42e2271c6c May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-323257077 May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FlavorsAccessNegativeTestJSON-323257077-project May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f4b23f5b1ab74f7fa71198332272371e May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-323257077-project May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: {"addTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '527844245', 'body': {'addTenantAccess': {'tenant': '73d588fde472479792172e42e2271c6c'}}} May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 19 08:16:11.608546 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 19 08:16:11.612719 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.621968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef593655-a855-4b06-bead-4b9d90f83ec1 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:11.622884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef593655-a855-4b06-bead-4b9d90f83ec1 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] 10.222.0.78 "POST /compute/v2.1/flavors/527844245/action" status: 403 len: 130 microversion: 2.1 time: 0.478199 May 19 08:16:11.631914 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 175/341] 10.222.0.78 () {60 vars in 1196 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/flavors/527844245/action => generated 130 bytes in 479 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:11.639678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26043ed7-a423-45fd-8daf-4acc84353e4e tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Calling method '.version_select at 0x7f3212871040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:11.653425 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-26043ed7-a423-45fd-8daf-4acc84353e4e tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-939278402 not found for user 76179b2310c74db49a6679570ec8648f May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26043ed7-a423-45fd-8daf-4acc84353e4e tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Request method failure captured: May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-939278402 HTTP/1.1 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzJ-6mn8DG57-HCCBTmc-nb2eRLzo4oQJneNK2cW9uzCCImN2ClFolESPOaAA6mOngUvZxIOzRsp8AGyMSkVk0rm3ON5vbzQGQS-evG6nvwXyc0xnf6ykHzo2pQ3qUTYk_v1f4LPPJQkCaNtMUvmxX-YtasFfMayobV9phkcDpFlmM May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7fd2d052889499780625a57c2c75b2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b7fd2d052889499780625a57c2c75b2e May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-373794170 May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 76179b2310c74db49a6679570ec8648f May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-373794170-project May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: exception: Keypair tempest-keypair-non-existent-939278402 not found for user 76179b2310c74db49a6679570ec8648f May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'tempest-keypair-non-existent-939278402'} May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-939278402 not found for user 76179b2310c74db49a6679570ec8648f May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.655843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-939278402 not found for user 76179b2310c74db49a6679570ec8648f May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-939278402 not found for user 76179b2310c74db49a6679570ec8648f May 19 08:16:11.661918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:11.664895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26043ed7-a423-45fd-8daf-4acc84353e4e tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] Returning 404 to user: Keypair tempest-keypair-non-existent-939278402 not found for user 76179b2310c74db49a6679570ec8648f {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:11.666287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26043ed7-a423-45fd-8daf-4acc84353e4e tempest-KeyPairsNegativeTestJSON-373794170 tempest-KeyPairsNegativeTestJSON-373794170-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-939278402" status: 404 len: 144 microversion: 2.1 time: 0.030758 May 19 08:16:11.666993 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 176/342] 10.222.0.78 () {58 vars in 1256 bytes} [Thu May 19 08:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-939278402 => generated 144 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:11.672366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:11.679768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43c6150e-68ba-4bd1-933f-380f7859381b tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:11.681383 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5e94d07b-01d8-4127-8054-5fd57d57770c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1470 microversion: 2.1 time: 0.262704 May 19 08:16:11.682058 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 167/343] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:11 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:11.714831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43c6150e-68ba-4bd1-933f-380f7859381b tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/527844245" status: 202 len: 0 microversion: 2.1 time: 0.044803 May 19 08:16:11.716174 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 177/344] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:16:11 2022] DELETE /compute/v2.1/flavors/527844245 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:11.726608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b85a5f20-5228-40b4-8e5f-21b24e62c319 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:11.748976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b85a5f20-5228-40b4-8e5f-21b24e62c319 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.029145 May 19 08:16:11.749689 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 178/345] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:11 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:11.766124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-861aec79-3c6d-430f-921e-461a581f0d3d tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1569166466", "id": 1224218612, "os-flavor-access:is_public": "False"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:11.792085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-861aec79-3c6d-430f-921e-461a581f0d3d tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.029540 May 19 08:16:11.792690 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 179/346] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/flavors => generated 439 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:11.806459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90c5f2f1-34ae-42e7-9212-e5be96234f53 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:12.215124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77403b33-debd-495c-b3cf-9590cc4f6436 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:12.216352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-77403b33-debd-495c-b3cf-9590cc4f6436 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] [instance: 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:12.230843 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-77403b33-debd-495c-b3cf-9590cc4f6436 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] HTTP exception thrown: Instance 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638 could not be found. May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77403b33-debd-495c-b3cf-9590cc4f6436 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Request method failure captured: May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/22711b6c-8aeb-4ff0-8eb9-a98b09ff5638/action HTTP/1.1 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 15 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfy355Eumpb6y_iCGZOOSa_XLrdg42l5HD1b12N3ArhGAT27oL5CLKGWYBzMQ0vMZxprlSLtqpkIJS5eIsJwq9ciTpmp94afM6pchtF3P_bX6fbVEpyqqZChloh2Mq63XeniU3uSyAURp5_6uQdklLeS1A3zm94rRCQAX95X8R1oK7s May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: efca41309cf648cd883a21d5f4a5cf83 May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: {"migrate": {}} May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638 could not be found. May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '22711b6c-8aeb-4ff0-8eb9-a98b09ff5638', 'body': {'migrate': {}}} May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638 could not be found. May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638 could not be found. May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:12.233623 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:12.248211 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:12.248211 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:12.248211 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:12.248211 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:12.248211 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638 could not be found. May 19 08:16:12.248211 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:12.259007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77403b33-debd-495c-b3cf-9590cc4f6436 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Returning 404 to user: Instance 22711b6c-8aeb-4ff0-8eb9-a98b09ff5638 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:12.260439 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-77403b33-debd-495c-b3cf-9590cc4f6436 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/22711b6c-8aeb-4ff0-8eb9-a98b09ff5638/action" status: 404 len: 111 microversion: 2.1 time: 0.546992 May 19 08:16:12.261399 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 168/347] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/servers/22711b6c-8aeb-4ff0-8eb9-a98b09ff5638/action => generated 111 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:16:12.267234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:12.268603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:12.277607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:12.278282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:12.279306 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:12.280159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:12.333800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:12.334475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:12.335253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lazy-loading 'fault' on Instance uuid 52db3ef4-a451-42e4-b057-c74dc0d51aa2 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:12.422150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90c5f2f1-34ae-42e7-9212-e5be96234f53 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1224218612/action" status: 200 len: 97 microversion: 2.1 time: 0.619643 May 19 08:16:12.423302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 180/348] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:11 2022] POST /compute/v2.1/flavors/1224218612/action => generated 97 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:16:12.433242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:12.433945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:12.444335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:12.444764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:12.445984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:12.446747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:12.848036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:12.854017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:12.876556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdc56a29-c31d-41fc-9f6d-8fcf5b50b935 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1318 microversion: 2.1 time: 0.450479 May 19 08:16:12.881093 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-be87d8bf-dc09-4afe-81b4-16644f67e44a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1459 microversion: 2.1 time: 0.618419 May 19 08:16:12.881599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 181/349] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:12 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:12.893659 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 169/350] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:12 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1459 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:12.902440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f094ebd-45b9-456b-bb47-03a53e4935d2 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:12.903929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1376443916", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:12.905923 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:12.905923 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:12.906822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0f094ebd-45b9-456b-bb47-03a53e4935d2 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f4b23f5b1ab74f7fa71198332272371e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d588fde472479792172e42e2271c6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f094ebd-45b9-456b-bb47-03a53e4935d2 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Request method failure captured: May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/flavors/1224218612/action HTTP/1.1 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 70 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzFFC6FBfeAxwvXFW5ipBI8eH8b0xz31mc8lGWDitkYr7ZuihyWVtjiIAewcAEVZNnOPyi4VoXT6NvBhhoOi6PWmUcWh9g0nOhI8B9NT9Jg8xmovyP8SwCKQf0Dk-yIKue7_9_iQJJR3Pfz2nklwzZIH9FRE4_PszLQk2E1jyl510Q May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 73d588fde472479792172e42e2271c6c May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-323257077 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73d588fde472479792172e42e2271c6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73d588fde472479792172e42e2271c6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73d588fde472479792172e42e2271c6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73d588fde472479792172e42e2271c6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-323257077 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 73d588fde472479792172e42e2271c6c May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-323257077 May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FlavorsAccessNegativeTestJSON-323257077-project May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f4b23f5b1ab74f7fa71198332272371e May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-323257077-project May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: {"removeTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1224218612', 'body': {'removeTenantAccess': {'tenant': '73d588fde472479792172e42e2271c6c'}}} May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can( May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 19 08:16:12.909362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f094ebd-45b9-456b-bb47-03a53e4935d2 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:12.912881 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f094ebd-45b9-456b-bb47-03a53e4935d2 tempest-FlavorsAccessNegativeTestJSON-323257077 tempest-FlavorsAccessNegativeTestJSON-323257077-project] 10.222.0.78 "POST /compute/v2.1/flavors/1224218612/action" status: 403 len: 133 microversion: 2.1 time: 0.028094 May 19 08:16:12.922394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 182/351] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:12 2022] POST /compute/v2.1/flavors/1224218612/action => generated 133 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:12.938509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbf35254-e16d-4ada-abea-287965f37fcb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "73d588fde472479792172e42e2271c6c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:13.023696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:16:13.254778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbf35254-e16d-4ada-abea-287965f37fcb tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1224218612/action" status: 200 len: 21 microversion: 2.1 time: 0.330677 May 19 08:16:13.255387 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 183/352] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:12 2022] POST /compute/v2.1/flavors/1224218612/action => generated 21 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:16:13.276118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc777e3b-2487-4b8d-83d3-4b135088f5c4 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:13.277604 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:13.277604 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:13.318669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc777e3b-2487-4b8d-83d3-4b135088f5c4 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1224218612" status: 202 len: 0 microversion: 2.1 time: 0.055720 May 19 08:16:13.321673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 184/353] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:13 2022] DELETE /compute/v2.1/flavors/1224218612 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:13.335599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4a0c97d-5a83-4cc4-ae5f-1e703b4b277d tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:13.372212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=30 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:13.398634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4a0c97d-5a83-4cc4-ae5f-1e703b4b277d tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.070179 May 19 08:16:13.399432 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 185/354] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:13.418136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1da70ea9-6874-4bd0-b7fb-708c3931852a tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1792162057", "id": 1887561019, "os-flavor-access:is_public": "False"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:13.421884 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:13.421884 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:13.445783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1da70ea9-6874-4bd0-b7fb-708c3931852a tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.032851 May 19 08:16:13.446779 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 186/355] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:13.456898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-00e04ed3-ed05-4977-8455-5c75da486764 req-750648f4-0fa6-4428-9f82-d2ebd650e19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb48504-a486-455f-99b7-463da687fa80", "name": "network-vif-plugged", "status": "completed", "tag": "8605f768-c0f6-405f-a304-18ef4a72dca7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:13.469243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00e04ed3-ed05-4977-8455-5c75da486764 req-750648f4-0fa6-4428-9f82-d2ebd650e19a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:13.470149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00e04ed3-ed05-4977-8455-5c75da486764 req-750648f4-0fa6-4428-9f82-d2ebd650e19a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:13.483751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-00e04ed3-ed05-4977-8455-5c75da486764 req-750648f4-0fa6-4428-9f82-d2ebd650e19a service nova] Creating event network-vif-plugged:8605f768-c0f6-405f-a304-18ef4a72dca7 for instance 1eb48504-a486-455f-99b7-463da687fa80 on chh2-842464-2 May 19 08:16:13.490620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-00e04ed3-ed05-4977-8455-5c75da486764 req-750648f4-0fa6-4428-9f82-d2ebd650e19a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040262 May 19 08:16:13.492387 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 187/356] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:13.501088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-566c9a22-4eea-4533-bc7a-df4e240f7435 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "035b6ac03ad1428f851ac8980e80d0a1"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:13.503573 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:13.503573 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:13.880640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:16:13.881248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:16:13.882050 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:16:13.882931 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:16:13.883687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:16:13.904365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:13.905254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:13.906980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:13.907465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:13.952224 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Getting quotas for project ba7ec07150584e2782994ccd2f717547. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:13.959961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Getting quotas for user f17de9a8121442b79cca9a9f3221e08a and project ba7ec07150584e2782994ccd2f717547. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:13.979644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:16:13.983063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:16:14.074464 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ccd7d65f-991c-4afd-966f-52c9779db02f tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179555 May 19 08:16:14.075463 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 170/357] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:16:14.082526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-700bb6ad-bb99-44e1-9919-a8aac8d0b21f req-cd192c0e-1b5a-4e29-a414-cb1550d73c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52db3ef4-a451-42e4-b057-c74dc0d51aa2", "name": "network-vif-deleted", "tag": "0ee7d153-5924-4b1f-ae67-ab3ff794b077"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:14.094418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-700bb6ad-bb99-44e1-9919-a8aac8d0b21f req-cd192c0e-1b5a-4e29-a414-cb1550d73c3f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:14.096629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-700bb6ad-bb99-44e1-9919-a8aac8d0b21f req-cd192c0e-1b5a-4e29-a414-cb1550d73c3f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:14.113435 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-700bb6ad-bb99-44e1-9919-a8aac8d0b21f req-cd192c0e-1b5a-4e29-a414-cb1550d73c3f service nova] Creating event network-vif-deleted:0ee7d153-5924-4b1f-ae67-ab3ff794b077 for instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 on chh1-842464-2 May 19 08:16:14.119346 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-700bb6ad-bb99-44e1-9919-a8aac8d0b21f req-cd192c0e-1b5a-4e29-a414-cb1550d73c3f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042091 May 19 08:16:14.120604 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 171/358] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:14.129176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:14.130388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:14.138621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:14.139376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:14.144856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:14.145555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:14.301957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-566c9a22-4eea-4533-bc7a-df4e240f7435 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] HTTP exception thrown: Flavor access not found for 26 / 035b6ac03ad1428f851ac8980e80d0a1 combination. May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-566c9a22-4eea-4533-bc7a-df4e240f7435 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Request method failure captured: May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/flavors/1887561019/action HTTP/1.1 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 70 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzHm45Ah02hzYGdh4eX1zcG9tXoVRL9i9Ct24wq3CHrsSTqllrVNF6Q46Jn_DbqJQrKYweRxVV0AHoiKDhnPV4HY0ZnHJcUSgRy47n3q-2qA5ZRUqyPqtiB15mN9fR15VfMYFAs4A2AGvqmt4OWwVrHiiqGo2si_00UAyeosYNE-pQ May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 456bb5a259854bf6a6b563109b4ea672 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/456bb5a259854bf6a6b563109b4ea672"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 456bb5a259854bf6a6b563109b4ea672 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389 May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ee38d79377284ed4a334aa3c75f2722f May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: {"removeTenantAccess": {"tenant": "035b6ac03ad1428f851ac8980e80d0a1"}} May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: exception: Flavor access not found for 26 / 035b6ac03ad1428f851ac8980e80d0a1 combination. May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1887561019', 'body': {'removeTenantAccess': {'tenant': '035b6ac03ad1428f851ac8980e80d0a1'}}} May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 26 / 035b6ac03ad1428f851ac8980e80d0a1 combination. May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:14.308361 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 26 / 035b6ac03ad1428f851ac8980e80d0a1 combination. May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 26 / 035b6ac03ad1428f851ac8980e80d0a1 combination. May 19 08:16:14.312422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:14.317210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-566c9a22-4eea-4533-bc7a-df4e240f7435 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Returning 404 to user: Flavor access not found for 26 / 035b6ac03ad1428f851ac8980e80d0a1 combination. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:14.322955 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-566c9a22-4eea-4533-bc7a-df4e240f7435 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1887561019/action" status: 404 len: 124 microversion: 2.1 time: 0.828428 May 19 08:16:14.328092 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 188/359] 10.222.0.78 () {60 vars in 1199 bytes} [Thu May 19 08:16:13 2022] POST /compute/v2.1/flavors/1887561019/action => generated 124 bytes in 835 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:14.339094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:14.342346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:14.344790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:14.358944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:14.359459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:14.360361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:14.360991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:14.386067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:14.399225 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5bd3cea9-f662-4f14-92ae-8e81bf7b84ac tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1318 microversion: 2.1 time: 0.274862 May 19 08:16:14.399925 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 172/360] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:14 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:14.422666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4a81ae10-6fbd-4473-aa05-89fe0b813239 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:14.423405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4a81ae10-6fbd-4473-aa05-89fe0b813239 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:14.455714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:14.458674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:14.459556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lazy-loading 'fault' on Instance uuid 52db3ef4-a451-42e4-b057-c74dc0d51aa2 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:14.521269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4a81ae10-6fbd-4473-aa05-89fe0b813239 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:14.531426 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4a81ae10-6fbd-4473-aa05-89fe0b813239 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1222 microversion: 2.1 time: 0.117274 May 19 08:16:14.532624 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 173/361] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:14 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:14.549853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-26c4b48b-09d9-457d-8e09-48f4ab94efec tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:14.550566 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:14.550566 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:14.585387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce6e8adf2d4c4413965e77e5ab9359d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6f85a12d6d4ee9ba2950f2ca028e21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:14.591118 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-26c4b48b-09d9-457d-8e09-48f4ab94efec tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1887561019" status: 202 len: 0 microversion: 2.1 time: 0.050839 May 19 08:16:14.592159 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 174/362] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:14 2022] DELETE /compute/v2.1/flavors/1887561019 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:14.603241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9fb19364-c48c-489f-824c-13a945afd170 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:14.607291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca02620b-a134-47ee-8c8b-64185a9e5a20 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 200 len: 1310 microversion: 2.1 time: 0.277818 May 19 08:16:14.619940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 189/363] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:14 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 1310 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:14.646269 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9fb19364-c48c-489f-824c-13a945afd170 tempest-FlavorsAccessNegativeTestJSON-1349444389 tempest-FlavorsAccessNegativeTestJSON-1349444389-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.048692 May 19 08:16:14.647547 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 175/364] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:14 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:15.011315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79d0ea91-aec2-4991-9a35-a8a1393e17e7 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-210701655", "id": 1864401874, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.013224 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:15.013224 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:15.033431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79d0ea91-aec2-4991-9a35-a8a1393e17e7 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.411988 May 19 08:16:15.034472 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 190/365] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:14 2022] POST /compute/v2.1/flavors => generated 429 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:15.051942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e5001ca-045b-466a-92fd-20784f572561 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.053152 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:15.053152 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:15.075373 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e5001ca-045b-466a-92fd-20784f572561 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1864401874" status: 202 len: 0 microversion: 2.1 time: 0.033527 May 19 08:16:15.079769 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 191/366] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/flavors/1864401874 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:16:15.085489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af8803fc-46c3-4cf2-91da-502af4f75619 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.125292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af8803fc-46c3-4cf2-91da-502af4f75619 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.043010 May 19 08:16:15.126734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 192/367] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:15.146058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c2d336a-3cc7-4f73-8d4f-8cc9dc0a5483 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-851552824", "id": 1394954233, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.164717 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c2d336a-3cc7-4f73-8d4f-8cc9dc0a5483 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.023937 May 19 08:16:15.165714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 193/368] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:15 2022] POST /compute/v2.1/flavors => generated 416 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:15.177112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c13c9bf-733b-4778-b27a-122d0e19ab0b tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.201431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c13c9bf-733b-4778-b27a-122d0e19ab0b tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.028820 May 19 08:16:15.202406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 194/369] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:15.220096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89081c87-9a38-46e1-bc24-eec5ceddf84d tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.239780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89081c87-9a38-46e1-bc24-eec5ceddf84d tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1394954233" status: 202 len: 0 microversion: 2.1 time: 0.025195 May 19 08:16:15.240473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 195/370] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/flavors/1394954233 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:16:15.249074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2b83e0c-4c60-4a8b-96ac-3830eaf00ecd tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.270454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2b83e0c-4c60-4a8b-96ac-3830eaf00ecd tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.025567 May 19 08:16:15.271231 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 196/371] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:15.287256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-567b88ad-5c9b-413b-a797-7cd0280ea199 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1748146376", "id": 1794301517, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.304484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a948545e-6bca-49fd-90b3-90c86ac59eef tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f32125ef8b0>, body: {"keypair": {"name": "tempest-keypair-481064698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfvHYg9PepNc2MrsrZTvdK+p6N3cd756Zih4/aKpS2I//bQMLmUv0Vt0/eojNjulenFomyBqlXjnKjKmV9hE5LEdYcUZNAxz9BRG6DlRkZgAv0mQKTTxpUFGBAhts0bvg=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.321817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-567b88ad-5c9b-413b-a797-7cd0280ea199 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.038178 May 19 08:16:15.322849 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 197/372] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:15 2022] POST /compute/v2.1/flavors => generated 429 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:15.338015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bde290e-f479-47f2-a163-1b15dc3f1e0a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.343097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-a948545e-6bca-49fd-90b3-90c86ac59eef tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:15.349647 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-a948545e-6bca-49fd-90b3-90c86ac59eef tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:15.376248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bde290e-f479-47f2-a163-1b15dc3f1e0a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1794301517" status: 202 len: 0 microversion: 2.1 time: 0.043559 May 19 08:16:15.377165 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 198/373] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/flavors/1794301517 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:16:15.386778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f960f2bf-4f97-4fe2-8e59-f1bd509fdae7 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.397174 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a948545e-6bca-49fd-90b3-90c86ac59eef tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.622606 May 19 08:16:15.401468 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 176/374] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 628 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 19 08:16:15.410142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6097aa3c-911a-42af-b2f6-31e615388c02 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f3212661040>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.418341 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6097aa3c-911a-42af-b2f6-31e615388c02 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-481064698" status: 200 len: 511 microversion: 2.2 time: 0.013368 May 19 08:16:15.419259 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 177/375] 10.222.0.78 () {60 vars in 1254 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-481064698 => generated 511 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:15.425097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.426112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:15.435114 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f960f2bf-4f97-4fe2-8e59-f1bd509fdae7 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.047477 May 19 08:16:15.435337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.435882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.436764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.437122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.437375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 199/376] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:15.451541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8b3541c-03f6-408e-9e77-6a2878739907 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32128714c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.492261 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8b3541c-03f6-408e-9e77-6a2878739907 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481064698" status: 204 len: 0 microversion: 2.2 time: 0.051078 May 19 08:16:15.494528 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 200/377] 10.222.0.78 () {60 vars in 1257 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481064698 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:15.503423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-913d3eeb-0405-4e1c-93ee-a19acae46e89 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2130494639", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.538692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-913d3eeb-0405-4e1c-93ee-a19acae46e89 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.039625 May 19 08:16:15.541639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 201/378] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:15.548051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e239d85-def6-4bd2-bb37-1ce4ac508bf9 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f3212681310>, body: {"keypair": {"name": "tempest-keypair-2057703598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkonvQgG8sM7vcxZRNh2H64y6RDM9U5K4PFaOZDprleug9B6y+ZMr9xQtv7ZedXOyUPxrFrH3EgMEUjBXniRNK4T04+9yKZyN5l+fRjlvYT0mG1v/xAPd7T8bGdtPjLNA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.588324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5e239d85-def6-4bd2-bb37-1ce4ac508bf9 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:15.595090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5e239d85-def6-4bd2-bb37-1ce4ac508bf9 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:15.639682 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e239d85-def6-4bd2-bb37-1ce4ac508bf9 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.096253 May 19 08:16:15.640615 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 202/379] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 98 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 08:16:15.655406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f18410d2-1915-4cb5-9a06-6e25a4c191f6 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.696843 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f18410d2-1915-4cb5-9a06-6e25a4c191f6 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/fe5a52c2-947c-488c-a906-9e54042b09d1" status: 202 len: 0 microversion: 2.1 time: 0.052819 May 19 08:16:15.699361 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 203/380] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/flavors/fe5a52c2-947c-488c-a906-9e54042b09d1 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:15.705995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.706999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:15.725393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.727204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.732854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.734417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.791428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:15.803596 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-53ad28cb-be1c-4bd0-be8f-0619117ab798 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1468 microversion: 2.1 time: 0.383101 May 19 08:16:15.804295 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 178/381] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:15.817089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.817734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:15.825094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.825751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.826706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.827287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.850669 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] HTTP exception thrown: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.852110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Request method failure captured: May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 HTTP/1.1 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyQelHVgmh3o0SjXoNG79UFaDJWaBdnRgmhB4beHFp7f_RrTwVCMMuchs-HNgdipUcac84Kz9Q2HdpezCuhWTb6s2k7N5aD72ftZRd9TqTnt4PNT3tsL3k9v5bZkjBFpLxcIyBvRSC-fyAL__ly95__HkMA7VNjqGutoC8pcZuYnnw May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ce6e8adf2d4c4413965e77e5ab9359d4 May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '52db3ef4-a451-42e4-b057-c74dc0d51aa2'} May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:15.852300 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.856119 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.858106 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Returning 404 to user: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:15.859247 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a5ea119a-cc1f-4317-b6c4-78652a28b6f4 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 404 len: 111 microversion: 2.1 time: 0.053701 May 19 08:16:15.860024 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 179/382] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:15.867186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16efa64a-84a2-4339-aecc-83bed3da4666 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1280 microversion: 2.1 time: 0.165999 May 19 08:16:15.867980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 204/383] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1280 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:15.880048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fe6837ca-53e6-4eaa-8348-9101695571ec tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32125ef940>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.883649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99114883-6dfd-4096-94fa-0f4d6d647754 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.910050 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99114883-6dfd-4096-94fa-0f4d6d647754 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.040825 May 19 08:16:15.911256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 205/384] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:15 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:15.915960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.916487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:15.923353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.923839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.924465 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fe6837ca-53e6-4eaa-8348-9101695571ec tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057703598" status: 204 len: 0 microversion: 2.2 time: 0.062378 May 19 08:16:15.924613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.925036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.925709 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 180/385] 10.222.0.78 () {60 vars in 1260 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057703598 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:15.932671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:15.933633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:15.941476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.942304 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.943691 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:15.944674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:15.965651 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] HTTP exception thrown: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Request method failure captured: May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 HTTP/1.1 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyQelHVgmh3o0SjXoNG79UFaDJWaBdnRgmhB4beHFp7f_RrTwVCMMuchs-HNgdipUcac84Kz9Q2HdpezCuhWTb6s2k7N5aD72ftZRd9TqTnt4PNT3tsL3k9v5bZkjBFpLxcIyBvRSC-fyAL__ly95__HkMA7VNjqGutoC8pcZuYnnw May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ce6e8adf2d4c4413965e77e5ab9359d4 May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '52db3ef4-a451-42e4-b057-c74dc0d51aa2'} May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:15.967389 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Returning 404 to user: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:15.971046 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b6512d50-f9aa-48b7-9203-d3dfe836e61a tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "DELETE /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 404 len: 111 microversion: 2.1 time: 0.042731 May 19 08:16:15.972155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lazy-loading 'flavor' on Instance uuid 1eb48504-a486-455f-99b7-463da687fa80 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:15.973482 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 181/386] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:15 2022] DELETE /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:15.980780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cdd84412-ff6f-45fc-940c-82e98ea6f99a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2137715159", "id": "70d2d5ae-778f-4c2f-abee-e96690870220", "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:15.983025 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:15.983025 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:16.005908 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cdd84412-ff6f-45fc-940c-82e98ea6f99a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028715 May 19 08:16:16.006857 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 182/387] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:15 2022] POST /compute/v2.1/flavors => generated 507 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:16.011681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de9f64e8-cfd2-42b9-a63a-4818772f4a5a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f3212592dc0>, body: {"keypair": {"name": "tempest-keypair-1516626133", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:16.027111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-de9f64e8-cfd2-42b9-a63a-4818772f4a5a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:16.032195 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-de9f64e8-cfd2-42b9-a63a-4818772f4a5a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:16.063218 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de9f64e8-cfd2-42b9-a63a-4818772f4a5a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.053995 May 19 08:16:16.065480 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 183/388] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:16 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 08:16:16.072720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.073610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 52db3ef4-a451-42e4-b057-c74dc0d51aa2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:16.085431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.087332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.088342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.090346 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.109761 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] HTTP exception thrown: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Request method failure captured: May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 HTTP/1.1 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyQelHVgmh3o0SjXoNG79UFaDJWaBdnRgmhB4beHFp7f_RrTwVCMMuchs-HNgdipUcac84Kz9Q2HdpezCuhWTb6s2k7N5aD72ftZRd9TqTnt4PNT3tsL3k9v5bZkjBFpLxcIyBvRSC-fyAL__ly95__HkMA7VNjqGutoC8pcZuYnnw May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ce6e8adf2d4c4413965e77e5ab9359d4 May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '52db3ef4-a451-42e4-b057-c74dc0d51aa2'} May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:16.112190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Returning 404 to user: Instance 52db3ef4-a451-42e4-b057-c74dc0d51aa2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-239acb57-438d-4fa6-a4d9-3def4d1e20e8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2" status: 404 len: 111 microversion: 2.1 time: 0.047077 May 19 08:16:16.116370 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 184/389] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/servers/52db3ef4-a451-42e4-b057-c74dc0d51aa2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:16.119329 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-690ada4c-4581-46d9-bc3b-15b45576100e tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.120272 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:16.120272 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:16.126472 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7f50c9e-9578-4f74-80f0-c3ff13b54a2e tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80/action" status: 202 len: 0 microversion: 2.1 time: 0.213716 May 19 08:16:16.132434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 206/390] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:15 2022] POST /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:16.139092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83b13e6-bcf2-4979-9ed8-37f8dcf470b1 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f321262f820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.144786 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-690ada4c-4581-46d9-bc3b-15b45576100e tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/70d2d5ae-778f-4c2f-abee-e96690870220" status: 202 len: 0 microversion: 2.1 time: 0.029045 May 19 08:16:16.149056 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 185/391] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:16 2022] DELETE /compute/v2.1/flavors/70d2d5ae-778f-4c2f-abee-e96690870220 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:16.158853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.159849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:16.162779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:16.172194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.172909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.174559 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.175082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.179226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e83b13e6-bcf2-4979-9ed8-37f8dcf470b1 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516626133" status: 204 len: 0 microversion: 2.2 time: 0.045020 May 19 08:16:16.180238 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 207/392] 10.222.0.78 () {60 vars in 1260 bytes} [Thu May 19 08:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516626133 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:16.191614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.193812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:16.203419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.204111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.204908 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] HTTP exception thrown: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.205591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.206379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Request method failure captured: May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 HTTP/1.1 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyQelHVgmh3o0SjXoNG79UFaDJWaBdnRgmhB4beHFp7f_RrTwVCMMuchs-HNgdipUcac84Kz9Q2HdpezCuhWTb6s2k7N5aD72ftZRd9TqTnt4PNT3tsL3k9v5bZkjBFpLxcIyBvRSC-fyAL__ly95__HkMA7VNjqGutoC8pcZuYnnw May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ce6e8adf2d4c4413965e77e5ab9359d4 May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '0c568ec3-f550-4f88-a7de-c2a2225800e2'} May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:16.207428 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Returning 404 to user: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-78341ffc-755d-4b91-8044-554e48bb4bf8 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 404 len: 111 microversion: 2.1 time: 0.059063 May 19 08:16:16.211159 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 186/393] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:16 2022] DELETE /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:16.220072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cd199acd-4786-457d-9f07-f3d19b60eab0 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.248489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:16.266969 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cd199acd-4786-457d-9f07-f3d19b60eab0 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.054968 May 19 08:16:16.284788 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 187/394] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:16.293569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2710cecf-62e0-4293-87c0-de046802221a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f3212661430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-186453634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRYRG7WDmBk7dZ3IWCNOq0Gwmicswdae6Xygr0RmHVm3CvO5U+wo6Xe4KQMio03TxjMUdnmEVMUunRismhgIk4tOagoUAk3agdHr8CpfQlMKsHXR2hvY3e6kMPuKGl//g=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:16.322491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-2710cecf-62e0-4293-87c0-de046802221a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:16.327328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-2710cecf-62e0-4293-87c0-de046802221a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:16.354911 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2710cecf-62e0-4293-87c0-de046802221a tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.068912 May 19 08:16:16.364091 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 188/395] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:16 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 08:16:16.373229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.378439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] [instance: 0c568ec3-f550-4f88-a7de-c2a2225800e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:16.394739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.397110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.398220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.398659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.431758 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] HTTP exception thrown: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Request method failure captured: May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 HTTP/1.1 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyQelHVgmh3o0SjXoNG79UFaDJWaBdnRgmhB4beHFp7f_RrTwVCMMuchs-HNgdipUcac84Kz9Q2HdpezCuhWTb6s2k7N5aD72ftZRd9TqTnt4PNT3tsL3k9v5bZkjBFpLxcIyBvRSC-fyAL__ly95__HkMA7VNjqGutoC8pcZuYnnw May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d6f85a12d6d4ee9ba2950f2ca028e21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d6f85a12d6d4ee9ba2950f2ca028e21 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-589914306 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ce6e8adf2d4c4413965e77e5ab9359d4 May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersAdminTestJSON-589914306-project May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '0c568ec3-f550-4f88-a7de-c2a2225800e2'} May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:16.433324 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:16.436901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] Returning 404 to user: Instance 0c568ec3-f550-4f88-a7de-c2a2225800e2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:16.439166 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-51a4cb6f-b685-4c59-8a6c-faba6e0fb146 tempest-DeleteServersAdminTestJSON-589914306 tempest-DeleteServersAdminTestJSON-589914306-project] 10.222.0.78 "GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2" status: 404 len: 111 microversion: 2.1 time: 0.073918 May 19 08:16:16.444639 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 189/396] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/servers/0c568ec3-f550-4f88-a7de-c2a2225800e2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:16.452981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5782c647-b826-42e6-b68b-abd5556ec701 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-138663152", "id": 1301387819, "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:16.459885 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:16.459885 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:16.498569 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5782c647-b826-42e6-b68b-abd5556ec701 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.051580 May 19 08:16:16.505854 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 190/397] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:16 2022] POST /compute/v2.1/flavors => generated 413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:16.506171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c43f6a56-4294-4097-94c5-b54bb143b4e2 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f3212661430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1605221623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbgGJ0hWL/xlLUha+YxtDZDxIb00+zdeWl/0r2tGPXWf+NPeIRVlPdOSkTQ19txiFrMo1JAnI7oZ0IGGWaka/erVpF5xu8JWpBQJcwui4reelcGR8/WyBFT8D/SGnGo+w=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:16.529938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-c43f6a56-4294-4097-94c5-b54bb143b4e2 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:16.539745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-c43f6a56-4294-4097-94c5-b54bb143b4e2 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:16.598180 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c43f6a56-4294-4097-94c5-b54bb143b4e2 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094264 May 19 08:16:16.598407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:16.598951 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 191/398] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 08:16:16.615083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-abad3020-3729-40fd-b76c-abcefc0343cb tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.620549 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20e9a055-97af-4f3c-86e7-0a36751b9231 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1476 microversion: 2.1 time: 0.438626 May 19 08:16:16.621150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 208/399] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:16.637833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64473699-6c4a-4d02-9012-65fff754efd1 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f3212607550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-427905372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa2zfKSGyL1F8rf6gn8oZ/uyOw57i/1dENdA9QLF8CMEGAeJEC9fA4N0cIZqvLCVHZLMEZ1J73BqLEvfoN596lXKpbj50KuL3qPdOynnjmkod7PgQ5HavtyRJbME8TaSw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:16.639843 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-abad3020-3729-40fd-b76c-abcefc0343cb tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1301387819" status: 200 len: 413 microversion: 2.1 time: 0.036646 May 19 08:16:16.640466 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 192/400] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/flavors/1301387819 => generated 413 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:16.670751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-64473699-6c4a-4d02-9012-65fff754efd1 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:16.680778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-64473699-6c4a-4d02-9012-65fff754efd1 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:16.727394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64473699-6c4a-4d02-9012-65fff754efd1 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.105151 May 19 08:16:16.734633 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 209/401] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:16 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 08:16:16.746342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f5a5c58-171d-41d9-a19f-4f00853a59bf tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32126814c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.758025 chdv-842464-2 devstack@n-api.service[119072]: WARNING oslo_db.sqlalchemy.utils [None req-0f5a5c58-171d-41d9-a19f-4f00853a59bf tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 08:16:16.767700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f5a5c58-171d-41d9-a19f-4f00853a59bf tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.031676 May 19 08:16:16.778903 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 210/402] 10.222.0.78 () {60 vars in 1176 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:16.787929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6450ab0e-4de0-4f17-9917-7bb6354e137f tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32125a9280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.807299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:DELETE=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:16.858695 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6450ab0e-4de0-4f17-9917-7bb6354e137f tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-427905372" status: 204 len: 0 microversion: 2.2 time: 0.078583 May 19 08:16:16.859509 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 211/403] 10.222.0.78 () {60 vars in 1317 bytes} [Thu May 19 08:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-427905372 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:16.878015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df04521c-f3ea-4918-8799-67f4f22a1976 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32125a9790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.913735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df04521c-f3ea-4918-8799-67f4f22a1976 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1605221623" status: 204 len: 0 microversion: 2.2 time: 0.049201 May 19 08:16:16.914846 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 212/404] 10.222.0.78 () {60 vars in 1320 bytes} [Thu May 19 08:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1605221623 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:16:16.922532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:16.923151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:16.939007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.940961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:16.944385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:16.945064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:17.325289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a97f835b-23c4-48e5-a444-10d9690b3612 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:17.352570 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a97f835b-23c4-48e5-a444-10d9690b3612 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.703148 May 19 08:16:17.364218 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 193/405] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:17.369999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8dcdb6f1-1fdd-41cb-9f06-51775b111e5c tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32125efe50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:17.418901 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8dcdb6f1-1fdd-41cb-9f06-51775b111e5c tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-186453634" status: 204 len: 0 microversion: 2.2 time: 0.052787 May 19 08:16:17.419505 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 194/406] 10.222.0.78 () {60 vars in 1317 bytes} [Thu May 19 08:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-186453634 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:17.433997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-547e3537-5cb0-4516-ba17-4b34c71ee421 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:17.438584 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:17.438584 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:17.468435 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-547e3537-5cb0-4516-ba17-4b34c71ee421 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1301387819" status: 202 len: 0 microversion: 2.1 time: 0.043424 May 19 08:16:17.471559 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 195/407] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:17 2022] DELETE /compute/v2.1/flavors/1301387819 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:17.479411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6b07961e-b047-47b1-b41b-4661b66fb597 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f3212592160>, body: {"keypair": {"name": "tempest-keypair-114221749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU9l+LvY5DR0vcSEMhNrqhFpKn20c0jXvW7mYPtcytxT37JMOBpUGSlEz5uHEdHgvw5S/7sgwoUiwAHTYBuQnYDuSP38gsDUuNNo8WnaFOTRKZ6WltB1LW4YsQp4Rg8Ng=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:17.501272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-6b07961e-b047-47b1-b41b-4661b66fb597 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:17.508957 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-6b07961e-b047-47b1-b41b-4661b66fb597 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:17.558669 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6b07961e-b047-47b1-b41b-4661b66fb597 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.085166 May 19 08:16:17.564854 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 196/408] 10.222.0.78 () {62 vars in 1198 bytes} [Thu May 19 08:16:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 19 08:16:17.574044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3ea00243-1982-45c8-a3ae-f53dab80f756 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:17.595699 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3ea00243-1982-45c8-a3ae-f53dab80f756 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.031749 May 19 08:16:17.597356 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 197/409] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:17 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:17.661436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:17.673085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc6089e5-2b5d-4926-bd22-9e9e1825da90 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.754034 May 19 08:16:17.685108 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 213/410] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:16 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:17.690506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01789609-cdf5-4fcc-8ed2-82f45a2b8484 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32126274c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:17.691454 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1798774841", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "f89cd20d-715f-4022-9b3a-1a63b86ac1fd"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:17.699028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01789609-cdf5-4fcc-8ed2-82f45a2b8484 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-114221749" status: 200 len: 512 microversion: 2.2 time: 0.012721 May 19 08:16:17.699915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 214/411] 10.222.0.78 () {60 vars in 1254 bytes} [Thu May 19 08:16:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-114221749 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:17.709153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c905f6c7-1624-45e7-b842-a82aa69937a8 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1892002878", "id": 1702588874, "os-flavor-access:is_public": "False"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:17.711129 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:17.711129 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:17.737642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c905f6c7-1624-45e7-b842-a82aa69937a8 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.036038 May 19 08:16:17.744667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 215/412] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:17 2022] POST /compute/v2.1/flavors => generated 430 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:17.750512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:17.751180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:17.760938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] validate_networks() for [('f89cd20d-715f-4022-9b3a-1a63b86ac1fd', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:16:17.763187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:17.765715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:17.768293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:17.768742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:18.177578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:18.194252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d221b74c-deb2-475c-aee1-744f5f8fb15a tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1459 microversion: 2.1 time: 0.447007 May 19 08:16:18.195422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 216/413] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:17 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1459 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:18.201082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-040329bd-f4c0-4179-9001-36d7d9023bb6 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32125a9820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:18.204628 chdv-842464-2 devstack@n-api.service[119072]: WARNING oslo_db.sqlalchemy.utils [None req-040329bd-f4c0-4179-9001-36d7d9023bb6 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 08:16:18.211761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-040329bd-f4c0-4179-9001-36d7d9023bb6 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.014990 May 19 08:16:18.213239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 217/414] 10.222.0.78 () {60 vars in 1176 bytes} [Thu May 19 08:16:18 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:18.218638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86086fe9-9984-4ce4-96db-4a84eae9b3e6 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "1702588874"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:18.232723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-86086fe9-9984-4ce4-96db-4a84eae9b3e6 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] HTTP exception thrown: Flavor 1702588874 could not be found. May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86086fe9-9984-4ce4-96db-4a84eae9b3e6 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] Request method failure captured: May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 107 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzNHdj8vbzlReYHlFJU4hFLXoPv_54sJg_eSr79vo7a0x3CXo7xFi3uqugkrwpz0lvyXXerWK_g_lIAlydVYhWdPo1Iar0xnwWgnz29kByTaJSSK-25EjMMjTDLqSe68yadn27CbDsWvzHC3_OJ8JvLEtTyw2vBGhTFkfIA9TSZD60 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 91cb26c63c85493eab11006cac847635 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FlavorsAdminTestJSON-1385060311 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/91cb26c63c85493eab11006cac847635"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/91cb26c63c85493eab11006cac847635"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_91cb26c63c85493eab11006cac847635"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/91cb26c63c85493eab11006cac847635"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FlavorsAdminTestJSON-1385060311 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 91cb26c63c85493eab11006cac847635 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1385060311 May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FlavorsAdminTestJSON-1385060311-project May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 4d6dc8d08eef4d6a85a5bbe6fa015c8f May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FlavorsAdminTestJSON-1385060311-project May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "test", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "1702588874"}} May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: exception: Flavor 1702588874 could not be found. May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '1702588874'}}} May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1702588874 could not be found. May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:18.246559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1702588874 could not be found. May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1702588874 could not be found. May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:18.250620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86086fe9-9984-4ce4-96db-4a84eae9b3e6 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] Returning 400 to user: Flavor 1702588874 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:18.253706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86086fe9-9984-4ce4-96db-4a84eae9b3e6 tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.036681 May 19 08:16:18.255056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 218/415] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:18 2022] POST /compute/v2.1/servers => generated 81 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:16:18.260333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:18.261188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:18.269277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:18.269907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:18.270850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:18.271316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:18.745579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:16:18.746304 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:16:18.746451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:16:18.746831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:16:18.747410 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:16:18.767211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:18.768089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:18.769142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:18.770110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:18.817458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:18.833737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for user 57e320171eec44a8bdb1dcd9e0039226 and project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:18.849365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:16:18.853760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:16:18.949406 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-140a4ee7-852d-4fc9-951f-870370ab38f3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350996 May 19 08:16:18.950359 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 198/416] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:16:18.966678 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d32e091c-917e-40d8-92b7-0104ccf678e8 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f32125924c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:19.027597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec6b7a69-29d0-4f13-9ea1-0718c7313dbe tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1610 microversion: 2.1 time: 0.770753 May 19 08:16:19.029259 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d32e091c-917e-40d8-92b7-0104ccf678e8 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-114221749" status: 204 len: 0 microversion: 2.2 time: 0.068700 May 19 08:16:19.031455 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 199/417] 10.222.0.78 () {60 vars in 1257 bytes} [Thu May 19 08:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-114221749 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:19.034552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 219/418] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:18 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1610 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:19.060911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-99680e82-ddfe-49db-8fce-eae35b043a5c tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:19.061870 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:19.061870 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:19.067015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:19.067742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:19.092380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.094015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.096276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.098135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.135157 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-99680e82-ddfe-49db-8fce-eae35b043a5c tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1702588874" status: 202 len: 0 microversion: 2.1 time: 0.102019 May 19 08:16:19.136917 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 200/419] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:19 2022] DELETE /compute/v2.1/flavors/1702588874 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:19.142303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-98ccdf99-3397-439f-ade1-660a466bd224 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:19.143943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-98ccdf99-3397-439f-ade1-660a466bd224 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:19.359543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-98ccdf99-3397-439f-ade1-660a466bd224 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:19.384709 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-98ccdf99-3397-439f-ade1-660a466bd224 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1211 microversion: 2.1 time: 0.244494 May 19 08:16:19.390016 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 201/420] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:19 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1211 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:19.407932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Action: 'create', calling method: .version_select at 0x7f32125924c0>, body: {"keypair": {"name": "tempest-keypair-489904944", "type": "x509"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:19.424036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:19.429743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:19.433158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:19.476001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:19.507161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.processutils [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnhypmdea/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnhypmdea/temp.key -subj /CN=778dfcaab222498c85c8f0b1c0d2f999 -extensions v3_req_client {{(pid=119073) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 19 08:16:19.516975 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c724c374-d569-457a-af39-8ae1ff57b5e7 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.480887 May 19 08:16:19.523811 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 220/421] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:19 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:19.530322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-936b963c-bf3f-47b4-89e5-2d1c4b427823 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:19.532043 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:19.532043 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:19.536588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-936b963c-bf3f-47b4-89e5-2d1c4b427823 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.537297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-936b963c-bf3f-47b4-89e5-2d1c4b427823 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.538314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-936b963c-bf3f-47b4-89e5-2d1c4b427823 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.539020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-936b963c-bf3f-47b4-89e5-2d1c4b427823 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.586672 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-936b963c-bf3f-47b4-89e5-2d1c4b427823 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061141 May 19 08:16:19.587946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 221/422] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:16:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:19.609925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f78c516e-8243-4c36-8122-787bbd0aa199 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:19.664344 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f78c516e-8243-4c36-8122-787bbd0aa199 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.071914 May 19 08:16:19.676813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 222/423] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:19 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:19.684819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d0bf9489-29c1-434d-b7fe-d72851aaae5e req-d972a0b3-419c-4db7-958c-e3cac7856288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae99d4c-8f94-4d58-9493-fc10c294e07d", "tag": "957a63fb-65f7-443a-b60b-479962507214"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:19.696952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0bf9489-29c1-434d-b7fe-d72851aaae5e req-d972a0b3-419c-4db7-958c-e3cac7856288 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.697819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0bf9489-29c1-434d-b7fe-d72851aaae5e req-d972a0b3-419c-4db7-958c-e3cac7856288 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.710449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d0bf9489-29c1-434d-b7fe-d72851aaae5e req-d972a0b3-419c-4db7-958c-e3cac7856288 service nova] Creating event network-changed:957a63fb-65f7-443a-b60b-479962507214 for instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d on chh1-842464-2 May 19 08:16:19.717272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d0bf9489-29c1-434d-b7fe-d72851aaae5e req-d972a0b3-419c-4db7-958c-e3cac7856288 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 May 19 08:16:19.718042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 223/424] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:19.724371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:19.725617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:19.732469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.732998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.734036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:19.735673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:19.959822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.processutils [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnhypmdea/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnhypmdea/temp.key -subj /CN=778dfcaab222498c85c8f0b1c0d2f999 -extensions v3_req_client" returned: 0 in 0.452s {{(pid=119073) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 19 08:16:19.961693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.processutils [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnhypmdea/temp.key -password pass: {{(pid=119073) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 19 08:16:20.015336 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.processutils [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnhypmdea/temp.key -password pass:" returned: 0 in 0.053s {{(pid=119073) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 19 08:16:20.068445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:20.075832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Getting quotas for user 778dfcaab222498c85c8f0b1c0d2f999 and project c35be92eaf194305ae77a55081801a32. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:20.092242 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b5ac8231-9aa3-4780-8f06-62b2e89bd21b tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.700480 May 19 08:16:20.093277 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 202/425] 10.222.0.78 () {62 vars in 1197 bytes} [Thu May 19 08:16:19 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 703 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:20.099795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ceb62490-e997-42e9-8610-4465a975c754 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1282334191", "id": 180891539, "os-flavor-access:is_public": "False"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:20.102303 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:20.102303 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:20.124800 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ceb62490-e997-42e9-8610-4465a975c754 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.029258 May 19 08:16:20.126079 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 203/426] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:20 2022] POST /compute/v2.1/flavors => generated 412 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:20.132747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2dece938-df58-4a42-b89a-6d4aa8cd32ee tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f3212661e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.148931 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2dece938-df58-4a42-b89a-6d4aa8cd32ee tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-489904944" status: 200 len: 1533 microversion: 2.2 time: 0.021325 May 19 08:16:20.150278 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 204/427] 10.222.0.78 () {60 vars in 1254 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-489904944 => generated 1533 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.155468 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f424addb-b6c6-4f8e-aaa8-0b6a50fa48ea tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1219681312", "id": 66837582, "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:20.176929 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f424addb-b6c6-4f8e-aaa8-0b6a50fa48ea tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.025281 May 19 08:16:20.177651 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 205/428] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:20.183213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-56c78a13-0bcf-4ec8-bc8d-50c50fa315af tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f321270c8b0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.185755 chdv-842464-2 devstack@n-api.service[119073]: WARNING oslo_db.sqlalchemy.utils [None req-56c78a13-0bcf-4ec8-bc8d-50c50fa315af tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 08:16:20.194509 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-56c78a13-0bcf-4ec8-bc8d-50c50fa315af tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.015234 May 19 08:16:20.195095 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 206/429] 10.222.0.78 () {60 vars in 1176 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.199567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4509d561-5706-4cb0-b39a-322b9ce9326e tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.223340 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4509d561-5706-4cb0-b39a-322b9ce9326e tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.027021 May 19 08:16:20.223939 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 207/430] 10.222.0.78 () {58 vars in 1168 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:20.228520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-53a4f767-33c8-4d0c-8875-ae783aade700 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] Calling method '.version_select at 0x7f3212661e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.249938 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-53a4f767-33c8-4d0c-8875-ae783aade700 tempest-KeyPairsV22TestJSON-854472919 tempest-KeyPairsV22TestJSON-854472919-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489904944" status: 204 len: 0 microversion: 2.2 time: 0.024920 May 19 08:16:20.250526 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 208/431] 10.222.0.78 () {60 vars in 1257 bytes} [Thu May 19 08:16:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489904944 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:20.259220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f9264fe-64a5-4d64-8e1d-7475b263e295 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.268457 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9f9264fe-64a5-4d64-8e1d-7475b263e295 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.012211 May 19 08:16:20.269097 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 209/432] 10.222.0.78 () {58 vars in 1176 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:20.279938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9feff365-2e29-4bdb-b686-102ff1749b4f tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.289669 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9feff365-2e29-4bdb-b686-102ff1749b4f tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.013368 May 19 08:16:20.290268 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 210/433] 10.222.0.78 () {58 vars in 1170 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:20.301482 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c1104bdc-8f28-4756-9f9a-9a7dc343b3bb tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.311700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Lazy-loading 'flavor' on Instance uuid 1eb48504-a486-455f-99b7-463da687fa80 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:20.312249 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c1104bdc-8f28-4756-9f9a-9a7dc343b3bb tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.014673 May 19 08:16:20.320303 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 211/434] 10.222.0.78 () {58 vars in 1168 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:20.325113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-51289493-3b3e-4b12-8aaf-24427dc71707 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.332521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 1eb48504-a486-455f-99b7-463da687fa80 while it is in vm_state suspended May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Request method failure captured: May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80/action HTTP/1.1 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 97 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyuM6hfkRel1fz-DyPG1Mrdj1Da_Yju29HBX3m4mjV9afj_lgol2I2g8JOrE6Ww2p_Q-x6rSP3C1wvx4js5RQERUD6y_dqsIJR5_lbqGwtSojUsHICKZO__0kC1y9kKaT2VUUyrquVOb1924k0p2_Ni22rrdXEIzj85CicYaqcwnB4 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 99d3faef55b547f49ad4d1d690997987 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-LiveMigrationNegativeTest-1134612278 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99d3faef55b547f49ad4d1d690997987"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99d3faef55b547f49ad4d1d690997987"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99d3faef55b547f49ad4d1d690997987"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99d3faef55b547f49ad4d1d690997987"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-LiveMigrationNegativeTest-1134612278 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 99d3faef55b547f49ad4d1d690997987 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1134612278 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-LiveMigrationNegativeTest-1134612278-project-admin May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5f16fe52dcbe478c88abc302cacb93d1 May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-LiveMigrationNegativeTest-1134612278-project-admin May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": true, "disk_over_commit": false}} May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'os-migrateLive' instance 1eb48504-a486-455f-99b7-463da687fa80 while it is in vm_state suspended May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1eb48504-a486-455f-99b7-463da687fa80', 'body': {'os-migrateLive': {'host': 'chh1-842464-2', 'block_migration': True, 'disk_over_commit': False}}} May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1eb48504-a486-455f-99b7-463da687fa80 in vm_state suspended. Cannot live_migrate while the instance is in this state. May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:20.335945 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 1eb48504-a486-455f-99b7-463da687fa80 while it is in vm_state suspended May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 1eb48504-a486-455f-99b7-463da687fa80 while it is in vm_state suspended May 19 08:16:20.340626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:20.348849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 1eb48504-a486-455f-99b7-463da687fa80 while it is in vm_state suspended {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:20.348995 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-51289493-3b3e-4b12-8aaf-24427dc71707 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.027081 May 19 08:16:20.350805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e442b929-762e-402c-b1c9-9f7a9e9d1e97 tempest-LiveMigrationNegativeTest-1134612278 tempest-LiveMigrationNegativeTest-1134612278-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80/action" status: 409 len: 155 microversion: 2.1 time: 0.631483 May 19 08:16:20.357927 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 224/435] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:19 2022] POST /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80/action => generated 155 bytes in 639 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:20.359865 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 212/436] 10.222.0.78 () {58 vars in 1168 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.363972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.364889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:20.365149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b9a02e1f-3a5a-4df4-a031-3b15c0711c3c tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.372720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.373616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.375646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.376378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.387833 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b9a02e1f-3a5a-4df4-a031-3b15c0711c3c tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.026727 May 19 08:16:20.399878 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 213/437] 10.222.0.78 () {58 vars in 1174 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.405081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.405890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:20.412595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.413052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.413908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.414195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:16:20.414351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.513325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:20.528382 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e3192c7a-8a6b-4530-a7a8-68e94f82b62e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1263 microversion: 2.1 time: 0.126422 May 19 08:16:20.530314 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 214/438] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1263 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.539185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a129f16e-70b4-4bee-9023-bc3cdb520690 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.572810 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a129f16e-70b4-4bee-9023-bc3cdb520690 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.039398 May 19 08:16:20.574487 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 215/439] 10.222.0.78 () {58 vars in 1172 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.585626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.588700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:20.596236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.597458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.598432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.599032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.606417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:20.626691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e82f39f5-54fb-4065-8a72-e36d0bd3cae6 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 204 len: 0 microversion: 2.1 time: 0.266958 May 19 08:16:20.628430 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 225/440] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:20 2022] DELETE /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:20.633944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3bf31d75-0afd-4e75-bc32-fdf538ae30b3 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.669713 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3bf31d75-0afd-4e75-bc32-fdf538ae30b3 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.039850 May 19 08:16:20.670464 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 226/441] 10.222.0.78 () {58 vars in 1168 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.676952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.677923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:20.685952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.686629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.687870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:20.688515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:20.859448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:20.871702 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7427ccee-77fe-455b-aa3d-d43f1e654769 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.295988 May 19 08:16:20.873381 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 216/442] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.892328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-868984a3-2bc6-4376-954c-0885c016ad7c tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.894427 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:20.894427 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:20.919334 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-868984a3-2bc6-4376-954c-0885c016ad7c tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/66837582" status: 202 len: 0 microversion: 2.1 time: 0.042833 May 19 08:16:20.921539 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 217/443] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:16:20 2022] DELETE /compute/v2.1/flavors/66837582 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:20.930126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0f7554f3-bc5e-4db5-a079-5ced1e9b18e8 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.941037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:20.952068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92af8864-a158-41f3-8aac-e650b2cefa92 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1465 microversion: 2.1 time: 0.279571 May 19 08:16:20.953246 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 227/444] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1465 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.972656 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0f7554f3-bc5e-4db5-a079-5ced1e9b18e8 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.046523 May 19 08:16:20.973835 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 218/445] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:20 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:20.992248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-626f1a7c-630c-43b1-b705-4c0197e197d1 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:20.997584 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:20.997584 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:21.022733 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-626f1a7c-630c-43b1-b705-4c0197e197d1 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/180891539" status: 202 len: 0 microversion: 2.1 time: 0.034509 May 19 08:16:21.028782 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 228/446] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:16:20 2022] DELETE /compute/v2.1/flavors/180891539 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:21.032927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-36ae2f55-8460-49f6-92cb-d50fec6f8b27 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.063345 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-36ae2f55-8460-49f6-92cb-d50fec6f8b27 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.034484 May 19 08:16:21.063943 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 219/447] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.091479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba5c5f46-9512-478b-b7a6-93f1789865d5 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2015242750", "id": 906089712, "os-flavor-access:is_public": "False"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:21.093090 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:21.093090 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:21.116913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba5c5f46-9512-478b-b7a6-93f1789865d5 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.029611 May 19 08:16:21.117883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 229/448] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:21 2022] POST /compute/v2.1/flavors => generated 412 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:21.139713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-47364e29-4bc1-4305-a93f-d6ec152a9c94 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.176034 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-47364e29-4bc1-4305-a93f-d6ec152a9c94 tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.050242 May 19 08:16:21.176653 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 220/449] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.193876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e5e51f6-a9c1-4ac8-a0ea-decf0d9ca6fb tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.230408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e5e51f6-a9c1-4ac8-a0ea-decf0d9ca6fb tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.041405 May 19 08:16:21.241094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 230/450] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.249105 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-59fbc725-0ab9-45d3-8111-6ff98c6478bb tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.278125 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-59fbc725-0ab9-45d3-8111-6ff98c6478bb tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/906089712" status: 202 len: 0 microversion: 2.1 time: 0.034553 May 19 08:16:21.289078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3cb2df6-e83a-4d7d-98f7-4e19d2297e3d tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.295223 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 221/451] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:16:21 2022] DELETE /compute/v2.1/flavors/906089712 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:21.316375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3cb2df6-e83a-4d7d-98f7-4e19d2297e3d tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.030856 May 19 08:16:21.323036 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 231/452] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.338412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-402f8959-6b76-4174-a2b8-ef7d24552bff tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1607311059", "id": 1818045046, "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:21.340072 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:21.340072 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:21.369985 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-402f8959-6b76-4174-a2b8-ef7d24552bff tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035420 May 19 08:16:21.370696 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 222/453] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:21 2022] POST /compute/v2.1/flavors => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:21.385244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5215506c-4900-49ed-995d-4f3fe74e69ef tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.422324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5215506c-4900-49ed-995d-4f3fe74e69ef tempest-FlavorsAdminTestJSON-1385060311 tempest-FlavorsAdminTestJSON-1385060311-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.035532 May 19 08:16:21.423700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 232/454] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.440362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1842aaba-842c-4107-861a-5aaccf95b68a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.462853 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1842aaba-842c-4107-861a-5aaccf95b68a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1818045046" status: 202 len: 0 microversion: 2.1 time: 0.026265 May 19 08:16:21.465247 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 223/455] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:16:21 2022] DELETE /compute/v2.1/flavors/1818045046 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:21.479238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78a6e6c4-f494-45f1-8261-4ceef878c99a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.502053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78a6e6c4-f494-45f1-8261-4ceef878c99a tempest-FlavorsAdminTestJSON-630101573 tempest-FlavorsAdminTestJSON-630101573-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.029918 May 19 08:16:21.503531 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 233/456] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.547305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.548412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:21.557968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:21.558728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:21.559819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:21.560408 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:21.678204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:21.688860 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f538ec76-37a7-4262-8106-ebc81e784de9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1271 microversion: 2.1 time: 0.146171 May 19 08:16:21.689944 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 224/457] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:21.890484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:21.891243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:21.899932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:21.901418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:21.902605 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:21.903288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.010019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5efb8f25-1818-4fa3-b956-115195df3bcc tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Calling method '.version_select at 0x7f32126273a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.011985 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:22.011985 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:22.014628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5efb8f25-1818-4fa3-b956-115195df3bcc tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'a60dccef02634a03be82fa1e09c8bf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0889f22cda542969b4243c94fcaa163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5efb8f25-1818-4fa3-b956-115195df3bcc tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Request method failure captured: May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzU3uLsabwqjfyB5A32VQ7R3fTjp_x7tROthSic1IEX2knVTvbEPLsge_HJhkM8oWPzEIlYmHS1XBnIzUyRB1Ce1hv0-QV6IIjrMOSoBuhA2Sehg5Zq00N1Vm98lcBvFWPxpE4lKUrqhoSAjVIOyAaNCg3o8wtDoaUNhOf_9sWxoE4 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0889f22cda542969b4243c94fcaa163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: a60dccef02634a03be82fa1e09c8bf44 May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._detail(req) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 19 08:16:22.019738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 19 08:16:22.024073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.026149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5efb8f25-1818-4fa3-b956-115195df3bcc tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:22.030682 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5efb8f25-1818-4fa3-b956-115195df3bcc tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.444848 May 19 08:16:22.036804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 234/458] 10.222.0.78 () {58 vars in 1166 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 451 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:22.045452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.046560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:22.054522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.055470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.056419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.058004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.332020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.341738 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8943992e-9076-4878-aa71-512f5a13fa58 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.454976 May 19 08:16:22.341738 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 225/459] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:21 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:22.356739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cfbb9a0b-9bdd-42b7-b4b8-b59229a0711e tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Calling method '.version_select at 0x7f32125ef940>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.357659 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:22.357659 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:22.367057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cfbb9a0b-9bdd-42b7-b4b8-b59229a0711e tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'a60dccef02634a03be82fa1e09c8bf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0889f22cda542969b4243c94fcaa163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cfbb9a0b-9bdd-42b7-b4b8-b59229a0711e tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Request method failure captured: May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzU3uLsabwqjfyB5A32VQ7R3fTjp_x7tROthSic1IEX2knVTvbEPLsge_HJhkM8oWPzEIlYmHS1XBnIzUyRB1Ce1hv0-QV6IIjrMOSoBuhA2Sehg5Zq00N1Vm98lcBvFWPxpE4lKUrqhoSAjVIOyAaNCg3o8wtDoaUNhOf_9sWxoE4 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0889f22cda542969b4243c94fcaa163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a60dccef02634a03be82fa1e09c8bf44 May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: action_args: {} May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._index(req) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 19 08:16:22.370370 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cfbb9a0b-9bdd-42b7-b4b8-b59229a0711e tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cfbb9a0b-9bdd-42b7-b4b8-b59229a0711e tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019087 May 19 08:16:22.373817 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 226/460] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:22.435691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.445626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90308623-45c8-4f69-93a6-80659b6f30e9 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1465 microversion: 2.1 time: 0.405883 May 19 08:16:22.446937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 235/461] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1465 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:22.463532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02eba63d-7ead-4477-aa26-2108fe88ff8f tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Calling method '.version_select at 0x7f3212681ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.463532 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:22.463532 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:22.464641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02eba63d-7ead-4477-aa26-2108fe88ff8f tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'a60dccef02634a03be82fa1e09c8bf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0889f22cda542969b4243c94fcaa163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02eba63d-7ead-4477-aa26-2108fe88ff8f tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Request method failure captured: May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzU3uLsabwqjfyB5A32VQ7R3fTjp_x7tROthSic1IEX2knVTvbEPLsge_HJhkM8oWPzEIlYmHS1XBnIzUyRB1Ce1hv0-QV6IIjrMOSoBuhA2Sehg5Zq00N1Vm98lcBvFWPxpE4lKUrqhoSAjVIOyAaNCg3o8wtDoaUNhOf_9sWxoE4 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0889f22cda542969b4243c94fcaa163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: a60dccef02634a03be82fa1e09c8bf44 May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.467752 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02eba63d-7ead-4477-aa26-2108fe88ff8f tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02eba63d-7ead-4477-aa26-2108fe88ff8f tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011855 May 19 08:16:22.472315 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 236/462] 10.222.0.78 () {58 vars in 1178 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:22.696879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Calling method '.version_select at 0x7f32125efa60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.700521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.701386 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.739236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.739900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.769521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Calling method '.version_select at 0x7f321262fe50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.770446 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:22.770446 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:22.771700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.772358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.779518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.781051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.801490 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-92e78b8c-2eaf-4248-8ee6-e36cf5f42b1c tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.427787 May 19 08:16:22.802317 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 227/463] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:22.807156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.811184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.812174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.816643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:22.833765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.834453 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.835442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.838034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.842868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.844946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.860422 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-303d560a-20bf-4bae-8e4d-751bd565d3a0 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.383510 May 19 08:16:22.868178 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 237/464] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:22.878021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7cb2b31-39bb-4b6c-b249-b33c81b1ff41 tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Calling method '.version_select at 0x7f3212627430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.880760 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:22.880760 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:22.882876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7cb2b31-39bb-4b6c-b249-b33c81b1ff41 tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.884513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7cb2b31-39bb-4b6c-b249-b33c81b1ff41 tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.929427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7cb2b31-39bb-4b6c-b249-b33c81b1ff41 tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:22.930088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7cb2b31-39bb-4b6c-b249-b33c81b1ff41 tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:22.942071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7cb2b31-39bb-4b6c-b249-b33c81b1ff41 tempest-HypervisorAdminV228Test-239071332 tempest-HypervisorAdminV228Test-239071332-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.072253 May 19 08:16:22.946590 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 238/465] 10.222.0.78 () {60 vars in 1192 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:22.962831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcaa6476-97d0-4d8d-8bfe-6904e8e484e0 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Calling method '.version_select at 0x7f32126074c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:22.964174 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:22.964174 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:22.969665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dcaa6476-97d0-4d8d-8bfe-6904e8e484e0 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'a60dccef02634a03be82fa1e09c8bf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0889f22cda542969b4243c94fcaa163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.976512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcaa6476-97d0-4d8d-8bfe-6904e8e484e0 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Request method failure captured: May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzU3uLsabwqjfyB5A32VQ7R3fTjp_x7tROthSic1IEX2knVTvbEPLsge_HJhkM8oWPzEIlYmHS1XBnIzUyRB1Ce1hv0-QV6IIjrMOSoBuhA2Sehg5Zq00N1Vm98lcBvFWPxpE4lKUrqhoSAjVIOyAaNCg3o8wtDoaUNhOf_9sWxoE4 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0889f22cda542969b4243c94fcaa163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: a60dccef02634a03be82fa1e09c8bf44 May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1'} May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.990317 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:22.993947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcaa6476-97d0-4d8d-8bfe-6904e8e484e0 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:22.994445 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-01528e4f-71eb-49bd-9966-528cf16e41bd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1269 microversion: 2.1 time: 0.190794 May 19 08:16:22.995447 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dcaa6476-97d0-4d8d-8bfe-6904e8e484e0 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.044033 May 19 08:16:22.996308 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 228/466] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:22.996509 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 239/467] 10.222.0.78 () {58 vars in 1172 bytes} [Thu May 19 08:16:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:23.015987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85410451-08f9-44b9-b5d7-a00ae5488123 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Calling method '.version_select at 0x7f321270c9d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.017395 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:23.017395 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:23.018664 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-85410451-08f9-44b9-b5d7-a00ae5488123 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] HTTP exception thrown: Hypervisor with ID '3c31833d-1aff-4f87-b986-1b304e47126b' could not be found. May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85410451-08f9-44b9-b5d7-a00ae5488123 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Request method failure captured: May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hypervisors/3c31833d-1aff-4f87-b986-1b304e47126b/uptime HTTP/1.1 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzVdNZCfNgkDEJ4rtZ3CUzDOulvdUTju-MTeKYkJQ6OtJjvyRuahumlY1J8hP2QUGqjAEZzng6sZqeZViHtA7YXCYs8FvGYdVoSPNZY662ak6T6rPHZVDn5iAgn2mkFeTzGZ87s4A6fS6Jr97eRcvyugLIrzIK_j5GtZYTovnMRc6Q May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: e2126b200b724c4096309e6f849d97f1 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-942944009 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2126b200b724c4096309e6f849d97f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2126b200b724c4096309e6f849d97f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2126b200b724c4096309e6f849d97f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2126b200b724c4096309e6f849d97f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-942944009 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: e2126b200b724c4096309e6f849d97f1 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-942944009 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: aae0100362834feaa49eba9a3799a323 May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: exception: Hypervisor with ID '3c31833d-1aff-4f87-b986-1b304e47126b' could not be found. May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '3c31833d-1aff-4f87-b986-1b304e47126b'} May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3c31833d-1aff-4f87-b986-1b304e47126b' May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:23.029441 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3c31833d-1aff-4f87-b986-1b304e47126b' could not be found. May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3c31833d-1aff-4f87-b986-1b304e47126b' could not be found. May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85410451-08f9-44b9-b5d7-a00ae5488123 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Returning 404 to user: Hypervisor with ID '3c31833d-1aff-4f87-b986-1b304e47126b' could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-85410451-08f9-44b9-b5d7-a00ae5488123 tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/3c31833d-1aff-4f87-b986-1b304e47126b/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020001 May 19 08:16:23.033657 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 229/468] 10.222.0.78 () {58 vars in 1277 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/os-hypervisors/3c31833d-1aff-4f87-b986-1b304e47126b/uptime => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:23.045979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Calling method '.version_select at 0x7f32128713a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.047213 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:23.047213 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:23.049466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.050216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.079856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.082146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.111099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.112965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.130979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4b1fa14-e781-4474-acb5-36eadc581c3d tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088843 May 19 08:16:23.135245 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 240/469] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:23.142193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-35c3fc43-b996-4322-a0dc-f5e5c3a5ef33 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Calling method '.version_select at 0x7f3212592550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.143577 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:23.143577 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:23.144968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-35c3fc43-b996-4322-a0dc-f5e5c3a5ef33 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'a60dccef02634a03be82fa1e09c8bf44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0889f22cda542969b4243c94fcaa163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-35c3fc43-b996-4322-a0dc-f5e5c3a5ef33 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Request method failure captured: May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzU3uLsabwqjfyB5A32VQ7R3fTjp_x7tROthSic1IEX2knVTvbEPLsge_HJhkM8oWPzEIlYmHS1XBnIzUyRB1Ce1hv0-QV6IIjrMOSoBuhA2Sehg5Zq00N1Vm98lcBvFWPxpE4lKUrqhoSAjVIOyAaNCg3o8wtDoaUNhOf_9sWxoE4 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0889f22cda542969b4243c94fcaa163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0889f22cda542969b4243c94fcaa163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c0889f22cda542969b4243c94fcaa163 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-755995193 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a60dccef02634a03be82fa1e09c8bf44 May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-755995193-project May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '1'} May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 19 08:16:23.146527 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 19 08:16:23.150164 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:23.152243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-35c3fc43-b996-4322-a0dc-f5e5c3a5ef33 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:23.153511 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-35c3fc43-b996-4322-a0dc-f5e5c3a5ef33 tempest-HypervisorAdminNegativeTestJSON-755995193 tempest-HypervisorAdminNegativeTestJSON-755995193-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.015259 May 19 08:16:23.159271 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 230/470] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:23.165186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd948b4e-bf01-4855-90e1-df1d08a0d76a tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Calling method '.version_select at 0x7f321262fe50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.166090 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:23.166090 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:23.166957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-dd948b4e-bf01-4855-90e1-df1d08a0d76a tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] HTTP exception thrown: Hypervisor with ID 'afab60ef-b839-4df1-8692-d8df6308e8bd' could not be found. May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd948b4e-bf01-4855-90e1-df1d08a0d76a tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Request method failure captured: May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hypervisors/afab60ef-b839-4df1-8692-d8df6308e8bd HTTP/1.1 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzVdNZCfNgkDEJ4rtZ3CUzDOulvdUTju-MTeKYkJQ6OtJjvyRuahumlY1J8hP2QUGqjAEZzng6sZqeZViHtA7YXCYs8FvGYdVoSPNZY662ak6T6rPHZVDn5iAgn2mkFeTzGZ87s4A6fS6Jr97eRcvyugLIrzIK_j5GtZYTovnMRc6Q May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e2126b200b724c4096309e6f849d97f1 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-942944009 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e2126b200b724c4096309e6f849d97f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2126b200b724c4096309e6f849d97f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e2126b200b724c4096309e6f849d97f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e2126b200b724c4096309e6f849d97f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-942944009 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e2126b200b724c4096309e6f849d97f1 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-942944009 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: aae0100362834feaa49eba9a3799a323 May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: exception: Hypervisor with ID 'afab60ef-b839-4df1-8692-d8df6308e8bd' could not be found. May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'afab60ef-b839-4df1-8692-d8df6308e8bd'} May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'afab60ef-b839-4df1-8692-d8df6308e8bd' May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:23.170000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'afab60ef-b839-4df1-8692-d8df6308e8bd' could not be found. May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'afab60ef-b839-4df1-8692-d8df6308e8bd' could not be found. May 19 08:16:23.174614 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:23.175731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd948b4e-bf01-4855-90e1-df1d08a0d76a tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] Returning 404 to user: Hypervisor with ID 'afab60ef-b839-4df1-8692-d8df6308e8bd' could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:23.175805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd948b4e-bf01-4855-90e1-df1d08a0d76a tempest-HypervisorAdminNegativeTestJSON-942944009 tempest-HypervisorAdminNegativeTestJSON-942944009-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/afab60ef-b839-4df1-8692-d8df6308e8bd" status: 404 len: 123 microversion: 2.1 time: 0.015302 May 19 08:16:23.176363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 241/471] 10.222.0.78 () {58 vars in 1256 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/os-hypervisors/afab60ef-b839-4df1-8692-d8df6308e8bd => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:16:23.336558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dc0a217c-0481-490a-9a7b-8a47404bff2b req-460902b5-b5d4-4079-b7b9-9dc6586a9ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eb48504-a486-455f-99b7-463da687fa80", "name": "network-vif-deleted", "tag": "8605f768-c0f6-405f-a304-18ef4a72dca7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:23.355591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc0a217c-0481-490a-9a7b-8a47404bff2b req-460902b5-b5d4-4079-b7b9-9dc6586a9ae6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.356836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc0a217c-0481-490a-9a7b-8a47404bff2b req-460902b5-b5d4-4079-b7b9-9dc6586a9ae6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.389136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dc0a217c-0481-490a-9a7b-8a47404bff2b req-460902b5-b5d4-4079-b7b9-9dc6586a9ae6 service nova] Creating event network-vif-deleted:8605f768-c0f6-405f-a304-18ef4a72dca7 for instance 1eb48504-a486-455f-99b7-463da687fa80 on chh2-842464-2 May 19 08:16:23.402168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dc0a217c-0481-490a-9a7b-8a47404bff2b req-460902b5-b5d4-4079-b7b9-9dc6586a9ae6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083827 May 19 08:16:23.402992 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 242/472] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:23.419549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.421933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:23.442182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.443740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.445210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.446219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.680342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:23.691046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffbeece7-2efc-4700-b563-950887ae1ccb tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.283316 May 19 08:16:23.693057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 243/473] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:23.698960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.702293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:23.713825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.714569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.715511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.716103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.756431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.756883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.757373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lazy-loading 'fault' on Instance uuid 1eb48504-a486-455f-99b7-463da687fa80 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:23.822025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:23.836261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4545fbbb-5045-483d-a4b5-d05e1b453211 tempest-AbsoluteLimitsTestJSON-1447581105 tempest-AbsoluteLimitsTestJSON-1447581105-project] Calling method '.version_select at 0x7f3212aab280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:23.837640 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab2c30b6-deea-49a9-ace1-9637e0828997 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 200 len: 1308 microversion: 2.1 time: 0.140028 May 19 08:16:23.839572 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 244/474] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 1308 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:23.857715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4545fbbb-5045-483d-a4b5-d05e1b453211 tempest-AbsoluteLimitsTestJSON-1447581105 tempest-AbsoluteLimitsTestJSON-1447581105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.858425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4545fbbb-5045-483d-a4b5-d05e1b453211 tempest-AbsoluteLimitsTestJSON-1447581105 tempest-AbsoluteLimitsTestJSON-1447581105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.861656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4545fbbb-5045-483d-a4b5-d05e1b453211 tempest-AbsoluteLimitsTestJSON-1447581105 tempest-AbsoluteLimitsTestJSON-1447581105-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:23.862357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4545fbbb-5045-483d-a4b5-d05e1b453211 tempest-AbsoluteLimitsTestJSON-1447581105 tempest-AbsoluteLimitsTestJSON-1447581105-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:23.897658 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4545fbbb-5045-483d-a4b5-d05e1b453211 tempest-AbsoluteLimitsTestJSON-1447581105 tempest-AbsoluteLimitsTestJSON-1447581105-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.705612 May 19 08:16:23.898460 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 231/475] 10.222.0.78 () {58 vars in 1121 bytes} [Thu May 19 08:16:23 2022] GET /compute/v2.1/limits => generated 511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:24.018539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:24.019325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:24.029511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.029969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.030755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.031183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.060156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:24.297365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:24.306066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-2cb1cb5f-91f8-4d83-8b5b-c1f7bf11c4b7 req-2546d097-7e44-48c0-bd0f-47764765e2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd25d84e-f3ec-4845-a751-609e31473949", "tag": "4d3cebd2-0571-4120-b6e1-f2e22fcf9194"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:24.324572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eaf8a7e5-8cbd-4eed-a219-f644ddfb5d81 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 0.304255 May 19 08:16:24.338621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 245/476] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:24 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:24.350421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2cb1cb5f-91f8-4d83-8b5b-c1f7bf11c4b7 req-2546d097-7e44-48c0-bd0f-47764765e2af service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.352068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2cb1cb5f-91f8-4d83-8b5b-c1f7bf11c4b7 req-2546d097-7e44-48c0-bd0f-47764765e2af service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.398166 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-2cb1cb5f-91f8-4d83-8b5b-c1f7bf11c4b7 req-2546d097-7e44-48c0-bd0f-47764765e2af service nova] Creating event network-changed:4d3cebd2-0571-4120-b6e1-f2e22fcf9194 for instance fd25d84e-f3ec-4845-a751-609e31473949 on chh2-842464-2 May 19 08:16:24.412700 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-2cb1cb5f-91f8-4d83-8b5b-c1f7bf11c4b7 req-2546d097-7e44-48c0-bd0f-47764765e2af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111722 May 19 08:16:24.415005 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 232/477] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:24.714106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:24.714852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:24.726574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.727036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.727812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.729717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.866019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:24.871019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 1eb48504-a486-455f-99b7-463da687fa80] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:24.881117 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=10 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:24.892221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.893432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.895061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.896037 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:24.949659 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] HTTP exception thrown: Instance 1eb48504-a486-455f-99b7-463da687fa80 could not be found. May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Request method failure captured: May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 HTTP/1.1 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfytw83fPn2BCn6w8SuHvUW2RhjjJvgHKKQf14qcxOpcRQ7GHi1a63Luk8YA4mkoGz_aGKMkNvkKKTHP3TNVHL961_AFornnmiJ8Xk3NvfyUA4vOuanBPC4n4vMSrO0DQBdozbJDua062NFGNI_Biv0itz6QCGpPApdApeT0agPuQDk May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 2498755892a5447c9103cc54e740dfbd May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-LiveMigrationNegativeTest-1673664115 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2498755892a5447c9103cc54e740dfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2498755892a5447c9103cc54e740dfbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2498755892a5447c9103cc54e740dfbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2498755892a5447c9103cc54e740dfbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-LiveMigrationNegativeTest-1673664115 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 2498755892a5447c9103cc54e740dfbd May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1673664115 May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-LiveMigrationNegativeTest-1673664115-project May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 4c2650c1e71d41a5ac2412eda518ee1e May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-LiveMigrationNegativeTest-1673664115-project May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 1eb48504-a486-455f-99b7-463da687fa80 could not be found. May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '1eb48504-a486-455f-99b7-463da687fa80'} May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eb48504-a486-455f-99b7-463da687fa80 could not be found. May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eb48504-a486-455f-99b7-463da687fa80 could not be found. May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:24.956243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eb48504-a486-455f-99b7-463da687fa80 could not be found. May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Returning 404 to user: Instance 1eb48504-a486-455f-99b7-463da687fa80 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-25633d78-3e8c-4425-b9ee-2e1626a908a7 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80" status: 404 len: 111 microversion: 2.1 time: 0.104026 May 19 08:16:24.962954 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 233/478] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:24 2022] GET /compute/v2.1/servers/1eb48504-a486-455f-99b7-463da687fa80 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:24.978082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:24.981508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:24.998174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:24.999282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:25.000643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:25.001760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:25.036374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:16:25.157657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4f0478a4-d98f-48ac-9725-bee6a2c159e2 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "DELETE /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 204 len: 0 microversion: 2.1 time: 0.191779 May 19 08:16:25.159395 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 234/479] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:24 2022] DELETE /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:25.169025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:25.170757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:25.178831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:25.179561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:25.180624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:25.181246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:25.213704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:25.239512 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cafc2688-c198-48a6-9ea3-386c0a7b60c9 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.531975 May 19 08:16:25.247676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 246/480] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:24 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:25.348178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:25.348987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:25.357908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:25.358560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:25.359631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:25.360756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:25.606939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:25.631000 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e1e44c92-de8b-475d-a84c-b3d901d74d45 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1473 microversion: 2.1 time: 0.464800 May 19 08:16:25.632493 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 235/481] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:25 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1473 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:25.651772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:25.674770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a544925-8674-4d38-adcd-534b52ce849a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 0.332232 May 19 08:16:25.676675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 247/482] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:25 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:26.257133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:26.257947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:26.269969 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.276171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-336747c3-9c14-44da-a032-f5c71a663df5 req-5ea4ed87-e8d3-4790-82c3-4a8c82b88794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae99d4c-8f94-4d58-9493-fc10c294e07d", "name": "network-vif-plugged", "status": "completed", "tag": "957a63fb-65f7-443a-b60b-479962507214"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:26.284325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:26.289677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-336747c3-9c14-44da-a032-f5c71a663df5 req-5ea4ed87-e8d3-4790-82c3-4a8c82b88794 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.290246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.290833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:26.296599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-336747c3-9c14-44da-a032-f5c71a663df5 req-5ea4ed87-e8d3-4790-82c3-4a8c82b88794 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:26.324567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-336747c3-9c14-44da-a032-f5c71a663df5 req-5ea4ed87-e8d3-4790-82c3-4a8c82b88794 service nova] Creating event network-vif-plugged:957a63fb-65f7-443a-b60b-479962507214 for instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d on chh1-842464-2 May 19 08:16:26.334203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-336747c3-9c14-44da-a032-f5c71a663df5 req-5ea4ed87-e8d3-4790-82c3-4a8c82b88794 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061908 May 19 08:16:26.336903 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 248/483] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:26.560595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:26.575747 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dfa2ac1f-9690-44cc-bb90-8a1c48698ac1 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.323660 May 19 08:16:26.576454 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 236/484] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:26 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:26.659411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:26.660097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:26.683561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.684039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:26.684905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.693670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:26.694605 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:26.701349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:26.702551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=72 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:26.708927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.709430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:26.710223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:26.710662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:27.043518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:27.060053 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-629edfc6-d81f-48fd-adb2-50900c59848c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 0.370289 May 19 08:16:27.066247 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 237/485] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:26 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:27.081629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:27.094934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5064cff9-30ac-4afb-86f3-d3c1b5088e5b tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1473 microversion: 2.1 time: 0.440414 May 19 08:16:27.096634 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 249/486] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:26 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1473 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:27.598666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:27.599407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:27.608828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:27.609598 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:27.611153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:27.612922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:28.076872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:28.078555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:28.079174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:28.090453 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d08be5d9-7a69-44ed-85ee-e515cca2908b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1322 microversion: 2.1 time: 0.499524 May 19 08:16:28.090937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:28.091401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:28.092237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:28.093267 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 238/487] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:27 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:28.096293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:28.120786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:28.122355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:28.132343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:28.133192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:28.134785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:28.135579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:28.538188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:28.567418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2650c1e71d41a5ac2412eda518ee1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2498755892a5447c9103cc54e740dfbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:28.572168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f3a188c-9929-40bf-b51b-bb799873897c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 0.497102 May 19 08:16:28.582764 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9818a0e0-cd9f-405e-9a7e-5015c651b5a0 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 200 len: 1473 microversion: 2.1 time: 0.469028 May 19 08:16:28.583365 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 239/488] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:28 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:16:28.584262 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 250/489] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:28 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:28.737177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3ee439ad-72c4-43f8-9564-c7e8a14bb53c req-4d4a9087-6350-486c-bc53-f2f6c2aa5bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717491f6-c7fd-430d-bd7c-361f49bdc7d9", "name": "network-vif-deleted", "tag": "40a7c23b-46ec-4dd5-aadb-2351c464f618"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:28.746446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=5,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:28.748233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3ee439ad-72c4-43f8-9564-c7e8a14bb53c req-4d4a9087-6350-486c-bc53-f2f6c2aa5bf1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:28.748843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3ee439ad-72c4-43f8-9564-c7e8a14bb53c req-4d4a9087-6350-486c-bc53-f2f6c2aa5bf1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:28.786831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3ee439ad-72c4-43f8-9564-c7e8a14bb53c req-4d4a9087-6350-486c-bc53-f2f6c2aa5bf1 service nova] Creating event network-vif-deleted:40a7c23b-46ec-4dd5-aadb-2351c464f618 for instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 on chh2-842464-2 May 19 08:16:28.793115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3ee439ad-72c4-43f8-9564-c7e8a14bb53c req-4d4a9087-6350-486c-bc53-f2f6c2aa5bf1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060859 May 19 08:16:28.794007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 251/490] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:16:29.026370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8c18a1b3-adee-432f-9fab-be5fd8df0578 tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1715838715", "id": 1762214629, "os-flavor-access:is_public": "True"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:29.030722 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:29.030722 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:29.055934 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8c18a1b3-adee-432f-9fab-be5fd8df0578 tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.469682 May 19 08:16:29.056809 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 240/491] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:16:28 2022] POST /compute/v2.1/flavors => generated 471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:29.071454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ba02ce7-f1dd-4d0c-ae9c-448331671d39 tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:29.073337 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:29.073337 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:29.111455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:29.112082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:29.126459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.130334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.131324 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.132553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.485947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ba02ce7-f1dd-4d0c-ae9c-448331671d39 tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1762214629/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.418421 May 19 08:16:29.487378 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 252/492] 10.222.0.78 () {62 vars in 1264 bytes} [Thu May 19 08:16:29 2022] POST /compute/v2.1/flavors/1762214629/os-extra_specs => generated 62 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:29.504717 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:29.505443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-389ba1a3-4598-41dd-b5ed-cad892f3ffbf tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:29.506745 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:29.506745 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:29.515082 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f26f316c-8ae5-4934-b030-e3f9d24766be tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1472 microversion: 2.1 time: 0.408670 May 19 08:16:29.515844 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 241/493] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:29 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:29.532496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-389ba1a3-4598-41dd-b5ed-cad892f3ffbf tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1762214629" status: 202 len: 0 microversion: 2.86 time: 0.031861 May 19 08:16:29.537602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:29.538138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:29.538281 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 253/494] 10.222.0.78 () {60 vars in 1201 bytes} [Thu May 19 08:16:29 2022] DELETE /compute/v2.1/flavors/1762214629 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:29.544888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b802157-ef31-45b8-a77b-93a0ecf285f1 tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:29.552222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:29.554799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.555002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.560607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.561057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.583231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b802157-ef31-45b8-a77b-93a0ecf285f1 tempest-FlavorMetadataValidation-606768138 tempest-FlavorMetadataValidation-606768138-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6683 microversion: 2.86 time: 0.043238 May 19 08:16:29.592813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 254/495] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:16:29 2022] GET /compute/v2.1/flavors/detail => generated 6683 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:16:29.601257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:29.602082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:29.629573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.631012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.631970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.643188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.722049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:16:29.757925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lazy-loading 'flavor' on Instance uuid 5ae99d4c-8f94-4d58-9493-fc10c294e07d {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:29.898031 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:29.925764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-078de6ca-8a95-4369-8054-a4edb8d753ea tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 204 len: 0 microversion: 2.1 time: 0.326812 May 19 08:16:29.926406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 255/496] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:29 2022] DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:29.941147 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f67d099f-b2c7-49cd-8185-ce266b5ed6fd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d/action" status: 202 len: 0 microversion: 2.1 time: 0.406834 May 19 08:16:29.946058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:29.946257 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 242/497] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:29 2022] POST /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:16:29.950781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] [instance: 717491f6-c7fd-430d-bd7c-361f49bdc7d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:29.958520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:29.959353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:29.964048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.964784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.966178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.966826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.973643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.974226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:29.975191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:29.982449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:30.001857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] HTTP exception thrown: Instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 could not be found. May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Request method failure captured: May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 HTTP/1.1 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfytw83fPn2BCn6w8SuHvUW2RhjjJvgHKKQf14qcxOpcRQ7GHi1a63Luk8YA4mkoGz_aGKMkNvkKKTHP3TNVHL961_AFornnmiJ8Xk3NvfyUA4vOuanBPC4n4vMSrO0DQBdozbJDua062NFGNI_Biv0itz6QCGpPApdApeT0agPuQDk May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2498755892a5447c9103cc54e740dfbd May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-LiveMigrationNegativeTest-1673664115 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2498755892a5447c9103cc54e740dfbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2498755892a5447c9103cc54e740dfbd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2498755892a5447c9103cc54e740dfbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2498755892a5447c9103cc54e740dfbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-LiveMigrationNegativeTest-1673664115 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2498755892a5447c9103cc54e740dfbd May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1673664115 May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-LiveMigrationNegativeTest-1673664115-project May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 4c2650c1e71d41a5ac2412eda518ee1e May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-LiveMigrationNegativeTest-1673664115-project May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 could not be found. May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '717491f6-c7fd-430d-bd7c-361f49bdc7d9'} May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 could not be found. May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 could not be found. May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:30.003784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 could not be found. May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] Returning 404 to user: Instance 717491f6-c7fd-430d-bd7c-361f49bdc7d9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:30.007588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ef5a150-7d6d-4738-abbe-13d08fdc8415 tempest-LiveMigrationNegativeTest-1673664115 tempest-LiveMigrationNegativeTest-1673664115-project] 10.222.0.78 "GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9" status: 404 len: 111 microversion: 2.1 time: 0.074810 May 19 08:16:30.018256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 256/498] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:29 2022] GET /compute/v2.1/servers/717491f6-c7fd-430d-bd7c-361f49bdc7d9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:30.023151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:30.023762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:30.029845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:30.030290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:30.031058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:30.031703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:30.329726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:30.338756 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3c3e2ff1-bf77-483b-8bc2-712b3a8dabf4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 0.391115 May 19 08:16:30.344855 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 243/499] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:29 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:30.544932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33c09f09-5e57-4a01-ae4a-c9324b817427 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1631 microversion: 2.1 time: 0.525474 May 19 08:16:30.557872 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 257/500] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:30 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1631 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:30.570970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-202357265", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "1407221823", "adminPass": "***", "networks": [{"uuid": "cd02c628-7eca-4237-a4fb-a4ce5e196d97"}], "security_groups": [{"name": "tempest-securitygroup--936821863"}], "key_name": "tempest-keypair-1865817268", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:30.757745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] validate_networks() for [('cd02c628-7eca-4237-a4fb-a4ce5e196d97', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:16:30.968937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-46349675-a1a9-4fe1-bcdd-ac20aedcd548 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f32125efc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1597419095", "description": "tempest-description-94148794"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:31.763585 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-46349675-a1a9-4fe1-bcdd-ac20aedcd548 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.416054 May 19 08:16:31.765032 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 244/501] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:32.107692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:16:32.108349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:16:32.108573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:16:32.109216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:16:32.109661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:16:32.123316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-257711992", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:32.132616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:32.133376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:32.134494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:32.135119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:32.161607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Getting quotas for project 5ab46fa809fe4a9bb8ad076da226b643. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:32.167461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Getting quotas for user 83555ee44aaf44b5aec6a2afe7f43d46 and project 5ab46fa809fe4a9bb8ad076da226b643. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:32.183366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:16:32.186805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:16:32.209532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:16:32.253407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4894b8c-18c7-4639-a3d2-aa47b9863faf tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.693630 May 19 08:16:32.260302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 258/502] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:16:32.553893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce5da3d-9656-441f-99cd-9ba5f2642031 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:32.554823 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:32.554823 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:32.557841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-dce5da3d-9656-441f-99cd-9ba5f2642031 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce5da3d-9656-441f-99cd-9ba5f2642031 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin] Request method failure captured: May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzf6Tn1V8HZEfeDjkDA097z-22JfdZCRrxUELFGU3kicNVAEOVnCJ1Vk4YvEF-llKXebx-dVWesviaid4OQqmW0D0ZgRzoD2gKWJpFCyS6ptBH6AJGziN6Fp7rNKetb5l3Fq1LZpn_fguiNxWbCMMwTG6J6vMxa4l_O-zv44GuAzbE May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 46ccc85e97844c0686560e06493d5b52 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/46ccc85e97844c0686560e06493d5b52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/46ccc85e97844c0686560e06493d5b52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_46ccc85e97844c0686560e06493d5b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/46ccc85e97844c0686560e06493d5b52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 46ccc85e97844c0686560e06493d5b52 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6b70c72af97e420e9c076ff5c7739ef7 May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid timestamp for date invalid_time May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'invalid_time'} May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:32.573165 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:32.582796 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 19 08:16:32.582796 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:32.582796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce5da3d-9656-441f-99cd-9ba5f2642031 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:32.582796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dce5da3d-9656-441f-99cd-9ba5f2642031 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115 tempest-InstanceUsageAuditLogNegativeTestJSON-47636115-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.313293 May 19 08:16:32.582796 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 259/503] 10.222.0.78 () {58 vars in 1223 bytes} [Thu May 19 08:16:32 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 314 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:16:32.585124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:32.585765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:32.596330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:32.596888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:32.597779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:32.598244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.113153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:16:33.113740 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:16:33.114054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:16:33.114500 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:16:33.114855 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:16:33.140108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.140555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.141825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.143970 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.176314 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:33.183052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for user f40ef4d25a474b3c83a3c2808a87a30d and project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:33.188894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:33.201230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:16:33.203874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:16:33.210126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8078eba-bb1c-4ff0-9263-15d87c8c1d9e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 0.625288 May 19 08:16:33.210808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 260/504] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:32 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:33.215311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b526c047-b1a5-4a33-a0db-48160d473a0b req-86930d10-96f5-4d3f-b112-02e76a1e7b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd25d84e-f3ec-4845-a751-609e31473949", "name": "network-vif-plugged", "status": "completed", "tag": "4d3cebd2-0571-4120-b6e1-f2e22fcf9194"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:33.228258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b526c047-b1a5-4a33-a0db-48160d473a0b req-86930d10-96f5-4d3f-b112-02e76a1e7b2e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.228709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b526c047-b1a5-4a33-a0db-48160d473a0b req-86930d10-96f5-4d3f-b112-02e76a1e7b2e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.244991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b526c047-b1a5-4a33-a0db-48160d473a0b req-86930d10-96f5-4d3f-b112-02e76a1e7b2e service nova] Creating event network-vif-plugged:4d3cebd2-0571-4120-b6e1-f2e22fcf9194 for instance fd25d84e-f3ec-4845-a751-609e31473949 on chh2-842464-2 May 19 08:16:33.252004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b526c047-b1a5-4a33-a0db-48160d473a0b req-86930d10-96f5-4d3f-b112-02e76a1e7b2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039457 May 19 08:16:33.253465 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 261/505] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:33.261177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:33.263759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:33.275357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.276085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.277209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.277964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.322210 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-67079670-5504-45b5-a123-4674074c332d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554413 May 19 08:16:33.323394 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 245/506] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:16:33.330006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-55407eea-9bed-4262-92cf-b26d1f4dfcfe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f32125ef040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-770781064", "description": "tempest-description-12798016"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:33.787901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8637b1e-df95-457b-8134-293d0711671a tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1614 microversion: 2.1 time: 0.530608 May 19 08:16:33.802851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 262/507] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:33 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1614 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:33.820823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:33.821491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:33.839978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.840436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.843838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:33.844349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:33.991100 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-55407eea-9bed-4262-92cf-b26d1f4dfcfe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.666037 May 19 08:16:33.992504 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 246/508] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:33 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:34.034861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:34.047055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-caa81b05-af7a-4714-acd3-341a810c4d5d tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1324 microversion: 2.1 time: 0.242526 May 19 08:16:34.047653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 263/509] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:33 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:34.054571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:34.055179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:34.061349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:34.061809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:34.062583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:34.063211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:34.152157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:34.160371 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75cb61fc-1f54-479d-bd27-69d9c5a180f3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1216 microversion: 2.1 time: 0.109532 May 19 08:16:34.160966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 264/510] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:34 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:34.178632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:34.179289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:34.190379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:34.191910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:34.192890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:34.193701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:34.309624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] HTTP exception thrown: Cannot 'migrate' instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d while it is in vm_state suspended May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Request method failure captured: May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d/action HTTP/1.1 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfy355Eumpb6y_iCGZOOSa_XLrdg42l5HD1b12N3ArhGAT27oL5CLKGWYBzMQ0vMZxprlSLtqpkIJS5eIsJwq9ciTpmp94afM6pchtF3P_bX6fbVEpyqqZChloh2Mq63XeniU3uSyAURp5_6uQdklLeS1A3zm94rRCQAX95X8R1oK7s May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: efca41309cf648cd883a21d5f4a5cf83 May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: {"migrate": {}} May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'migrate' instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d while it is in vm_state suspended May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5ae99d4c-8f94-4d58-9493-fc10c294e07d', 'body': {'migrate': {}}} May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d in vm_state suspended. Cannot resize while the instance is in this state. May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:34.312657 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d while it is in vm_state suspended May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d while it is in vm_state suspended May 19 08:16:34.316820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:34.322054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Returning 409 to user: Cannot 'migrate' instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d while it is in vm_state suspended {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:34.324439 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5075794e-b075-4343-9c86-0059ed6bfcdd tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d/action" status: 409 len: 148 microversion: 2.1 time: 0.161968 May 19 08:16:34.326166 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 265/511] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:34 2022] POST /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d/action => generated 148 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:34.336301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:34.342523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:34.353703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:34.359638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:34.362302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:34.363255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:34.452777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fabbcf30-75b5-4edd-bfaf-0d958da83ea9 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:34.453669 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:34.453669 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:34.454798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fabbcf30-75b5-4edd-bfaf-0d958da83ea9 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd139b1806aad40f1a2dfb8b26f674fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81db6c084a6d41968ead43a4a5e55722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fabbcf30-75b5-4edd-bfaf-0d958da83ea9 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Request method failure captured: May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzcx7bAlUPwAwgGIFNg8FAg9XG6mKIroM1LINzKLx1Vc3V3IuPnqnuMcSLEPJ_2fN8ZpGOqrl7jbSCA8JTzh6loz_nYjMPIpHUWSyjqyRWfhXA-6CeroNS9tMLleVtURXhUDlCG4t-4oAAhGdULPLHKqCFcuGY-qPco8p6Xr262RZw May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 81db6c084a6d41968ead43a4a5e55722 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 81db6c084a6d41968ead43a4a5e55722 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: d139b1806aad40f1a2dfb8b26f674fc6 May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: action_args: {} May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:34.457712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fabbcf30-75b5-4edd-bfaf-0d958da83ea9 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fabbcf30-75b5-4edd-bfaf-0d958da83ea9 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.460742 May 19 08:16:34.461123 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 247/512] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:16:33 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 462 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:34.482440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1903828244", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "476a6071-8d69-4933-aad7-9ec8aa51858f"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:34.582514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] validate_networks() for [('476a6071-8d69-4933-aad7-9ec8aa51858f', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:16:35.406318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:35.419862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-530e53af-10f1-44f3-bf4d-1ad4b718a1ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1311 microversion: 2.1 time: 1.089166 May 19 08:16:35.420861 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 266/513] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:34 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1311 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:35.439288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-214b1aca-99ab-497b-81dd-a505129492be tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-214b1aca-99ab-497b-81dd-a505129492be tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Request method failure captured: May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792/action HTTP/1.1 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 39 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfy355Eumpb6y_iCGZOOSa_XLrdg42l5HD1b12N3ArhGAT27oL5CLKGWYBzMQ0vMZxprlSLtqpkIJS5eIsJwq9ciTpmp94afM6pchtF3P_bX6fbVEpyqqZChloh2Mq63XeniU3uSyAURp5_6uQdklLeS1A3zm94rRCQAX95X8R1oK7s May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: efca41309cf648cd883a21d5f4a5cf83 May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: {"os-resetState": {"state": "invalid"}} May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a31cad69-9458-48a2-b3d5-85288d047792', 'body': {'os-resetState': {'state': 'invalid'}}} May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'invalid' May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:35.443367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.451337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-214b1aca-99ab-497b-81dd-a505129492be tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:35.454285 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-214b1aca-99ab-497b-81dd-a505129492be tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792/action" status: 400 len: 144 microversion: 2.1 time: 0.023038 May 19 08:16:35.462881 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 267/514] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:35 2022] POST /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792/action => generated 144 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:35.475230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bd47c77-74eb-46c4-a269-7906e6ff6301 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:35.477606 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:35.477606 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:35.479404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1bd47c77-74eb-46c4-a269-7906e6ff6301 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd139b1806aad40f1a2dfb8b26f674fc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81db6c084a6d41968ead43a4a5e55722', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bd47c77-74eb-46c4-a269-7906e6ff6301 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Request method failure captured: May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19%2008:16:34 HTTP/1.1 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzcx7bAlUPwAwgGIFNg8FAg9XG6mKIroM1LINzKLx1Vc3V3IuPnqnuMcSLEPJ_2fN8ZpGOqrl7jbSCA8JTzh6loz_nYjMPIpHUWSyjqyRWfhXA-6CeroNS9tMLleVtURXhUDlCG4t-4oAAhGdULPLHKqCFcuGY-qPco8p6Xr262RZw May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 81db6c084a6d41968ead43a4a5e55722 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81db6c084a6d41968ead43a4a5e55722"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 81db6c084a6d41968ead43a4a5e55722 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d139b1806aad40f1a2dfb8b26f674fc6 May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2022-05-19 08:16:34'} May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.483872 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:35.491130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:35.491130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:35.491130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:35.491130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:35.491130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 19 08:16:35.491130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:35.494579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bd47c77-74eb-46c4-a269-7906e6ff6301 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:35.495940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1bd47c77-74eb-46c4-a269-7906e6ff6301 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608 tempest-InstanceUsageAuditLogNegativeTestJSON-1368467608-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19 08:16:34" status: 403 len: 128 microversion: 2.1 time: 0.031844 May 19 08:16:35.497631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 268/515] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:16:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19%2008%3A16%3A34 => generated 128 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:35.506307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-df8dc436-86cc-4754-9582-cec24dc3f2ed req-96f97e7c-8601-4603-906d-a5b013044bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ebe82b-7784-4409-942a-d691ed1937d1", "name": "network-vif-deleted", "tag": "9f49cf5c-fad7-4a96-a537-884a26eee24b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:35.521884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-df8dc436-86cc-4754-9582-cec24dc3f2ed req-96f97e7c-8601-4603-906d-a5b013044bca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:35.526177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-df8dc436-86cc-4754-9582-cec24dc3f2ed req-96f97e7c-8601-4603-906d-a5b013044bca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:35.557909 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-df8dc436-86cc-4754-9582-cec24dc3f2ed req-96f97e7c-8601-4603-906d-a5b013044bca service nova] Creating event network-vif-deleted:9f49cf5c-fad7-4a96-a537-884a26eee24b for instance d2ebe82b-7784-4409-942a-d691ed1937d1 on chh1-842464-2 May 19 08:16:35.571557 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-df8dc436-86cc-4754-9582-cec24dc3f2ed req-96f97e7c-8601-4603-906d-a5b013044bca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072482 May 19 08:16:35.573879 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 269/516] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:35.584328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:35.585418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:35.631622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:35.632089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:35.632899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:35.634292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:35.843232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:35.850465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:35.853340 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01f7a774-53a9-42d4-a063-121801b7f5f9 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1322 microversion: 2.1 time: 0.278103 May 19 08:16:35.862585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 270/517] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:35 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:35.882049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:35.882729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:35.899597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:35.900839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:35.904814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:35.907300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:35.989473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:16:35.990047 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:16:35.990504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:16:35.991037 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:16:35.991461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:16:36.024266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:36.027636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:36.027885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:36.029633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:36.086557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Getting quotas for project 699efd30daad449889b1823bf7990948. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:16:36.087347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:36.099401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Getting quotas for user adcf30b9ac4f4046b0343bc1435a6562 and project 699efd30daad449889b1823bf7990948. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:16:36.114769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed08f886-b90b-4bc9-8397-8d169b8f02b5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1272 microversion: 2.1 time: 0.246544 May 19 08:16:36.116024 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 271/518] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:35 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:36.125497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:16:36.130083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:16:36.200331 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5965fc4e-a2f2-495a-a601-b7a102edc2cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.739671 May 19 08:16:36.201651 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 248/519] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:16:36.216767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-13be7dc4-1f5a-4be9-8d6e-f8d2ce993339 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-13be7dc4-1f5a-4be9-8d6e-f8d2ce993339 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Request method failure captured: May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792/action HTTP/1.1 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 31 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfy355Eumpb6y_iCGZOOSa_XLrdg42l5HD1b12N3ArhGAT27oL5CLKGWYBzMQ0vMZxprlSLtqpkIJS5eIsJwq9ciTpmp94afM6pchtF3P_bX6fbVEpyqqZChloh2Mq63XeniU3uSyAURp5_6uQdklLeS1A3zm94rRCQAX95X8R1oK7s May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: efca41309cf648cd883a21d5f4a5cf83 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: {"os-resetState": {"state": 1}} May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'a31cad69-9458-48a2-b3d5-85288d047792', 'body': {'os-resetState': {'state': 1}}} May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 1 May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 19 08:16:36.229033 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-13be7dc4-1f5a-4be9-8d6e-f8d2ce993339 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:36.233882 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-13be7dc4-1f5a-4be9-8d6e-f8d2ce993339 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792/action" status: 400 len: 120 microversion: 2.1 time: 0.027610 May 19 08:16:36.244386 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 249/520] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:36 2022] POST /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792/action => generated 120 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:36.471854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-678e0edf-fff5-40aa-9061-88d9a281200b tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] Action: 'create', calling method: .version_select at 0x7f321270cdc0>, body: {"security_group": {"name": "tempest-securitygroup-1652463903", "description": "tempest-description-1996371710"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:36.483475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-363c5810-4145-49e0-9bf6-f9747a59a74e tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Calling method '.version_select at 0x7f321258f430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:36.485930 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:36.485930 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:36.492536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-363c5810-4145-49e0-9bf6-f9747a59a74e tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:36.500591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-363c5810-4145-49e0-9bf6-f9747a59a74e tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:36.501667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-363c5810-4145-49e0-9bf6-f9747a59a74e tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:36.502269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-363c5810-4145-49e0-9bf6-f9747a59a74e tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:36.586311 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-363c5810-4145-49e0-9bf6-f9747a59a74e tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.466277 May 19 08:16:36.587338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 272/521] 10.222.0.78 () {58 vars in 1127 bytes} [Thu May 19 08:16:36 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:36.600798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1217751c-c201-4091-96e5-e8373a23d7f3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:36.609449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1217751c-c201-4091-96e5-e8373a23d7f3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:36.707620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1217751c-c201-4091-96e5-e8373a23d7f3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:36.721729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1217751c-c201-4091-96e5-e8373a23d7f3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1216 microversion: 2.1 time: 0.132843 May 19 08:16:36.724119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 273/522] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:36 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:36.778377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6c808a6-30f0-4f44-9a51-e45c2a501d81 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:36.783022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6c808a6-30f0-4f44-9a51-e45c2a501d81 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Failed to fetch instance by id 999 {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:16:36.786500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c6c808a6-30f0-4f44-9a51-e45c2a501d81 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] HTTP exception thrown: Instance 999 could not be found. May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6c808a6-30f0-4f44-9a51-e45c2a501d81 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Request method failure captured: May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 37 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfy355Eumpb6y_iCGZOOSa_XLrdg42l5HD1b12N3ArhGAT27oL5CLKGWYBzMQ0vMZxprlSLtqpkIJS5eIsJwq9ciTpmp94afM6pchtF3P_bX6fbVEpyqqZChloh2Mq63XeniU3uSyAURp5_6uQdklLeS1A3zm94rRCQAX95X8R1oK7s May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4625ac1b17fc46fdbeb8a113ee7a302b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4625ac1b17fc46fdbeb8a113ee7a302b May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1255983720 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: efca41309cf648cd883a21d5f4a5cf83 May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1255983720-project-admin May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: {"os-resetState": {"state": "error"}} May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 999 could not be found. May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:36.810150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:36.815531 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:36.815531 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 19 08:16:36.815531 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:36.815531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6c808a6-30f0-4f44-9a51-e45c2a501d81 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:36.815531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6c808a6-30f0-4f44-9a51-e45c2a501d81 tempest-ServersAdminNegativeTestJSON-1255983720 tempest-ServersAdminNegativeTestJSON-1255983720-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.085868 May 19 08:16:36.817644 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 274/523] 10.222.0.78 () {60 vars in 1178 bytes} [Thu May 19 08:16:36 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:36.828407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:36.829604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:36.847838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:36.848329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:36.849207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:36.855850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.271124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:37.285657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a51dc29-f92c-48a1-af19-024803b539e0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1494 microversion: 2.1 time: 0.461563 May 19 08:16:37.298186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 275/524] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:36 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1494 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:37.326235 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-678e0edf-fff5-40aa-9061-88d9a281200b tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.078141 May 19 08:16:37.329192 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 250/525] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:36 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:37.342112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:37.348610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:37.360801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:37.367130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.370668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:37.372595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.430986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:16:37.555092 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bd5a5002-493e-4629-9ccb-3ca7b5fbdc6c tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 204 len: 0 microversion: 2.1 time: 0.215630 May 19 08:16:37.555812 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 251/526] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:37 2022] DELETE /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:37.565454 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:37.566985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:37.577477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:37.578315 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.580563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:37.581575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.665193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b362b7bb-131f-4347-8ba4-3b566209a662 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Calling method '.version_select at 0x7f321256cf70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:37.666984 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:37.666984 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:37.669611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b362b7bb-131f-4347-8ba4-3b566209a662 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'dd8f53441a154466a009dbf4fe03a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ec19b1738c4f2d8730165cab7a6829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b362b7bb-131f-4347-8ba4-3b566209a662 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Request method failure captured: May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzhL4nBdbMWSbpzTXGJIxkCBTLNcGZ207BmIBEsD837xL-S4bFl3fHOj14ALmW_8NQ2RWlPIfBflyVRgx8YytCU_-KwpIN3cpMxd17gn38Ktr-NDfzO-XDoZZn310P9eWhQ4jGdBsoixIteT-8_B8PVngl0wXFMr0dL1AmPBPh9iDE May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dd8f53441a154466a009dbf4fe03a8c0 May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:37.672367 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 19 08:16:37.676714 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:37.679268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b362b7bb-131f-4347-8ba4-3b566209a662 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:37.680481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b362b7bb-131f-4347-8ba4-3b566209a662 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.380106 May 19 08:16:37.681163 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 276/527] 10.222.0.78 () {58 vars in 1127 bytes} [Thu May 19 08:16:37 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:37.694645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:37.696279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:37.733289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:37.742639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.743660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:37.744123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:37.901271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:37.919046 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bb84b2ce-9ea9-4a32-a0e1-805b798cd2ba tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1389 microversion: 2.1 time: 0.360538 May 19 08:16:37.920244 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 252/528] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:37 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1389 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:38.054279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:38.069105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdd9aba0-2c28-4b4f-bea4-2dbf093548d8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1312 microversion: 2.1 time: 0.386648 May 19 08:16:38.082587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 277/529] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:37 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:38.089711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1318ea0-da60-4bb1-b345-e7522de76f4d tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] Action: 'create', calling method: .version_select at 0x7f3212555dc0>, body: {"security_group": {"name": "tempest-securitygroup-758714707", "description": "tempest-description-2146505387"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:38.265708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:38.266492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:38.275797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.276607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.278035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.278786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.487239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1318ea0-da60-4bb1-b345-e7522de76f4d tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.399135 May 19 08:16:38.489294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 278/530] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:38 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:38.495928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:38.497606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:38.508607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.509603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.511890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.513214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.632949 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5ddceb6e-2356-4de3-9b01-cfa77bdcdd25 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1645 microversion: 2.1 time: 0.711136 May 19 08:16:38.634541 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 253/531] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:37 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1645 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:38.639799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85587bcf-ca45-4be5-8caa-76e2cb6ff512 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Calling method '.version_select at 0x7f32125923a0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:38.640964 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:38.640964 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:38.642890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-85587bcf-ca45-4be5-8caa-76e2cb6ff512 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'dd8f53441a154466a009dbf4fe03a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ec19b1738c4f2d8730165cab7a6829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85587bcf-ca45-4be5-8caa-76e2cb6ff512 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Request method failure captured: May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hosts/chdv-842464-2/reboot HTTP/1.1 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzhL4nBdbMWSbpzTXGJIxkCBTLNcGZ207BmIBEsD837xL-S4bFl3fHOj14ALmW_8NQ2RWlPIfBflyVRgx8YytCU_-KwpIN3cpMxd17gn38Ktr-NDfzO-XDoZZn310P9eWhQ4jGdBsoixIteT-8_B8PVngl0wXFMr0dL1AmPBPh9iDE May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: dd8f53441a154466a009dbf4fe03a8c0 May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'chdv-842464-2'} May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:38.645684 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:38.650398 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:38.650398 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:38.650398 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:38.650398 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:38.650398 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 19 08:16:38.650398 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:38.653630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85587bcf-ca45-4be5-8caa-76e2cb6ff512 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:38.654768 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-85587bcf-ca45-4be5-8caa-76e2cb6ff512 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/chdv-842464-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018876 May 19 08:16:38.662629 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 254/532] 10.222.0.78 () {58 vars in 1190 bytes} [Thu May 19 08:16:38 2022] GET /compute/v2.1/os-hosts/chdv-842464-2/reboot => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:38.670825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:38.671812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:38.681538 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.682524 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.683572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.684252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.865813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:38.875224 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1869394d-ae32-415e-be48-ee9835b84294 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1268 microversion: 2.1 time: 0.210866 May 19 08:16:38.875821 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 255/533] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:38 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:38.927445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:38.944047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef8460a0-fff2-4a89-bcf7-b9868f237135 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 200 len: 1469 microversion: 2.1 time: 0.453139 May 19 08:16:38.956330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 279/534] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:38 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 1469 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:38.966704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:38.972309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:38.987318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.991668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:38.992709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:38.993720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:39.267713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-39a2c24b-de77-4a29-b979-f2da9db8b9b0 tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] Action: 'create', calling method: .version_select at 0x7f3212592a60>, body: {"security_group": {"name": "tempest-securitygroup-598741131", "description": "tempest-description-999078051"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:39.652329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4043c765-f3bb-4560-ab69-ef9afa8b4f31 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1645 microversion: 2.1 time: 0.694553 May 19 08:16:39.661591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 280/535] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:38 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1645 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:39.670597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aab966b6-dde1-4d1b-90a8-e93c663f523b tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Calling method '.version_select at 0x7f32124b98b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:39.671811 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:39.671811 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:39.688986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-aab966b6-dde1-4d1b-90a8-e93c663f523b tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aab966b6-dde1-4d1b-90a8-e93c663f523b tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'nonexistent_hostname'} May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:39.691775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aab966b6-dde1-4d1b-90a8-e93c663f523b tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:39.696403 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aab966b6-dde1-4d1b-90a8-e93c663f523b tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.031343 May 19 08:16:39.701802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 281/536] 10.222.0.78 () {58 vars in 1211 bytes} [Thu May 19 08:16:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:39.707436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bcd98ead-1cb6-4f41-95d1-3605f09e63e8 req-e6e7c50c-fc21-497b-96a0-e615ca128e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c58c656-8f86-4a69-85ce-778327a4118e", "tag": "dd5a186c-59ec-41aa-992d-1ff94f5fc79c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:39.722329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bcd98ead-1cb6-4f41-95d1-3605f09e63e8 req-e6e7c50c-fc21-497b-96a0-e615ca128e61 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:39.723288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bcd98ead-1cb6-4f41-95d1-3605f09e63e8 req-e6e7c50c-fc21-497b-96a0-e615ca128e61 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:39.736277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bcd98ead-1cb6-4f41-95d1-3605f09e63e8 req-e6e7c50c-fc21-497b-96a0-e615ca128e61 service nova] Creating event network-changed:dd5a186c-59ec-41aa-992d-1ff94f5fc79c for instance 7c58c656-8f86-4a69-85ce-778327a4118e on chh2-842464-2 May 19 08:16:39.750758 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bcd98ead-1cb6-4f41-95d1-3605f09e63e8 req-e6e7c50c-fc21-497b-96a0-e615ca128e61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047337 May 19 08:16:39.755455 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 282/537] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:39.760798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2ce4229e-766f-4b1f-ab75-ff0d898a6a39 req-34ca7a7b-6762-4e1d-b3cb-4a76c9735aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e73b117-8cc4-43db-a810-618ca851c6e2", "tag": "7994c7b7-4412-4f8d-a104-920b64ccfec2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:39.776052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2ce4229e-766f-4b1f-ab75-ff0d898a6a39 req-34ca7a7b-6762-4e1d-b3cb-4a76c9735aef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:39.776869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2ce4229e-766f-4b1f-ab75-ff0d898a6a39 req-34ca7a7b-6762-4e1d-b3cb-4a76c9735aef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:39.790444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2ce4229e-766f-4b1f-ab75-ff0d898a6a39 req-34ca7a7b-6762-4e1d-b3cb-4a76c9735aef service nova] Creating event network-changed:7994c7b7-4412-4f8d-a104-920b64ccfec2 for instance 3e73b117-8cc4-43db-a810-618ca851c6e2 on chh2-842464-2 May 19 08:16:39.796324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2ce4229e-766f-4b1f-ab75-ff0d898a6a39 req-34ca7a7b-6762-4e1d-b3cb-4a76c9735aef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039466 May 19 08:16:39.797175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 283/538] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:39.805757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:39.806705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:39.813755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:39.814485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:39.825180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:39.825939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:40.617566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:40.631460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01a77c97-8723-4a7f-8483-649cab455686 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1389 microversion: 2.1 time: 0.832833 May 19 08:16:40.632098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 284/539] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:39 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1389 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:40.641981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:40.644460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:40.662051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:40.662797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:40.663801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:40.664288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:40.726665 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-39a2c24b-de77-4a29-b979-f2da9db8b9b0 tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.842701 May 19 08:16:40.729955 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 256/540] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:38 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:40.736798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-24d75d38-8f4d-4e74-9af0-f373dba50181 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:40.740893 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:40.740893 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:40.742534 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24d75d38-8f4d-4e74-9af0-f373dba50181 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:40.744675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24d75d38-8f4d-4e74-9af0-f373dba50181 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:40.746389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24d75d38-8f4d-4e74-9af0-f373dba50181 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:40.747019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24d75d38-8f4d-4e74-9af0-f373dba50181 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:40.761762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=11 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:40.836091 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-24d75d38-8f4d-4e74-9af0-f373dba50181 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.103886 May 19 08:16:40.837202 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 257/541] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:16:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:40.847451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-671d33ef-0e2f-4e53-94f0-67584e19a60b tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Calling method '.version_select at 0x7f3212592670>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:40.848499 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:40.848499 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:40.850174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-671d33ef-0e2f-4e53-94f0-67584e19a60b tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'dd8f53441a154466a009dbf4fe03a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ec19b1738c4f2d8730165cab7a6829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-671d33ef-0e2f-4e53-94f0-67584e19a60b tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Request method failure captured: May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hosts/chdv-842464-2 HTTP/1.1 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzhL4nBdbMWSbpzTXGJIxkCBTLNcGZ207BmIBEsD837xL-S4bFl3fHOj14ALmW_8NQ2RWlPIfBflyVRgx8YytCU_-KwpIN3cpMxd17gn38Ktr-NDfzO-XDoZZn310P9eWhQ4jGdBsoixIteT-8_B8PVngl0wXFMr0dL1AmPBPh9iDE May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: dd8f53441a154466a009dbf4fe03a8c0 May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'chdv-842464-2'} May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:40.852811 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:40.857445 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:40.857445 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:40.857445 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:40.857445 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:40.857445 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 19 08:16:40.857445 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:40.870540 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-671d33ef-0e2f-4e53-94f0-67584e19a60b tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:40.872461 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-671d33ef-0e2f-4e53-94f0-67584e19a60b tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/chdv-842464-2" status: 403 len: 109 microversion: 2.1 time: 0.032876 May 19 08:16:40.879761 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 258/542] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:16:40 2022] GET /compute/v2.1/os-hosts/chdv-842464-2 => generated 109 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:40.908942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:40.912241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:40.937355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:40.937998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:40.939012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:40.940599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:41.081987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:41.087481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:41.098724 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9b1b6781-88f9-4f8d-80b9-99311f98c32a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1274 microversion: 2.1 time: 0.217793 May 19 08:16:41.100553 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f953cf5-23e2-4bb9-beaa-effd820ac3db tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1312 microversion: 2.1 time: 0.461753 May 19 08:16:41.108735 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 259/543] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:40 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:41.108897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 285/544] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:40 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:41.114400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:41.115025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: 5ae99d4c-8f94-4d58-9493-fc10c294e07d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:41.116772 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c3789ddd-0a17-4e22-afe8-3505f1849a33 tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] Action: 'create', calling method: .version_select at 0x7f3212592160>, body: {"security_group": {"name": "tempest-securitygroup-1006521025", "description": "tempest-description-1901081141"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:41.131969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:41.132506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:41.133491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:41.134084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:41.165607 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] HTTP exception thrown: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d could not be found. May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Request method failure captured: May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d HTTP/1.1 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfy2MH14ahrsjciNJkZ5aqcDxqLTSnoYVeM57QDVmIrT6AOsTSFjvlXTWQ_gTSuNpBjUrTOOBKEp__24JO9ob_N-iFed4DvW01zDERNObLFResFiPEeKNKUhg2bCombfKLqSVSim8DEbho759DxHeMIuj8Ai6FQ-V50euBlLYSKMlmo May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ba7ec07150584e2782994ccd2f717547 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1986386336 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba7ec07150584e2782994ccd2f717547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba7ec07150584e2782994ccd2f717547"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba7ec07150584e2782994ccd2f717547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba7ec07150584e2782994ccd2f717547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1986386336 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ba7ec07150584e2782994ccd2f717547 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1986386336 May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-1986386336-project May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f17de9a8121442b79cca9a9f3221e08a May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1986386336-project May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d could not be found. May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5ae99d4c-8f94-4d58-9493-fc10c294e07d'} May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d could not be found. May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d could not be found. May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:41.167268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d could not be found. May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Returning 404 to user: Instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:41.171100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-988377de-732c-4539-85a6-4defd3bb728b tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d" status: 404 len: 111 microversion: 2.1 time: 0.058686 May 19 08:16:41.176066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 286/545] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:41 2022] GET /compute/v2.1/servers/5ae99d4c-8f94-4d58-9493-fc10c294e07d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:41.183550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:41.184957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:41.193012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:41.209844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:41.214152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:41.215078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:41.215533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:41.277401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lazy-loading 'flavor' on Instance uuid fd25d84e-f3ec-4845-a751-609e31473949 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:16:41.292470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Going to try to live migrate instance to chh1-842464-2 {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:16:41.924539 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c3789ddd-0a17-4e22-afe8-3505f1849a33 tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.813529 May 19 08:16:41.926252 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 260/546] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:41.936947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5cbbcc91-3759-43ac-89ea-c53196ce6569 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Calling method '.version_select at 0x7f3212615dc0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:41.939262 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:41.939262 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:41.948871 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-5cbbcc91-3759-43ac-89ea-c53196ce6569 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5cbbcc91-3759-43ac-89ea-c53196ce6569 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'nonexistent_hostname'} May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:41.953557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:41.958805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:41.962531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5cbbcc91-3759-43ac-89ea-c53196ce6569 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:41.963970 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5cbbcc91-3759-43ac-89ea-c53196ce6569 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036609 May 19 08:16:41.965183 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 261/547] 10.222.0.78 () {58 vars in 1190 bytes} [Thu May 19 08:16:41 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:41.976041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:41.976774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:41.988674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:41.989774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:41.991613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:41.992394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:42.029114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:16:42.199801 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e78e2db2-a81d-478d-8f57-c1c6d464c783 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 204 len: 0 microversion: 2.1 time: 0.232762 May 19 08:16:42.200781 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 262/548] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:16:41 2022] DELETE /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:16:42.213009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:42.215004 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:42.226882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:42.227400 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:42.228649 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:42.229144 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:42.536966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:42.562283 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-49e041b8-b178-4f04-8c25-45b134befd47 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1389 microversion: 2.1 time: 0.358391 May 19 08:16:42.577388 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 263/549] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:42 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1389 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:42.768168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-81001b42-aa3f-4722-ba7b-8509467e66f4 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Action: 'update', calling method: .version_select at 0x7f32124eeee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:42.865586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=63 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:42.870704 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81001b42-aa3f-4722-ba7b-8509467e66f4 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:42.871095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81001b42-aa3f-4722-ba7b-8509467e66f4 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:42.871900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81001b42-aa3f-4722-ba7b-8509467e66f4 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:42.872406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81001b42-aa3f-4722-ba7b-8509467e66f4 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:42.898309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:42.964526 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-81001b42-aa3f-4722-ba7b-8509467e66f4 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668" status: 200 len: 240 microversion: 2.36 time: 0.391250 May 19 08:16:42.967011 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 264/550] 10.222.0.78 () {62 vars in 1302 bytes} [Thu May 19 08:16:42 2022] PUT /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668 => generated 240 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:42.975131 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-d5a8715d-b24e-4019-8390-de263035e881 req-6edc5ae9-a105-4c1b-a27a-d0f6e47f1c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae99d4c-8f94-4d58-9493-fc10c294e07d", "name": "network-vif-deleted", "tag": "957a63fb-65f7-443a-b60b-479962507214"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:42.988532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d5a8715d-b24e-4019-8390-de263035e881 req-6edc5ae9-a105-4c1b-a27a-d0f6e47f1c8a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:42.989366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d5a8715d-b24e-4019-8390-de263035e881 req-6edc5ae9-a105-4c1b-a27a-d0f6e47f1c8a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:43.006337 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-d5a8715d-b24e-4019-8390-de263035e881 req-6edc5ae9-a105-4c1b-a27a-d0f6e47f1c8a service nova] Creating event network-vif-deleted:957a63fb-65f7-443a-b60b-479962507214 for instance 5ae99d4c-8f94-4d58-9493-fc10c294e07d on chh1-842464-2 May 19 08:16:43.013784 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-d5a8715d-b24e-4019-8390-de263035e881 req-6edc5ae9-a105-4c1b-a27a-d0f6e47f1c8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043398 May 19 08:16:43.015426 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 265/551] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:43.024527 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0a93a2e8-2725-4ad7-9b2e-72a0fa4deb7f tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] Calling method '.version_select at 0x7f32125efa60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:44.368559 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b512360d-5dd7-4934-a535-54921bc31084 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949/action" status: 202 len: 0 microversion: 2.1 time: 3.193217 May 19 08:16:44.369410 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 287/552] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:41 2022] POST /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949/action => generated 0 bytes in 3195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:44.375517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3a6536b-43c5-430f-a19d-53636a27947d tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Calling method '.version_select at 0x7f32123bf940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:44.380978 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:44.380978 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:44.382457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3a6536b-43c5-430f-a19d-53636a27947d tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'dd8f53441a154466a009dbf4fe03a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ec19b1738c4f2d8730165cab7a6829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3a6536b-43c5-430f-a19d-53636a27947d tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Request method failure captured: May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hosts/chdv-842464-2/shutdown HTTP/1.1 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzhL4nBdbMWSbpzTXGJIxkCBTLNcGZ207BmIBEsD837xL-S4bFl3fHOj14ALmW_8NQ2RWlPIfBflyVRgx8YytCU_-KwpIN3cpMxd17gn38Ktr-NDfzO-XDoZZn310P9eWhQ4jGdBsoixIteT-8_B8PVngl0wXFMr0dL1AmPBPh9iDE May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dd8f53441a154466a009dbf4fe03a8c0 May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'chdv-842464-2'} May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:44.384433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:44.389141 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:44.389141 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:44.389141 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:44.389141 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:44.389141 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 19 08:16:44.389141 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:44.390729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3a6536b-43c5-430f-a19d-53636a27947d tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:44.391592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3a6536b-43c5-430f-a19d-53636a27947d tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/chdv-842464-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020948 May 19 08:16:44.392162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 288/553] 10.222.0.78 () {58 vars in 1196 bytes} [Thu May 19 08:16:44 2022] GET /compute/v2.1/os-hosts/chdv-842464-2/shutdown => generated 113 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:44.399064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:44.399680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:44.409257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:44.410186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:44.411245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:44.411705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:44.766756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:44.775456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4bb7070-f14a-42ed-aec2-ad89578f32af tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1316 microversion: 2.1 time: 0.381059 May 19 08:16:44.776055 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 289/554] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:44 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:44.780694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:44.781331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:44.788288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:44.788750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:44.789590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:44.790037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.032824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:45.041594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f46c820a-3c7f-4534-8b7f-d5862c148b35 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1312 microversion: 2.1 time: 0.264438 May 19 08:16:45.042185 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 290/555] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:44 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:45.046818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:45.047429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:45.054380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.054830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.055608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.056041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.134717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f17de9a8121442b79cca9a9f3221e08a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7ec07150584e2782994ccd2f717547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:45.142709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81faf8ae-723b-47c4-b07c-d1df049a33ff tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 200 len: 1434 microversion: 2.1 time: 0.099431 May 19 08:16:45.143312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 291/556] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:45 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 1434 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:45.148732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ebca55d6-eddc-4b64-a464-1db78a72165d tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Calling method '.version_select at 0x7f3212363b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:45.219742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebca55d6-eddc-4b64-a464-1db78a72165d tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.220341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebca55d6-eddc-4b64-a464-1db78a72165d tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.221954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebca55d6-eddc-4b64-a464-1db78a72165d tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.222518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebca55d6-eddc-4b64-a464-1db78a72165d tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.247933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ebca55d6-eddc-4b64-a464-1db78a72165d tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668/detail" status: 200 len: 672 microversion: 2.36 time: 0.103165 May 19 08:16:45.249295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 292/557] 10.222.0.78 () {60 vars in 1303 bytes} [Thu May 19 08:16:45 2022] GET /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668/detail => generated 672 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:45.254500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ace13ae7-e904-4541-9687-3680658ae3ba req-72384774-9043-4601-b10a-ade09fdb564e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ffa61b1-599a-419f-b13c-80555e11be0d", "tag": "709f676f-c0cd-4844-b149-76891d92ab2b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:45.263453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ace13ae7-e904-4541-9687-3680658ae3ba req-72384774-9043-4601-b10a-ade09fdb564e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.263939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ace13ae7-e904-4541-9687-3680658ae3ba req-72384774-9043-4601-b10a-ade09fdb564e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.277328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ace13ae7-e904-4541-9687-3680658ae3ba req-72384774-9043-4601-b10a-ade09fdb564e service nova] Creating event network-changed:709f676f-c0cd-4844-b149-76891d92ab2b for instance 5ffa61b1-599a-419f-b13c-80555e11be0d on chh1-842464-2 May 19 08:16:45.282605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ace13ae7-e904-4541-9687-3680658ae3ba req-72384774-9043-4601-b10a-ade09fdb564e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031863 May 19 08:16:45.283903 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 293/558] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:45.289254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:45.290135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:45.297399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.297915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.298772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.299407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.593651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:45.604590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06c9ef0e-4cae-440f-b325-680170a12700 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1389 microversion: 2.1 time: 0.319400 May 19 08:16:45.607956 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 294/559] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:45 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1389 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:45.619479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:45.620097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:45.631354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.631944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.633222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:45.633957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:45.654305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:45.938181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:45.947110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db56974e-129c-43f1-bda9-50c57c7eaa8a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.337958 May 19 08:16:45.958253 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 295/560] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:45 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:45.963174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-111269e6-8c77-469a-9283-ff1a852f0c54 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Calling method '.version_select at 0x7f3212555af0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:45.964245 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:45.964245 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:45.984219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-111269e6-8c77-469a-9283-ff1a852f0c54 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-111269e6-8c77-469a-9283-ff1a852f0c54 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'nonexistent_hostname'} May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:45.990013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:45.999627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.006335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-111269e6-8c77-469a-9283-ff1a852f0c54 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:46.008077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-111269e6-8c77-469a-9283-ff1a852f0c54 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.048155 May 19 08:16:46.015191 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 296/561] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:16:45 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:46.027619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Action: 'update', calling method: .version_select at 0x7f32123bfd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:46.154196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.155045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.155852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.156477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.202769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.203543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.204537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.205812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.276292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bcb815de-ecb5-431f-8802-1bc7e139ca79 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668?user_id=48b8870a8a324fc2ac848ba76f2e29eb" status: 200 len: 240 microversion: 2.36 time: 0.263782 May 19 08:16:46.278794 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 297/562] 10.222.0.78 () {62 vars in 1383 bytes} [Thu May 19 08:16:46 2022] PUT /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668?user_id=48b8870a8a324fc2ac848ba76f2e29eb => generated 240 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:46.284284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c459a342-2868-43c5-aa61-74a7669aa098 req-db3a79f4-091e-4bb8-9be5-ff03d04c3e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c58c656-8f86-4a69-85ce-778327a4118e", "name": "network-vif-plugged", "status": "completed", "tag": "dd5a186c-59ec-41aa-992d-1ff94f5fc79c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:46.297962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c459a342-2868-43c5-aa61-74a7669aa098 req-db3a79f4-091e-4bb8-9be5-ff03d04c3e3b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.298405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c459a342-2868-43c5-aa61-74a7669aa098 req-db3a79f4-091e-4bb8-9be5-ff03d04c3e3b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.310957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c459a342-2868-43c5-aa61-74a7669aa098 req-db3a79f4-091e-4bb8-9be5-ff03d04c3e3b service nova] Creating event network-vif-plugged:dd5a186c-59ec-41aa-992d-1ff94f5fc79c for instance 7c58c656-8f86-4a69-85ce-778327a4118e on chh2-842464-2 May 19 08:16:46.316819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c459a342-2868-43c5-aa61-74a7669aa098 req-db3a79f4-091e-4bb8-9be5-ff03d04c3e3b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038680 May 19 08:16:46.317468 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 298/563] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:46.323104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.323980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:46.330884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.331340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.332118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.332549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.511647 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0a93a2e8-2725-4ad7-9b2e-72a0fa4deb7f tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10815 microversion: 2.1 time: 3.494454 May 19 08:16:46.520799 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 266/564] 10.222.0.78 () {58 vars in 1190 bytes} [Thu May 19 08:16:43 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10815 bytes in 3496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:46.520799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c55bf91-c058-4ef6-a78e-3291d0e73543 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Calling method '.version_select at 0x7f32124eeb80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.520799 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:46.520799 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:46.522368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1c55bf91-c058-4ef6-a78e-3291d0e73543 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'dd8f53441a154466a009dbf4fe03a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ec19b1738c4f2d8730165cab7a6829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c55bf91-c058-4ef6-a78e-3291d0e73543 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Request method failure captured: May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-hosts/chdv-842464-2/startup HTTP/1.1 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzhL4nBdbMWSbpzTXGJIxkCBTLNcGZ207BmIBEsD837xL-S4bFl3fHOj14ALmW_8NQ2RWlPIfBflyVRgx8YytCU_-KwpIN3cpMxd17gn38Ktr-NDfzO-XDoZZn310P9eWhQ4jGdBsoixIteT-8_B8PVngl0wXFMr0dL1AmPBPh9iDE May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: dd8f53441a154466a009dbf4fe03a8c0 May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'chdv-842464-2'} May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:46.523789 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c55bf91-c058-4ef6-a78e-3291d0e73543 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1c55bf91-c058-4ef6-a78e-3291d0e73543 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/chdv-842464-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.011578 May 19 08:16:46.528229 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 267/565] 10.222.0.78 () {58 vars in 1193 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/os-hosts/chdv-842464-2/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:46.534327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.534971 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:46.542556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.543164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.543987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.544436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.590684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:46.600306 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-396f55c0-b121-47db-8df8-dd171b3efb1c tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1316 microversion: 2.1 time: 0.280728 May 19 08:16:46.601254 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 299/566] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:46.606655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.607270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] [instance: a31cad69-9458-48a2-b3d5-85288d047792] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:46.614288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.614729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.615500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.615930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.631911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] HTTP exception thrown: Instance a31cad69-9458-48a2-b3d5-85288d047792 could not be found. May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Request method failure captured: May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 HTTP/1.1 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfy2MH14ahrsjciNJkZ5aqcDxqLTSnoYVeM57QDVmIrT6AOsTSFjvlXTWQ_gTSuNpBjUrTOOBKEp__24JO9ob_N-iFed4DvW01zDERNObLFResFiPEeKNKUhg2bCombfKLqSVSim8DEbho759DxHeMIuj8Ai6FQ-V50euBlLYSKMlmo May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ba7ec07150584e2782994ccd2f717547 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1986386336 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba7ec07150584e2782994ccd2f717547"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba7ec07150584e2782994ccd2f717547"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba7ec07150584e2782994ccd2f717547"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba7ec07150584e2782994ccd2f717547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1986386336 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ba7ec07150584e2782994ccd2f717547 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1986386336 May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-1986386336-project May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f17de9a8121442b79cca9a9f3221e08a May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1986386336-project May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance a31cad69-9458-48a2-b3d5-85288d047792 could not be found. May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a31cad69-9458-48a2-b3d5-85288d047792'} May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a31cad69-9458-48a2-b3d5-85288d047792 could not be found. May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a31cad69-9458-48a2-b3d5-85288d047792 could not be found. May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.633602 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a31cad69-9458-48a2-b3d5-85288d047792 could not be found. May 19 08:16:46.637750 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.638686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] Returning 404 to user: Instance a31cad69-9458-48a2-b3d5-85288d047792 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:46.639211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90a0c1df-2f51-461a-a80d-34575042a493 tempest-ServersAdminNegativeTestJSON-1986386336 tempest-ServersAdminNegativeTestJSON-1986386336-project] 10.222.0.78 "GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792" status: 404 len: 111 microversion: 2.1 time: 0.036451 May 19 08:16:46.639969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 300/567] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/servers/a31cad69-9458-48a2-b3d5-85288d047792 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:46.656127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6b4864a-f515-4b56-8938-75a1a1ddbe88 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] Calling method '.version_select at 0x7f321235f3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.740364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:46.748712 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-931005c3-8006-417d-b1e3-b2db776a2ea6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1312 microversion: 2.1 time: 0.221469 May 19 08:16:46.753430 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 268/568] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:46.767074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65b0f1c8-6351-43f2-9e2a-5c1062d7156d tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] Calling method '.version_select at 0x7f32126158b0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.795729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6b4864a-f515-4b56-8938-75a1a1ddbe88 tempest-QuotasAdminTestV236-191553002 tempest-QuotasAdminTestV236-191553002-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668?user_id=48b8870a8a324fc2ac848ba76f2e29eb" status: 200 len: 282 microversion: 2.36 time: 0.154629 May 19 08:16:46.796504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 301/569] 10.222.0.78 () {60 vars in 1363 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/os-quota-sets/59a4e84c7ea742e1a54a5214241b1668?user_id=48b8870a8a324fc2ac848ba76f2e29eb => generated 282 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:16:46.805901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80d99394-40f6-4ed7-b092-d6d3f227872c tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Calling method '.version_select at 0x7f32123bf280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.806811 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:46.806811 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:46.827939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-80d99394-40f6-4ed7-b092-d6d3f227872c tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80d99394-40f6-4ed7-b092-d6d3f227872c tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'nonexistent_hostname'} May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:46.830067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:46.837180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:46.839995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80d99394-40f6-4ed7-b092-d6d3f227872c tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:46.841022 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80d99394-40f6-4ed7-b092-d6d3f227872c tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.040927 May 19 08:16:46.841688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 302/570] 10.222.0.78 () {58 vars in 1214 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:46.851880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:46.853374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:46.869463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.869921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:46.870708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:46.871147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.155043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:47.164187 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-65b0f1c8-6351-43f2-9e2a-5c1062d7156d tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.409101 May 19 08:16:47.165694 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 269/571] 10.222.0.78 () {58 vars in 1190 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:47.168860 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5df63d9a-a781-4cf1-adc2-341b9fd64be8 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1389 microversion: 2.1 time: 0.319993 May 19 08:16:47.171717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 303/572] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:46 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1389 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:47.171991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6aef3ea7-d733-4d23-819c-3b283c04faad req-ae90cc94-e068-4587-8048-fbd2819e12f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd25d84e-f3ec-4845-a751-609e31473949", "name": "network-vif-unplugged", "status": "completed", "tag": "4d3cebd2-0571-4120-b6e1-f2e22fcf9194"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:47.183823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19378b64-9bde-4f79-bf6e-ad56d2ed4f86 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Action: 'update', calling method: .version_select at 0x7f3212555790>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19378b64-9bde-4f79-bf6e-ad56d2ed4f86 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-hosts/chdv-842464-2 HTTP/1.1 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 51 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: {"status": "enable", "maintenance_mode": "invalid"} May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'chdv-842464-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'disable', May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'Enable', May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'Disable', May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'ENABLE', May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance: May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'invalid' May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:47.190869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.195553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.196447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6aef3ea7-d733-4d23-819c-3b283c04faad req-ae90cc94-e068-4587-8048-fbd2819e12f5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.196447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6aef3ea7-d733-4d23-819c-3b283c04faad req-ae90cc94-e068-4587-8048-fbd2819e12f5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.199924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19378b64-9bde-4f79-bf6e-ad56d2ed4f86 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:47.202209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19378b64-9bde-4f79-bf6e-ad56d2ed4f86 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/chdv-842464-2" status: 400 len: 199 microversion: 2.1 time: 0.028952 May 19 08:16:47.204386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 304/573] 10.222.0.78 () {60 vars in 1189 bytes} [Thu May 19 08:16:47 2022] PUT /compute/v2.1/os-hosts/chdv-842464-2 => generated 199 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:47.212955 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6aef3ea7-d733-4d23-819c-3b283c04faad req-ae90cc94-e068-4587-8048-fbd2819e12f5 service nova] Creating event network-vif-unplugged:4d3cebd2-0571-4120-b6e1-f2e22fcf9194 for instance fd25d84e-f3ec-4845-a751-609e31473949 on chh2-842464-2 May 19 08:16:47.215144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:47.218246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:47.221146 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6aef3ea7-d733-4d23-819c-3b283c04faad req-ae90cc94-e068-4587-8048-fbd2819e12f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052892 May 19 08:16:47.222284 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 270/574] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:47.230671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-884618e5-dcb6-4ce7-a222-f91bd56e7a20 tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] Calling method '.version_select at 0x7f321258f4c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:47.239283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.240222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.241298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.244408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.524335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:47.534187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff0213e5-c86d-4c9a-ae8f-44b7822e504c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.326662 May 19 08:16:47.544648 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 305/575] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:47 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:47.549948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c5aea2f-dd32-4c99-b1ed-0cbb6843a907 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Action: 'update', calling method: .version_select at 0x7f321235f040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c5aea2f-dd32-4c99-b1ed-0cbb6843a907 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-hosts/chdv-842464-2 HTTP/1.1 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 51 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: {"status": "invalid", "maintenance_mode": "enable"} May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'chdv-842464-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'disable', May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'Enable', May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'Disable', May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'ENABLE', May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance: May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'invalid' May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:47.553383 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 19 08:16:47.558841 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.561683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c5aea2f-dd32-4c99-b1ed-0cbb6843a907 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:47.562889 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c5aea2f-dd32-4c99-b1ed-0cbb6843a907 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/chdv-842464-2" status: 400 len: 189 microversion: 2.1 time: 0.017135 May 19 08:16:47.568115 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 306/576] 10.222.0.78 () {60 vars in 1189 bytes} [Thu May 19 08:16:47 2022] PUT /compute/v2.1/os-hosts/chdv-842464-2 => generated 189 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:47.573815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e056adbd-87b3-4305-b406-990412c4db31 req-43a0bce9-8b21-4269-aed3-4435e1904d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a31cad69-9458-48a2-b3d5-85288d047792", "name": "network-vif-deleted", "tag": "db19370b-0509-4a3d-82c6-489e570e7238"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:47.585081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e056adbd-87b3-4305-b406-990412c4db31 req-43a0bce9-8b21-4269-aed3-4435e1904d9d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.589602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e056adbd-87b3-4305-b406-990412c4db31 req-43a0bce9-8b21-4269-aed3-4435e1904d9d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.603041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e056adbd-87b3-4305-b406-990412c4db31 req-43a0bce9-8b21-4269-aed3-4435e1904d9d service nova] Creating event network-vif-deleted:db19370b-0509-4a3d-82c6-489e570e7238 for instance a31cad69-9458-48a2-b3d5-85288d047792 on chh1-842464-2 May 19 08:16:47.609136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e056adbd-87b3-4305-b406-990412c4db31 req-43a0bce9-8b21-4269-aed3-4435e1904d9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039453 May 19 08:16:47.610542 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 307/577] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:47.617251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-236c6b36-1fd8-4fda-a464-c3db35a37117 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Action: 'update', calling method: .version_select at 0x7f321262fe50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:47.618945 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:47.618945 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:47.620567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-236c6b36-1fd8-4fda-a464-c3db35a37117 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'dd8f53441a154466a009dbf4fe03a8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ec19b1738c4f2d8730165cab7a6829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-236c6b36-1fd8-4fda-a464-c3db35a37117 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Request method failure captured: May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-hosts/chdv-842464-2 HTTP/1.1 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 50 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzhL4nBdbMWSbpzTXGJIxkCBTLNcGZ207BmIBEsD837xL-S4bFl3fHOj14ALmW_8NQ2RWlPIfBflyVRgx8YytCU_-KwpIN3cpMxd17gn38Ktr-NDfzO-XDoZZn310P9eWhQ4jGdBsoixIteT-8_B8PVngl0wXFMr0dL1AmPBPh9iDE May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1ec19b1738c4f2d8730165cab7a6829"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e1ec19b1738c4f2d8730165cab7a6829 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-346069002 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dd8f53441a154466a009dbf4fe03a8c0 May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-346069002-project May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: {"status": "enable", "maintenance_mode": "enable"} May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'chdv-842464-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 19 08:16:47.623304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 19 08:16:47.627263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.629647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-236c6b36-1fd8-4fda-a464-c3db35a37117 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:47.631471 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-236c6b36-1fd8-4fda-a464-c3db35a37117 tempest-HostsAdminNegativeTestJSON-346069002 tempest-HostsAdminNegativeTestJSON-346069002-project] 10.222.0.78 "PUT /compute/v2.1/os-hosts/chdv-842464-2" status: 403 len: 111 microversion: 2.1 time: 0.019098 May 19 08:16:47.637998 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 308/578] 10.222.0.78 () {60 vars in 1189 bytes} [Thu May 19 08:16:47 2022] PUT /compute/v2.1/os-hosts/chdv-842464-2 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:47.653397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:47.654921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:47.665876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.666485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.667409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.668363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.910436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:47.921749 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-884618e5-dcb6-4ce7-a222-f91bd56e7a20 tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/6726747b-c502-4854-81a9-c3bc347277e8" status: 202 len: 0 microversion: 2.1 time: 0.697536 May 19 08:16:47.925930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c698af7-6058-4ea9-bf8b-2e26037147ca tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1316 microversion: 2.1 time: 0.285738 May 19 08:16:47.927126 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 271/579] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:16:47 2022] DELETE /compute/v2.1/os-security-groups/6726747b-c502-4854-81a9-c3bc347277e8 => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:47.927339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 309/580] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:47 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:47.933664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d0ba70f-f4f7-494c-a638-a81924b64b10 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Action: 'update', calling method: .version_select at 0x7f321235fd30>, body: {"status": null, "maintenance_mode": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:47.936469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:47.936469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d0ba70f-f4f7-494c-a638-a81924b64b10 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-hosts/chdv-842464-2 HTTP/1.1 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 42 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: {"status": null, "maintenance_mode": null} May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'chdv-842464-2', 'body': {'status': None, 'maintenance_mode': None}} May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'disable', May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'Enable', May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'Disable', May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'ENABLE', May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance: May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi None May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:16:47.936659 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 19 08:16:47.940911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:16:47.947967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d0ba70f-f4f7-494c-a638-a81924b64b10 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:47.949993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d0ba70f-f4f7-494c-a638-a81924b64b10 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/chdv-842464-2" status: 400 len: 127 microversion: 2.1 time: 0.021182 May 19 08:16:47.955606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 310/581] 10.222.0.78 () {60 vars in 1189 bytes} [Thu May 19 08:16:47 2022] PUT /compute/v2.1/os-hosts/chdv-842464-2 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:16:47.957697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.958556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.959634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:47.960116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:47.964107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e32fdde-c8c5-4821-809a-15a1d7e4addc tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] Calling method '.version_select at 0x7f321235f160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:48.263307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:48.290877 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4c5010e6-42b9-4ddc-be92-52a89681f893 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1312 microversion: 2.1 time: 0.362032 May 19 08:16:48.294274 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 272/582] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:47 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:48.311551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10b140d8-03bb-47c2-b67e-45595b89e5d4 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Action: 'update', calling method: .version_select at 0x7f32124aef70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:48.313021 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:48.313021 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:48.313940 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.hosts [None req-10b140d8-03bb-47c2-b67e-45595b89e5d4 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Enabling host nonexistent_hostname. May 19 08:16:48.329174 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-10b140d8-03bb-47c2-b67e-45595b89e5d4 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10b140d8-03bb-47c2-b67e-45595b89e5d4 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Request method failure captured: May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 50 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzjOas7IvP6S9lTy7F9a2yeT10cr9m-2XK8Kdcn5MgpWIHbN44VYlj8RfCpaER53MfIJIUID7w40uLpGiITG9wUDp20pOGFdg-7vSX8m4UzLkEzzMuyBuWjNKZfbxkjSZYn-6p3DHv9LR61JrS3cnyJ3j8gnB8qXCvn9XqOyyiQjss May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b8599b2c67f4815a99aa6de06e42624"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 4b8599b2c67f4815a99aa6de06e42624 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1491019827 May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: e16db194396d49b7819e1df017d4573a May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1491019827-project-admin May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: {"status": "enable", "maintenance_mode": "enable"} May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:48.332536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 19 08:16:48.336503 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:48.339367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10b140d8-03bb-47c2-b67e-45595b89e5d4 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:48.340324 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-10b140d8-03bb-47c2-b67e-45595b89e5d4 tempest-HostsAdminNegativeTestJSON-1491019827 tempest-HostsAdminNegativeTestJSON-1491019827-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.045042 May 19 08:16:48.345021 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 273/583] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:16:48 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:16:48.350321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:48.351184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:48.360640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:48.361460 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:48.362560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:48.363321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:48.657911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e32fdde-c8c5-4821-809a-15a1d7e4addc tempest-SecurityGroupsTestAdminJSON-112684554 tempest-SecurityGroupsTestAdminJSON-112684554-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4a727198-4afd-4204-b3d3-4f691e8f8d4a" status: 202 len: 0 microversion: 2.1 time: 0.698639 May 19 08:16:48.661986 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 311/584] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:16:47 2022] DELETE /compute/v2.1/os-security-groups/4a727198-4afd-4204-b3d3-4f691e8f8d4a => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:48.667015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fa4b768b-4b07-4d4b-ba8f-c2a434c61048 req-adf3e356-7d72-48c1-8b70-3b067385a277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73b117-8cc4-43db-a810-618ca851c6e2", "name": "network-vif-plugged", "status": "completed", "tag": "7994c7b7-4412-4f8d-a104-920b64ccfec2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:48.682984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fa4b768b-4b07-4d4b-ba8f-c2a434c61048 req-adf3e356-7d72-48c1-8b70-3b067385a277 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:48.694128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fa4b768b-4b07-4d4b-ba8f-c2a434c61048 req-adf3e356-7d72-48c1-8b70-3b067385a277 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:48.709895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fa4b768b-4b07-4d4b-ba8f-c2a434c61048 req-adf3e356-7d72-48c1-8b70-3b067385a277 service nova] Creating event network-vif-plugged:7994c7b7-4412-4f8d-a104-920b64ccfec2 for instance 3e73b117-8cc4-43db-a810-618ca851c6e2 on chh2-842464-2 May 19 08:16:48.716390 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fa4b768b-4b07-4d4b-ba8f-c2a434c61048 req-adf3e356-7d72-48c1-8b70-3b067385a277 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052871 May 19 08:16:48.717325 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 312/585] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:48.723003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:48.723717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:48.730497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:48.730983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:48.732046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:48.732520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:48.791626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:48.799532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:48.809900 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d039e3e5-a9d8-4bb5-a5fc-e79fc796ba73 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1588 microversion: 2.1 time: 0.467322 May 19 08:16:48.826790 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 274/586] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:48 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1588 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:48.842214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f7997ed0-4ef2-4f46-a2fd-33942b2bca2a tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] Calling method '.version_select at 0x7f32124ae700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:49.067659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:49.083999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aada24c5-eb90-4094-94fd-1858635f80fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.365055 May 19 08:16:49.085026 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 313/587] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:48 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:49.100087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:49.100870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:49.115299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.115749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.119176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.119664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.245217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30b08bcf-e22d-482b-90a7-9be1a72d8914 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158196 May 19 08:16:49.246159 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 314/588] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:16:49 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:49.251518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:49.253153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:49.265822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.268786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.270275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.271321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.535649 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f7997ed0-4ef2-4f46-a2fd-33942b2bca2a tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/2f220a90-6188-4f67-ad25-007ac5c34a9d" status: 202 len: 0 microversion: 2.1 time: 0.709901 May 19 08:16:49.536234 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 275/589] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:16:48 2022] DELETE /compute/v2.1/os-security-groups/2f220a90-6188-4f67-ad25-007ac5c34a9d => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:49.544486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-c7e12cb6-c1fd-407a-966a-786759bd2bec req-bb6e4835-c3ff-4dd6-9fc1-05650931f092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd25d84e-f3ec-4845-a751-609e31473949", "tag": "4d3cebd2-0571-4120-b6e1-f2e22fcf9194"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:49.563175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c7e12cb6-c1fd-407a-966a-786759bd2bec req-bb6e4835-c3ff-4dd6-9fc1-05650931f092 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.563634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c7e12cb6-c1fd-407a-966a-786759bd2bec req-bb6e4835-c3ff-4dd6-9fc1-05650931f092 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.593547 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-c7e12cb6-c1fd-407a-966a-786759bd2bec req-bb6e4835-c3ff-4dd6-9fc1-05650931f092 service nova] Creating event network-changed:4d3cebd2-0571-4120-b6e1-f2e22fcf9194 for instance fd25d84e-f3ec-4845-a751-609e31473949 on chh2-842464-2 May 19 08:16:49.603871 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-c7e12cb6-c1fd-407a-966a-786759bd2bec req-bb6e4835-c3ff-4dd6-9fc1-05650931f092 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066079 May 19 08:16:49.609480 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 276/590] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:49.617807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:49.619252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:49.633155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.633744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.635064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:49.635064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:49.669386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:49.682215 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e7f2755-9051-46ba-8fa3-2b6bf759ea46 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1316 microversion: 2.1 time: 0.434885 May 19 08:16:49.682816 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 315/591] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:49 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:49.687538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6033b2e0-62d8-4b5c-97f5-26875452b97d tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] Calling method '.version_select at 0x7f3212871dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:50.103446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:50.111297 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-581ebfe4-fac7-481b-9734-48124c750b0b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1312 microversion: 2.1 time: 0.500275 May 19 08:16:50.121686 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 277/592] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:49 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1312 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:50.127296 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:50.127871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:50.147580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:50.148034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:50.148966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:50.149469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:50.951048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:50.962072 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6df6e253-53b6-4697-a04c-ba132e2b4353 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.839154 May 19 08:16:50.962671 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 278/593] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:50 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:50.976091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:50.980491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:50.993021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:50.993591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:50.994404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:50.995048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:51.194505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6033b2e0-62d8-4b5c-97f5-26875452b97d tempest-SecurityGroupsTestAdminJSON-865225526 tempest-SecurityGroupsTestAdminJSON-865225526-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/7c3019b5-a8ae-4319-a355-33540b10d02a" status: 202 len: 0 microversion: 2.1 time: 1.509452 May 19 08:16:51.195529 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 316/594] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:16:49 2022] DELETE /compute/v2.1/os-security-groups/7c3019b5-a8ae-4319-a355-33540b10d02a => generated 0 bytes in 1512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:51.203507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2d4face4-9a21-4408-9571-27a0c1478c55 req-2d7c90b1-4bda-4cae-a71f-b273dd8f80f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffa61b1-599a-419f-b13c-80555e11be0d", "name": "network-vif-plugged", "status": "completed", "tag": "709f676f-c0cd-4844-b149-76891d92ab2b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:51.229471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2d4face4-9a21-4408-9571-27a0c1478c55 req-2d7c90b1-4bda-4cae-a71f-b273dd8f80f5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:51.230703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2d4face4-9a21-4408-9571-27a0c1478c55 req-2d7c90b1-4bda-4cae-a71f-b273dd8f80f5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:51.266463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2d4face4-9a21-4408-9571-27a0c1478c55 req-2d7c90b1-4bda-4cae-a71f-b273dd8f80f5 service nova] Creating event network-vif-plugged:709f676f-c0cd-4844-b149-76891d92ab2b for instance 5ffa61b1-599a-419f-b13c-80555e11be0d on chh1-842464-2 May 19 08:16:51.279335 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2d4face4-9a21-4408-9571-27a0c1478c55 req-2d7c90b1-4bda-4cae-a71f-b273dd8f80f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082231 May 19 08:16:51.283601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 317/595] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:51.293122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:51.299709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:51.317492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:51.321736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:51.323482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:51.325531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:51.440294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:51.455531 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f3bfddea-86bc-4403-b692-50fd0e510b2a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1316 microversion: 2.1 time: 0.484336 May 19 08:16:51.457453 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 279/596] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:50 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:51.756900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:51.772772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d638cb16-8d7d-422e-b5dd-c5f244bfd855 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1461 microversion: 2.1 time: 0.487110 May 19 08:16:51.773693 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 318/597] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:51 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1461 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:51.901440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:51.902424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:51.911795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:51.912663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:51.913648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:51.914243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.128463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:52.138818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c819a0e-2da3-49ea-8934-b18b3669722b tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1588 microversion: 2.1 time: 0.241493 May 19 08:16:52.143586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 319/598] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:51 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1588 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:52.159378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a194903c-b346-4376-a77c-0118c2995120 req-0763eab9-ea93-4195-b58d-d4a45a153e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c58c656-8f86-4a69-85ce-778327a4118e", "tag": "dd5a186c-59ec-41aa-992d-1ff94f5fc79c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:52.176844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a194903c-b346-4376-a77c-0118c2995120 req-0763eab9-ea93-4195-b58d-d4a45a153e85 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.177133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a194903c-b346-4376-a77c-0118c2995120 req-0763eab9-ea93-4195-b58d-d4a45a153e85 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.191329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a194903c-b346-4376-a77c-0118c2995120 req-0763eab9-ea93-4195-b58d-d4a45a153e85 service nova] Creating event network-changed:dd5a186c-59ec-41aa-992d-1ff94f5fc79c for instance 7c58c656-8f86-4a69-85ce-778327a4118e on chh2-842464-2 May 19 08:16:52.201696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a194903c-b346-4376-a77c-0118c2995120 req-0763eab9-ea93-4195-b58d-d4a45a153e85 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056727 May 19 08:16:52.202359 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 320/599] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:52.212201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:52.212900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:52.222759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.223501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.224537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.224977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.325778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:52.326248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:52.337693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.338286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.341907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.342355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.601233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:52.620630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d06c18c-40f5-4bdf-87ef-eecdabe0b0e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.415182 May 19 08:16:52.623653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 321/600] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:52 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:52.630737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:52.631400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:52.652665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.653137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.654224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:52.657512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:52.881645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:52.939836 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:53.144505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:53.166927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9393669c-995f-4146-bb43-c71b457db054 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1316 microversion: 2.1 time: 0.541625 May 19 08:16:53.176935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 322/601] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:52 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:53.487932 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-423ff952-a107-43d7-a06c-083b1c3d2d02 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1612 microversion: 2.1 time: 1.701886 May 19 08:16:53.488527 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 280/602] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:51 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1612 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:53.508157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:53.508757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:53.522943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:53.526780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:53.528913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:53.529390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:53.716647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-888c6f9e-f89c-4ee0-83e5-562de65dbec1 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:53.718749 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:53.718749 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:53.720601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-888c6f9e-f89c-4ee0-83e5-562de65dbec1 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:53.721281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-888c6f9e-f89c-4ee0-83e5-562de65dbec1 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:53.723242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-888c6f9e-f89c-4ee0-83e5-562de65dbec1 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:53.724198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd03b03867165463f85b38f2b927cdab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a205947cb26041d6b85f67a6455e9a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:53.724453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-888c6f9e-f89c-4ee0-83e5-562de65dbec1 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:53.727005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] flavor_id is None. Assuming migration. {{(pid=119073) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 08:16:53.728282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119073) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 08:16:53.758930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-888c6f9e-f89c-4ee0-83e5-562de65dbec1 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.580494 May 19 08:16:53.766530 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 323/603] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:16:53 2022] GET /compute/v2.1/os-services => generated 947 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:53.772130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:53.773437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:53.781158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:53.781954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:53.782969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:53.783606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.181946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:54.194408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6778b6c6-9833-4e3e-8f90-2b112ca86c3b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.426100 May 19 08:16:54.203781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 324/604] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:53 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:54.223531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c8f6a80-b255-4bf4-b96f-85a92b8647e6 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:54.239290 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:54.239290 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:54.241005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c8f6a80-b255-4bf4-b96f-85a92b8647e6 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.242128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c8f6a80-b255-4bf4-b96f-85a92b8647e6 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.243463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c8f6a80-b255-4bf4-b96f-85a92b8647e6 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.244252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c8f6a80-b255-4bf4-b96f-85a92b8647e6 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.271687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:54.296320 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c8f6a80-b255-4bf4-b96f-85a92b8647e6 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.089660 May 19 08:16:54.298129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 325/605] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:16:54 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:54.305351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:54.306435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:54.315046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.315926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.316889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.317530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.555522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:54.563944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:54.570638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4a4de0c-08d2-48b2-a434-b18d887aa331 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1504 microversion: 2.1 time: 0.271111 May 19 08:16:54.574897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 326/606] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:54 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:54.590474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a77c6c3-d760-4ecc-b28e-52b21189c7b8 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:54.592093 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:54.592093 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:54.594846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a77c6c3-d760-4ecc-b28e-52b21189c7b8 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.598525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a77c6c3-d760-4ecc-b28e-52b21189c7b8 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.601740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a77c6c3-d760-4ecc-b28e-52b21189c7b8 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.604843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a77c6c3-d760-4ecc-b28e-52b21189c7b8 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.638120 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a77c6c3-d760-4ecc-b28e-52b21189c7b8 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.061356 May 19 08:16:54.638758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 327/607] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:16:54 2022] GET /compute/v2.1/os-services => generated 947 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:54.644575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1597419095"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:54.646726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:54.653546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.653999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.654779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.660340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.701769 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-380ef399-8bc8-4f4c-b0b8-41a259b558c2 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2/action" status: 202 len: 0 microversion: 2.1 time: 1.200987 May 19 08:16:54.702758 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 281/608] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:53 2022] POST /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2/action => generated 0 bytes in 1203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:54.709859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dadf05a0-9271-460b-9365-a65ecdcfb1b2 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:54.712672 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:54.712672 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:54.715303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadf05a0-9271-460b-9365-a65ecdcfb1b2 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.716012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadf05a0-9271-460b-9365-a65ecdcfb1b2 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.717374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadf05a0-9271-460b-9365-a65ecdcfb1b2 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.718303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadf05a0-9271-460b-9365-a65ecdcfb1b2 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.787179 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dadf05a0-9271-460b-9365-a65ecdcfb1b2 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=chdv-842464-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.078490 May 19 08:16:54.789614 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 282/609] 10.222.0.78 () {58 vars in 1195 bytes} [Thu May 19 08:16:54 2022] GET /compute/v2.1/os-services?host=chdv-842464-2&binary=xxx => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:16:54.799576 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:54.803782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:54.817526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.817980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:54.818765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:54.822105 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:55.051740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Adding security group 25e246d0-4b31-4045-be36-68ac941391f4 to port 709f676f-c0cd-4844-b149-76891d92ab2b May 19 08:16:55.516980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:55.533670 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b2062194-2276-48c3-a4cb-684a31ce6988 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1470 microversion: 2.1 time: 0.742439 May 19 08:16:55.534609 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 283/610] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:54 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1470 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:55.539978 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a11d6360-6a2b-4229-bba7-991836a93974 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:55.541289 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:55.541289 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:55.543108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a11d6360-6a2b-4229-bba7-991836a93974 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:55.543803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a11d6360-6a2b-4229-bba7-991836a93974 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:55.544968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a11d6360-6a2b-4229-bba7-991836a93974 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:55.545695 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a11d6360-6a2b-4229-bba7-991836a93974 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:55.618321 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a11d6360-6a2b-4229-bba7-991836a93974 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.082445 May 19 08:16:55.621857 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 284/611] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:16:55 2022] GET /compute/v2.1/os-services => generated 947 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:55.640965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:55.642243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:55.671362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:55.686696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:55.690406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:55.690879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.223402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:56.253767 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b18af08f-5fa2-47c9-92e6-fc45c7182627 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1504 microversion: 2.1 time: 0.617702 May 19 08:16:56.263550 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 285/612] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:55 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1504 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:56.686270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f32123f5790>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:56.688196 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:56.688196 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:56.692187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.692833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.734603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.737179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.773127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=26 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:56.799206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.799437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.807257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63c21078-2f35-4841-8137-0f72c913b8b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d/action" status: 202 len: 0 microversion: 2.1 time: 2.167411 May 19 08:16:56.808059 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 328/613] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:54 2022] POST /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d/action => generated 0 bytes in 2169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:56.815606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-332fb85d-ecc5-4361-a776-bbef83d44133 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:56.816948 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:56.816948 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:56.821214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-332fb85d-ecc5-4361-a776-bbef83d44133 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.822540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-332fb85d-ecc5-4361-a776-bbef83d44133 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.824595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-332fb85d-ecc5-4361-a776-bbef83d44133 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.826124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-332fb85d-ecc5-4361-a776-bbef83d44133 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.832146 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2b2a1834-e113-42f0-8d81-e236ea75e8ff tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.575957 May 19 08:16:56.841141 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 286/614] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:56.850831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:56.853219 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:56.862937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.864010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.865346 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:56.866154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:56.905962 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-332fb85d-ecc5-4361-a776-bbef83d44133 tempest-ServicesAdminNegativeTestJSON-1437674107 tempest-ServicesAdminNegativeTestJSON-1437674107-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.097008 May 19 08:16:56.914754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 329/615] 10.222.0.78 () {58 vars in 1197 bytes} [Thu May 19 08:16:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:16:57.015944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a023ab9b-8cc2-4b40-953c-094edc5d76ab tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:57.019696 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:57.019696 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:57.025353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a023ab9b-8cc2-4b40-953c-094edc5d76ab tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.027654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a023ab9b-8cc2-4b40-953c-094edc5d76ab tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.030745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a023ab9b-8cc2-4b40-953c-094edc5d76ab tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.032054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a023ab9b-8cc2-4b40-953c-094edc5d76ab tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.077958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a023ab9b-8cc2-4b40-953c-094edc5d76ab tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.161695 May 19 08:16:57.087247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 330/616] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:16:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:57.104773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-770781064"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:57.105650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:57.117227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.118028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.120243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.121435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.227074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:57.246427 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0c193acb-a082-4bec-b053-e28edfe70535 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1470 microversion: 2.1 time: 0.397434 May 19 08:16:57.256212 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 287/617] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:56 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:57.276527 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f32124eeb80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:57.281531 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:57.281531 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:57.283730 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.284160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.355672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.356850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.410074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.410530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.431693 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-175b799d-4344-4551-889a-72f78203ff1a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.171248 May 19 08:16:57.434604 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 288/618] 10.222.0.78 () {58 vars in 1166 bytes} [Thu May 19 08:16:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:57.446211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-b948d183-ccbb-499e-9b8b-0bbfa7a4546f req-db8414d0-7053-479d-bf5d-547b2f6ae4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ffa61b1-599a-419f-b13c-80555e11be0d", "tag": "709f676f-c0cd-4844-b149-76891d92ab2b"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:57.475008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b948d183-ccbb-499e-9b8b-0bbfa7a4546f req-db8414d0-7053-479d-bf5d-547b2f6ae4ac service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.476281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b948d183-ccbb-499e-9b8b-0bbfa7a4546f req-db8414d0-7053-479d-bf5d-547b2f6ae4ac service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.478303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Adding security group 4fb30dde-fe9d-406d-bb1b-95d995806a66 to port 709f676f-c0cd-4844-b149-76891d92ab2b May 19 08:16:57.511057 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-b948d183-ccbb-499e-9b8b-0bbfa7a4546f req-db8414d0-7053-479d-bf5d-547b2f6ae4ac service nova] Creating event network-changed:709f676f-c0cd-4844-b149-76891d92ab2b for instance 5ffa61b1-599a-419f-b13c-80555e11be0d on chh1-842464-2 May 19 08:16:57.523272 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-b948d183-ccbb-499e-9b8b-0bbfa7a4546f req-db8414d0-7053-479d-bf5d-547b2f6ae4ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085173 May 19 08:16:57.524312 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 289/619] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:57.844780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cdb18bd0-0cd3-4cb9-b4a2-db3f4ee2651a tempest-ServicesAdminNegativeTestJSON-1022702271 tempest-ServicesAdminNegativeTestJSON-1022702271-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:57.847445 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:57.847445 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:57.848901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cdb18bd0-0cd3-4cb9-b4a2-db3f4ee2651a tempest-ServicesAdminNegativeTestJSON-1022702271 tempest-ServicesAdminNegativeTestJSON-1022702271-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '61d0884f71a64b16807dc111e96fa188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c53acff1a2184fa6a3f2cd8f69142622', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cdb18bd0-0cd3-4cb9-b4a2-db3f4ee2651a tempest-ServicesAdminNegativeTestJSON-1022702271 tempest-ServicesAdminNegativeTestJSON-1022702271-project] Request method failure captured: May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-services HTTP/1.1 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzy-tJH7UzbH0bmWCwWUMp742-bhXT9KLol-OEtF7bbndlOj2lHN7XZ398NkLEE32cmaUmTYvPCjj5-C5xbfxBu3LixeB-5lo7h4IkyrFX1tJfvafU6d9TsoiWC11VMa3Yjzg80GRKvujh1D4eSSuN8-peDz4OgM_HIuu2T82vxLcg May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c53acff1a2184fa6a3f2cd8f69142622 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1022702271 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c53acff1a2184fa6a3f2cd8f69142622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c53acff1a2184fa6a3f2cd8f69142622"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c53acff1a2184fa6a3f2cd8f69142622"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c53acff1a2184fa6a3f2cd8f69142622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1022702271 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c53acff1a2184fa6a3f2cd8f69142622 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1022702271 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServicesAdminNegativeTestJSON-1022702271-project May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 61d0884f71a64b16807dc111e96fa188 May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1022702271-project May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: action_args: {} May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 08:16:57.855853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:16:57.860529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cdb18bd0-0cd3-4cb9-b4a2-db3f4ee2651a tempest-ServicesAdminNegativeTestJSON-1022702271 tempest-ServicesAdminNegativeTestJSON-1022702271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:16:57.866296 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cdb18bd0-0cd3-4cb9-b4a2-db3f4ee2651a tempest-ServicesAdminNegativeTestJSON-1022702271 tempest-ServicesAdminNegativeTestJSON-1022702271-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.339297 May 19 08:16:57.868740 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 290/620] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:16:57 2022] GET /compute/v2.1/os-services => generated 112 bytes in 343 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:16:57.896376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e4eb451b-c612-4d17-936a-5b4c85bdc20b tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:57.908526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e4eb451b-c612-4d17-936a-5b4c85bdc20b tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.909202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e4eb451b-c612-4d17-936a-5b4c85bdc20b tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:57.912502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e4eb451b-c612-4d17-936a-5b4c85bdc20b tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:57.915251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e4eb451b-c612-4d17-936a-5b4c85bdc20b tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.007393 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e4eb451b-c612-4d17-936a-5b4c85bdc20b tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=chdv-842464-2" status: 200 len: 581 microversion: 2.1 time: 0.137363 May 19 08:16:58.021263 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 291/621] 10.222.0.78 () {58 vars in 1173 bytes} [Thu May 19 08:16:57 2022] GET /compute/v2.1/os-services?host=chdv-842464-2 => generated 581 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:58.028149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:58.029812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:58.038022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.038813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.039754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.040370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.553605 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:58.570848 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-31167d24-78af-4e4b-b119-3bb340906689 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1494 microversion: 2.1 time: 0.546544 May 19 08:16:58.571439 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 292/622] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:58 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1494 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:58.587596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f32124aeb80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:58.588402 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:58.588402 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:58.602838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.603530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.624487 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.627622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.629817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ef32f6d-c433-49a2-82d8-825b727499fe tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d/action" status: 202 len: 0 microversion: 2.1 time: 1.541024 May 19 08:16:58.635043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 331/623] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:16:57 2022] POST /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d/action => generated 0 bytes in 1547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:16:58.640370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-544efed7-723a-4c3f-90c2-cfcc129307c2 tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:58.643489 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:58.643489 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:16:58.644967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544efed7-723a-4c3f-90c2-cfcc129307c2 tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.645452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544efed7-723a-4c3f-90c2-cfcc129307c2 tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.646289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544efed7-723a-4c3f-90c2-cfcc129307c2 tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.649261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544efed7-723a-4c3f-90c2-cfcc129307c2 tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.664014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.664575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.675904 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aee293a2-aab8-4bbf-9659-cdcab9601811 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.091847 May 19 08:16:58.676829 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 293/624] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:58.685648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:58.686600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:58.707375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.708162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.709788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.710587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.725046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-544efed7-723a-4c3f-90c2-cfcc129307c2 tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088682 May 19 08:16:58.726851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 332/625] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:16:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:58.735525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb89f874-28e0-4f57-b948-bfa2109c1eb9 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '.version_select at 0x7f32123bf280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:58.738634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb89f874-28e0-4f57-b948-bfa2109c1eb9 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.739085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb89f874-28e0-4f57-b948-bfa2109c1eb9 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.777014 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb89f874-28e0-4f57-b948-bfa2109c1eb9 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 797 microversion: 2.1 time: 0.049057 May 19 08:16:58.784396 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 333/626] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:16:58 2022] GET /compute/v2.1/os-migrations => generated 797 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:58.802047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:58.803029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:58.828682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.829454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:58.832474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:58.833147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.308864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:16:59.317386 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-61881970-1a86-4eab-9e0c-c55dbfd87bd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1470 microversion: 2.1 time: 0.639190 May 19 08:16:59.318261 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 294/627] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:58 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1470 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:59.344254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3c9d95e4-e888-4a36-bbad-c58ae92833db tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f321270c550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:59.346682 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:59.346682 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:59.349561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c9d95e4-e888-4a36-bbad-c58ae92833db tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.351283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c9d95e4-e888-4a36-bbad-c58ae92833db tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.356462 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:16:59.396817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c9d95e4-e888-4a36-bbad-c58ae92833db tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.397709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c9d95e4-e888-4a36-bbad-c58ae92833db tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.411783 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3c9d95e4-e888-4a36-bbad-c58ae92833db tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.091843 May 19 08:16:59.413616 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 295/628] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:16:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:59.418684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10ee8524-51e4-4402-ad5d-6cc54b3fdacb tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.633014 May 19 08:16:59.419507 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 334/629] 10.222.0.78 () {58 vars in 1292 bytes} [Thu May 19 08:16:58 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d/os-security-groups => generated 1154 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:16:59.429873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-39c3261e-d825-4b05-b958-ea74a0ac260d tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:59.431312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:59.431928 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:59.431928 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:59.433127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:16:59.434138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-39c3261e-d825-4b05-b958-ea74a0ac260d tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.434952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-39c3261e-d825-4b05-b958-ea74a0ac260d tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.436279 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-39c3261e-d825-4b05-b958-ea74a0ac260d tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.436942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-39c3261e-d825-4b05-b958-ea74a0ac260d tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.447515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.447967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.450348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.451853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.468221 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-39c3261e-d825-4b05-b958-ea74a0ac260d tempest-ServicesAdminTestJSON-462167604 tempest-ServicesAdminTestJSON-462167604-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.053145 May 19 08:16:59.478700 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 296/630] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:16:59 2022] GET /compute/v2.1/os-services => generated 947 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:59.493713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9bc7c6c7-4278-4f25-821a-3344a61aabaf tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f321270c9d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:16:59.494515 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:16:59.494515 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:16:59.495681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9bc7c6c7-4278-4f25-821a-3344a61aabaf tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:16:59.496130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9bc7c6c7-4278-4f25-821a-3344a61aabaf tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:16:59.514485 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9bc7c6c7-4278-4f25-821a-3344a61aabaf tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.029521 May 19 08:16:59.523575 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 297/631] 10.222.0.78 () {58 vars in 1178 bytes} [Thu May 19 08:16:59 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:16:59.528655 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0a925456-ff07-4359-9724-5dc5459b275a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f32124eed30>, body: {"security_group": {"name": " tempest-securitygroup -418884853 ", "description": "tempest-description-1548526667"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:16:59.983380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffb5b779-1e17-4d09-bbf6-446a6274972a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1645 microversion: 2.1 time: 0.562386 May 19 08:16:59.990472 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 335/632] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:16:59 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1645 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:00.008120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f321258f310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.008724 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:00.008724 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:17:00.010451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.011102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.032440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.033725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.050214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.050929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.063153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-854a4014-4d57-4ca4-9868-38f926a90374 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070511 May 19 08:17:00.070291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 336/633] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:16:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.076691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c97b181d-308a-4a6a-be7a-9d76fbec8b7a req-08351284-a869-4140-9a80-14b1637c9101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ffa61b1-599a-419f-b13c-80555e11be0d", "tag": "709f676f-c0cd-4844-b149-76891d92ab2b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:00.088038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c97b181d-308a-4a6a-be7a-9d76fbec8b7a req-08351284-a869-4140-9a80-14b1637c9101 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.088695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c97b181d-308a-4a6a-be7a-9d76fbec8b7a req-08351284-a869-4140-9a80-14b1637c9101 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.090843 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0a925456-ff07-4359-9724-5dc5459b275a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.565856 May 19 08:17:00.091842 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 298/634] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:16:59 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.101411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77ca9f50-b019-4944-89a1-aa07b3f20059 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f32123f5280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.102295 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:00.102295 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:17:00.103821 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c97b181d-308a-4a6a-be7a-9d76fbec8b7a req-08351284-a869-4140-9a80-14b1637c9101 service nova] Creating event network-changed:709f676f-c0cd-4844-b149-76891d92ab2b for instance 5ffa61b1-599a-419f-b13c-80555e11be0d on chh1-842464-2 May 19 08:17:00.104293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77ca9f50-b019-4944-89a1-aa07b3f20059 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.104865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77ca9f50-b019-4944-89a1-aa07b3f20059 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.111933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c97b181d-308a-4a6a-be7a-9d76fbec8b7a req-08351284-a869-4140-9a80-14b1637c9101 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038817 May 19 08:17:00.113745 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 337/635] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.120842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c28283e-1043-4576-9913-b80c210589e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321236cc10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.162560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77ca9f50-b019-4944-89a1-aa07b3f20059 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.163510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77ca9f50-b019-4944-89a1-aa07b3f20059 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.174055 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-77ca9f50-b019-4944-89a1-aa07b3f20059 tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.081076 May 19 08:17:00.176589 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 299/636] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:17:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.186949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a34fff06-b208-4132-ae1a-bfb4409eb73a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f32124ee820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.187592 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:00.187592 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:17:00.188778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a34fff06-b208-4132-ae1a-bfb4409eb73a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.193255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a34fff06-b208-4132-ae1a-bfb4409eb73a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.209934 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a34fff06-b208-4132-ae1a-bfb4409eb73a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.210775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a34fff06-b208-4132-ae1a-bfb4409eb73a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.222906 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a34fff06-b208-4132-ae1a-bfb4409eb73a tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.039657 May 19 08:17:00.225037 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 300/637] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:17:00 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.238232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1493645722", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "f89cd20d-715f-4022-9b3a-1a63b86ac1fd"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:00.268868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c28283e-1043-4576-9913-b80c210589e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda" status: 200 len: 223 microversion: 2.1 time: 0.153003 May 19 08:17:00.269805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 338/638] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:17:00 2022] GET /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda => generated 223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.275705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Calling method '.version_select at 0x7f321236cca0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.286184 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:00.286184 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:17:00.287576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.288037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.305642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.306100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.309073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] validate_networks() for [('f89cd20d-715f-4022-9b3a-1a63b86ac1fd', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:00.331671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.332410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.371697 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a76e3301-20fe-45ee-bd7c-ec9a047f39da tempest-HypervisorAdminTestJSON-667843672 tempest-HypervisorAdminTestJSON-667843672-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 168 microversion: 2.1 time: 0.098291 May 19 08:17:00.373374 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 339/639] 10.222.0.78 () {58 vars in 1172 bytes} [Thu May 19 08:17:00 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 168 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:00.380406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4fccd1bd-06d0-49cd-8c43-497ff17d90b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212341a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.796363 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4fccd1bd-06d0-49cd-8c43-497ff17d90b7 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda" status: 202 len: 0 microversion: 2.1 time: 0.421097 May 19 08:17:00.799445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 340/640] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:17:00 2022] DELETE /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:00.808116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:00.809130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:00.826944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.827680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:00.828730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:00.829397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:01.308670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:01.318814 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d33e46b-974b-4ce9-8314-6d50a98a48ee tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.517040 May 19 08:17:01.319413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 341/641] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:00 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:01.324172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32122cc9d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:01.395055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:01.395663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group cfb73928-3c75-44da-b50e-57b2300e7dda not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:17:01.396187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.396187 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda HTTP/1.1 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'cfb73928-3c75-44da-b50e-57b2300e7dda'} May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:01.420644 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] May 19 08:17:01.427937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:01.437669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:17:01.437669 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-8d7980f0-3f7e-47ae-aedf-2954c69f281f'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:01.442447 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7aec3614-e8fa-4b3f-af98-f2e3dfd73025 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda" status: 404 len: 194 microversion: 2.1 time: 0.121822 May 19 08:17:01.443966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 342/642] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:17:01 2022] GET /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:01.457480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a54c3f7c-fb98-4f57-b7cb-c6cca6abc631 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f3212206160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1738808465", "description": "tempest-description-1385935259"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:01.520145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:01.520617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:01.520979 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:01.521411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:01.521819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:01.537515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:01.542934 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:01.543903 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:01.544338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:01.590479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:01.596256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for user 57e320171eec44a8bdb1dcd9e0039226 and project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:01.627816 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:01.630214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:01.783871 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-37ab10d6-f853-4e3e-a070-c2d75d2d0133 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547512 May 19 08:17:01.793808 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 301/643] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:01.814798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-496f7804-cfbd-4541-9b86-c6fb166d4d32 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:01.816402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-496f7804-cfbd-4541-9b86-c6fb166d4d32 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:01.928520 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a54c3f7c-fb98-4f57-b7cb-c6cca6abc631 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.478596 May 19 08:17:01.929473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 343/644] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:17:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:01.944205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef3f4ccd-a70d-4e20-8153-46b965a31ed8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f3212333b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-407059602", "description": "tempest-description-1299348059"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:02.002733 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-496f7804-cfbd-4541-9b86-c6fb166d4d32 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:02.013152 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-496f7804-cfbd-4541-9b86-c6fb166d4d32 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1211 microversion: 2.1 time: 0.217181 May 19 08:17:02.027271 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 302/645] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:01 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1211 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:02.290188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef3f4ccd-a70d-4e20-8153-46b965a31ed8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.353918 May 19 08:17:02.291768 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 344/646] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:17:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:17:02.317930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6a63895b-eb3e-4c3f-9ca3-7dbcb00698e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f32123f5430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-99485259", "description": "tempest-description-1889458286"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:02.343596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:02.344970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:02.381244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:02.400254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:02.402260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:02.403503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:02.773825 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6a63895b-eb3e-4c3f-9ca3-7dbcb00698e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.468889 May 19 08:17:02.776030 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 303/647] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:17:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:02.792300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1f72b854-4cb2-483d-9fe7-1b23a01f6bb2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32124ae700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:02.866631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:02.879808 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b60b2ae6-4479-4aaf-a566-ebefbd77eb76 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.542129 May 19 08:17:02.880763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 345/648] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:02 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:03.031464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:03.032747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:03.050744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:03.051573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:03.053606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:03.058050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:03.197355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:03.210315 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f949524-4902-4009-975a-504b897d5e6b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1263 microversion: 2.1 time: 0.182956 May 19 08:17:03.219657 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 346/649] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:03 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:03.462064 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1f72b854-4cb2-483d-9fe7-1b23a01f6bb2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.678262 May 19 08:17:03.462664 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 304/650] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:17:02 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:03.476830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33587624-d39f-4cd8-b83f-d24a42b5bfaa tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32122061f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:03.903890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:03.905713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:03.916757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:03.918394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33587624-d39f-4cd8-b83f-d24a42b5bfaa tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e" status: 202 len: 0 microversion: 2.1 time: 0.446376 May 19 08:17:03.919653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 347/651] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:17:03 2022] DELETE /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:03.928130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212206790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:03.943154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:03.944020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:03.944977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:03.945837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:04.046833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:04.047445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:17:04.047974 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.047974 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e HTTP/1.1 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e'} May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:04.050611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-3ff31cd3-c259-4444-b29f-8b4851d72825'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:04.054489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6d8462e-a31c-4b7f-a6b7-7cf289764c85 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e" status: 404 len: 194 microversion: 2.1 time: 0.128700 May 19 08:17:04.057031 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 348/652] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:17:03 2022] GET /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:04.069057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f833818c-9767-4d86-b13d-c88b9ccdecb8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32122745e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:04.263884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:04.281590 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3ba5dcaa-82ce-4c50-a52b-1e52b175ca8d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.385746 May 19 08:17:04.286515 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 305/653] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:03 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:04.298188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:04.301539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:04.320687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:04.322703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:04.323711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:04.324150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:04.496837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:04.508634 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bd1a8dc2-1b68-4133-a2ed-b5b3528e2e7e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1269 microversion: 2.1 time: 0.219051 May 19 08:17:04.511430 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 306/654] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:04 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1269 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:04.535145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f833818c-9767-4d86-b13d-c88b9ccdecb8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc" status: 202 len: 0 microversion: 2.1 time: 0.477692 May 19 08:17:04.547256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 349/655] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:17:04 2022] DELETE /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:04.552936 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32124aea60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:04.584294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:04.584967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group efff9408-7b5f-4c62-ab03-6152507b6cfc not found {{(pid=119073) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:17:04.585537 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.585537 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc HTTP/1.1 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'efff9408-7b5f-4c62-ab03-6152507b6cfc'} May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:04.593043 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] May 19 08:17:04.598553 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:04.606833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:17:04.606833 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-d53476da-4523-4d54-9a0e-4e49061d3449'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:04.606833 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-46222356-cc2e-4b2e-8d4a-240670596a86 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc" status: 404 len: 194 microversion: 2.1 time: 0.062204 May 19 08:17:04.606833 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 307/656] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:17:04 2022] GET /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:04.614569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19c61c3c-f913-482a-95ad-8ad53638eaa5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32122cb670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:04.898417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19c61c3c-f913-482a-95ad-8ad53638eaa5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af" status: 202 len: 0 microversion: 2.1 time: 0.288734 May 19 08:17:04.905933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 350/657] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:17:04 2022] DELETE /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:17:04.915269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32122cb310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:04.945748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:04.947195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group 691ad307-e48d-4b1a-8939-ca1ec18a66af not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:17:04.948415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.948415 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af HTTP/1.1 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '691ad307-e48d-4b1a-8939-ca1ec18a66af'} May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:04.951278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] May 19 08:17:04.960132 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:04.966804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:17:04.966804 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-ae4c3bfb-74e8-4e13-aa85-69ab2df62a9f'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:04.968061 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05cbae51-f967-4ad8-bed3-e3ab4e14a9c8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af" status: 404 len: 194 microversion: 2.1 time: 0.057358 May 19 08:17:04.969250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 351/658] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:17:04 2022] GET /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:04.981489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-520032d6-7191-47aa-a65f-b65527ded399 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321221e4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:05.291687 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-520032d6-7191-47aa-a65f-b65527ded399 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.314368 May 19 08:17:05.292278 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 352/659] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:17:04 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:05.306983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:05.307610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:05.320739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:05.322095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:05.325732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:05.328510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:05.372391 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4f099fdf-c118-4cda-b7a5-fdc7d7e075bd tempest-TenantUsagesNegativeTestJSON-2092266194 tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-18T08%3A17%3A04.896117&end=2022-05-20T08%3A17%3A04.896117" status: 404 len: 112 microversion: - time: 0.471687 May 19 08:17:05.374210 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 308/660] 10.222.0.78 () {58 vars in 1315 bytes} [Thu May 19 08:17:04 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-18T08%3A17%3A04.896117&end=2022-05-20T08%3A17%3A04.896117 => generated 112 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 08:17:05.388416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3f39cc9f-d5de-47ca-a290-17d76d34c7ff tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f3212249550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1679311435", "description": "tempest-description-1236944417"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:05.582527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:05.599872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d793993-7ac0-4d4a-82cc-c590fa50ff47 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.294574 May 19 08:17:05.601112 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 353/661] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:05 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:05.615027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0878937d-cbd7-4b76-a051-925bb2d2be40 tempest-TenantUsagesNegativeTestJSON-2092266194 tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin] Calling method '.version_select at 0x7f32122cbee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:05.628155 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0878937d-cbd7-4b76-a051-925bb2d2be40 tempest-TenantUsagesNegativeTestJSON-2092266194 tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0878937d-cbd7-4b76-a051-925bb2d2be40 tempest-TenantUsagesNegativeTestJSON-2092266194 tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin] Request method failure captured: May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-simple-tenant-usage/2bdca7c4ce3b43e5a812c8882b9ff79a?start=2022-05-20T08%3A17%3A04.896117&end=2022-05-18T08%3A17%3A04.896117 HTTP/1.1 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0A5mIAiL3pn3n0H9kd_D59A5487GL0mIONp17LVAOELZdv7V9SBqF-yBjQO8MZC8hJP6Ycd4AJNP8qbfRJoBh4AdfcsfHCr5dSv-x_NiF1Suu-sEOTYtPem71TmcReuRx8tFWvmSrp9qkjKNRMcOG00Hx-q5L8I66qnVuiUhZFF1g May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 23b668b8ff6741cba6bdecdd3f52b9b9 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2092266194 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23b668b8ff6741cba6bdecdd3f52b9b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23b668b8ff6741cba6bdecdd3f52b9b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23b668b8ff6741cba6bdecdd3f52b9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23b668b8ff6741cba6bdecdd3f52b9b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2092266194 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 23b668b8ff6741cba6bdecdd3f52b9b9 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2092266194 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dcfd30531a844916ae84ea02706ac281 May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid start time. The start time cannot occur after the end time. May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2bdca7c4ce3b43e5a812c8882b9ff79a'} May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 19 08:17:05.630771 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:05.639622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0878937d-cbd7-4b76-a051-925bb2d2be40 tempest-TenantUsagesNegativeTestJSON-2092266194 tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:05.640813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0878937d-cbd7-4b76-a051-925bb2d2be40 tempest-TenantUsagesNegativeTestJSON-2092266194 tempest-TenantUsagesNegativeTestJSON-2092266194-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/2bdca7c4ce3b43e5a812c8882b9ff79a?start=2022-05-20T08%3A17%3A04.896117&end=2022-05-18T08%3A17%3A04.896117" status: 400 len: 111 microversion: 2.1 time: 0.037220 May 19 08:17:05.647109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 354/662] 10.222.0.78 () {58 vars in 1411 bytes} [Thu May 19 08:17:05 2022] GET /compute/v2.1/os-simple-tenant-usage/2bdca7c4ce3b43e5a812c8882b9ff79a?start=2022-05-20T08%3A17%3A04.896117&end=2022-05-18T08%3A17%3A04.896117 => generated 111 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:17:05.652347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:05.656569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:05.674166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:05.674628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:05.675432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:05.675866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:05.857600 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3f39cc9f-d5de-47ca-a290-17d76d34c7ff tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.481998 May 19 08:17:05.858204 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 309/663] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:17:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:05.951121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:05.961350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17ddd02c-3236-4125-9c8f-d4d36cae4140 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.312784 May 19 08:17:05.963285 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 355/664] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:05 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:05.970113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c0aed6b-27b0-439b-bd2d-c09e537d75f4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f3212206430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1050406038", "description": "tempest-description-1082023203"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:06.202839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69981fa7-f33a-4170-95be-95d2e4a0e859 tempest-TenantUsagesNegativeTestJSON-526212619 tempest-TenantUsagesNegativeTestJSON-526212619-project] Calling method '.version_select at 0x7f32124aea60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:06.209722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-69981fa7-f33a-4170-95be-95d2e4a0e859 tempest-TenantUsagesNegativeTestJSON-526212619 tempest-TenantUsagesNegativeTestJSON-526212619-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7842ae5eb03a49e0816a53695bb8058d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdca7c4ce3b43e5a812c8882b9ff79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:06.225026 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c0aed6b-27b0-439b-bd2d-c09e537d75f4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.259616 May 19 08:17:06.225727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 356/665] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:17:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69981fa7-f33a-4170-95be-95d2e4a0e859 tempest-TenantUsagesNegativeTestJSON-526212619 tempest-TenantUsagesNegativeTestJSON-526212619-project] Request method failure captured: May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T08%3A17%3A04.896117&end=2022-05-20T08%3A17%3A04.896117&detailed=1 HTTP/1.1 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfz_2LhrRp6b6wpfO7aIRZcuVPgUgw9tvme3B4qI3KHyBVZsNs1n-BPfNpxVLwdWqDDuhOfar5ZLui5YC2vpp7q9UyliFLNSxHD-HfMzTiwkQYT-dSjagPyN9YcJik4ERpJfyWcdIzfVNzhFcMO63vz4YSYeSZs5BvAmzrOaFBK14VU May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 2bdca7c4ce3b43e5a812c8882b9ff79a May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-526212619 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2bdca7c4ce3b43e5a812c8882b9ff79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2bdca7c4ce3b43e5a812c8882b9ff79a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2bdca7c4ce3b43e5a812c8882b9ff79a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2bdca7c4ce3b43e5a812c8882b9ff79a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-526212619 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 2bdca7c4ce3b43e5a812c8882b9ff79a May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-526212619 May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-TenantUsagesNegativeTestJSON-526212619-project May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 7842ae5eb03a49e0816a53695bb8058d May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-526212619-project May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: action_args: {} May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._index(req) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:17:06.230950 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 19 08:17:06.234939 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:06.238933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69981fa7-f33a-4170-95be-95d2e4a0e859 tempest-TenantUsagesNegativeTestJSON-526212619 tempest-TenantUsagesNegativeTestJSON-526212619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:06.243744 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-69981fa7-f33a-4170-95be-95d2e4a0e859 tempest-TenantUsagesNegativeTestJSON-526212619 tempest-TenantUsagesNegativeTestJSON-526212619-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T08%3A17%3A04.896117&end=2022-05-20T08%3A17%3A04.896117&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.380680 May 19 08:17:06.248275 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 310/666] 10.222.0.78 () {58 vars in 1334 bytes} [Thu May 19 08:17:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T08%3A17%3A04.896117&end=2022-05-20T08%3A17%3A04.896117&detailed=1 => generated 123 bytes in 386 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:06.456014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-257564152", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "7b6fe1bf-d728-45d9-a817-17609e81eb8e"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:06.525120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] validate_networks() for [('7b6fe1bf-d728-45d9-a817-17609e81eb8e', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:06.721572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6381a74a-c1b5-4ed2-8f73-da2f9440ee3b tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:06.740970 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6381a74a-c1b5-4ed2-8f73-da2f9440ee3b tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.481660 May 19 08:17:06.755674 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 311/667] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:17:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:06.762825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-34543355", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "476a6071-8d69-4933-aad7-9ec8aa51858f"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:06.893229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] validate_networks() for [('476a6071-8d69-4933-aad7-9ec8aa51858f', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:07.323425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:07.323896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:07.324300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:07.324846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:07.325255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:07.351396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:07.351840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:07.354288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:07.355472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:07.408265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=24 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:07.433129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Getting quotas for project 204d5dba56554f908677919295586e57. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:07.443686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Getting quotas for user dab9b2c7376c46df8668606028491b8c and project 204d5dba56554f908677919295586e57. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:07.473857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:07.476193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:07.593560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94eebadf-c013-494c-a527-3e8341ca67ea tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348630 May 19 08:17:07.594521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 357/668] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:17:07.603537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:07.610747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:07.636361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:07.637970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:07.639396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:07.639858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:07.953055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:07.970058 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9713d6ec-0093-4eb3-bd88-14f961ad5ac6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.374449 May 19 08:17:07.990272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 358/669] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:07 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:07.995638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:07.996181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:08.012155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.012657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:08.013489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.013995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:08.824383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:08.834857 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:08.838135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70d9bc5f-fd9d-43c0-b9e8-cf977e01daac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.846622 May 19 08:17:08.838340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:08.838631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:08.839279 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 359/670] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:07 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:08.851655 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:08.852087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:08.853912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-708071df-d7ea-4ff2-b6e5-e9923077f59d req-c342f42c-771b-4c8e-8442-7156bf8648ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93eae31-e24a-436c-bc97-3baa1493eb1c", "tag": "c1a5faf3-ec9b-44d9-be6b-4d996e247878"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:08.866184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.866618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:08.867677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.868445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:08.890530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-708071df-d7ea-4ff2-b6e5-e9923077f59d req-c342f42c-771b-4c8e-8442-7156bf8648ba service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.892960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-708071df-d7ea-4ff2-b6e5-e9923077f59d req-c342f42c-771b-4c8e-8442-7156bf8648ba service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:08.895608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Getting quotas for project 699efd30daad449889b1823bf7990948. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:08.901206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Getting quotas for user adcf30b9ac4f4046b0343bc1435a6562 and project 699efd30daad449889b1823bf7990948. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:08.912937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-708071df-d7ea-4ff2-b6e5-e9923077f59d req-c342f42c-771b-4c8e-8442-7156bf8648ba service nova] Creating event network-changed:c1a5faf3-ec9b-44d9-be6b-4d996e247878 for instance d93eae31-e24a-436c-bc97-3baa1493eb1c on chh1-842464-2 May 19 08:17:08.917807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:08.919030 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-708071df-d7ea-4ff2-b6e5-e9923077f59d req-c342f42c-771b-4c8e-8442-7156bf8648ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078331 May 19 08:17:08.920922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:08.924891 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 360/671] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:08.949853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:08.950778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:08.966131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.966858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:08.967863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:08.969847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:09.021196 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b6dcc6c2-153e-4d03-a432-7232f6f6c41e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263059 May 19 08:17:09.022086 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 312/672] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:09.028511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65c90740-fd2b-4d1d-9240-9d42f0060b56 tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-399754795", "imageRef": "4be4845e-ee74-461a-bda9-6a9e749149e7", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:09.092687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:09.109453 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b35d9846-f6af-47c9-a83d-fdf82d0dcf16 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1227 microversion: 2.1 time: 0.181655 May 19 08:17:09.110225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 361/673] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:08 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1227 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:09.120296 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-65c90740-fd2b-4d1d-9240-9d42f0060b56 tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:09.125565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:09.126598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:09.134049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:09.135008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:09.136068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:09.136786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:09.618696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:09.625834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:09.631659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be728240-9c41-4315-b5bc-c99fdd0261ed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.520053 May 19 08:17:09.641039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 362/674] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:09 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:09.654148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47ee4dfc-0bb0-4e2e-bebe-7a25fd838169 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:09.656556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47ee4dfc-0bb0-4e2e-bebe-7a25fd838169 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:09.683955 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-65c90740-fd2b-4d1d-9240-9d42f0060b56 tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65c90740-fd2b-4d1d-9240-9d42f0060b56 tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] Request method failure captured: May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 142 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0CtisvvcWZDuppYk0aEgDDR90ey7wqbbSFCXo7D0zxCOfnPeN6WBBXqbBJTqskKjWTPKsIp8MF8qr9E96DC4qmCKdKEjeOnBsg3FZVzXLZBnkdfVCkEYYxURs8Q_y5QkfdU4jrZJgIxkuiJ6j3NOXFv-VDMrD1xTzK6gKIuAFMSfQ May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: af202d756c7d4fd9a48af3fd40a8e306 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsV2NegativeTest-449887356 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af202d756c7d4fd9a48af3fd40a8e306"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af202d756c7d4fd9a48af3fd40a8e306"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af202d756c7d4fd9a48af3fd40a8e306"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af202d756c7d4fd9a48af3fd40a8e306"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsV2NegativeTest-449887356 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: af202d756c7d4fd9a48af3fd40a8e306 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-449887356 May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsV2NegativeTest-449887356-project May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: f3392227db4f445aa6f9b7cf4e1cc8ef May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsV2NegativeTest-449887356-project May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-399754795", "imageRef": "4be4845e-ee74-461a-bda9-6a9e749149e7", "flavorRef": "452"}} May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: exception: Flavor's memory is too small for requested image. May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-399754795', 'imageRef': '4be4845e-ee74-461a-bda9-6a9e749149e7', 'flavorRef': '452'}}} May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:17:09.686028 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 19 08:17:09.691743 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:09.693752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65c90740-fd2b-4d1d-9240-9d42f0060b56 tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:09.695382 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-65c90740-fd2b-4d1d-9240-9d42f0060b56 tempest-FlavorsV2NegativeTest-449887356 tempest-FlavorsV2NegativeTest-449887356-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.671596 May 19 08:17:09.700696 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 313/675] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:09 2022] POST /compute/v2.1/servers => generated 93 bytes in 678 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:17:09.818632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47ee4dfc-0bb0-4e2e-bebe-7a25fd838169 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:09.827339 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47ee4dfc-0bb0-4e2e-bebe-7a25fd838169 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1214 microversion: 2.1 time: 0.183033 May 19 08:17:09.849814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 363/676] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:09 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:09.857445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:09.858439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:09.870379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:09.872266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:09.873466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:09.874258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:10.241459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-618fb0b7-4fe6-4463-a09b-ea434101591c tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] Calling method '.version_select at 0x7f3212249e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:10.242886 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:10.242886 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:17:10.274225 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-618fb0b7-4fe6-4463-a09b-ea434101591c tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.572107 May 19 08:17:10.284947 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 314/677] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:17:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:10.290991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:10.292126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:10.302913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:10.303783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:10.305052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:10.305697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:10.331239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:10.347300 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af4890f4-8bbe-4754-b22d-667935523f0b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.492799 May 19 08:17:10.348744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 364/678] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:09 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:10.377419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0ff1988-009b-4a36-9c47-d7f2ec9ac733 tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] Action: 'update', calling method: .version_select at 0x7f3212208160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:10.383705 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:10.383705 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:17:10.427125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:10.437580 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-132135ce-d1dd-4efa-8a67-3e3c9bb81a52 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1289 microversion: 2.1 time: 0.151077 May 19 08:17:10.438786 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 315/679] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:10 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:10.565458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:10.659466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:10.660508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:10.683102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:10.685282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:10.688352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:10.690529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:10.758218 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0ff1988-009b-4a36-9c47-d7f2ec9ac733 tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.406756 May 19 08:17:10.764761 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 365/680] 10.222.0.78 () {60 vars in 1205 bytes} [Thu May 19 08:17:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:10.776931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-250c1c12-b0f8-43e7-a200-a90487987d5e tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] Calling method '.version_select at 0x7f3212333700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:10.779414 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:10.779414 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:17:10.822961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-250c1c12-b0f8-43e7-a200-a90487987d5e tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.052970 May 19 08:17:10.829325 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 366/681] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:17:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:10.841206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82a90d80-16d6-4b09-b9f1-1a05cceb3e12 tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] Action: 'update', calling method: .version_select at 0x7f32121ccc10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:11.036851 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82a90d80-16d6-4b09-b9f1-1a05cceb3e12 tempest-QuotaClassesAdminTestJSON-1615818918 tempest-QuotaClassesAdminTestJSON-1615818918-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.205936 May 19 08:17:11.038405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 367/682] 10.222.0.78 () {60 vars in 1205 bytes} [Thu May 19 08:17:10 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:11.054898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:11.056058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:11.056797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:11.064749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:11.065965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:11.066650 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-52d3c713-ab8c-48d1-bdfb-210bafefe2f1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.412081 May 19 08:17:11.067021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:11.067534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:11.070680 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 316/683] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:10 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:11.175134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:11.187229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc3c4433-f422-452f-95fa-9497ff6a2474 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1284 microversion: 2.1 time: 0.136107 May 19 08:17:11.190889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 368/684] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:11 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:11.378107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:11.379959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:11.393742 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:11.395034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:11.399674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:11.401706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:11.458407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:11.459033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:11.473712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:11.474239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:11.474964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:11.475527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:11.874033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:11.885221 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0a3651e1-8eed-49c9-8431-59b7ea4ecbe9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.519681 May 19 08:17:11.885862 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 317/685] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:11 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:11.968753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:11.982819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd9cc5a0-ebe4-4c2a-9209-8256372737fd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.526858 May 19 08:17:11.995340 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 369/686] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:11 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:12.085860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:12.087113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:12.095344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:12.096160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:12.097495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:12.098315 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:12.210624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:12.211321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:12.222742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:12.223203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:12.223995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:12.224438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:12.411272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:12.422103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef73a9ed-bcbb-4475-88a5-107ce8c04d7f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1272 microversion: 2.1 time: 0.216420 May 19 08:17:12.424265 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 370/687] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:12 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:12.429569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:12.440660 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3d023c8b-284b-45d3-95f9-d4c82cdf1e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.358528 May 19 08:17:12.451090 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 318/688] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:12 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:12.903806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:12.905425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:12.928978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:12.933943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:12.943512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:12.949284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:13.017817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:13.019875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:13.042402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:13.047231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:13.050544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:13.051055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:13.559253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:13.571271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-983e8c51-63b1-4053-a0b0-33da0ff36609 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.672988 May 19 08:17:13.579384 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 371/689] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:12 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:13.607692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:13.611394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:13.655860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:13.656412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:13.660198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:13.661695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:13.662823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:13.667880 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-17d07f1d-d209-4b4a-a81e-ce8cd6b4b747 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.659120 May 19 08:17:13.669372 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 319/690] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:13 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:13.688240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:13.693513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:13.714950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:13.716135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:13.719464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:13.721297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.014336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:14.023102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e198a5b3-1644-4878-8b9a-e4dc13c1dae1 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.440871 May 19 08:17:14.024273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 372/691] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:13 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:14.040454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-78efb5fb-19ba-4f90-8695-2e22d1618ee1 req-d8f07469-d4a9-4a31-8106-3baf03f2e0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22835dee-16c8-439c-9ae8-4033a030d2ff", "tag": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:14.046442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:14.051530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-78efb5fb-19ba-4f90-8695-2e22d1618ee1 req-d8f07469-d4a9-4a31-8106-3baf03f2e0c4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:14.052514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-78efb5fb-19ba-4f90-8695-2e22d1618ee1 req-d8f07469-d4a9-4a31-8106-3baf03f2e0c4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.055363 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-20bf0dff-6c51-4aac-bda7-03477f3fca77 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.384389 May 19 08:17:14.056390 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 320/692] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:13 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:14.068614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-78efb5fb-19ba-4f90-8695-2e22d1618ee1 req-d8f07469-d4a9-4a31-8106-3baf03f2e0c4 service nova] Creating event network-changed:1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 for instance 22835dee-16c8-439c-9ae8-4033a030d2ff on chh2-842464-2 May 19 08:17:14.074624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-78efb5fb-19ba-4f90-8695-2e22d1618ee1 req-d8f07469-d4a9-4a31-8106-3baf03f2e0c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048765 May 19 08:17:14.075406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 373/693] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:14.487516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-73a7cf7e-9494-4c98-9986-4e979489758e req-f0a718b6-b560-45c4-876f-bd616ab72436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93eae31-e24a-436c-bc97-3baa1493eb1c", "name": "network-vif-plugged", "status": "completed", "tag": "c1a5faf3-ec9b-44d9-be6b-4d996e247878"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:14.496877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-73a7cf7e-9494-4c98-9986-4e979489758e req-f0a718b6-b560-45c4-876f-bd616ab72436 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:14.497334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-73a7cf7e-9494-4c98-9986-4e979489758e req-f0a718b6-b560-45c4-876f-bd616ab72436 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.509681 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-73a7cf7e-9494-4c98-9986-4e979489758e req-f0a718b6-b560-45c4-876f-bd616ab72436 service nova] Creating event network-vif-plugged:c1a5faf3-ec9b-44d9-be6b-4d996e247878 for instance d93eae31-e24a-436c-bc97-3baa1493eb1c on chh1-842464-2 May 19 08:17:14.518720 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-73a7cf7e-9494-4c98-9986-4e979489758e req-f0a718b6-b560-45c4-876f-bd616ab72436 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 May 19 08:17:14.522317 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 321/694] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:14.592746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:14.594151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:14.601154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:14.601671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.602450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:14.602887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.707683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:14.708638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:14.718283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:14.718907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.719817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:14.721142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:14.977759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:14.989020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a730d06-41b7-411e-aa6a-e7935002661d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.400451 May 19 08:17:14.990898 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 374/695] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:14 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:15.043322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:15.044643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:15.055116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:15.056909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:15.058157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:15.058845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:15.116159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:15.125051 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-14bec2d7-db56-4661-8e53-8e2d728214f0 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.431035 May 19 08:17:15.126015 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 322/696] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:14 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:15.131662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:15.132433 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:15.139732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:15.140179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:15.141115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:15.141602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:15.457009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:15.466507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:15.468221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-226401c1-5e9d-4d1e-8d6d-26bdd8f69ce0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.430839 May 19 08:17:15.469574 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 375/697] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:15 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:15.476830 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cef02fbd-ff34-4282-9f1e-74b3a2b8063a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.349032 May 19 08:17:15.477455 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 323/698] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:15 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:16.006509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:16.011925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:16.024358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.024801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:16.027600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.032309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:16.102309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-2eb9bd07-48e5-48f5-aa34-1a2c02d36735 req-06161910-bfaf-4f42-8301-2077250884a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03150fbb-bbc2-47a5-ad11-896ae4a22674", "tag": "42fe0906-22b6-46e0-a3b8-c77bc4205f33"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:16.114687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2eb9bd07-48e5-48f5-aa34-1a2c02d36735 req-06161910-bfaf-4f42-8301-2077250884a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.115345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2eb9bd07-48e5-48f5-aa34-1a2c02d36735 req-06161910-bfaf-4f42-8301-2077250884a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:16.153963 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-2eb9bd07-48e5-48f5-aa34-1a2c02d36735 req-06161910-bfaf-4f42-8301-2077250884a8 service nova] Creating event network-changed:42fe0906-22b6-46e0-a3b8-c77bc4205f33 for instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 on chh1-842464-2 May 19 08:17:16.167005 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-2eb9bd07-48e5-48f5-aa34-1a2c02d36735 req-06161910-bfaf-4f42-8301-2077250884a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068151 May 19 08:17:16.168566 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 324/699] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:17:16.181323 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:16.188644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:16.196153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.202966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:16.205588 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.207865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:16.871944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:16.882257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-755577c3-a9fa-480a-9341-472010aa75ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1311 microversion: 2.1 time: 0.879776 May 19 08:17:16.883715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 376/700] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:16 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1311 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:16.890662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:16.891872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:16.900050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.900874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:16.902086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:16.902920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:17.015075 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:17.025792 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-14c37647-670e-4a52-a62d-d650ace64c6e tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.853343 May 19 08:17:17.036800 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 325/701] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:16 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:17.044902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:17.045560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:17.054670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:17.055113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:17.056119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:17.057073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:17.354940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:17.367918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84120b0f-4a18-4b12-b8eb-ab050c7b3e5f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.482632 May 19 08:17:17.389586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 377/702] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:16 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:17.549779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:17.571755 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-88e3bcfe-9305-4512-9f4b-55d455c34f96 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.524827 May 19 08:17:17.574919 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 326/703] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:17 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:17.900066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:17.900680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:17.902764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:17.909783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:17.910507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:17.911444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:17.912034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.044577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:18.045193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:18.055018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:18.059569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.060382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:18.060995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.670739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:18.685232 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1fbe87d2-383a-42c3-b01f-a5612528544e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1495 microversion: 2.1 time: 0.788989 May 19 08:17:18.700726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:18.702024 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 378/704] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:17 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1495 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:18.710800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:18.713604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:18.714688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:18.715058 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f25ac14c-309b-42a6-ad25-691087f2d15d tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.674539 May 19 08:17:18.716461 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 327/705] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:18 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:18.723058 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:18.723988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:18.731042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:18.732494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.733780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:18.734511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.737865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:18.739636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.740675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:18.749921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:18.885585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=12 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:19.144606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:19.154380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:19.162103 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6052e653-4671-4c4a-8e7a-d762255d3aa3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.444014 May 19 08:17:19.164997 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-418e8872-2373-445e-bb3b-f4412344be3f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.462222 May 19 08:17:19.166666 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 328/706] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:18 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:19.175200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:19.176272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:19.180322 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 379/707] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:18 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:19.191470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:19.192739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:19.193790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:19.194643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:19.515807 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-64ca4a68-9b0d-4ffd-bfdb-d6232e4b154e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1646 microversion: 2.1 time: 0.347828 May 19 08:17:19.529970 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 329/708] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:19 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1646 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:19.540873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:19.541555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:19.577004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:19.577496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:19.578283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:19.578753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:19.737970 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:19.741206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:19.767933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:19.771510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:19.775503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:19.776307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.081441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:20.097625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55848296-555c-4ef8-9c41-b20c17025b3c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1646 microversion: 2.1 time: 0.560237 May 19 08:17:20.100119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 380/709] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:19 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1646 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:20.115408 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1851744f-069b-47a6-894b-4ae34120462a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.386516 May 19 08:17:20.121450 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 330/710] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:19 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:20.156273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2a7d975-6cd5-4615-b279-05924682e666 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:20.160163 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:20.160163 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:17:20.164171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2a7d975-6cd5-4615-b279-05924682e666 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.170404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2a7d975-6cd5-4615-b279-05924682e666 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.171842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2a7d975-6cd5-4615-b279-05924682e666 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.175906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2a7d975-6cd5-4615-b279-05924682e666 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.184938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:20.186365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:20.201096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.203312 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.204337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.206932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.241780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2a7d975-6cd5-4615-b279-05924682e666 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.124937 May 19 08:17:20.242633 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 381/711] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:17:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:20.257349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:20.263045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:20.277980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.284404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.285365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.287454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.289261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=16 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:20.771181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:20.783229 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2444b2c0-8fbe-42e0-a122-39da4b60274f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.603565 May 19 08:17:20.795645 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 331/712] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:20 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:17:20.805021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:20.818448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:20.836222 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.837108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:20.837908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.841746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:20.842517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:20.850533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56611013-da17-4039-beb6-e8beaf37d81a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.598987 May 19 08:17:20.852857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 382/713] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:20 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:21.006549 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2b7d8bde-fa18-423f-9738-1964cf9e2d4d tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c/action" status: 202 len: 0 microversion: 2.1 time: 0.216736 May 19 08:17:21.011157 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 332/714] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:20 2022] POST /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:21.018601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:21.019655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:21.032136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:21.043810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.044849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.045986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.050763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.142734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:21.147772 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:21.164870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.165765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.170472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.175241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.450100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24cd4c0c-c266-46a7-a6c5-a6a8933fb738 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1651 microversion: 2.1 time: 0.435639 May 19 08:17:21.451601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 383/715] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:21 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1651 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:21.608042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:21.622828 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-28b25b50-450a-486b-bdcb-e2c613d34bca tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.488838 May 19 08:17:21.627541 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 333/716] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:21 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:21.804438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:21.805744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:21.820182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.821684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.822452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.823788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.868059 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:21.868650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:21.875110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.875555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:21.886853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:21.887435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:22.640945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:22.646246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:22.651941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b9aaa07-fd02-44d3-96e5-a50a28405562 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1475 microversion: 2.1 time: 0.851764 May 19 08:17:22.654501 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 384/717] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:21 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1475 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:22.660416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:22.661335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:22.676048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:22.676507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:22.677337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:22.677773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:22.720718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:22.734588 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2624a0e6-52b4-43b5-89a7-5f3327fbd710 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.868430 May 19 08:17:22.737544 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 334/718] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:21 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:22.758962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:22.759961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:22.766414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:22.767832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:22.770184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:22.770787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:23.051952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f4ead59-9a2a-4bc6-ba30-fa146d488128 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1631 microversion: 2.1 time: 0.395967 May 19 08:17:23.052884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 385/719] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:22 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1631 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:23.074140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-842464-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:23.076261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:23.114409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:23.116048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:23.117827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:23.118621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:23.184374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lazy-loading 'flavor' on Instance uuid d93eae31-e24a-436c-bc97-3baa1493eb1c {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:17:23.206442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Going to try to live migrate instance to chh2-842464-2 {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:17:23.280489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:23.290194 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1fedecc7-5f0d-45ee-84d2-bc656346ddbf tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.549979 May 19 08:17:23.296672 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 335/720] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:22 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:23.352382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-02d6a703-4165-4c64-8f91-26cae4d63d54 req-7236f2d0-ec7e-41c1-acc1-cb27912f7ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73b117-8cc4-43db-a810-618ca851c6e2", "name": "network-vif-unplugged", "status": "completed", "tag": "7994c7b7-4412-4f8d-a104-920b64ccfec2"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:23.369625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-02d6a703-4165-4c64-8f91-26cae4d63d54 req-7236f2d0-ec7e-41c1-acc1-cb27912f7ce4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:23.375546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-02d6a703-4165-4c64-8f91-26cae4d63d54 req-7236f2d0-ec7e-41c1-acc1-cb27912f7ce4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:23.414839 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-02d6a703-4165-4c64-8f91-26cae4d63d54 req-7236f2d0-ec7e-41c1-acc1-cb27912f7ce4 service nova] Creating event network-vif-unplugged:7994c7b7-4412-4f8d-a104-920b64ccfec2 for instance 3e73b117-8cc4-43db-a810-618ca851c6e2 on chh1-842464-2 May 19 08:17:23.460991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [req-02d6a703-4165-4c64-8f91-26cae4d63d54 req-7236f2d0-ec7e-41c1-acc1-cb27912f7ce4 service nova] Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:17:23.505809 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-02d6a703-4165-4c64-8f91-26cae4d63d54 req-7236f2d0-ec7e-41c1-acc1-cb27912f7ce4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152229 May 19 08:17:23.511315 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 336/721] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:17:23.672412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:23.673131 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:23.705729 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:23.706199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:23.708358 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:23.715486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:24.266483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:24.278657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-436ff62e-eb55-4205-8cbe-54bd90380368 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1474 microversion: 2.1 time: 0.610560 May 19 08:17:24.282421 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 337/722] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:23 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1474 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:24.303856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:24.305048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:24.316098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:24.317135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:24.318207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:24.318810 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:24.751931 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:24.809202 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bec6b2c1-6bed-4234-af81-9a280edd1b3e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.524076 May 19 08:17:24.814715 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 338/723] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:24 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:25.203653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-624921548", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "7ad11d47-0088-4573-b689-7e5f3470dca9"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:25.323815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] validate_networks() for [('7ad11d47-0088-4573-b689-7e5f3470dca9', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:26.242121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:26.243530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:26.244909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:26.245891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:26.246711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:26.271485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.271941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.274735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.274735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.293650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Getting quotas for project 75983445eabf4515a84869f1af0f0b43. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:26.300240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Getting quotas for user 9102338976074e61ad6b552baf015229 and project 75983445eabf4515a84869f1af0f0b43. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:26.318242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:26.320839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:26.336925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a62774f-2e98-43dd-8b12-42deea679c5b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c/action" status: 202 len: 0 microversion: 2.1 time: 3.271728 May 19 08:17:26.340777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 386/724] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:23 2022] POST /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c/action => generated 0 bytes in 3277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:26.346227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:26.348423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:26.356853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.357215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.358024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.358665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.384894 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-81f44ace-2438-4685-a486-5ee7e808210a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.564830 May 19 08:17:26.386531 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 339/725] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:26.500355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf71aa27-e6d7-4430-bd42-0557483106a6 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Action: 'create', calling method: .version_select at 0x7f321234f280>, body: {"keypair": {"name": "tempest-keypair-1558659763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTXVedutQSmlHp6JKmiDQ2XLOqbU93Ewvl78DODie8edhP/t7iiM4ld/VKrm91ZlOYaV5VQr2MCUKuq/0fHURq72WRfMaSD5fkUbTFuEbEmp0+BFOac4666zfUWCFPgvQ=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:26.522692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-bf71aa27-e6d7-4430-bd42-0557483106a6 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Getting quotas for project 36fdc1b726454b47a508f87d2af575d2. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:26.531522 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-bf71aa27-e6d7-4430-bd42-0557483106a6 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Getting quotas for user 7124c7ef587a474b900d252885eb7e2e and project 36fdc1b726454b47a508f87d2af575d2. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:26.538686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:26.552594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff8acf86-1482-4a64-9253-484a6e877538 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1331 microversion: 2.1 time: 0.210694 May 19 08:17:26.553230 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 387/726] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:26 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1331 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:26.554767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:26.563547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8d347a38-e646-4a72-9c1b-bdd1e44ff99a req-615c1832-f5ec-4bdd-884f-a44ec316cd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22835dee-16c8-439c-9ae8-4033a030d2ff", "name": "network-vif-plugged", "status": "completed", "tag": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:26.572818 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf71aa27-e6d7-4430-bd42-0557483106a6 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183752 May 19 08:17:26.584052 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 340/727] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:17:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:26.589977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:26.590905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:26.593226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8d347a38-e646-4a72-9c1b-bdd1e44ff99a req-615c1832-f5ec-4bdd-884f-a44ec316cd0b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.593759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8d347a38-e646-4a72-9c1b-bdd1e44ff99a req-615c1832-f5ec-4bdd-884f-a44ec316cd0b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.599512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.600214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.601485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.602092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.627789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8d347a38-e646-4a72-9c1b-bdd1e44ff99a req-615c1832-f5ec-4bdd-884f-a44ec316cd0b service nova] Creating event network-vif-plugged:1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 for instance 22835dee-16c8-439c-9ae8-4033a030d2ff on chh2-842464-2 May 19 08:17:26.637162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8d347a38-e646-4a72-9c1b-bdd1e44ff99a req-615c1832-f5ec-4bdd-884f-a44ec316cd0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082336 May 19 08:17:26.638578 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 388/728] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:26.657574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fb270da8-6c4a-4366-b1e6-78dc8a293ca1 req-c3b06ea2-6ce1-4a34-9b0a-54f2097277b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e73b117-8cc4-43db-a810-618ca851c6e2", "tag": "7994c7b7-4412-4f8d-a104-920b64ccfec2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:26.663998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=19,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:26.677246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fb270da8-6c4a-4366-b1e6-78dc8a293ca1 req-c3b06ea2-6ce1-4a34-9b0a-54f2097277b6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.679025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fb270da8-6c4a-4366-b1e6-78dc8a293ca1 req-c3b06ea2-6ce1-4a34-9b0a-54f2097277b6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.708899 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fb270da8-6c4a-4366-b1e6-78dc8a293ca1 req-c3b06ea2-6ce1-4a34-9b0a-54f2097277b6 service nova] Creating event network-changed:7994c7b7-4412-4f8d-a104-920b64ccfec2 for instance 3e73b117-8cc4-43db-a810-618ca851c6e2 on chh1-842464-2 May 19 08:17:26.723728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-fb270da8-6c4a-4366-b1e6-78dc8a293ca1 req-c3b06ea2-6ce1-4a34-9b0a-54f2097277b6 service nova] Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:17:26.762725 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fb270da8-6c4a-4366-b1e6-78dc8a293ca1 req-c3b06ea2-6ce1-4a34-9b0a-54f2097277b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120289 May 19 08:17:26.764120 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 389/729] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:26.778891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:26.779801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:26.800974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.801490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.802252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:26.802685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:26.978685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:26.990519 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d012a8ac-2598-4995-a042-fa6c8360a636 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1472 microversion: 2.1 time: 0.405010 May 19 08:17:26.991121 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 341/730] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:26 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:27.077651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1869957154", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "54df6a27-dc6e-457f-b69c-50c48499146f"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:27.154598 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] validate_networks() for [('54df6a27-dc6e-457f-b69c-50c48499146f', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:27.188818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:27.197812 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f1cf4c2-5ef3-43b7-b576-6d6e67c64490 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.432177 May 19 08:17:27.198390 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 390/731] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:26 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:27.208738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:27.209765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:27.215951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:27.216708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:27.219422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:27.219913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.273910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:28.294032 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1337491f-315d-4c3b-99c1-2d962319304c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1505 microversion: 2.1 time: 1.089711 May 19 08:17:28.296037 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 391/732] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:27 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1505 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:28.306768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:28.312100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:28.327516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.328327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.330354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.331408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.503320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:28.519952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dce5227e-f2fe-4363-bc13-c2e4312f16a0 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1213 microversion: 2.1 time: 0.221420 May 19 08:17:28.520565 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 392/733] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:28 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:28.525240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:28.533252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:28.552338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.553181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.554080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.554529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.598894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:17:28.754346 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c63fb00-4f1b-4a6b-9be8-d12617801de2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 204 len: 0 microversion: 2.1 time: 0.232436 May 19 08:17:28.758825 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 393/734] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:17:28 2022] DELETE /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:17:28.765535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:28.777365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:28.810068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.810837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.813647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.817632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.937794 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:28.938782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:28.939971 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:28.940628 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:28.941226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:28.966366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.967396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:28.970588 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:28.975353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.015496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Getting quotas for project 6d1c48363495440688a94cad914be0f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:29.029751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Getting quotas for user 9eb7e9176a904e8a97f21e31b54c631e and project 6d1c48363495440688a94cad914be0f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:29.045163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:29.047661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:29.108552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:29.122170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2349e537-dd31-4b80-b827-cfd2a63b97fb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1534 microversion: 2.1 time: 0.361505 May 19 08:17:29.123064 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 394/735] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:28 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1534 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:29.139917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:29.144541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:29.160027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.160486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.161429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.161609 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0bff59c8-2465-46fb-b9c9-9bef117a5b7c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.169281 May 19 08:17:29.161868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.162974 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 342/736] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:29.171825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:29.179839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:29.188215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.189071 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.190351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.191045 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.428760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:29.442204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07d3babb-8074-4fa7-a604-73c01a544cb6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1469 microversion: 2.1 time: 0.313636 May 19 08:17:29.457090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 395/737] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:29 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1469 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:29.462398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:29.463021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:29.485677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.486829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.487797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.488443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.708830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:29.718162 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dfce96dd-b592-4292-bcac-7cf5a681c6f6 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.553858 May 19 08:17:29.722153 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 343/738] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:29 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:29.731664 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-e69beed7-7174-491f-88c4-afdf4d256c1a req-14f22ea9-874b-4bed-a80d-862697bdf8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03150fbb-bbc2-47a5-ad11-896ae4a22674", "name": "network-vif-plugged", "status": "completed", "tag": "42fe0906-22b6-46e0-a3b8-c77bc4205f33"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:29.757838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-e69beed7-7174-491f-88c4-afdf4d256c1a req-14f22ea9-874b-4bed-a80d-862697bdf8ce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.758503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-e69beed7-7174-491f-88c4-afdf4d256c1a req-14f22ea9-874b-4bed-a80d-862697bdf8ce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.778228 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-e69beed7-7174-491f-88c4-afdf4d256c1a req-14f22ea9-874b-4bed-a80d-862697bdf8ce service nova] Creating event network-vif-plugged:42fe0906-22b6-46e0-a3b8-c77bc4205f33 for instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 on chh1-842464-2 May 19 08:17:29.796017 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-e69beed7-7174-491f-88c4-afdf4d256c1a req-14f22ea9-874b-4bed-a80d-862697bdf8ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071720 May 19 08:17:29.799791 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 344/739] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:29.827173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a4204548-f5cb-49a1-99a4-547d9dd95cae tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'create', calling method: .version_select at 0x7f3212281c10>, body: {"pool": "9f3c70ce-fbff-47a9-b500-e2e998efb9cd"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:29.838973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:29.861729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-431694b1-4bfd-4cf1-9723-2c10be847065 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1713 microversion: 2.1 time: 0.402740 May 19 08:17:29.865029 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 396/740] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:29 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1713 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:29.890130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:29.896893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:29.910959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.914222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:29.915369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:29.918962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:30.417610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:30.683869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:30.701533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8359b086-516a-49c1-97e5-2937aa5ee2b4 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1228 microversion: 2.1 time: 0.821784 May 19 08:17:30.703667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 397/741] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:29 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1228 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:30.714318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:30.715274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:30.723273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:30.724783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:30.726527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:30.727229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:31.114066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:31.119405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:31.133044 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce9d0e99-1b11-4926-9746-ee6e2dbcf38b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1505 microversion: 2.1 time: 0.426793 May 19 08:17:31.144914 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 398/742] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:30 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:31.148355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:31.149035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:31.167006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:31.167734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:31.169338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:31.169338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:31.290147 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f8e9535-7c2b-4eeb-a51d-42b4f166c4d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2/action" status: 204 len: 0 microversion: 2.1 time: 0.153715 May 19 08:17:31.294447 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 399/743] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:31 2022] POST /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2/action => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:17:31.304491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:31.305639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:31.316889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:31.318059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:31.319420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:31.320322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:31.555521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:31.566184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b60de463-06cc-4a1e-a314-d0555298824a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1275 microversion: 2.1 time: 0.268673 May 19 08:17:31.567035 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 400/744] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:31 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:31.585084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:31.585734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:31.607373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:31.607904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:31.609007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:31.609691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:32.133903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:32.141783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ef05bfa-1885-431d-9f5b-9d84ea699347 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1314 microversion: 2.1 time: 0.573390 May 19 08:17:32.165866 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 401/745] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:31 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:32.171625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:32.172254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:32.194963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:32.205792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:32.206758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:32.207213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:32.982660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83555ee44aaf44b5aec6a2afe7f43d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab46fa809fe4a9bb8ad076da226b643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:32.993201 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90f228b2-3ff5-4733-b86b-d77b74ac1dfe tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 200 len: 1713 microversion: 2.1 time: 0.826088 May 19 08:17:32.999520 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 402/746] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:32 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 1713 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:33.010793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:33.012659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:33.026684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:33.027426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:33.028400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:33.029095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:33.485387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:33.496189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9346f916-bd5a-47ad-99fc-e1154d2a788b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1469 microversion: 2.1 time: 0.495339 May 19 08:17:33.497457 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 403/747] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:32 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1469 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:33.504433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:33.505365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:33.512901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:33.513583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:33.514554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:33.515338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:34.317867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:34.326715 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0331530c-da65-4204-a780-6bf54d98e13b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1324 microversion: 2.1 time: 0.827537 May 19 08:17:34.327313 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 404/748] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:33 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1324 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:34.368563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:34.369191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:34.379182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:34.379182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:34.379867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:34.388077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:34.944174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:34.954272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4eada849-f2a2-4ea5-8818-b8616536fe45 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1505 microversion: 2.1 time: 0.611966 May 19 08:17:34.959369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 405/749] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:34 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:34.977362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:34.978295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:34.994849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:34.995747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:34.996775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:35.000534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:35.478359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:35.496764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8edd617-6fb0-479b-b7c9-fec16ea58a30 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1317 microversion: 2.1 time: 0.535832 May 19 08:17:35.501154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 406/750] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:34 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:35.521117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b2be510f-aa49-4183-875f-c039e7ca394a req-42ab53ae-cec9-48bb-bca2-0b619d825cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73b117-8cc4-43db-a810-618ca851c6e2", "name": "network-vif-plugged", "status": "completed", "tag": "7994c7b7-4412-4f8d-a104-920b64ccfec2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:35.539427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b2be510f-aa49-4183-875f-c039e7ca394a req-42ab53ae-cec9-48bb-bca2-0b619d825cd8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:35.545962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b2be510f-aa49-4183-875f-c039e7ca394a req-42ab53ae-cec9-48bb-bca2-0b619d825cd8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:35.576168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b2be510f-aa49-4183-875f-c039e7ca394a req-42ab53ae-cec9-48bb-bca2-0b619d825cd8 service nova] Creating event network-vif-plugged:7994c7b7-4412-4f8d-a104-920b64ccfec2 for instance 3e73b117-8cc4-43db-a810-618ca851c6e2 on chh1-842464-2 May 19 08:17:35.587853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b2be510f-aa49-4183-875f-c039e7ca394a req-42ab53ae-cec9-48bb-bca2-0b619d825cd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075686 May 19 08:17:35.593765 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 407/751] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:35.606349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a1aebc4e-65fb-4f24-a6d2-d067386ad0f2 req-a4fe5661-7c14-4dfd-badc-7a434bcc4ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93eae31-e24a-436c-bc97-3baa1493eb1c", "name": "network-vif-unplugged", "status": "completed", "tag": "c1a5faf3-ec9b-44d9-be6b-4d996e247878"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:35.633921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a1aebc4e-65fb-4f24-a6d2-d067386ad0f2 req-a4fe5661-7c14-4dfd-badc-7a434bcc4ca0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:35.634732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a1aebc4e-65fb-4f24-a6d2-d067386ad0f2 req-a4fe5661-7c14-4dfd-badc-7a434bcc4ca0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:35.654430 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a1aebc4e-65fb-4f24-a6d2-d067386ad0f2 req-a4fe5661-7c14-4dfd-badc-7a434bcc4ca0 service nova] Creating event network-vif-unplugged:c1a5faf3-ec9b-44d9-be6b-4d996e247878 for instance d93eae31-e24a-436c-bc97-3baa1493eb1c on chh1-842464-2 May 19 08:17:35.672176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a1aebc4e-65fb-4f24-a6d2-d067386ad0f2 req-a4fe5661-7c14-4dfd-badc-7a434bcc4ca0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074425 May 19 08:17:35.673519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 408/752] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:35.700498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:35.701904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:35.722735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:35.726893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:35.727830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:35.728286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.242611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:36.252468 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c55989ee-0d51-453d-97f1-637417297507 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1502 microversion: 2.1 time: 0.576964 May 19 08:17:36.269544 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 409/753] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:35 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1502 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:36.274910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:36.275757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:36.286921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.287791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.288772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.289409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.323591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e HTTP/1.1 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7c58c656-8f86-4a69-85ce-778327a4118e'} May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:36.326701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:36.332170 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:36.333675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:36.334782 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2bf09ba-292b-4536-a0e6-fd33dbd5bac7 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 404 len: 111 microversion: 2.1 time: 0.063885 May 19 08:17:36.335519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 410/754] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:36 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:36.341698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:36.342699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:36.350452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.351397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.352787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.353515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.391412 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a4204548-f5cb-49a1-99a4-547d9dd95cae tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.589741 May 19 08:17:36.399485 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 345/755] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:17:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:36.404676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:36.406578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:36.430407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.431029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.431956 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.436509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.745993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:36.757185 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36e57e14-6faf-46a1-92d0-fa8beb71e715 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1461 microversion: 2.1 time: 0.420383 May 19 08:17:36.757821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 411/756] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:36 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1461 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:36.766046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:36.766939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:36.773785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:36.793216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.794003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.795023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.795465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.806401 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7979dc54-7b7a-4ea3-93b6-f2f94efcbaf2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1324 microversion: 2.1 time: 0.405504 May 19 08:17:36.818548 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 346/757] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:36 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1324 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:36.825551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1679311435"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:36.831221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:36.845942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.846930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:36.848877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:36.849198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:37.168226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:37.176222 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.network.security_group_api [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Adding security group 9ffa7152-ec72-4937-aa6b-13d3feef940c to port 42fe0906-22b6-46e0-a3b8-c77bc4205f33 May 19 08:17:37.179577 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69f08f47-4ed1-4f41-bbec-8a441006b3db tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1505 microversion: 2.1 time: 0.419942 May 19 08:17:37.182132 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 412/758] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:36 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:37.187473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:37.187978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:37.203551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:37.204312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:37.205096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:37.205735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:37.226424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 HTTP/1.1 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd2ebe82b-7784-4409-942a-d691ed1937d1'} May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:37.228318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2e7dcf1-88a0-49d5-a22c-f8f379a29727 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 404 len: 111 microversion: 2.1 time: 0.046948 May 19 08:17:37.234595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 413/759] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:17:37 2022] DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:37.239835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'action', calling method: .version_select at 0x7f3214bc3dc0>, body: {"addFloatingIp": {"address": "172.33.1.211"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:37.241052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:37.247807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:37.248542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:37.249103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:37.249594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:37.332664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Acquired lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:17:38.462216 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a391874e-8d39-4d5d-a32b-9440441145e2 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674/action" status: 202 len: 0 microversion: 2.1 time: 1.642086 May 19 08:17:38.467934 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 347/760] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:36 2022] POST /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674/action => generated 0 bytes in 1648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:38.475625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-f1fe4e93-cade-4d34-b9d2-23413f63082f req-892e34f2-1a7e-456d-8410-de86fcadf61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743a356d-1eac-4730-8979-0734df0b9685", "tag": "b6c92392-c4e2-4fc2-ba09-f4ab93f4ecc9"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:38.502472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-f1fe4e93-cade-4d34-b9d2-23413f63082f req-892e34f2-1a7e-456d-8410-de86fcadf61e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:38.505797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-f1fe4e93-cade-4d34-b9d2-23413f63082f req-892e34f2-1a7e-456d-8410-de86fcadf61e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:38.512070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:38.526066 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-f1fe4e93-cade-4d34-b9d2-23413f63082f req-892e34f2-1a7e-456d-8410-de86fcadf61e service nova] Creating event network-changed:b6c92392-c4e2-4fc2-ba09-f4ab93f4ecc9 for instance 743a356d-1eac-4730-8979-0734df0b9685 on chh2-842464-2 May 19 08:17:38.532321 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-f1fe4e93-cade-4d34-b9d2-23413f63082f req-892e34f2-1a7e-456d-8410-de86fcadf61e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062447 May 19 08:17:38.534046 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 348/761] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:38.541474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:38.542191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:38.552026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:38.552480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:38.553814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:38.554418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:38.904599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:38.921013 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6c1ac9fb-624a-42cb-b78b-3b85cdaea974 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1317 microversion: 2.1 time: 0.384856 May 19 08:17:38.932284 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 349/762] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:38 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:38.938073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:38.939075 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:38.962755 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:38.963452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:38.964622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:38.965088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:39.005760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:39.038758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=16 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:39.279625 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-02362d26-51a6-4e05-8b61-1063e34fd545 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1612 microversion: 2.1 time: 0.345740 May 19 08:17:39.293847 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 350/763] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:38 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1612 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:39.303089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:39.303910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:39.310449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:39.311002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:39.311811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:39.312117 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:39.328320 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 HTTP/1.1 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'd2ebe82b-7784-4409-942a-d691ed1937d1'} May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:39.330536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7d819a74-97e5-4ef4-9530-36ed2feb6dc2 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 404 len: 111 microversion: 2.1 time: 0.033939 May 19 08:17:39.334470 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 351/764] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:39 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:39.339305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c58c656-8f86-4a69-85ce-778327a4118e", "name": "network-vif-deleted", "tag": "dd5a186c-59ec-41aa-992d-1ff94f5fc79c"}, {"name": "network-changed", "server_uuid": "d93eae31-e24a-436c-bc97-3baa1493eb1c", "tag": "c1a5faf3-ec9b-44d9-be6b-4d996e247878"}, {"name": "network-changed", "server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:39.347598 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:39.348049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:39.365178 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] Creating event network-vif-deleted:dd5a186c-59ec-41aa-992d-1ff94f5fc79c for instance 7c58c656-8f86-4a69-85ce-778327a4118e on chh2-842464-2 May 19 08:17:39.365737 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] Creating event network-changed:c1a5faf3-ec9b-44d9-be6b-4d996e247878 for instance d93eae31-e24a-436c-bc97-3baa1493eb1c on chh1-842464-2 May 19 08:17:39.366231 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] Creating event network-changed:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:17:39.380755 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a1e7317f-0369-4c7e-a3bf-09731ef123cd req-c76642c2-5cd5-4ffb-8ee9-d2d2d142a9d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.046865 May 19 08:17:39.383210 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 352/765] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:39.388942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:39.389342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:39.407292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:39.408477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:39.409075 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:39.409547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:40.053144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Building network info cache for instance {{(pid=119072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:17:40.490679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:40.505289 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-82d7ad65-f6db-4e4e-a98a-2dd15cc83282 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1324 microversion: 2.1 time: 1.120639 May 19 08:17:40.518085 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 353/766] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:39 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1324 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:40.544489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:40.551821 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:40.575664 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:40.576709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:40.578307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:40.582953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:41.576380 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:41.595826 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5b5b4c40-222a-42bb-9907-c8d9ce30e697 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1505 microversion: 2.1 time: 1.075544 May 19 08:17:41.600521 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 354/767] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:40 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1505 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:41.608467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e68e95b8-135e-42cb-ad1d-24733d580069 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32124ae700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:42.016434 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-e68e95b8-135e-42cb-ad1d-24733d580069 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use.", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:42.018129 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-e68e95b8-135e-42cb-ad1d-24733d580069 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.018129 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e68e95b8-135e-42cb-ad1d-24733d580069 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c HTTP/1.1 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: exception: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '9ffa7152-ec72-4937-aa6b-13d3feef940c'} May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.020272 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e68e95b8-135e-42cb-ad1d-24733d580069 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 400 to user: Security Group 9ffa7152-ec72-4937-aa6b-13d3feef940c in use. May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-eaa51166-6cf8-47cc-bfef-25679f529f38'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:42.024273 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e68e95b8-135e-42cb-ad1d-24733d580069 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c" status: 400 len: 185 microversion: 2.1 time: 0.417019 May 19 08:17:42.032028 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 355/768] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:17:41 2022] DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c => generated 185 bytes in 423 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:17:42.034347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c3d8b695-1b56-49b9-95c9-ce0b44c0ca47 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '.version_select at 0x7f32122810d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:42.036948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c3d8b695-1b56-49b9-95c9-ce0b44c0ca47 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:42.037428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c3d8b695-1b56-49b9-95c9-ce0b44c0ca47 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:42.070566 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c3d8b695-1b56-49b9-95c9-ce0b44c0ca47 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.042021 May 19 08:17:42.080177 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 356/769] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:17:42 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:42.086284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-843660e1-9441-4b92-b4d0-cd3a5d2120a4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '.version_select at 0x7f32124aeca0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:42.129813 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-843660e1-9441-4b92-b4d0-cd3a5d2120a4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865817268" status: 202 len: 0 microversion: 2.1 time: 0.047800 May 19 08:17:42.130411 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 357/770] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865817268 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:42.163386 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:42.164335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:42.193967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:42.209176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:42.210173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:42.215359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:42.708772 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:42.726777 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ca68b789-eb1a-4b81-b660-e97917dce00a tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1317 microversion: 2.1 time: 0.594436 May 19 08:17:42.727607 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 358/771] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:42 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:42.739484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-244de530-d551-4b70-8af5-9a400bd118f5 req-978f8b0d-7759-48b8-8443-cb9218129342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03150fbb-bbc2-47a5-ad11-896ae4a22674", "tag": "42fe0906-22b6-46e0-a3b8-c77bc4205f33"}, {"name": "network-changed", "server_uuid": "22835dee-16c8-439c-9ae8-4033a030d2ff", "tag": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:42.766915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-244de530-d551-4b70-8af5-9a400bd118f5 req-978f8b0d-7759-48b8-8443-cb9218129342 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:42.767927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-244de530-d551-4b70-8af5-9a400bd118f5 req-978f8b0d-7759-48b8-8443-cb9218129342 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:42.794815 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-244de530-d551-4b70-8af5-9a400bd118f5 req-978f8b0d-7759-48b8-8443-cb9218129342 service nova] Creating event network-changed:42fe0906-22b6-46e0-a3b8-c77bc4205f33 for instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 on chh1-842464-2 May 19 08:17:42.795584 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-244de530-d551-4b70-8af5-9a400bd118f5 req-978f8b0d-7759-48b8-8443-cb9218129342 service nova] Creating event network-changed:1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 for instance 22835dee-16c8-439c-9ae8-4033a030d2ff on chh2-842464-2 May 19 08:17:42.817680 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-244de530-d551-4b70-8af5-9a400bd118f5 req-978f8b0d-7759-48b8-8443-cb9218129342 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082781 May 19 08:17:42.818614 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 359/772] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:42.831591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:42.832608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:42.850944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:42.851633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:42.852631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:42.853228 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:43.198221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Updating instance_info_cache with network_info: [{"id": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3", "address": "fa:16:3e:11:a5:10", "network": {"id": "7b6fe1bf-d728-45d9-a817-17609e81eb8e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-960013584-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.33.1.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "204d5dba56554f908677919295586e57", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1f455f10-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:17:43.245069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Releasing lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:17:43.247997 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a86a912e-2412-41a8-a321-58ca925f2bcb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action" status: 202 len: 0 microversion: 2.1 time: 6.012582 May 19 08:17:43.249127 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 414/773] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:37 2022] POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action => generated 0 bytes in 6018 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:17:43.263521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:43.268322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:43.287510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:43.291515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:43.293988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:43.296557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:43.424350 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:43.441882 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dad23625-ac02-4558-9373-5d6b9cae8196 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1324 microversion: 2.1 time: 0.620462 May 19 08:17:43.447031 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 360/774] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:42 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:43.457268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2023285487", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:43.461028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:43.530901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a615d5a-9496-4312-b3a9-8814d6d59761 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674/action" status: 202 len: 0 microversion: 2.1 time: 0.270109 May 19 08:17:43.532729 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 415/775] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:43 2022] POST /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:43.544206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:43.555333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:43.571947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:43.572616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:43.577957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:43.578586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:43.585827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:44.148863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:44.163866 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-707b9995-aca8-4aac-ba95-9fa0e76f2fb1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1480 microversion: 2.1 time: 0.621767 May 19 08:17:44.165456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 416/776] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:43 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1480 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:44.172487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1bba49d6-382a-4c83-a652-6f0e1136bb0f req-f74201e8-bd32-47df-822b-57c671643aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "name": "network-vif-plugged", "status": "completed", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:44.187063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1bba49d6-382a-4c83-a652-6f0e1136bb0f req-f74201e8-bd32-47df-822b-57c671643aeb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:44.187793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1bba49d6-382a-4c83-a652-6f0e1136bb0f req-f74201e8-bd32-47df-822b-57c671643aeb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:44.222749 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bba49d6-382a-4c83-a652-6f0e1136bb0f req-f74201e8-bd32-47df-822b-57c671643aeb service nova] Creating event network-vif-plugged:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:17:44.234570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1bba49d6-382a-4c83-a652-6f0e1136bb0f req-f74201e8-bd32-47df-822b-57c671643aeb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067656 May 19 08:17:44.236726 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 417/777] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:44.247581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0cda6fe0-bdf2-451f-a9fe-74773586a82a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'create', calling method: .version_select at 0x7f32123bfb80>, body: {"pool": "9f3c70ce-fbff-47a9-b500-e2e998efb9cd"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:44.881402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:44.881987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:44.882469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:44.883846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:44.884274 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:44.895103 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:44.895570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:44.901362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:44.901362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:44.920525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:44.927618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for user f40ef4d25a474b3c83a3c2808a87a30d and project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:44.942902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:44.945223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:44.993909 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a3840baf-da8e-461a-9df6-5c5bcbc8075a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545576 May 19 08:17:44.995196 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 361/778] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:45.000031 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:45.001186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:45.009174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.010151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:45.011065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.011566 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:45.335397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:45.351186 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8d60d208-efdb-4b1d-ab2d-c7bcfe281bd3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1573 microversion: 2.1 time: 0.353753 May 19 08:17:45.352452 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 362/779] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:44 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1573 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:45.357516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:45.358547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:45.368156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.369988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:45.371112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.372067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:45.629930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:45.640992 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5698524d-8b56-4738-a67d-5ad2cadc8552 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1317 microversion: 2.1 time: 0.287402 May 19 08:17:45.641901 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 363/780] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:45 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:45.647264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-352052ee-5836-4b88-8c6d-5ac7f77c5946 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:45.648199 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:45.648199 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:17:45.675466 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-352052ee-5836-4b88-8c6d-5ac7f77c5946 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1256612231" status: 202 len: 0 microversion: 2.1 time: 0.032091 May 19 08:17:45.676701 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 364/781] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:17:45 2022] DELETE /compute/v2.1/flavors/1256612231 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:45.682642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6e4218ea-f759-4318-911d-9c4ce536a7ce tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '.version_select at 0x7f32121c6310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:45.686764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e4218ea-f759-4318-911d-9c4ce536a7ce tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.687909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e4218ea-f759-4318-911d-9c4ce536a7ce tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:45.705830 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6e4218ea-f759-4318-911d-9c4ce536a7ce tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.026475 May 19 08:17:45.707146 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 365/782] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:17:45 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:45.713167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:45.714077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:45.724041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.727546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:45.729370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:45.730225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.069196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:46.077131 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-524886f0-fbc2-4f57-bd34-a7c344a5e400 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1324 microversion: 2.1 time: 0.368508 May 19 08:17:46.077746 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 366/783] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:45 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1324 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:46.083089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:46.083711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:46.089885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.090336 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.091109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.091782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.174066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:46.184698 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eadf933e-24aa-4de2-8f53-06f834477381 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1265 microversion: 2.1 time: 0.105897 May 19 08:17:46.185647 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 367/784] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:46 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:46.190253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b97bc101-e305-46a9-b827-b219e963d1a3 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:46.214602 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b97bc101-e305-46a9-b827-b219e963d1a3 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.027637 May 19 08:17:46.215204 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 368/785] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:17:46 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:46.219831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:46.221377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:46.227683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.228223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.229070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.229597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.656301 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2d015266-b78f-48fb-b2fc-434b05f2886a tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1631 microversion: 2.1 time: 0.439785 May 19 08:17:46.657493 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 369/786] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:46 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1631 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:46.663577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d5eea7fa-de66-4ec1-bc82-e2efeff31ab9 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:46.663954 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:17:46.663954 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:17:46.698657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d5eea7fa-de66-4ec1-bc82-e2efeff31ab9 tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1407221823" status: 202 len: 0 microversion: 2.1 time: 0.039521 May 19 08:17:46.700336 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 370/787] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:17:46 2022] DELETE /compute/v2.1/flavors/1407221823 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:46.706710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-eaf4c357-6589-4fc6-a386-6c04ebd9ac7b req-090ef3cf-3b22-4011-a10c-ea80f7c3168e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743a356d-1eac-4730-8979-0734df0b9685", "name": "network-vif-plugged", "status": "completed", "tag": "b6c92392-c4e2-4fc2-ba09-f4ab93f4ecc9"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:46.716028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-eaf4c357-6589-4fc6-a386-6c04ebd9ac7b req-090ef3cf-3b22-4011-a10c-ea80f7c3168e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.716671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-eaf4c357-6589-4fc6-a386-6c04ebd9ac7b req-090ef3cf-3b22-4011-a10c-ea80f7c3168e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.735322 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-eaf4c357-6589-4fc6-a386-6c04ebd9ac7b req-090ef3cf-3b22-4011-a10c-ea80f7c3168e service nova] Creating event network-vif-plugged:b6c92392-c4e2-4fc2-ba09-f4ab93f4ecc9 for instance 743a356d-1eac-4730-8979-0734df0b9685 on chh2-842464-2 May 19 08:17:46.741266 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-eaf4c357-6589-4fc6-a386-6c04ebd9ac7b req-090ef3cf-3b22-4011-a10c-ea80f7c3168e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039348 May 19 08:17:46.742563 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 371/788] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:46.752160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:46.753404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:46.760526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.761212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:46.762215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:46.762806 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:47.322171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:47.332055 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-48aab0a6-0c03-4a03-8454-63b2e75bf109 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1573 microversion: 2.1 time: 0.582571 May 19 08:17:47.344637 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 372/789] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:46 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1573 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:47.351939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:47.352569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:47.359995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:47.361094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:47.361987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:47.362421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:47.412628 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0cda6fe0-bdf2-451f-a9fe-74773586a82a tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.171539 May 19 08:17:47.420245 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 418/790] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:17:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:47.427308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30c84e28-372b-4009-8078-180615b12cdf tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:47.450875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30c84e28-372b-4009-8078-180615b12cdf tempest-ServersWithSpecificFlavorTestJSON-520642570 tempest-ServersWithSpecificFlavorTestJSON-520642570-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028555 May 19 08:17:47.461534 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 419/791] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:17:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:47.467232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1065761568", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "f89cd20d-715f-4022-9b3a-1a63b86ac1fd"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:47.545899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] validate_networks() for [('f89cd20d-715f-4022-9b3a-1a63b86ac1fd', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:47.706030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:47.714529 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3ed67012-0d91-4bd3-b06b-35d3e7cf6226 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1317 microversion: 2.1 time: 0.367190 May 19 08:17:47.717439 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 373/792] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:47 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:47.720395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:47.721024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:47.724051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:DELETE=7 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:47.728078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:47.728541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:47.729388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:47.729870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.107618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:48.115695 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ba4cad52-d5cf-41da-bcd0-f004e7f0e3aa tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1520 microversion: 2.1 time: 0.399196 May 19 08:17:48.117065 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 374/793] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:47 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:48.121974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:48.122794 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:48.130180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:48.130636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.131437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:48.132133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.136631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:48.373634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:48.375239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:48.377120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:48.378337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:48.379367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:48.412998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:48.415206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.416131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:48.416561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.442188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:48.451113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for user 57e320171eec44a8bdb1dcd9e0039226 and project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:48.469688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:48.473493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:48.564891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dac6f35a-d90a-4725-8d20-437d781492ef tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.107896 May 19 08:17:48.565834 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 420/794] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:48.572706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.33.1.247"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:48.574143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:48.588126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:48.588574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.594507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:48.594985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:48.641669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Acquired lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:17:49.123044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:49.137554 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-34ffae87-2db4-414b-b8e8-9dbd31e73456 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1313 microversion: 2.1 time: 1.018560 May 19 08:17:49.139085 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 375/795] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:48 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1313 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:49.168000 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:49.169196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:49.187147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:49.188582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:49.191326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:49.192477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:49.222693 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e HTTP/1.1 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '7c58c656-8f86-4a69-85ce-778327a4118e'} May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:49.226689 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f7b5dc83-44d8-4079-b548-79f7c98071f4 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 404 len: 111 microversion: 2.1 time: 0.082038 May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 376/796] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:17:49 2022] DELETE /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:49.243998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4b6d98ae-2f83-4383-b021-4896868e97b1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'create', calling method: .version_select at 0x7f3212272af0>, body: {"pool": null} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:49.991091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd.", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:49.992918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Releasing lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:17:49.993531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] HTTP exception thrown: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:49.993531 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Request method failure captured: May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action HTTP/1.1 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 46 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0BnTtHvwyHrkjiVksBhUMzjGJrTyj1FlZCOuCd1A2w3C5zqEi94NUVUjs89a_zQteuSIZRR5Vp4t_yI_84CAtmha1b6anMENfyNAptNKjmSp33-Nglp1WcuEBSS_WbUM7XRMOFwWaLpTHPCPcq5Nv88Fal9GYuNQ3in_QLC8hzA_U May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 204d5dba56554f908677919295586e57 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/204d5dba56554f908677919295586e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_204d5dba56554f908677919295586e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 204d5dba56554f908677919295586e57 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dab9b2c7376c46df8668606028491b8c May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: {"addFloatingIp": {"address": "172.33.1.247"}} May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '22835dee-16c8-439c-9ae8-4033a030d2ff', 'body': {'addFloatingIp': {'address': '172.33.1.247'}}} May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2688, in associate_floating_ip May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:49.996641 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2690, in associate_floating_ip May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] May 19 08:17:50.001130 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:50.006662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Returning 400 to user: Cannot associate floating IP 172.33.1.247 (3fa7ff49-19dc-4b67-a187-042d47433f85) with port 1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 9f3c70ce-fbff-47a9-b500-e2e998efb9cd. May 19 08:17:50.006662 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-a3db4585-d060-4b45-af20-8e8cb8471485'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:50.007716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4980093-d3f2-4304-b823-88bd1c31f039 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action" status: 400 len: 381 microversion: 2.1 time: 1.440675 May 19 08:17:50.011787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 421/797] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:48 2022] POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action => generated 381 bytes in 1445 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:17:50.018216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:50.018848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:50.026359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.027069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.028031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.029001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.412119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:50.425788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea6b9086-4bf2-40d1-91eb-628cab007de4 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1571 microversion: 2.1 time: 0.412765 May 19 08:17:50.428078 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 422/798] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:50 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1571 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:50.442725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:50.443364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:50.452780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.454233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.457036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.458407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.572812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:50.586438 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efc7ff39-5d22-4588-b7f4-45bbada481d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1269 microversion: 2.1 time: 0.155255 May 19 08:17:50.587514 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 423/799] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:50 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:50.592861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:50.593745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:50.602136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.602898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.603903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.605443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.905889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:50.917601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-445dea95-1716-4f9d-93b2-790e87420771 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1508 microversion: 2.1 time: 0.328657 May 19 08:17:50.922195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 424/800] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:50 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:50.927771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:50.928399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: 7c58c656-8f86-4a69-85ce-778327a4118e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:50.960380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.960838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:50.961682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:50.962122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:51.019202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e HTTP/1.1 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7c58c656-8f86-4a69-85ce-778327a4118e'} May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:51.021802 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. May 19 08:17:51.026850 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:51.030595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance 7c58c656-8f86-4a69-85ce-778327a4118e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:51.031844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d080c99-2598-49c6-b4f8-0d04da5529e6 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e" status: 404 len: 111 microversion: 2.1 time: 0.108685 May 19 08:17:51.036836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 425/801] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:50 2022] GET /compute/v2.1/servers/7c58c656-8f86-4a69-85ce-778327a4118e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:51.055638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d319b609-c80f-4cfc-bff8-3c0992a39f60 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '.version_select at 0x7f321256c430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:53.238789 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4b6d98ae-2f83-4383-b021-4896868e97b1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.003076 May 19 08:17:53.239711 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 377/802] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:17:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:53.244637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:53.245496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:53.251760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.252539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.253348 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.253791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.505696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:53.514328 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2345c9eb-0bc4-4db5-a619-737c1dcf0c9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1313 microversion: 2.1 time: 0.272927 May 19 08:17:53.515790 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 378/803] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:53 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:53.521688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d319b609-c80f-4cfc-bff8-3c0992a39f60 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/3fa7ff49-19dc-4b67-a187-042d47433f85" status: 202 len: 0 microversion: 2.1 time: 2.483088 May 19 08:17:53.525251 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 426/804] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:17:51 2022] DELETE /compute/v2.1/os-floating-ips/3fa7ff49-19dc-4b67-a187-042d47433f85 => generated 0 bytes in 2488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:53.530242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ed153563-0def-4d29-9596-d8b2636c8b1d req-8443b21c-801a-4218-b0aa-0cbf6b7c622e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732", "tag": "6e772834-07e5-4353-bb91-c927a7797689"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:53.538231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1050406038"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:53.539003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:53.547817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ed153563-0def-4d29-9596-d8b2636c8b1d req-8443b21c-801a-4218-b0aa-0cbf6b7c622e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.548852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ed153563-0def-4d29-9596-d8b2636c8b1d req-8443b21c-801a-4218-b0aa-0cbf6b7c622e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.552548 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.553019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.554077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.554697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.565906 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ed153563-0def-4d29-9596-d8b2636c8b1d req-8443b21c-801a-4218-b0aa-0cbf6b7c622e service nova] Creating event network-changed:6e772834-07e5-4353-bb91-c927a7797689 for instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 on chh1-842464-2 May 19 08:17:53.572814 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ed153563-0def-4d29-9596-d8b2636c8b1d req-8443b21c-801a-4218-b0aa-0cbf6b7c622e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046111 May 19 08:17:53.573514 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 427/805] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:53.583635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:53.584218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:53.604446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.604954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.609546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.610313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.625533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 HTTP/1.1 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd2ebe82b-7784-4409-942a-d691ed1937d1'} May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:53.627873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73c44e85-01ab-429d-b8bf-824359aeca04 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 404 len: 111 microversion: 2.1 time: 0.050960 May 19 08:17:53.633207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 428/806] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:17:53 2022] DELETE /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:53.644087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:53.644087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:53.644087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.644087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.644622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.645341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.753628 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.network.security_group_api [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Adding security group 4596e3d3-c387-4dca-a5bf-525401a3da8e to port 42fe0906-22b6-46e0-a3b8-c77bc4205f33 May 19 08:17:53.897801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:53.906146 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11f97ccd-fc2c-4adf-a104-7c3ef43931df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1311 microversion: 2.1 time: 0.275130 May 19 08:17:53.906850 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 429/807] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:53 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:53.913954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0949751b-29b0-4be1-b512-4472aaa58b63 req-ea862bfb-f003-415a-aa4e-705878b532e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62299986-c4dc-49cf-9f63-fccde1b436ed", "tag": "a6ce6c6f-2f39-4049-bf13-b32836bd3d67"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:53.920720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0949751b-29b0-4be1-b512-4472aaa58b63 req-ea862bfb-f003-415a-aa4e-705878b532e2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:53.921242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0949751b-29b0-4be1-b512-4472aaa58b63 req-ea862bfb-f003-415a-aa4e-705878b532e2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:53.939800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0949751b-29b0-4be1-b512-4472aaa58b63 req-ea862bfb-f003-415a-aa4e-705878b532e2 service nova] Creating event network-changed:a6ce6c6f-2f39-4049-bf13-b32836bd3d67 for instance 62299986-c4dc-49cf-9f63-fccde1b436ed on chh2-842464-2 May 19 08:17:53.949338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0949751b-29b0-4be1-b512-4472aaa58b63 req-ea862bfb-f003-415a-aa4e-705878b532e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041144 May 19 08:17:53.950191 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 430/808] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:53.960003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-663963119", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "54df6a27-dc6e-457f-b69c-50c48499146f"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:53.969899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:54.052714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] validate_networks() for [('54df6a27-dc6e-457f-b69c-50c48499146f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:17:54.807604 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9f3f5823-ea69-43e7-95e5-2a2dfb73d7e3 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674/action" status: 202 len: 0 microversion: 2.1 time: 1.290200 May 19 08:17:54.817200 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 379/809] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:53 2022] POST /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674/action => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:17:54.822972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'action', calling method: .version_select at 0x7f3214bc4e50>, body: {"removeFloatingIp": {"address": "172.33.1.211"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:54.908580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:54.937003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:17:55.180607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:17:55.183340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:17:55.184062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:17:55.184649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:17:55.185392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:17:55.197597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.198510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.201268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:55.210205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.210918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.211888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.213254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.214056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.214690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.256559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Getting quotas for project 6d1c48363495440688a94cad914be0f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:17:55.266312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Getting quotas for user 9eb7e9176a904e8a97f21e31b54c631e and project 6d1c48363495440688a94cad914be0f2. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:17:55.289849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:17:55.293049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:17:55.367995 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-227d1fc7-67ab-47b4-9b57-7b6ba769af66 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415816 May 19 08:17:55.370015 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 431/810] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:17:55.380085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:55.381770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] [instance: d2ebe82b-7784-4409-942a-d691ed1937d1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:55.393736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.395017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.396778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.397805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.432479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] HTTP exception thrown: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Request method failure captured: May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 HTTP/1.1 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfyKf08XpV7XzdXjQPIOkaeSlFDDQDMWwKAACJHcwvLhK2oxjYqbO6UV40-_gPe63dX_k8_fI5XlVxfgsienuQlt6Ki5ECMPzN1zaYK3rtJ_YQ8X4ph5rGSaHLYn71-HsQG1QqQmB544jGRBJIyWz1atSjTnLKesSZG7c3-YMQcSuwU May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5ab46fa809fe4a9bb8ad076da226b643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5ab46fa809fe4a9bb8ad076da226b643 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 83555ee44aaf44b5aec6a2afe7f43d46 May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-599623607-project May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd2ebe82b-7784-4409-942a-d691ed1937d1'} May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:55.438971 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. May 19 08:17:55.447574 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:55.450868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] Returning 404 to user: Instance d2ebe82b-7784-4409-942a-d691ed1937d1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:55.452928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da7205a7-a4dd-4440-aa0d-f245ca33fe18 tempest-ServersWithSpecificFlavorTestJSON-599623607 tempest-ServersWithSpecificFlavorTestJSON-599623607-project] 10.222.0.78 "GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1" status: 404 len: 111 microversion: 2.1 time: 0.081007 May 19 08:17:55.455964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 432/811] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:55 2022] GET /compute/v2.1/servers/d2ebe82b-7784-4409-942a-d691ed1937d1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:17:55.465845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:55.467207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:55.487300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.488885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.491828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:55.495133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:55.671456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Acquired lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:17:56.276381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:56.287943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f344faf-5549-4a61-a8e5-e9ac11f541aa tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1313 microversion: 2.1 time: 0.829568 May 19 08:17:56.305524 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 433/812] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:55 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:56.317848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50cddd34-52bb-419c-931e-5d2433379ea5"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:56.319696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:56.331678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:56.332583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:56.333801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:56.334456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:56.956199 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aefa269e-5cbf-4d2d-8527-e60675681f4d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "POST /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647891 May 19 08:17:56.978926 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 434/813] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:17:56 2022] POST /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:57.008286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f91a828-26a2-46bf-b879-1d2c712a4de5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212163280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:57.028685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Building network info cache for instance {{(pid=119073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:17:57.549926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-1f91a828-26a2-46bf-b879-1d2c712a4de5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use.", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:17:57.550518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1f91a828-26a2-46bf-b879-1d2c712a4de5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.550518 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f91a828-26a2-46bf-b879-1d2c712a4de5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e HTTP/1.1 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: exception: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4596e3d3-c387-4dca-a5bf-525401a3da8e'} May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.552811 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f91a828-26a2-46bf-b879-1d2c712a4de5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 400 to user: Security Group 4596e3d3-c387-4dca-a5bf-525401a3da8e in use. May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-11a70b40-5b8d-4469-8df3-ab471a05bd99'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f91a828-26a2-46bf-b879-1d2c712a4de5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e" status: 400 len: 185 microversion: 2.1 time: 0.561282 May 19 08:17:57.556582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 435/814] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:17:56 2022] DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e => generated 185 bytes in 577 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:17:57.568349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:57.575988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:57.599485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:57.600822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:57.602385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:57.604250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.503558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:58.512199 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f780b7a-3329-4e31-b204-72054dad0b52 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1311 microversion: 2.1 time: 0.955923 May 19 08:17:58.515759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 436/815] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:57 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1311 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:58.527126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:58.530379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:58.544334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.546339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.549965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.551033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.586548 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Updating instance_info_cache with network_info: [{"id": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3", "address": "fa:16:3e:11:a5:10", "network": {"id": "7b6fe1bf-d728-45d9-a817-17609e81eb8e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-960013584-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "204d5dba56554f908677919295586e57", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1f455f10-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:17:58.606202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Releasing lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:17:58.607847 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-80be5600-33d9-4cc9-90c0-90746444691f tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action" status: 202 len: 0 microversion: 2.1 time: 3.789014 May 19 08:17:58.608741 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 380/816] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:17:54 2022] POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action => generated 0 bytes in 3791 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:17:58.619559 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-0ac399e3-90c7-438b-bc14-89b4e4f6f889 req-4baa28f3-c21b-47b8-ae25-16f55cb6047d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03150fbb-bbc2-47a5-ad11-896ae4a22674", "tag": "42fe0906-22b6-46e0-a3b8-c77bc4205f33"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:58.644401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0ac399e3-90c7-438b-bc14-89b4e4f6f889 req-4baa28f3-c21b-47b8-ae25-16f55cb6047d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.648785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0ac399e3-90c7-438b-bc14-89b4e4f6f889 req-4baa28f3-c21b-47b8-ae25-16f55cb6047d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.672230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:58.693837 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-0ac399e3-90c7-438b-bc14-89b4e4f6f889 req-4baa28f3-c21b-47b8-ae25-16f55cb6047d service nova] Creating event network-changed:42fe0906-22b6-46e0-a3b8-c77bc4205f33 for instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 on chh1-842464-2 May 19 08:17:58.696992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3729496c-18f5-4916-b59d-678c2b029e48 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1281 microversion: 2.1 time: 0.173540 May 19 08:17:58.701131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 437/817] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:58 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:58.714288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:58.718152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:58.719140 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-0ac399e3-90c7-438b-bc14-89b4e4f6f889 req-4baa28f3-c21b-47b8-ae25-16f55cb6047d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108191 May 19 08:17:58.734539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.735008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.736403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.737015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.743996 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 381/818] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:58.758299 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:58.763952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:58.776134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.778021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.779217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:58.782120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:58.864259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:17:59.029667 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-770fb466-8aff-4a76-a906-5d5bd146232e tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 204 len: 0 microversion: 2.1 time: 0.283650 May 19 08:17:59.031360 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 382/819] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:17:58 2022] DELETE /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:17:59.045139 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-027a0aaa-3508-4f73-9aed-385ad906a161 req-0a771235-d628-4423-831e-a8a7fe885956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62299986-c4dc-49cf-9f63-fccde1b436ed", "name": "network-vif-plugged", "status": "completed", "tag": "a6ce6c6f-2f39-4049-bf13-b32836bd3d67"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:17:59.069349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-027a0aaa-3508-4f73-9aed-385ad906a161 req-0a771235-d628-4423-831e-a8a7fe885956 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:59.070246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-027a0aaa-3508-4f73-9aed-385ad906a161 req-0a771235-d628-4423-831e-a8a7fe885956 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:59.096826 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-027a0aaa-3508-4f73-9aed-385ad906a161 req-0a771235-d628-4423-831e-a8a7fe885956 service nova] Creating event network-vif-plugged:a6ce6c6f-2f39-4049-bf13-b32836bd3d67 for instance 62299986-c4dc-49cf-9f63-fccde1b436ed on chh2-842464-2 May 19 08:17:59.116974 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-027a0aaa-3508-4f73-9aed-385ad906a161 req-0a771235-d628-4423-831e-a8a7fe885956 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078427 May 19 08:17:59.119222 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 383/820] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:17:59.134307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-524ad4ce-72f1-4a3e-87ce-54d5fe9b18cb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '.version_select at 0x7f32124ee820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:59.488250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:17:59.499084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54353d6f-03fd-4b3c-bce1-9da4569e177f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1313 microversion: 2.1 time: 0.796238 May 19 08:17:59.500467 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 438/821] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:58 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:17:59.513369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:17:59.515467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:17:59.525785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:59.529692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:17:59.531874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:17:59.536382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:00.333872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:00.347885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77d2c414-aa19-4954-bea8-d98aacdb619a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1646 microversion: 2.1 time: 0.843318 May 19 08:18:00.350305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 439/822] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:17:59 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1646 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:00.364923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:00.366991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:00.382073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:00.382540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:00.398101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:00.398805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:00.423172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:01.259783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:01.270385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30330046-8417-405b-8d5e-b2a079e7327c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1311 microversion: 2.1 time: 0.918856 May 19 08:18:01.273034 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 440/823] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:00 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1311 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:01.278550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:01.279733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:01.286906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:01.287686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:01.289357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:01.290202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:02.360576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:02.371198 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0f8e673-76e3-4add-b652-7ee4bc36d24b tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1323 microversion: 2.1 time: 1.096648 May 19 08:18:02.377887 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 441/824] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:01 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1323 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:02.394279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:02.395278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:02.410024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:02.415383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:02.418948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:02.419578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:02.543746 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-524ad4ce-72f1-4a3e-87ce-54d5fe9b18cb tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/4e6b86e8-9ee6-4317-a944-89a8d08923d8" status: 202 len: 0 microversion: 2.1 time: 3.421919 May 19 08:18:02.549812 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 384/825] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:17:59 2022] DELETE /compute/v2.1/os-floating-ips/4e6b86e8-9ee6-4317-a944-89a8d08923d8 => generated 0 bytes in 3425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:02.555344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-3d8bcec8-b11a-45bd-91c3-2605f689105a req-d71caf62-e099-42c4-99b2-b4c69227cbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22835dee-16c8-439c-9ae8-4033a030d2ff", "tag": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:02.583178 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-3d8bcec8-b11a-45bd-91c3-2605f689105a req-d71caf62-e099-42c4-99b2-b4c69227cbe1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:02.588111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-3d8bcec8-b11a-45bd-91c3-2605f689105a req-d71caf62-e099-42c4-99b2-b4c69227cbe1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:02.625237 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-3d8bcec8-b11a-45bd-91c3-2605f689105a req-d71caf62-e099-42c4-99b2-b4c69227cbe1 service nova] Creating event network-changed:1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 for instance 22835dee-16c8-439c-9ae8-4033a030d2ff on chh2-842464-2 May 19 08:18:02.632316 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-3d8bcec8-b11a-45bd-91c3-2605f689105a req-d71caf62-e099-42c4-99b2-b4c69227cbe1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083894 May 19 08:18:02.633693 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 385/826] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:02.641094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9d1ffda8-3fc1-4733-9b3b-5320116c2e14 req-c1133ab4-e74d-46c2-91df-45258ca2a516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732", "name": "network-vif-plugged", "status": "completed", "tag": "6e772834-07e5-4353-bb91-c927a7797689"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:02.677421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9d1ffda8-3fc1-4733-9b3b-5320116c2e14 req-c1133ab4-e74d-46c2-91df-45258ca2a516 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:02.680567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9d1ffda8-3fc1-4733-9b3b-5320116c2e14 req-c1133ab4-e74d-46c2-91df-45258ca2a516 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:02.714092 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9d1ffda8-3fc1-4733-9b3b-5320116c2e14 req-c1133ab4-e74d-46c2-91df-45258ca2a516 service nova] Creating event network-vif-plugged:6e772834-07e5-4353-bb91-c927a7797689 for instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 on chh1-842464-2 May 19 08:18:02.728779 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9d1ffda8-3fc1-4733-9b3b-5320116c2e14 req-c1133ab4-e74d-46c2-91df-45258ca2a516 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091702 May 19 08:18:02.730156 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 386/827] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:02.747683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:02.750293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:02.764959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:02.766301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:02.767938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:02.769133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:03.438251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:03.451544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a9fb2ae-1aa3-4eb3-bf01-029bf5c9bb5c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1313 microversion: 2.1 time: 1.072124 May 19 08:18:03.455822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 442/828] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:02 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1313 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:03.464831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d83869db-bdc6-46a7-abec-d26fe03daca6 req-67e74483-7724-4e55-921c-ff190c1badc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6be73c7-debf-40af-bcab-064bae60410a", "tag": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:03.503377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d83869db-bdc6-46a7-abec-d26fe03daca6 req-67e74483-7724-4e55-921c-ff190c1badc0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:03.503832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d83869db-bdc6-46a7-abec-d26fe03daca6 req-67e74483-7724-4e55-921c-ff190c1badc0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:03.531985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d83869db-bdc6-46a7-abec-d26fe03daca6 req-67e74483-7724-4e55-921c-ff190c1badc0 service nova] Creating event network-changed:84df3723-56e7-4f2c-bda2-1b9c9f0370ca for instance a6be73c7-debf-40af-bcab-064bae60410a on chh2-842464-2 May 19 08:18:03.546020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d83869db-bdc6-46a7-abec-d26fe03daca6 req-67e74483-7724-4e55-921c-ff190c1badc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088623 May 19 08:18:03.546964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 443/829] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:03.552930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:03.554124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:03.575209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:03.576020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:03.577113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:03.577852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:03.771891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:03.790960 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-453d77e9-57ac-4f5d-9910-35ce11e86cbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1646 microversion: 2.1 time: 1.057903 May 19 08:18:03.793635 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 387/830] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:02 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1646 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:03.811910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cbb64403-e377-4dd1-a452-d4bacdad83dd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'action', calling method: .version_select at 0x7f3214bc4dc0>, body: {"addFloatingIp": {"address": ""}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cbb64403-e377-4dd1-a452-d4bacdad83dd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Request method failure captured: May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action HTTP/1.1 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 34 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0BnTtHvwyHrkjiVksBhUMzjGJrTyj1FlZCOuCd1A2w3C5zqEi94NUVUjs89a_zQteuSIZRR5Vp4t_yI_84CAtmha1b6anMENfyNAptNKjmSp33-Nglp1WcuEBSS_WbUM7XRMOFwWaLpTHPCPcq5Nv88Fal9GYuNQ3in_QLC8hzA_U May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 204d5dba56554f908677919295586e57 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/204d5dba56554f908677919295586e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_204d5dba56554f908677919295586e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 204d5dba56554f908677919295586e57 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: dab9b2c7376c46df8668606028491b8c May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: {"addFloatingIp": {"address": ""}} May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '22835dee-16c8-439c-9ae8-4033a030d2ff', 'body': {'addFloatingIp': {'address': ''}}} May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise error May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi '' May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:18:03.819291 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 19 08:18:03.826139 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:03.832028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cbb64403-e377-4dd1-a452-d4bacdad83dd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:03.836699 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cbb64403-e377-4dd1-a452-d4bacdad83dd tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action" status: 400 len: 142 microversion: 2.1 time: 0.041500 May 19 08:18:03.849313 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 388/831] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:03 2022] POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action => generated 142 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:18:03.859431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:03.866458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:03.884717 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:03.887343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:03.888515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:03.890090 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.149011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:04.160468 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cdef7b45-506d-473c-9750-00008625af71 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1323 microversion: 2.1 time: 0.309921 May 19 08:18:04.161964 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 389/832] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:03 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:04.173421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:04.175045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:04.178909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:04.190610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7eac86a3-28f2-486b-addc-80f98229a5a8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1494 microversion: 2.1 time: 0.642358 May 19 08:18:04.191754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 444/833] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:03 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1494 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:04.197904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.198357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.203473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.204016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.211319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:04.211956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:04.224832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.225616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.226624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.227266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.286767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Acquired lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:18:04.652934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e79390f-3714-4995-a8f3-5a734a3ff30b tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1645 microversion: 2.1 time: 0.443246 May 19 08:18:04.665341 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 445/834] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:04 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1645 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:18:04.674528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Releasing lock "refresh_cache-22835dee-16c8-439c-9ae8-4033a030d2ff" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:18:04.674793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:04.675454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:04.677963 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] HTTP exception thrown: floating IP not found May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Request method failure captured: May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action HTTP/1.1 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 41 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0BnTtHvwyHrkjiVksBhUMzjGJrTyj1FlZCOuCd1A2w3C5zqEi94NUVUjs89a_zQteuSIZRR5Vp4t_yI_84CAtmha1b6anMENfyNAptNKjmSp33-Nglp1WcuEBSS_WbUM7XRMOFwWaLpTHPCPcq5Nv88Fal9GYuNQ3in_QLC8hzA_U May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 204d5dba56554f908677919295586e57 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/204d5dba56554f908677919295586e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_204d5dba56554f908677919295586e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 204d5dba56554f908677919295586e57 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: dab9b2c7376c46df8668606028491b8c May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: {"addFloatingIp": {"address": "0.0.0.0"}} May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: exception: floating IP not found May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '22835dee-16c8-439c-9ae8-4033a030d2ff', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2684, in associate_floating_ip May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 19 08:18:04.684546 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 19 08:18:04.688637 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:04.699427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.699427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.700931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.702163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Returning 404 to user: floating IP not found {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:04.702910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.707911 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1cdeb0e5-661f-47dc-83c1-304a31ac9ae5 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action" status: 404 len: 67 microversion: 2.1 time: 0.536061 May 19 08:18:04.714468 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 390/835] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:04 2022] POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action => generated 67 bytes in 550 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:18:04.738780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-16bbdafd-7d8b-458e-8c9c-eb8ecc13013c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:04.744149 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:04.744149 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:04.749459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16bbdafd-7d8b-458e-8c9c-eb8ecc13013c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.752201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16bbdafd-7d8b-458e-8c9c-eb8ecc13013c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.756028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16bbdafd-7d8b-458e-8c9c-eb8ecc13013c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.757568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16bbdafd-7d8b-458e-8c9c-eb8ecc13013c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.838873 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-16bbdafd-7d8b-458e-8c9c-eb8ecc13013c tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.120929 May 19 08:18:04.848038 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 391/836] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:18:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:04.854587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-54c01d84-2f55-41b6-aab2-9aeaa2af882d req-d2527166-a6d8-48a6-b58d-6342df21a68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03150fbb-bbc2-47a5-ad11-896ae4a22674", "name": "network-vif-deleted", "tag": "42fe0906-22b6-46e0-a3b8-c77bc4205f33"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:04.868530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-54c01d84-2f55-41b6-aab2-9aeaa2af882d req-d2527166-a6d8-48a6-b58d-6342df21a68d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:04.869230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-54c01d84-2f55-41b6-aab2-9aeaa2af882d req-d2527166-a6d8-48a6-b58d-6342df21a68d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:04.898976 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-54c01d84-2f55-41b6-aab2-9aeaa2af882d req-d2527166-a6d8-48a6-b58d-6342df21a68d service nova] Creating event network-vif-deleted:42fe0906-22b6-46e0-a3b8-c77bc4205f33 for instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 on chh1-842464-2 May 19 08:18:04.906577 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-54c01d84-2f55-41b6-aab2-9aeaa2af882d req-d2527166-a6d8-48a6-b58d-6342df21a68d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056403 May 19 08:18:04.908155 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 392/837] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:04.915951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-661a6a77-26fe-43b2-b949-6af4a8bc7566 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:05.095385 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-661a6a77-26fe-43b2-b949-6af4a8bc7566 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-661a6a77-26fe-43b2-b949-6af4a8bc7566 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Request method failure captured: May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action HTTP/1.1 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 44 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0BnTtHvwyHrkjiVksBhUMzjGJrTyj1FlZCOuCd1A2w3C5zqEi94NUVUjs89a_zQteuSIZRR5Vp4t_yI_84CAtmha1b6anMENfyNAptNKjmSp33-Nglp1WcuEBSS_WbUM7XRMOFwWaLpTHPCPcq5Nv88Fal9GYuNQ3in_QLC8hzA_U May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 204d5dba56554f908677919295586e57 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/204d5dba56554f908677919295586e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_204d5dba56554f908677919295586e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 204d5dba56554f908677919295586e57 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: dab9b2c7376c46df8668606028491b8c May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: exception: Floating IP not found for address 0.0.0.0. May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '22835dee-16c8-439c-9ae8-4033a030d2ff', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2912, in get_instance_id_by_floating_address May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 19 08:18:05.097945 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-661a6a77-26fe-43b2-b949-6af4a8bc7566 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:05.101712 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-661a6a77-26fe-43b2-b949-6af4a8bc7566 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action" status: 404 len: 88 microversion: 2.1 time: 0.189928 May 19 08:18:05.106270 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 393/838] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:04 2022] POST /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff/action => generated 88 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:18:05.119313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:05.120068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:05.153781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.154257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.162045 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.162503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.192895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:05.226997 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ec6c70a-ff6e-4cfa-ba2e-9c04d14467df tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1313 microversion: 2.1 time: 0.555086 May 19 08:18:05.229458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 446/839] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:04 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:05.239977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.240683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.241363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lazy-loading 'fault' on Instance uuid 03150fbb-bbc2-47a5-ad11-896ae4a22674 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:18:05.242400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:05.245871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:05.261979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:05.271777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.272383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.273533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.275941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.285070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:05.323192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:18:05.328739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:05.343210 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5e690aa9-9df2-45bf-8560-cd05dc8eb3ea tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 200 len: 1304 microversion: 2.1 time: 0.234890 May 19 08:18:05.348255 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 394/840] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:05 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 1304 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:05.354633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:05.363144 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:05.383121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.383749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.386891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.387338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.537391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a173b84c-519a-4326-934a-60e8cf0276d6 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "DELETE /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 204 len: 0 microversion: 2.1 time: 0.303478 May 19 08:18:05.540909 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 447/841] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:05 2022] DELETE /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:05.549876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:05.551067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:05.557783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.561603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.569669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:05.570030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:05.788407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:05.808331 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de79290d-3083-44f3-b50a-fcaf60ce5b12 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1323 microversion: 2.1 time: 0.458452 May 19 08:18:05.826333 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 395/842] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:05 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:05.838360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:05.853675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed87ec85-abaa-425f-aebb-ec4a4c6bfc44 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1540 microversion: 2.1 time: 0.308192 May 19 08:18:05.854278 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 448/843] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:05 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1540 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:18:05.893562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1738859753", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "533df18e-9523-4d54-ab20-c321818985f0"}], "security_groups": [{"name": "tempest-securitygroup--394128883"}], "key_name": "tempest-keypair-1558659763", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d98bbd41-f5c3-44e2-a926-7d8daff4f229", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:06.158804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] validate_networks() for [('533df18e-9523-4d54-ab20-c321818985f0', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:18:06.246905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:06.247948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:06.255325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:06.256207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:06.257246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:06.257975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:06.604563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:06.615591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b23d75c-6b81-4af3-97c5-24c3af39c833 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1462 microversion: 2.1 time: 0.372329 May 19 08:18:06.628131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 449/844] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:06 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1462 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:06.633635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:06.634620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:06.643426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:06.644278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:06.645345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:06.646018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:06.662748 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 HTTP/1.1 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '03150fbb-bbc2-47a5-ad11-896ae4a22674'} May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:06.666751 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:06.671100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:06.675574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:06.676842 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4021377-6e37-4f91-9462-bd97306d80bc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 404 len: 111 microversion: 2.1 time: 0.047338 May 19 08:18:06.678116 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 450/845] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:06 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:06.684066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:06.685600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:06.692390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:06.693361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:06.694964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:06.695732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:06.888013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:06.896183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 08:18:06.921354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:18:06.922334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:18:06.923728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:18:06.925433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:18:06.926195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:18:07.118407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53fc220f-3a8d-460f-900a-0fa1c0d69a46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732/action" status: 202 len: 0 microversion: 2.1 time: 0.438824 May 19 08:18:07.124623 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 451/846] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:06 2022] POST /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:07.139402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eef3ca70-0198-4043-85ea-f4a72886e2ba tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32121ccd30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:07.149012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Getting quotas for project 36fdc1b726454b47a508f87d2af575d2. Resources: dict_keys(['metadata_items']) {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:18:07.169904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Getting quotas for user 7124c7ef587a474b900d252885eb7e2e and project 36fdc1b726454b47a508f87d2af575d2. Resources: dict_keys(['metadata_items']) {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:18:07.209529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:18:07.210571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:18:07.211202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:18:07.211756 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:18:07.212332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:18:07.224763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:07.225550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:07.226773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:07.227360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:07.254363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Getting quotas for project 36fdc1b726454b47a508f87d2af575d2. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:18:07.262728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Getting quotas for user 7124c7ef587a474b900d252885eb7e2e and project 36fdc1b726454b47a508f87d2af575d2. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:18:07.372077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:18:07.375743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d98bbd41-f5c3-44e2-a926-7d8daff4f229',volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:18:07.776917 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-084b0a85-5b1c-4f00-8cd0-768d31bdcd51 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.890252 May 19 08:18:07.781143 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 396/847] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:18:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:18:07.802985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:07.812734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:07.867094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:07.867567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:07.875025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:07.875241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.020685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:09.029242 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7fe2e0de-f55a-4c23-9d81-34e0543afeac tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1323 microversion: 2.1 time: 1.243006 May 19 08:18:09.030478 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 397/848] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:07 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1323 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:09.036565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:09.037590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:09.052301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.053138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.054255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.054773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.093113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.094509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.094509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lazy-loading 'fault' on Instance uuid 22835dee-16c8-439c-9ae8-4033a030d2ff {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:18:09.098297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:09.175150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab9b2c7376c46df8668606028491b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '204d5dba56554f908677919295586e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:09.185506 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e877aba8-b64b-47fe-9d3d-7948b2f5d9da tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 200 len: 1321 microversion: 2.1 time: 0.153487 May 19 08:18:09.187395 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 398/849] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:09 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:09.193603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:09.194586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:09.210224 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.211227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.212579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.213580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.220520 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eef3ca70-0198-4043-85ea-f4a72886e2ba tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c" status: 202 len: 0 microversion: 2.1 time: 2.093578 May 19 08:18:09.222050 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 452/850] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:07 2022] DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c => generated 0 bytes in 2097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:09.230167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:09.231973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:09.249769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.249769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.252088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.252734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.403309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:09.414315 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99cce7a9-3aa3-44be-ab48-30dffad28905 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1164 microversion: 2.1 time: 0.190435 May 19 08:18:09.415071 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 453/851] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:09 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1164 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:09.438310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-37a788b5-372f-45f5-ae66-f80b71eb6f52 req-00a75532-e5c9-48b8-973b-64d453b79658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22835dee-16c8-439c-9ae8-4033a030d2ff", "name": "network-vif-deleted", "tag": "1f455f10-fccd-40bc-9e79-5b3ce48dc3f3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:09.474325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-37a788b5-372f-45f5-ae66-f80b71eb6f52 req-00a75532-e5c9-48b8-973b-64d453b79658 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.474775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-37a788b5-372f-45f5-ae66-f80b71eb6f52 req-00a75532-e5c9-48b8-973b-64d453b79658 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.517644 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-37a788b5-372f-45f5-ae66-f80b71eb6f52 req-00a75532-e5c9-48b8-973b-64d453b79658 service nova] Creating event network-vif-deleted:1f455f10-fccd-40bc-9e79-5b3ce48dc3f3 for instance 22835dee-16c8-439c-9ae8-4033a030d2ff on chh2-842464-2 May 19 08:18:09.537260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-37a788b5-372f-45f5-ae66-f80b71eb6f52 req-00a75532-e5c9-48b8-973b-64d453b79658 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116607 May 19 08:18:09.538189 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 454/852] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:09.559226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86cc03c1-e0ba-419d-a7e0-35ffe13be8b9", "device": "/dev/xvdb"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:09.560915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:09.576785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.577959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.579269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:09.579976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:09.598814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:09.618986 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e04c528c-93dc-4fef-8e45-51ddc04d5c8e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1471 microversion: 2.1 time: 0.430111 May 19 08:18:09.622296 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 399/853] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:09 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1471 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:09.630719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-809f452a-1942-4392-83d5-0a3f338a50ce tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321219c1f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:09.982664 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-809f452a-1942-4392-83d5-0a3f338a50ce tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e" status: 202 len: 0 microversion: 2.1 time: 0.358926 May 19 08:18:09.984526 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 400/854] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:09 2022] DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:09.995677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e3438a59-ae02-4241-b455-1527a900bc0f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'create', calling method: .version_select at 0x7f321219c430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1340764570", "description": "tempest-description-849058589"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:10.294792 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e3438a59-ae02-4241-b455-1527a900bc0f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.301050 May 19 08:18:10.296895 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 401/855] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:18:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:10.307247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:10.311286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:10.337576 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:10.339547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:10.340847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:10.349145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:10.456929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:10.517104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6927309-876b-47d0-b7e8-8e00d1cef135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "POST /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960513 May 19 08:18:10.523129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 455/856] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:18:09 2022] POST /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:10.544525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:10.547122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] [instance: 22835dee-16c8-439c-9ae8-4033a030d2ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:10.567112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:10.567841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:10.569251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:10.571015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:10.602129 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] HTTP exception thrown: Instance 22835dee-16c8-439c-9ae8-4033a030d2ff could not be found. May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Request method failure captured: May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff HTTP/1.1 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0BnTtHvwyHrkjiVksBhUMzjGJrTyj1FlZCOuCd1A2w3C5zqEi94NUVUjs89a_zQteuSIZRR5Vp4t_yI_84CAtmha1b6anMENfyNAptNKjmSp33-Nglp1WcuEBSS_WbUM7XRMOFwWaLpTHPCPcq5Nv88Fal9GYuNQ3in_QLC8hzA_U May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 204d5dba56554f908677919295586e57 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/204d5dba56554f908677919295586e57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_204d5dba56554f908677919295586e57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/204d5dba56554f908677919295586e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 204d5dba56554f908677919295586e57 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dab9b2c7376c46df8668606028491b8c May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 22835dee-16c8-439c-9ae8-4033a030d2ff could not be found. May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '22835dee-16c8-439c-9ae8-4033a030d2ff'} May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22835dee-16c8-439c-9ae8-4033a030d2ff could not be found. May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22835dee-16c8-439c-9ae8-4033a030d2ff could not be found. May 19 08:18:10.604047 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22835dee-16c8-439c-9ae8-4033a030d2ff could not be found. May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:10.609044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] Returning 404 to user: Instance 22835dee-16c8-439c-9ae8-4033a030d2ff could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:10.610002 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25403824-1ebd-43b2-bc19-d54917068f68 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592 tempest-FloatingIPsAssociationNegativeTestJSON-2066565592-project] 10.222.0.78 "GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff" status: 404 len: 111 microversion: 2.1 time: 0.085422 May 19 08:18:10.614933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 456/857] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:10 2022] GET /compute/v2.1/servers/22835dee-16c8-439c-9ae8-4033a030d2ff => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:10.630582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-692f1624-8154-4545-b686-5c3e1a7c0e07 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Action: 'update', calling method: .version_select at 0x7f321217e430>, body: {"security_group": {"name": "tempest-sg-hth-1650726084", "description": "tempest-description-hth-222991693"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:11.263510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:11.276728 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c0f341e6-a934-4fe5-94b3-7a9e2b07922c tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1323 microversion: 2.1 time: 0.976322 May 19 08:18:11.277365 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 402/858] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:10 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1323 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:11.299955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:11.300591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:11.319494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:11.323578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:11.324646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:11.325242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:11.602720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:11.614358 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1db24707-3b0c-4d8b-a497-354f9d2ad641 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1238 microversion: 2.1 time: 0.324584 May 19 08:18:11.614942 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 403/859] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:11 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1238 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:11.639874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-3d21b198-b6cc-4d73-8a73-b93d6f8e1872 req-deb20022-59d1-45db-a8ff-703505460f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6be73c7-debf-40af-bcab-064bae60410a", "name": "network-vif-plugged", "status": "completed", "tag": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:11.664485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-3d21b198-b6cc-4d73-8a73-b93d6f8e1872 req-deb20022-59d1-45db-a8ff-703505460f9a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:11.664976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-3d21b198-b6cc-4d73-8a73-b93d6f8e1872 req-deb20022-59d1-45db-a8ff-703505460f9a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:11.707604 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-3d21b198-b6cc-4d73-8a73-b93d6f8e1872 req-deb20022-59d1-45db-a8ff-703505460f9a service nova] Creating event network-vif-plugged:84df3723-56e7-4f2c-bda2-1b9c9f0370ca for instance a6be73c7-debf-40af-bcab-064bae60410a on chh2-842464-2 May 19 08:18:11.720885 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-3d21b198-b6cc-4d73-8a73-b93d6f8e1872 req-deb20022-59d1-45db-a8ff-703505460f9a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102303 May 19 08:18:11.729343 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 404/860] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:11.735809 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-692f1624-8154-4545-b686-5c3e1a7c0e07 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/baa2d94f-50d1-41e3-9884-7eaa5ccf26ff" status: 200 len: 217 microversion: 2.1 time: 1.118593 May 19 08:18:11.743751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 457/861] 10.222.0.78 () {60 vars in 1289 bytes} [Thu May 19 08:18:10 2022] PUT /compute/v2.1/os-security-groups/baa2d94f-50d1-41e3-9884-7eaa5ccf26ff => generated 217 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:11.749280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90a982e3-cf96-4d39-a733-7ae04eabcd38 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212182430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:11.759471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:11.760170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:11.791548 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:11.792070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:11.792968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:11.793454 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:12.113778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:12.129523 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c25f17b6-908c-40fa-9c02-fd2c3e344f90 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1471 microversion: 2.1 time: 0.398727 May 19 08:18:12.130112 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 405/862] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:11 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1471 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:12.219145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90a982e3-cf96-4d39-a733-7ae04eabcd38 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/baa2d94f-50d1-41e3-9884-7eaa5ccf26ff" status: 200 len: 217 microversion: 2.1 time: 0.474215 May 19 08:18:12.219961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 458/863] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:18:11 2022] GET /compute/v2.1/os-security-groups/baa2d94f-50d1-41e3-9884-7eaa5ccf26ff => generated 217 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:12.232038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7f361b4e-48ba-4268-8368-dc2ba3cc0f1b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321219c9d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:12.294563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:12.295610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:12.343202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:12.348946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:12.350208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:12.355103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:13.238040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:13.252681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-091ce387-61fc-49c8-ae75-0c2b9d1e94b6 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1323 microversion: 2.1 time: 0.962095 May 19 08:18:13.262845 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 459/864] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:12 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1323 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:18:13.268966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:13.269948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:13.276493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:13.277249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:13.278321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:13.278985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:13.302930 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7f361b4e-48ba-4268-8368-dc2ba3cc0f1b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/baa2d94f-50d1-41e3-9884-7eaa5ccf26ff" status: 202 len: 0 microversion: 2.1 time: 1.074286 May 19 08:18:13.304786 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 406/865] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:12 2022] DELETE /compute/v2.1/os-security-groups/baa2d94f-50d1-41e3-9884-7eaa5ccf26ff => generated 0 bytes in 1077 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:13.311708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:13.312672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:13.320895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:13.321977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:13.322856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:13.323429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.182584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:14.188485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:14.195289 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b3d20e8-ea60-4a82-b1fe-8609996ec172 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.929865 May 19 08:18:14.197158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 460/866] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:13 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:14.209425 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e2890929-6ff2-41ff-a307-df43f9716dc1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1471 microversion: 2.1 time: 0.902229 May 19 08:18:14.213036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-970fb33e-20bb-4734-9c2b-4a0cf0afa812 req-a4053708-991f-453b-bed3-3c51932da9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d39a76-db81-4bb9-9e41-4e434ef59341", "tag": "4a11627b-afc0-4edd-a386-a6068f747e6a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:14.214963 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 407/867] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:13 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1471 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:14.230469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.238705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-970fb33e-20bb-4734-9c2b-4a0cf0afa812 req-a4053708-991f-453b-bed3-3c51932da9a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.239840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:14.240637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-970fb33e-20bb-4734-9c2b-4a0cf0afa812 req-a4053708-991f-453b-bed3-3c51932da9a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.263858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.267158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.270226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.274120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.292204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-970fb33e-20bb-4734-9c2b-4a0cf0afa812 req-a4053708-991f-453b-bed3-3c51932da9a2 service nova] Creating event network-changed:4a11627b-afc0-4edd-a386-a6068f747e6a for instance 24d39a76-db81-4bb9-9e41-4e434ef59341 on chh2-842464-2 May 19 08:18:14.320629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-970fb33e-20bb-4734-9c2b-4a0cf0afa812 req-a4053708-991f-453b-bed3-3c51932da9a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120712 May 19 08:18:14.324961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 461/868] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:14.337746 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 HTTP/1.1 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '03150fbb-bbc2-47a5-ad11-896ae4a22674'} May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:14.343419 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.349058 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.349744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.349744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:14.354295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:14.356609 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c533e4d8-2513-497f-a611-44d672d67d8a tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 404 len: 111 microversion: 2.1 time: 0.140885 May 19 08:18:14.360465 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 408/869] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:14 2022] DELETE /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:14.369015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.369730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.372755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.373468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.396703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.398364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 03150fbb-bbc2-47a5-ad11-896ae4a22674] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:14.416026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.417659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.418995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.421367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.467724 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 HTTP/1.1 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '03150fbb-bbc2-47a5-ad11-896ae4a22674'} May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.469816 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. May 19 08:18:14.474749 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.476543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Instance 03150fbb-bbc2-47a5-ad11-896ae4a22674 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:14.477449 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-436919da-a47f-49aa-ac6a-fdf114ea8e2b tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674" status: 404 len: 111 microversion: 2.1 time: 0.102855 May 19 08:18:14.478023 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 409/870] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:14 2022] GET /compute/v2.1/servers/03150fbb-bbc2-47a5-ad11-896ae4a22674 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:14.493414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f32126154c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.603164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:18:14.605765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group 4596e3d3-c387-4dca-a5bf-525401a3da8e not found {{(pid=119073) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:18:14.606834 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.606834 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e HTTP/1.1 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '4596e3d3-c387-4dca-a5bf-525401a3da8e'} May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:18:14.610124 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group 4596e3d3-c387-4dca-a5bf-525401a3da8e does not exist May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-ea396508-ec87-4721-bae0-da4638033ceb'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-92376255-9882-4dc8-8cfa-2938a414c21f tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e" status: 404 len: 194 microversion: 2.1 time: 0.125624 May 19 08:18:14.616155 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 410/871] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:14 2022] DELETE /compute/v2.1/os-security-groups/4596e3d3-c387-4dca-a5bf-525401a3da8e => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:18:14.627671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321218d1f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.746733 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:18:14.748109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group 9ffa7152-ec72-4937-aa6b-13d3feef940c not found {{(pid=119073) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:18:14.752825 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.752825 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c HTTP/1.1 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '9ffa7152-ec72-4937-aa6b-13d3feef940c'} May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:18:14.762693 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] May 19 08:18:14.766431 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.773900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group 9ffa7152-ec72-4937-aa6b-13d3feef940c does not exist May 19 08:18:14.773900 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-26daab29-3b39-470d-b64e-7594fb7bd77c'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:14.778153 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-385026f7-08b0-4235-8933-4bb5fd064df8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c" status: 404 len: 194 microversion: 2.1 time: 0.157433 May 19 08:18:14.785444 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 411/872] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:14 2022] DELETE /compute/v2.1/os-security-groups/9ffa7152-ec72-4937-aa6b-13d3feef940c => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:14.821371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212249430>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.862643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:14.881411 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b89d85f6-19f2-49b2-938b-9f088fe00a86 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 200 len: 1519 microversion: 2.1 time: 0.550520 May 19 08:18:14.882015 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 462/873] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:14 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 1519 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:14.886023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:18:14.886784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group 691ad307-e48d-4b1a-8939-ca1ec18a66af not found {{(pid=119073) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:18:14.887322 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.887322 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af HTTP/1.1 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '691ad307-e48d-4b1a-8939-ca1ec18a66af'} May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:18:14.889339 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group 691ad307-e48d-4b1a-8939-ca1ec18a66af does not exist May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-23977ac2-1984-4418-a9e0-968e8e92249c'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f51abde1-d4af-4e5e-9f74-3ca618e668f0 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af" status: 404 len: 194 microversion: 2.1 time: 0.104113 May 19 08:18:14.898069 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 412/874] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:14 2022] DELETE /compute/v2.1/os-security-groups/691ad307-e48d-4b1a-8939-ca1ec18a66af => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:14.907363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212333ca0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:14.913961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.33.1.181"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:14.915137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:14.930544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.930986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.931771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:14.932234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:14.964829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Acquired lock "refresh_cache-1255db25-bef6-4811-911c-9ce729d641ea" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:18:14.981215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:18:14.981856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group efff9408-7b5f-4c62-ab03-6152507b6cfc not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:18:14.982389 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.982389 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc HTTP/1.1 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'efff9408-7b5f-4c62-ab03-6152507b6cfc'} May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:18:14.984359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group efff9408-7b5f-4c62-ab03-6152507b6cfc does not exist May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-18e0d6f8-ba50-4d58-9a39-576f284e2ec0'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:14.989266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9b0afda-f473-4eab-8990-81ec842f85f8 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc" status: 404 len: 194 microversion: 2.1 time: 0.083027 May 19 08:18:14.995027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 463/875] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:14 2022] DELETE /compute/v2.1/os-security-groups/efff9408-7b5f-4c62-ab03-6152507b6cfc => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:14.998111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212065670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:15.117006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:18:15.118267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:18:15.119132 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.119132 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e HTTP/1.1 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e'} May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:18:15.124225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] May 19 08:18:15.129923 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.144788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e does not exist May 19 08:18:15.144788 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-6d38b806-7a81-4d11-b6d1-17754f1b40fe'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:15.146037 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6317959c-9579-4b20-a6c9-9c915feb37b5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e" status: 404 len: 194 microversion: 2.1 time: 0.153181 May 19 08:18:15.146941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 464/876] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:14 2022] DELETE /compute/v2.1/os-security-groups/f21fb97b-530e-4ad4-ad5b-18d45d0a8d6e => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:15.156182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f3212182dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:15.317168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:18:15.318724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Neutron security group cfb73928-3c75-44da-b50e-57b2300e7dda not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:18:15.319546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.319546 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda HTTP/1.1 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'cfb73928-3c75-44da-b50e-57b2300e7dda'} May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:18:15.323680 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Security group cfb73928-3c75-44da-b50e-57b2300e7dda does not exist May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-46496826-6fff-4e11-a880-a7429c66a28a'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:15.327444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-611d6e6a-424c-4bbd-879e-8d66e2f281a5 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda" status: 404 len: 194 microversion: 2.1 time: 0.176328 May 19 08:18:15.336130 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 465/877] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:15 2022] DELETE /compute/v2.1/os-security-groups/cfb73928-3c75-44da-b50e-57b2300e7dda => generated 194 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:18:15.355916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:15.356656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:15.364314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:15.364776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:15.365592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:15.366038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:15.996288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:16.013915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f97859d-7a60-4b0d-9f24-624c4932ed10 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.676363 May 19 08:18:16.014528 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 466/878] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:15 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:16.023897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:16.023897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:16.030629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:16.031089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:16.031875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:16.032323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:16.467627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:16.486531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-230fdff7-70b6-4712-8015-d7db2d44ab16 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.470455 May 19 08:18:16.487939 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 467/879] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:16 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:16.498379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:16.499337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:16.509392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:16.513953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:16.515202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:16.515851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:16.551015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:18:16.677970 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de85fa12-1888-4944-bbf1-f4e2781a2690 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 204 len: 0 microversion: 2.1 time: 0.187670 May 19 08:18:16.681227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 468/880] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:16 2022] DELETE /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:16.690717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:16.691831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:16.700218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:16.701068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:16.702140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:16.702834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:17.242326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:17.276218 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=10 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:17.573280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:17.586314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8738585-ac52-423c-800c-87125a234fbc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1647 microversion: 2.1 time: 0.900550 May 19 08:18:17.586912 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 469/881] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:16 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1647 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:17.601488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:17.602105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:17.638623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:17.639095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:17.639926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:17.640365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:17.997772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:18.029641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac8ec977-b6c5-4d0a-952c-efb63915223a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.429351 May 19 08:18:18.032402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 470/882] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:17 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:18.046131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:18.050389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:18.060862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:18.061648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:18.062606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:18.063573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:18.406508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:18.419830 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c660ce47-dcaa-4c8e-9f2e-4f4a20040310 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.383086 May 19 08:18:18.433713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 471/883] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:18 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:18.495666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Building network info cache for instance {{(pid=119073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:18:18.529225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-68cab2fb-855e-4c40-b984-79f6190bcbd1 req-e3cc4d8e-2b70-4e6d-aba0-7ae12895429f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:18.549201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-68cab2fb-855e-4c40-b984-79f6190bcbd1 req-e3cc4d8e-2b70-4e6d-aba0-7ae12895429f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:18.549742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-68cab2fb-855e-4c40-b984-79f6190bcbd1 req-e3cc4d8e-2b70-4e6d-aba0-7ae12895429f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:18.578240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-68cab2fb-855e-4c40-b984-79f6190bcbd1 req-e3cc4d8e-2b70-4e6d-aba0-7ae12895429f service nova] Creating event network-changed:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:18:18.586990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-68cab2fb-855e-4c40-b984-79f6190bcbd1 req-e3cc4d8e-2b70-4e6d-aba0-7ae12895429f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062016 May 19 08:18:18.591846 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 472/884] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:18:18.612911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:18.617124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:18.628908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:18.634476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:18.635321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:18.636305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:18.636895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:19.271195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:19.285060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd68dfbe-699b-43d5-8158-6bb6aaef7320 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1647 microversion: 2.1 time: 0.679772 May 19 08:18:19.296202 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 473/885] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:18 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1647 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:19.315305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:19.316228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:19.334582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:19.335413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:19.339350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:19.341648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:19.790939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:19.823590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fa971b3-de67-49ea-88a0-cded75383a18 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.522991 May 19 08:18:19.824787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 474/886] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:19 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:19.833277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:19.842525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:19.858660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:19.860690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:19.861815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:19.863119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:20.294456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:20.304154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa14f636-b223-4b51-864f-2a9f61fc44f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.477967 May 19 08:18:20.321422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 475/887] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:19 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:20.637847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d80cd0b-7b1f-4a7f-bdf1-a6d52dbb1058 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1735744278", "ram": 512, "vcpus": 1, "disk": 10, "id": 938996656, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:20.640024 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:20.640024 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:18:20.663395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d80cd0b-7b1f-4a7f-bdf1-a6d52dbb1058 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.340339 May 19 08:18:20.664523 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 476/888] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:18:20 2022] POST /compute/v2.1/flavors => generated 413 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:20.670484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:20.671516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:20.681403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:20.682204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:20.683821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:20.684538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:20.930019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adcf30b9ac4f4046b0343bc1435a6562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699efd30daad449889b1823bf7990948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:20.959723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83d9b869-21b3-44b3-8d56-0b0805113d73 tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 200 len: 1468 microversion: 2.1 time: 0.293492 May 19 08:18:20.967013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 477/889] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:20 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 1468 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:21.166982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Updating instance_info_cache with network_info: [{"id": "0f5d3d5c-c55f-44ea-8092-60df41f1febb", "address": "fa:16:3e:ef:ba:44", "network": {"id": "54df6a27-dc6e-457f-b69c-50c48499146f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1376613455-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.33.1.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1c48363495440688a94cad914be0f2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f5d3d5c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:18:21.183665 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Releasing lock "refresh_cache-1255db25-bef6-4811-911c-9ce729d641ea" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:18:21.184863 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a87b39b6-8fe5-4093-914b-5a68e07b5dce tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action" status: 202 len: 0 microversion: 2.1 time: 6.275511 May 19 08:18:21.185686 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 413/890] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:14 2022] POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action => generated 0 bytes in 6277 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:18:21.190656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-803c1f6c-fb4e-4e46-8df4-182abb5aa74e tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:21.196616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:21.197520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:21.207304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-803c1f6c-fb4e-4e46-8df4-182abb5aa74e tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] HTTP exception thrown: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:21.212231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-803c1f6c-fb4e-4e46-8df4-182abb5aa74e tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Request method failure captured: May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/flavors/938996656/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1KJt36dYUht1LzE5J8lo_ZbJ07IJIygJItW8VUU82FhsaXubxuSYZ2pfctmmb9yw1qv6HBW25MuhSlqimJatFDmcSuW8HrgHaq0eIPnGXRGUnz8UIJFSLP7dZ9mWMA8wXQ1jNBLQE6tmc5sUfak6idEkhte-IMYF_4qPltbAJSLrM May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b464ce85e84145d19ecd0299c8f7dcca May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: exception: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'flavor_id': '938996656', 'id': 'hw:cpu_thread_policy'} May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:21.216061 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:21.221245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.221245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.221607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-803c1f6c-fb4e-4e46-8df4-182abb5aa74e tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Returning 404 to user: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:21.221787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.221945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-803c1f6c-fb4e-4e46-8df4-182abb5aa74e tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] 10.222.0.78 "GET /compute/v2.1/flavors/938996656/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.249088 May 19 08:18:21.222100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.222253 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 478/891] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:18:20 2022] GET /compute/v2.1/flavors/938996656/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:21.230024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9a1ca597-0770-4960-accc-a7ba5890f6e8 req-78f1314a-a741-4ce6-ac09-7f35d0a23ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffa61b1-599a-419f-b13c-80555e11be0d", "name": "network-vif-deleted", "tag": "709f676f-c0cd-4844-b149-76891d92ab2b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:21.246682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9a1ca597-0770-4960-accc-a7ba5890f6e8 req-78f1314a-a741-4ce6-ac09-7f35d0a23ee8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.247117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9a1ca597-0770-4960-accc-a7ba5890f6e8 req-78f1314a-a741-4ce6-ac09-7f35d0a23ee8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.260508 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9a1ca597-0770-4960-accc-a7ba5890f6e8 req-78f1314a-a741-4ce6-ac09-7f35d0a23ee8 service nova] Creating event network-vif-deleted:709f676f-c0cd-4844-b149-76891d92ab2b for instance 5ffa61b1-599a-419f-b13c-80555e11be0d on chh1-842464-2 May 19 08:18:21.294867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9a1ca597-0770-4960-accc-a7ba5890f6e8 req-78f1314a-a741-4ce6-ac09-7f35d0a23ee8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070218 May 19 08:18:21.299310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 479/892] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:21.314740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.33.1.181"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:21.316690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:21.335614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.336095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.341961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.348554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.363896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:21.402435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Acquired lock "refresh_cache-a6be73c7-debf-40af-bcab-064bae60410a" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:18:21.534294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:21.544764 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8aa0f3a0-aaa7-4e9e-803f-e9a62bc0b3fd tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.357622 May 19 08:18:21.555460 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 414/893] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:21 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:21.560800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-327748ae-8941-4d98-bcb5-30f308abf9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:21.562515 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:21.562515 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:21.563741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-327748ae-8941-4d98-bcb5-30f308abf9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b464ce85e84145d19ecd0299c8f7dcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834b7cfdd2be4f038bd5eb9896ba9b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-327748ae-8941-4d98-bcb5-30f308abf9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Request method failure captured: May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/flavors/938996656/os-extra_specs HTTP/1.1 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 66 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1KJt36dYUht1LzE5J8lo_ZbJ07IJIygJItW8VUU82FhsaXubxuSYZ2pfctmmb9yw1qv6HBW25MuhSlqimJatFDmcSuW8HrgHaq0eIPnGXRGUnz8UIJFSLP7dZ9mWMA8wXQ1jNBLQE6tmc5sUfak6idEkhte-IMYF_4qPltbAJSLrM May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: b464ce85e84145d19ecd0299c8f7dcca May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '938996656', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:18:21.566626 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 19 08:18:21.570539 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:21.573252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-327748ae-8941-4d98-bcb5-30f308abf9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:21.574878 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-327748ae-8941-4d98-bcb5-30f308abf9a9 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] 10.222.0.78 "POST /compute/v2.1/flavors/938996656/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.018142 May 19 08:18:21.582953 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 415/894] 10.222.0.78 () {60 vars in 1220 bytes} [Thu May 19 08:18:21 2022] POST /compute/v2.1/flavors/938996656/os-extra_specs => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:21.588380 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:21.589264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:21.598360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.599160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.600153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:21.600790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:21.927338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:21.934561 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-95b8eb7d-3f1f-40f4-85f5-c0f1a813ea7c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.350166 May 19 08:18:21.935405 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 416/895] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:21 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:21.942098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e8260c2f-3ef6-44b2-aec9-e3c5cc00617b tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:21.943484 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:21.943484 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:21.969630 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e8260c2f-3ef6-44b2-aec9-e3c5cc00617b tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/938996656/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032764 May 19 08:18:21.970322 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 417/896] 10.222.0.78 () {60 vars in 1220 bytes} [Thu May 19 08:18:21 2022] POST /compute/v2.1/flavors/938996656/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:18:21.980218 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1fc0c27f-8b18-4696-bbd4-7b3992985a6b tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:21.981464 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:21.981464 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:21.982791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1fc0c27f-8b18-4696-bbd4-7b3992985a6b tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b464ce85e84145d19ecd0299c8f7dcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834b7cfdd2be4f038bd5eb9896ba9b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1fc0c27f-8b18-4696-bbd4-7b3992985a6b tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Request method failure captured: May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1KJt36dYUht1LzE5J8lo_ZbJ07IJIygJItW8VUU82FhsaXubxuSYZ2pfctmmb9yw1qv6HBW25MuhSlqimJatFDmcSuW8HrgHaq0eIPnGXRGUnz8UIJFSLP7dZ9mWMA8wXQ1jNBLQE6tmc5sUfak6idEkhte-IMYF_4qPltbAJSLrM May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: b464ce85e84145d19ecd0299c8f7dcca May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '938996656', 'id': 'hw:numa_nodes'} May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:21.984886 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1fc0c27f-8b18-4696-bbd4-7b3992985a6b tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1fc0c27f-8b18-4696-bbd4-7b3992985a6b tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] 10.222.0.78 "DELETE /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011225 May 19 08:18:21.993188 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 418/897] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:18:21 2022] DELETE /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 19 08:18:21.998508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:21.999388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] [instance: 5ffa61b1-599a-419f-b13c-80555e11be0d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:22.008481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:22.009235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:22.010417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:22.010861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:22.026373 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] HTTP exception thrown: Instance 5ffa61b1-599a-419f-b13c-80555e11be0d could not be found. May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Request method failure captured: May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d HTTP/1.1 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzdFg6Yybi_9DnOH5ZGNjtLX0kT2Y5FG6cO9BRqnM0GFXHwLkow7_uoCILART19QsDOMIjkiSfJx_UquMOlNkasq4uZibq6lFsImN-_hBRYatQbFExKpK9ggDBqOoNmYRL9lb06FkSip70kKCHMZXdGdySfouX4whem6rHiQggAUdQ May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/699efd30daad449889b1823bf7990948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_699efd30daad449889b1823bf7990948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/699efd30daad449889b1823bf7990948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 699efd30daad449889b1823bf7990948 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-45677522 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: adcf30b9ac4f4046b0343bc1435a6562 May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupsTestJSON-45677522-project May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 5ffa61b1-599a-419f-b13c-80555e11be0d could not be found. May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '5ffa61b1-599a-419f-b13c-80555e11be0d'} May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ffa61b1-599a-419f-b13c-80555e11be0d could not be found. May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ffa61b1-599a-419f-b13c-80555e11be0d could not be found. May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:22.027917 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ffa61b1-599a-419f-b13c-80555e11be0d could not be found. May 19 08:18:22.031986 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.033989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Returning 404 to user: Instance 5ffa61b1-599a-419f-b13c-80555e11be0d could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:22.035158 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aef0b0ff-47ba-4a3e-a93b-bb6cf1cbaa3d tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d" status: 404 len: 111 microversion: 2.1 time: 0.045892 May 19 08:18:22.035738 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 419/898] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:21 2022] GET /compute/v2.1/servers/5ffa61b1-599a-419f-b13c-80555e11be0d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:22.040610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-74c62d27-1ede-44cf-9bce-818480bf3749 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:22.042033 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:22.042033 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:22.063005 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-74c62d27-1ede-44cf-9bce-818480bf3749 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/938996656/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025984 May 19 08:18:22.064242 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 420/899] 10.222.0.78 () {60 vars in 1220 bytes} [Thu May 19 08:18:22 2022] POST /compute/v2.1/flavors/938996656/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:18:22.068982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-94abea3e-75f4-43b3-a217-01acfc5b01cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321218dd30>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:22.936100 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-94abea3e-75f4-43b3-a217-01acfc5b01cc tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/4fb30dde-fe9d-406d-bb1b-95d995806a66" status: 202 len: 0 microversion: 2.1 time: 0.870607 May 19 08:18:22.937535 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 421/900] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:22 2022] DELETE /compute/v2.1/os-security-groups/4fb30dde-fe9d-406d-bb1b-95d995806a66 => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:22.944461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a9a892cc-7e35-40cc-84b3-b02cd2497153 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:22.945740 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:22.945740 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:22.947512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a9a892cc-7e35-40cc-84b3-b02cd2497153 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b464ce85e84145d19ecd0299c8f7dcca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834b7cfdd2be4f038bd5eb9896ba9b4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a9a892cc-7e35-40cc-84b3-b02cd2497153 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Request method failure captured: May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: request: PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 22 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1KJt36dYUht1LzE5J8lo_ZbJ07IJIygJItW8VUU82FhsaXubxuSYZ2pfctmmb9yw1qv6HBW25MuhSlqimJatFDmcSuW8HrgHaq0eIPnGXRGUnz8UIJFSLP7dZ9mWMA8wXQ1jNBLQE6tmc5sUfak6idEkhte-IMYF_4qPltbAJSLrM May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/834b7cfdd2be4f038bd5eb9896ba9b4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 834b7cfdd2be4f038bd5eb9896ba9b4a May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: b464ce85e84145d19ecd0299c8f7dcca May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: {"hw:numa_nodes": "1"} May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '938996656', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 19 08:18:22.949252 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 19 08:18:22.953057 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:22.961486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a9a892cc-7e35-40cc-84b3-b02cd2497153 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:22.963197 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a9a892cc-7e35-40cc-84b3-b02cd2497153 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593 tempest-FlavorsExtraSpecsNegativeTestJSON-797297593-project] 10.222.0.78 "PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024221 May 19 08:18:22.966184 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 422/901] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:18:22 2022] PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:22.980574 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:22.981722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:22.990210 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:22.990749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:22.991760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:22.992266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:23.254838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:23.264571 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-078d7742-3c69-4648-9b9b-dc7c9c48d3eb tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.296956 May 19 08:18:23.266303 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 423/902] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:22 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:23.273337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5d6bce0e-b9a2-4e06-b5cb-4e5a0adf60ed tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] Calling method '.version_select at 0x7f321219cb80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:23.710081 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5d6bce0e-b9a2-4e06-b5cb-4e5a0adf60ed tempest-SecurityGroupsTestJSON-45677522 tempest-SecurityGroupsTestJSON-45677522-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/25e246d0-4b31-4045-be36-68ac941391f4" status: 202 len: 0 microversion: 2.1 time: 0.440381 May 19 08:18:23.711863 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 424/903] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:18:23 2022] DELETE /compute/v2.1/os-security-groups/25e246d0-4b31-4045-be36-68ac941391f4 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:23.722932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:23.723965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:23.734225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:23.734942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:23.736581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:23.737118 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:24.066853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:24.077821 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-acf294cf-c4f0-48b9-987a-cec67909cfb3 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.363622 May 19 08:18:24.088041 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 425/904] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:23 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:24.098509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2224ca74-9cc1-4cac-8152-929eb5abf050 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:24.099343 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:24.099343 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:24.119804 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-2224ca74-9cc1-4cac-8152-929eb5abf050 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] HTTP exception thrown: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2224ca74-9cc1-4cac-8152-929eb5abf050 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Request method failure captured: May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/flavors/938996656/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1LTppA5Ur_Lt2ojKIRk6FPgsjr79LfRrM4A-_xm0EGMIWWGXU00lvY6syyTFbMWuJSsh2y47Qjy7B_EjPHHDhdKYulJTP1H4Pyp2_atqETzmnzrNpEmfI0ZrDnoTTxNQyxWJYg6svs67yyuEQ2fSv05-bi3BwpN7E_i-nFctXX6Zc May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ab011dec3147413084ae6ef12704844b May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ab011dec3147413084ae6ef12704844b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab011dec3147413084ae6ef12704844b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ab011dec3147413084ae6ef12704844b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab011dec3147413084ae6ef12704844b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ab011dec3147413084ae6ef12704844b May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 8ae3464aabb04c09ac23c98b017293cf May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: exception: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '938996656', 'id': 'hw:cpu_thread_policy'} May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. May 19 08:18:24.121299 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.125204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2224ca74-9cc1-4cac-8152-929eb5abf050 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Returning 404 to user: Flavor 938996656 has no extra specs with key hw:cpu_thread_policy. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:24.125204 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2224ca74-9cc1-4cac-8152-929eb5abf050 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/938996656/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.035485 May 19 08:18:24.134978 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 426/905] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:18:24 2022] DELETE /compute/v2.1/flavors/938996656/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:24.145748 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-026adc07-ef86-40a1-a0fc-8c22091d44e9 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:24.147143 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:24.147143 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:24.148273 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-026adc07-ef86-40a1-a0fc-8c22091d44e9 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] HTTP exception thrown: Request body and URI mismatch May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-026adc07-ef86-40a1-a0fc-8c22091d44e9 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Request method failure captured: May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: request: PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 27 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1LTppA5Ur_Lt2ojKIRk6FPgsjr79LfRrM4A-_xm0EGMIWWGXU00lvY6syyTFbMWuJSsh2y47Qjy7B_EjPHHDhdKYulJTP1H4Pyp2_atqETzmnzrNpEmfI0ZrDnoTTxNQyxWJYg6svs67yyuEQ2fSv05-bi3BwpN7E_i-nFctXX6Zc May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ab011dec3147413084ae6ef12704844b May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ab011dec3147413084ae6ef12704844b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab011dec3147413084ae6ef12704844b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ab011dec3147413084ae6ef12704844b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab011dec3147413084ae6ef12704844b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ab011dec3147413084ae6ef12704844b May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 8ae3464aabb04c09ac23c98b017293cf May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: {"hw:cpu_policy": "shared"} May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: exception: Request body and URI mismatch May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '938996656', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 19 08:18:24.150101 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.159237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-026adc07-ef86-40a1-a0fc-8c22091d44e9 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:24.160923 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-026adc07-ef86-40a1-a0fc-8c22091d44e9 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024688 May 19 08:18:24.166614 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 427/906] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:18:24 2022] PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes => generated 73 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:18:24.187880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e85619cb-75e6-4459-9ec2-c40f13cd4121 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e85619cb-75e6-4459-9ec2-c40f13cd4121 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Request method failure captured: May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: request: PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes HTTP/1.1 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 49 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1LTppA5Ur_Lt2ojKIRk6FPgsjr79LfRrM4A-_xm0EGMIWWGXU00lvY6syyTFbMWuJSsh2y47Qjy7B_EjPHHDhdKYulJTP1H4Pyp2_atqETzmnzrNpEmfI0ZrDnoTTxNQyxWJYg6svs67yyuEQ2fSv05-bi3BwpN7E_i-nFctXX6Zc May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ab011dec3147413084ae6ef12704844b May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ab011dec3147413084ae6ef12704844b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab011dec3147413084ae6ef12704844b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ab011dec3147413084ae6ef12704844b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab011dec3147413084ae6ef12704844b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ab011dec3147413084ae6ef12704844b May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 8ae3464aabb04c09ac23c98b017293cf May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'flavor_id': '938996656', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise error May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'type': ['string', May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'number']}}, May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi On instance: May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:18:24.198257 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 19 08:18:24.202288 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:24.215251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e85619cb-75e6-4459-9ec2-c40f13cd4121 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:24.216421 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e85619cb-75e6-4459-9ec2-c40f13cd4121 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.041510 May 19 08:18:24.217586 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 428/907] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:18:24 2022] PUT /compute/v2.1/flavors/938996656/os-extra_specs/hw:numa_nodes => generated 117 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:18:24.234345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e10f0f1-99fa-44ad-b9ce-88377710cb21 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:24.235326 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:24.235326 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:24.291521 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8e10f0f1-99fa-44ad-b9ce-88377710cb21 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/938996656" status: 202 len: 0 microversion: 2.1 time: 0.062109 May 19 08:18:24.292678 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 429/908] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:18:24 2022] DELETE /compute/v2.1/flavors/938996656 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:24.297606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:24.298985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:24.318568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:24.319021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:24.319813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:24.320261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:24.719867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:24.735319 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dd62d282-b74f-4c22-9907-f746a4970bec tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.441329 May 19 08:18:24.736534 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 430/909] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:24 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:24.772205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-49b09383-4881-4300-af12-c6e284494df4 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:24.802160 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-49b09383-4881-4300-af12-c6e284494df4 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441 tempest-FlavorsExtraSpecsNegativeTestJSON-534784441-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053321 May 19 08:18:24.803095 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 431/910] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:18:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:24.808493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9c7f9667-b66d-49a0-b393-05f3ca11bb5f req-cf787387-e74d-4c78-9757-394906d13ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:24.825194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9c7f9667-b66d-49a0-b393-05f3ca11bb5f req-cf787387-e74d-4c78-9757-394906d13ecf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:24.825934 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9c7f9667-b66d-49a0-b393-05f3ca11bb5f req-cf787387-e74d-4c78-9757-394906d13ecf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:24.862906 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9c7f9667-b66d-49a0-b393-05f3ca11bb5f req-cf787387-e74d-4c78-9757-394906d13ecf service nova] Creating event network-changed:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:18:24.877817 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9c7f9667-b66d-49a0-b393-05f3ca11bb5f req-cf787387-e74d-4c78-9757-394906d13ecf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069363 May 19 08:18:24.878640 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 432/911] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:24.961569 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.neutron [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] re-assign floating IP 172.33.1.181 from instance 1255db25-bef6-4811-911c-9ce729d641ea May 19 08:18:25.070246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Building network info cache for instance {{(pid=119072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:18:25.108312 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:25.110256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:25.151610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:25.155288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:25.158667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:25.164618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:25.693938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:25.705043 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-36eb4cec-ea40-4b6b-ae25-79424bf14407 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.611546 May 19 08:18:25.708780 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 433/912] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:25 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:18:25.931959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-529308811", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "220be69f-b0ca-49aa-856a-990da7941ef6"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:26.031978 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] validate_networks() for [('220be69f-b0ca-49aa-856a-990da7941ef6', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:18:26.826431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Updating instance_info_cache with network_info: [{"id": "0f5d3d5c-c55f-44ea-8092-60df41f1febb", "address": "fa:16:3e:ef:ba:44", "network": {"id": "54df6a27-dc6e-457f-b69c-50c48499146f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1376613455-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1c48363495440688a94cad914be0f2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f5d3d5c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:18:26.837532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Building network info cache for instance {{(pid=119072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:18:27.116496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:18:27.117066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:18:27.117418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:18:27.117846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:18:27.118244 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:18:27.136439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:27.136885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:27.137715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:27.138155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:27.179933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for project d36e395d75dd44ce8e9852bb61c14193. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:18:27.186322 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for user ec18a0cd947847b6a084c3eed533e74e and project d36e395d75dd44ce8e9852bb61c14193. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:18:27.202776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:18:27.206628 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:18:27.282156 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7f153483-553f-4b84-a5a2-1f578a89f4d0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572006 May 19 08:18:27.284174 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 434/913] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:18:27.289273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:27.290223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:27.312603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:27.313633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:27.315170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:27.316211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:28.146367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:28.156155 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0c29e7a0-519b-44be-ab61-10748e30d809 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.870595 May 19 08:18:28.160965 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 435/914] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:27 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:28.187290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:28.190494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:28.211017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:28.216977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:28.221535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:28.225563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:28.272249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:28.623650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:28.632157 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8e198f44-dbb9-476a-98ea-e24a1b8fe2cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.469971 May 19 08:18:28.632748 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 436/915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:28 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:28.652840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-70c3a026-dbd3-4474-ad54-161a89095429 req-007d39ec-55dd-4493-8f57-d47d361dda55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6be73c7-debf-40af-bcab-064bae60410a", "tag": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:28.665760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Updating instance_info_cache with network_info: [{"id": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca", "address": "fa:16:3e:09:13:db", "network": {"id": "54df6a27-dc6e-457f-b69c-50c48499146f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1376613455-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.33.1.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1c48363495440688a94cad914be0f2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap84df3723-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:18:28.673519 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-70c3a026-dbd3-4474-ad54-161a89095429 req-007d39ec-55dd-4493-8f57-d47d361dda55 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:28.674421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-70c3a026-dbd3-4474-ad54-161a89095429 req-007d39ec-55dd-4493-8f57-d47d361dda55 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:28.687494 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-70c3a026-dbd3-4474-ad54-161a89095429 req-007d39ec-55dd-4493-8f57-d47d361dda55 service nova] Creating event network-changed:84df3723-56e7-4f2c-bda2-1b9c9f0370ca for instance a6be73c7-debf-40af-bcab-064bae60410a on chh2-842464-2 May 19 08:18:28.694262 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-70c3a026-dbd3-4474-ad54-161a89095429 req-007d39ec-55dd-4493-8f57-d47d361dda55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045478 May 19 08:18:28.695413 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 437/916] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:28.700141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Releasing lock "refresh_cache-a6be73c7-debf-40af-bcab-064bae60410a" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:18:28.701911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:28.703081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:28.703578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a781464-33f4-49c7-8330-3d53b693c349 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a/action" status: 202 len: 0 microversion: 2.1 time: 7.400708 May 19 08:18:28.707478 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 480/917] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:21 2022] POST /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a/action => generated 0 bytes in 7407 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:18:28.717424 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:28.717864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:28.719124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:28.719773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:28.720524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'action', calling method: .version_select at 0x7f3214bc3e50>, body: {"removeFloatingIp": {"address": "172.33.1.181"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:28.863997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:28.875284 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ccdec05c-3f20-4bd9-a53d-1b7ad45513c4 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1294 microversion: 2.1 time: 0.178357 May 19 08:18:28.880504 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 438/918] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:28 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1294 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:29.170171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:29.176959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:29.177783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:29.179158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:29.179688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:29.180634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:29.186515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:29.194886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:29.196128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:29.208160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:29.210384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:29.651561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:29.660969 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-172dc9de-6920-4dca-9ff5-223edb545488 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.488693 May 19 08:18:29.661618 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 439/919] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:29 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:18:29.777544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] HTTP exception thrown: Floating IP 172.33.1.181 is not associated with instance 1255db25-bef6-4811-911c-9ce729d641ea. May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Request method failure captured: May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action HTTP/1.1 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 49 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0WIx3w5OZqHBybWAbSari5awYTUwam4x7D5pNj20YHzo_3l9VSx8HoT6xhXQT3sPys42_B1NNiw0tArBrg6zB4nAnT3ppBOkxQ2_Dz_FkBozTTgg_gpeYpJsvcOhKTW3gQgkLhxywiqtgxXF-BDok302ThPjdi4MwE6vu6SOvnnz4 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d1c48363495440688a94cad914be0f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d1c48363495440688a94cad914be0f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9eb7e9176a904e8a97f21e31b54c631e May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: {"removeFloatingIp": {"address": "172.33.1.181"}} May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: exception: Floating IP 172.33.1.181 is not associated with instance 1255db25-bef6-4811-911c-9ce729d641ea. May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1255db25-bef6-4811-911c-9ce729d641ea', 'body': {'removeFloatingIp': {'address': '172.33.1.181'}}} May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.33.1.181 is not associated with instance 1255db25-bef6-4811-911c-9ce729d641ea. May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.33.1.181 is not associated with instance 1255db25-bef6-4811-911c-9ce729d641ea. May 19 08:18:29.779631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:29.786000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Returning 409 to user: Floating IP 172.33.1.181 is not associated with instance 1255db25-bef6-4811-911c-9ce729d641ea. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:29.787183 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5da48691-7b0c-4bd2-b86e-1c0e65d4be16 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action" status: 409 len: 146 microversion: 2.1 time: 1.074827 May 19 08:18:29.788039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 481/920] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:28 2022] POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action => generated 146 bytes in 1076 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:18:29.795763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:29.796670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:29.811017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:29.811752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:29.812720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:29.817636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:30.072586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-289325539", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "aa2d7beb-731b-4835-8074-b40956692c19"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:30.079154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:30.089008 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54bd0db6-f0f9-4b9b-944f-8004f6dd73f9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1476 microversion: 2.1 time: 0.299705 May 19 08:18:30.090173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 482/921] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:29 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:30.103742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.33.1.181"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:30.152054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] validate_networks() for [('aa2d7beb-731b-4835-8074-b40956692c19', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:18:30.445853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:30.453637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:30.454303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:30.455307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:30.455773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:30.788614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Acquired lock "refresh_cache-a6be73c7-debf-40af-bcab-064bae60410a" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:18:30.972067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:18:30.972523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:18:30.973010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:18:30.973441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:18:30.973867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:18:30.999676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:31.000129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:31.000959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:31.001703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:31.020514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Getting quotas for project a94ddeb7ac414580a4388699435ac103. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:18:31.026697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Getting quotas for user 581c4b6e41864dec9aaef13792c0a487 and project a94ddeb7ac414580a4388699435ac103. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:18:31.040864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:18:31.043243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:18:31.094162 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e2b7d200-5c0e-45a4-a9f3-59593c9d0392 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.425369 May 19 08:18:31.100457 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 440/922] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:18:31.105915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:31.106380 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:31.113825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:31.115070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:31.115565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:31.116001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:31.518134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:31.536398 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 0.436605 May 19 08:18:31.537355 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 441/923] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:31 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:31.539265 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:31.545075 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-47d0d999-17c9-4500-85f0-2c395b9705ea tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006542 May 19 08:18:31.545899 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 442/924] 10.222.0.78 () {56 vars in 885 bytes} [Thu May 19 08:18:31 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 08:18:31.568153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:31.569159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:31.584712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:31.585589 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:31.586954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:31.587404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:32.383676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:32.415800 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7d61218e-34a1-4cfd-a21b-caa8937f014b tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.861465 May 19 08:18:32.448072 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 443/925] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:31 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:32.460406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:32.461466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:32.497132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:32.500373 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:32.501489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:32.501970 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:32.538823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Building network info cache for instance {{(pid=119072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:18:32.706153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:32.741594 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6e5598ac-2f4a-4d98-960f-9d97208318e1 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1275 microversion: 2.1 time: 0.286033 May 19 08:18:32.742417 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 444/926] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:32 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:32.747023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:32.747637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:32.769948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:32.772611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:32.773868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:32.777905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:33.429967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:33.450240 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5c62676c-88eb-43d4-95ed-a9ffd016ac7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1475 microversion: 2.1 time: 0.706846 May 19 08:18:33.467271 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 445/927] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:32 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1475 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:33.473689 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:33.474568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:33.478384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:33.496549 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:33.497819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:33.498809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:33.499411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:33.936827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:33.950575 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a404ae98-2df9-45c4-8602-68da0d5c0ca3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 0.481895 May 19 08:18:33.951421 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 446/928] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:33 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:33.961159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-b0186dbc-8e35-49cf-b7b6-5ad9bbe3759a req-3e1d5e83-bf2d-4184-a255-d49522336042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6be73c7-debf-40af-bcab-064bae60410a", "tag": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:33.979204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b0186dbc-8e35-49cf-b7b6-5ad9bbe3759a req-3e1d5e83-bf2d-4184-a255-d49522336042 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:33.979920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b0186dbc-8e35-49cf-b7b6-5ad9bbe3759a req-3e1d5e83-bf2d-4184-a255-d49522336042 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.007985 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-b0186dbc-8e35-49cf-b7b6-5ad9bbe3759a req-3e1d5e83-bf2d-4184-a255-d49522336042 service nova] Creating event network-changed:84df3723-56e7-4f2c-bda2-1b9c9f0370ca for instance a6be73c7-debf-40af-bcab-064bae60410a on chh2-842464-2 May 19 08:18:34.014344 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-b0186dbc-8e35-49cf-b7b6-5ad9bbe3759a req-3e1d5e83-bf2d-4184-a255-d49522336042 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058968 May 19 08:18:34.015743 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 447/929] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:34.022137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-d25ddfa7-13c4-4022-bc12-aa21c8c45e1b req-3b9e6179-d76b-4a53-b2da-bab100f866f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732", "name": "network-vif-unplugged", "status": "completed", "tag": "6e772834-07e5-4353-bb91-c927a7797689"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:34.047743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d25ddfa7-13c4-4022-bc12-aa21c8c45e1b req-3b9e6179-d76b-4a53-b2da-bab100f866f2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.050027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d25ddfa7-13c4-4022-bc12-aa21c8c45e1b req-3b9e6179-d76b-4a53-b2da-bab100f866f2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.080260 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-d25ddfa7-13c4-4022-bc12-aa21c8c45e1b req-3b9e6179-d76b-4a53-b2da-bab100f866f2 service nova] Creating event network-vif-unplugged:6e772834-07e5-4353-bb91-c927a7797689 for instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 on chh2-842464-2 May 19 08:18:34.096431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [req-d25ddfa7-13c4-4022-bc12-aa21c8c45e1b req-3b9e6179-d76b-4a53-b2da-bab100f866f2 service nova] Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:18:34.129784 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-d25ddfa7-13c4-4022-bc12-aa21c8c45e1b req-3b9e6179-d76b-4a53-b2da-bab100f866f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110520 May 19 08:18:34.133712 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 448/930] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:34.141285 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:34.142094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:34.159319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.159992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.161412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.162655 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.765660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Updating instance_info_cache with network_info: [{"id": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca", "address": "fa:16:3e:09:13:db", "network": {"id": "54df6a27-dc6e-457f-b69c-50c48499146f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1376613455-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1c48363495440688a94cad914be0f2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap84df3723-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:18:34.784238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Releasing lock "refresh_cache-a6be73c7-debf-40af-bcab-064bae60410a" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:18:34.785134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8ab14fa-d74d-4a4e-9ccb-4aafc319c5e1 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a/action" status: 202 len: 0 microversion: 2.1 time: 4.693722 May 19 08:18:34.787610 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 483/931] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:30 2022] POST /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a/action => generated 0 bytes in 4697 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:18:34.805653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:34.809656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:34.815325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:34.823930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.824395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.825199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.825677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.835150 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f39b2fa7-df66-4538-a785-b6c6b26f51ce tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.699424 May 19 08:18:34.837038 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 449/932] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:34 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:34.849105 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:34.853343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:34.882405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.883332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:34.884880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:34.885593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.010870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:35.033101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c12e8cab-78fa-4527-a949-825d296b4a98 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1273 microversion: 2.1 time: 0.242780 May 19 08:18:35.034386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 484/933] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:34 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:35.042296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:35.043028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:35.050482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:35.051420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.053018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:35.053654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.088429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:18:35.191692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a35eb7a-622a-46e3-bc10-9c6d35f5fc63 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 204 len: 0 microversion: 2.1 time: 0.154700 May 19 08:18:35.192671 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 485/934] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:35 2022] DELETE /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:35.203963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:35.205290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:35.213021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:35.213764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.214734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:35.215671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.367690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:35.395016 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-75983c91-1dd6-44e3-bc2d-f2bc36f22134 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1473 microversion: 2.1 time: 0.556446 May 19 08:18:35.395629 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 450/935] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:34 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1473 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:35.418104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.33.1.181"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:35.420819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:35.430551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:35.431384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.433910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:35.434651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:35.472527 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Acquired lock "refresh_cache-1255db25-bef6-4811-911c-9ce729d641ea" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:18:36.190393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:36.211758 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdc3f518-f9da-4a00-91b0-c13d39e8f632 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 1.017652 May 19 08:18:36.212880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 486/936] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:35 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:36.224970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:36.226510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:36.233090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:36.233997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:36.236909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:36.240833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:36.629757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:36.640604 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6abb836f-b9cc-4bfe-9425-116ce2d660e0 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1305 microversion: 2.1 time: 0.426324 May 19 08:18:36.641988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 487/937] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:36 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1305 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:36.646954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:36.647803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:36.653870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:36.654324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:36.655108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:36.655545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.058476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:37.067280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c3e68a2-fb64-408c-b4da-cd51cd3f2d3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1315 microversion: 2.1 time: 0.423906 May 19 08:18:37.067890 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 488/938] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:36 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:37.073178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-973edc82-875e-46e7-a336-2be3c24ff579 req-c3b7a496-f9ae-4056-898e-7f266f8b7083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156034f8-d24a-47cd-acac-ae7e5c589acf", "tag": "a6930316-a7a2-4ed4-9a0d-8c099101e88b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:37.082852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-973edc82-875e-46e7-a336-2be3c24ff579 req-c3b7a496-f9ae-4056-898e-7f266f8b7083 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.083593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-973edc82-875e-46e7-a336-2be3c24ff579 req-c3b7a496-f9ae-4056-898e-7f266f8b7083 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.100033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-973edc82-875e-46e7-a336-2be3c24ff579 req-c3b7a496-f9ae-4056-898e-7f266f8b7083 service nova] Creating event network-changed:a6930316-a7a2-4ed4-9a0d-8c099101e88b for instance 156034f8-d24a-47cd-acac-ae7e5c589acf on chh1-842464-2 May 19 08:18:37.107302 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-973edc82-875e-46e7-a336-2be3c24ff579 req-c3b7a496-f9ae-4056-898e-7f266f8b7083 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037847 May 19 08:18:37.108138 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 489/939] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:37.113953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bec5fcd7-c7f9-4e41-b316-e165f4c8d0d8 req-248c26ba-2f69-45e3-89c1-955f42800ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732", "tag": "6e772834-07e5-4353-bb91-c927a7797689"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:37.124213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bec5fcd7-c7f9-4e41-b316-e165f4c8d0d8 req-248c26ba-2f69-45e3-89c1-955f42800ec0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.124555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bec5fcd7-c7f9-4e41-b316-e165f4c8d0d8 req-248c26ba-2f69-45e3-89c1-955f42800ec0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.139935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bec5fcd7-c7f9-4e41-b316-e165f4c8d0d8 req-248c26ba-2f69-45e3-89c1-955f42800ec0 service nova] Creating event network-changed:6e772834-07e5-4353-bb91-c927a7797689 for instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 on chh2-842464-2 May 19 08:18:37.156009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-bec5fcd7-c7f9-4e41-b316-e165f4c8d0d8 req-248c26ba-2f69-45e3-89c1-955f42800ec0 service nova] Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:18:37.168986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bec5fcd7-c7f9-4e41-b316-e165f4c8d0d8 req-248c26ba-2f69-45e3-89c1-955f42800ec0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058650 May 19 08:18:37.169831 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 490/940] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:37.178262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:37.179091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:37.187091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.190153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.191426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.191998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.765677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:37.778323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-109b4faf-a88a-4085-97e0-6433c2f8cc21 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1473 microversion: 2.1 time: 0.606529 May 19 08:18:37.791851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 491/941] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:37 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1473 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:37.948452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Calling method '.version_select at 0x7f3212151940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:37.949572 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:37.949572 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:18:37.951033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.951593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.967501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.968412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.981448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:37.982242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:37.990680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17973b45-ebf8-427c-9aa7-3fa32168c6ea tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.197112 May 19 08:18:37.991383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 492/942] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:18:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:38.145270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8620f718-60c9-4757-8b4a-b89ec1382ede"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:38.146353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:38.152477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:38.152928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:38.153734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:38.154174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:38.183797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:38.339239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] HTTP exception thrown: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Request method failure captured: May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/50cddd34-52bb-419c-931e-5d2433379ea5 HTTP/1.1 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 74 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0TR7wN2J00beanNtfC_ApopYiASn3-jZOd5Bgh7RbAZM_QYfTHlVvZVmC1Yzc2tR-T1L1-pCWxk9yVYp6f3ACsXh5_5vvPlF5JnyFIppOO-W0cdnfjEy2XfTJqAdqCZG2uxbLM4jPr05tLmV9EguB5cAFAFdjxthWdvfJP8yghLeQ May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: cde2b2b3156340bdbb9052535de4a4ef May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesAdminNegativeTest-1144541637 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesAdminNegativeTest-1144541637 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: cde2b2b3156340bdbb9052535de4a4ef May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1144541637 May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesAdminNegativeTest-1144541637-project-admin May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1b77e50b5d54490da53219ce51de362d May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesAdminNegativeTest-1144541637-project-admin May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: {"volumeAttachment": {"volumeId": "8620f718-60c9-4757-8b4a-b89ec1382ede"}} May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: exception: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '743a356d-1eac-4730-8979-0734df0b9685', 'id': '50cddd34-52bb-419c-931e-5d2433379ea5', 'body': {'volumeAttachment': {'volumeId': '8620f718-60c9-4757-8b4a-b89ec1382ede'}}} May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. (HTTP 404) (Request-ID: req-099f87b6-c7c7-4fa9-a57a-597dc0507032) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:18:38.344631 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. May 19 08:18:38.350042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:38.353588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Returning 400 to user: Volume 8620f718-60c9-4757-8b4a-b89ec1382ede could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:38.355895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8199c41a-fb72-4a2d-b249-ac843b06bd14 tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/50cddd34-52bb-419c-931e-5d2433379ea5" status: 400 len: 107 microversion: 2.1 time: 0.362247 May 19 08:18:38.356243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 493/943] 10.222.0.78 () {60 vars in 1432 bytes} [Thu May 19 08:18:37 2022] PUT /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/50cddd34-52bb-419c-931e-5d2433379ea5 => generated 107 bytes in 364 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:18:38.377261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:38.378286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:38.399639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:38.400776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:38.402005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:38.402948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:39.639113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:39.658695 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-318aa1cc-684a-4769-aed5-a7c156db9a2a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 1.293731 May 19 08:18:39.659696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 494/944] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:38 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:39.664998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:39.666019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:39.675017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:39.675823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:39.676735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:39.677240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:40.151249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Building network info cache for instance {{(pid=119073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:18:40.352492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:40.366143 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d3bbfff-2d46-4f5e-8699-46c4c9ef61a5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.705082 May 19 08:18:40.366751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 495/945] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:39 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:40.380777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Calling method '.version_select at 0x7f3212182dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:40.387140 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:40.387140 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:18:40.391133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:40.395481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:40.425787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:40.426609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:40.515084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:40.516595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:40.536203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56802e6f-deee-432a-acfe-0d44e3111f95 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/chh1-842464-2/servers" status: 200 len: 512 microversion: 2.1 time: 0.159090 May 19 08:18:40.539349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 496/946] 10.222.0.78 () {58 vars in 1211 bytes} [Thu May 19 08:18:40 2022] GET /compute/v2.1/os-hypervisors/chh1-842464-2/servers => generated 512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:40.557147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:40.559460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:40.573902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:40.576400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:40.578154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:40.580500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.009066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:41.034354 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=12 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:41.108811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:41.128189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8396243e-0ddb-495e-9ec1-fbf93e8f5f96 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1315 microversion: 2.1 time: 0.585449 May 19 08:18:41.132365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 497/947] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:40 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:41.151085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:41.154028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:41.177480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.179159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.182226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.182704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.462632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lazy-loading 'services' on Instance uuid 743a356d-1eac-4730-8979-0734df0b9685 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:18:41.541985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Updating instance_info_cache with network_info: [{"id": "0f5d3d5c-c55f-44ea-8092-60df41f1febb", "address": "fa:16:3e:ef:ba:44", "network": {"id": "54df6a27-dc6e-457f-b69c-50c48499146f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1376613455-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.33.1.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1c48363495440688a94cad914be0f2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f5d3d5c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:18:41.559546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Releasing lock "refresh_cache-1255db25-bef6-4811-911c-9ce729d641ea" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:18:41.560760 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6401a46f-7eb0-421d-84de-b4a3c0cca9d0 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action" status: 202 len: 0 microversion: 2.1 time: 6.147649 May 19 08:18:41.561842 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 451/948] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:35 2022] POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action => generated 0 bytes in 6149 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:18:41.574667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:41.575829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:41.586135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.587016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.588700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.590726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.652341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6aaf08b-4dc9-49e3-bcfb-35a0042dc564 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "DELETE /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/50cddd34-52bb-419c-931e-5d2433379ea5" status: 202 len: 0 microversion: 2.1 time: 0.518247 May 19 08:18:41.653435 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 498/949] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:18:41 2022] DELETE /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/50cddd34-52bb-419c-931e-5d2433379ea5 => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:41.659463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-94ef8dfc-ba2e-4ddf-9e81-6c0a1f279fa7 req-8e516bef-8413-457c-914c-58eb611073a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5216e7ca-110f-409a-b2ba-ccc1d6d756eb", "tag": "43314f32-b4bc-4c20-832e-93bd97e30852"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:41.670625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-94ef8dfc-ba2e-4ddf-9e81-6c0a1f279fa7 req-8e516bef-8413-457c-914c-58eb611073a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.670625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-94ef8dfc-ba2e-4ddf-9e81-6c0a1f279fa7 req-8e516bef-8413-457c-914c-58eb611073a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.683922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-94ef8dfc-ba2e-4ddf-9e81-6c0a1f279fa7 req-8e516bef-8413-457c-914c-58eb611073a2 service nova] Creating event network-changed:43314f32-b4bc-4c20-832e-93bd97e30852 for instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb on chh1-842464-2 May 19 08:18:41.689256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-94ef8dfc-ba2e-4ddf-9e81-6c0a1f279fa7 req-8e516bef-8413-457c-914c-58eb611073a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033662 May 19 08:18:41.690329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 499/950] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:41.695628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Calling method '.version_select at 0x7f321200f430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:41.696710 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:41.696710 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:18:41.698263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.698713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.718351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.718802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.731901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.738592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.746208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-700c5fb2-64d1-425c-ac39-41dc40f176a7 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054567 May 19 08:18:41.746819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 500/951] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:18:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:41.752581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:41.753217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:41.759149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.759593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:41.760365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:41.760796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.272639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:42.281982 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-42ac2ed1-22ea-420d-99b2-5b6fbb57eb46 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1470 microversion: 2.1 time: 0.719058 May 19 08:18:42.283351 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 452/952] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:41 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1470 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:42.292844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-64cf6678-e9f3-415e-87f7-01ef42f8d9f0 req-f3831b44-ff63-48d0-ac01-04192a5ff483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732", "name": "network-vif-plugged", "status": "completed", "tag": "6e772834-07e5-4353-bb91-c927a7797689"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:42.302789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-64cf6678-e9f3-415e-87f7-01ef42f8d9f0 req-f3831b44-ff63-48d0-ac01-04192a5ff483 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:42.303318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-64cf6678-e9f3-415e-87f7-01ef42f8d9f0 req-f3831b44-ff63-48d0-ac01-04192a5ff483 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.324065 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-64cf6678-e9f3-415e-87f7-01ef42f8d9f0 req-f3831b44-ff63-48d0-ac01-04192a5ff483 service nova] Creating event network-vif-plugged:6e772834-07e5-4353-bb91-c927a7797689 for instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 on chh2-842464-2 May 19 08:18:42.330205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [req-64cf6678-e9f3-415e-87f7-01ef42f8d9f0 req-f3831b44-ff63-48d0-ac01-04192a5ff483 service nova] Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:18:42.342365 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-64cf6678-e9f3-415e-87f7-01ef42f8d9f0 req-f3831b44-ff63-48d0-ac01-04192a5ff483 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057363 May 19 08:18:42.343371 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 453/953] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:42.349886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:42.350807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:42.358242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:42.358785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.359661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:42.360168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.679650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:42.695082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a1b555d-3b16-4dd4-8a1c-367e298491da tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 0.945936 May 19 08:18:42.700081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 501/954] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:41 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:42.718007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b19b80a-3344-4ba4-a075-72a83a51deb2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '.version_select at 0x7f3211fef4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:42.889541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:42.900905 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1e971d34-4e9a-4a88-a337-8d48bf1ac736 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.556203 May 19 08:18:42.902320 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 454/955] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:42 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:42.914373 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:42.915624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:42.922995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:42.924207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.925267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:42.925939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.962692 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eecd5f33-10c3-4a2c-95c1-0a91f44b07ff tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052536 May 19 08:18:42.963544 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 455/956] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:42 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:42.971539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-971c003f-9c3a-4b3b-ab91-23d7a2bdef43 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Calling method '.version_select at 0x7f321219c550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:42.972720 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:42.972720 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:42.975300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-971c003f-9c3a-4b3b-ab91-23d7a2bdef43 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:42.976066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-971c003f-9c3a-4b3b-ab91-23d7a2bdef43 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:42.981143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:43.018765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-971c003f-9c3a-4b3b-ab91-23d7a2bdef43 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.019521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-971c003f-9c3a-4b3b-ab91-23d7a2bdef43 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.030732 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-971c003f-9c3a-4b3b-ab91-23d7a2bdef43 tempest-HypervisorAdminUnderV252Test-1548847791 tempest-HypervisorAdminUnderV252Test-1548847791-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/chh1-842464-2/search" status: 200 len: 104 microversion: 2.1 time: 0.065814 May 19 08:18:43.039759 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 456/957] 10.222.0.78 () {58 vars in 1208 bytes} [Thu May 19 08:18:42 2022] GET /compute/v2.1/os-hypervisors/chh1-842464-2/search => generated 104 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:43.050027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:43.053142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:43.065296 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.066100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.067729 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.068398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.309719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b19b80a-3344-4ba4-a075-72a83a51deb2 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/7f0ef12a-4ce5-4425-ac98-44c5e7655ed3" status: 200 len: 184 microversion: 2.1 time: 0.607261 May 19 08:18:43.316600 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 502/958] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:18:42 2022] GET /compute/v2.1/os-floating-ips/7f0ef12a-4ce5-4425-ac98-44c5e7655ed3 => generated 184 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:43.325992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:43.326529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:43.339051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.339903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.341016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.341711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.377060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:43.396067 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e5eb1ab6-d1cd-4605-892a-538efedb0307 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1315 microversion: 2.1 time: 0.353853 May 19 08:18:43.397964 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 457/959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:43 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:43.419840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.33.1.181"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:43.425750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-281d7d9a-5152-4362-beeb-83b55b9541f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732/action" status: 204 len: 0 microversion: 2.1 time: 0.107523 May 19 08:18:43.427146 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 503/960] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:43 2022] POST /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732/action => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:43.436038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:43.437077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:43.463373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.467158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.469148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.469892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.579171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:43.587635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.588642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.589703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.591998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.894111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:43.903323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12887ce1-4d07-439f-b3eb-d05364d02bad tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1470 microversion: 2.1 time: 0.471894 May 19 08:18:43.904404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 504/961] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:43 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1470 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:43.912946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:43.913868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:43.931651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.932385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:43.933273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:43.933744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:44.065323 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Acquired lock "refresh_cache-1255db25-bef6-4811-911c-9ce729d641ea" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:18:44.265115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:44.273384 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a323e7dd-30dc-430d-bce7-9d63f131c677 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 0.367724 May 19 08:18:44.278647 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 505/962] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:43 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:44.283735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3ecaa3ab-4c6f-46ec-9466-331945396583 req-302445f4-3a0d-4cd2-84b7-4d32693178b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}, {"server_uuid": "a6be73c7-debf-40af-bcab-064bae60410a", "name": "network-vif-deleted", "tag": "84df3723-56e7-4f2c-bda2-1b9c9f0370ca"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:44.298922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3ecaa3ab-4c6f-46ec-9466-331945396583 req-302445f4-3a0d-4cd2-84b7-4d32693178b3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:44.299474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3ecaa3ab-4c6f-46ec-9466-331945396583 req-302445f4-3a0d-4cd2-84b7-4d32693178b3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:44.314685 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3ecaa3ab-4c6f-46ec-9466-331945396583 req-302445f4-3a0d-4cd2-84b7-4d32693178b3 service nova] Creating event network-changed:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:18:44.315120 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3ecaa3ab-4c6f-46ec-9466-331945396583 req-302445f4-3a0d-4cd2-84b7-4d32693178b3 service nova] Creating event network-vif-deleted:84df3723-56e7-4f2c-bda2-1b9c9f0370ca for instance a6be73c7-debf-40af-bcab-064bae60410a on chh2-842464-2 May 19 08:18:44.326759 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3ecaa3ab-4c6f-46ec-9466-331945396583 req-302445f4-3a0d-4cd2-84b7-4d32693178b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051345 May 19 08:18:44.327726 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 506/963] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:44.337882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:44.337882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:44.346261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:44.346940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:44.347833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:44.348280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:44.923382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:44.934491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e30e0917-fc48-4fdf-a440-a99e3b88169a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.604956 May 19 08:18:44.937719 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 507/964] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:44 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:44.951358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:44.954717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:44.966323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:44.966842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:44.968117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:44.968657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.068776 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-434eed86-1323-41f8-8375-020bf10c5a06 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129471 May 19 08:18:45.070384 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 508/965] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:44 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:45.076162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8b5b3760-ea5a-45af-b0c0-8d077424358b req-ef33ba34-203d-4ae8-a758-ce9d9e67d45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156034f8-d24a-47cd-acac-ae7e5c589acf", "name": "network-vif-plugged", "status": "completed", "tag": "a6930316-a7a2-4ed4-9a0d-8c099101e88b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:45.088050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b5b3760-ea5a-45af-b0c0-8d077424358b req-ef33ba34-203d-4ae8-a758-ce9d9e67d45a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.088804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b5b3760-ea5a-45af-b0c0-8d077424358b req-ef33ba34-203d-4ae8-a758-ce9d9e67d45a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.109977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8b5b3760-ea5a-45af-b0c0-8d077424358b req-ef33ba34-203d-4ae8-a758-ce9d9e67d45a service nova] Creating event network-vif-plugged:a6930316-a7a2-4ed4-9a0d-8c099101e88b for instance 156034f8-d24a-47cd-acac-ae7e5c589acf on chh1-842464-2 May 19 08:18:45.126769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8b5b3760-ea5a-45af-b0c0-8d077424358b req-ef33ba34-203d-4ae8-a758-ce9d9e67d45a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054119 May 19 08:18:45.134445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 509/966] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:45.139890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:45.154058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:45.160839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.161571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.162510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.163088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.598281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:45.614328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c658f240-9eab-49b7-97b2-17b7e1780472 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1315 microversion: 2.1 time: 0.478558 May 19 08:18:45.614918 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 510/967] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:45 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:45.619372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:45.619977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:45.638074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.638762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.639727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.640379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.667467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:45.963139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:45.972797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17b976cc-8abf-4ea2-8c4b-d20e627bc7b4 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1470 microversion: 2.1 time: 0.356829 May 19 08:18:45.973404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 511/968] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:45 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1470 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:45.979503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:45.980340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:45.986946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.987705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:45.988545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:45.989687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:46.171981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Building network info cache for instance {{(pid=119073) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:18:46.605590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:46.622833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a80950d3-a4ee-4822-bdb8-03cd3f61606b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1324 microversion: 2.1 time: 0.648198 May 19 08:18:46.632640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 512/969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:45 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1324 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:46.647770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:46.648563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:46.659492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:46.663792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:46.664662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:46.665107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.170325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0dcc44bd-5af2-4247-86c6-c05229388df3 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1691 microversion: 2.1 time: 0.539271 May 19 08:18:47.175889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 513/970] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:46 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1691 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:47.183041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:47.184250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:47.208587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.212483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.215768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.217933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.575921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:47.589253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66b7dbec-9ed6-4a8d-86ca-66fa95196753 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.410295 May 19 08:18:47.593022 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 514/971] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:47 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:47.601757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:47.609375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:47.620841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.624100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.642721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.643396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.704720 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64003de8-00c4-46b0-a9a8-65c7f13414f6 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109776 May 19 08:18:47.705918 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 515/972] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:47 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:47.720909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-94f55494-cccd-47f9-82df-0e8016882c2c req-2d9bcfbc-6e2b-401d-bee8-480493250c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:47.735674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-94f55494-cccd-47f9-82df-0e8016882c2c req-2d9bcfbc-6e2b-401d-bee8-480493250c20 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.736791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-94f55494-cccd-47f9-82df-0e8016882c2c req-2d9bcfbc-6e2b-401d-bee8-480493250c20 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.753797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-94f55494-cccd-47f9-82df-0e8016882c2c req-2d9bcfbc-6e2b-401d-bee8-480493250c20 service nova] Creating event network-changed:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:18:47.760010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-94f55494-cccd-47f9-82df-0e8016882c2c req-2d9bcfbc-6e2b-401d-bee8-480493250c20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049040 May 19 08:18:47.761849 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 516/973] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:47.769192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:47.770136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:47.775942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:47.777680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.778309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.779419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.780039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.897690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Updating instance_info_cache with network_info: [{"id": "0f5d3d5c-c55f-44ea-8092-60df41f1febb", "address": "fa:16:3e:ef:ba:44", "network": {"id": "54df6a27-dc6e-457f-b69c-50c48499146f", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1376613455-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1c48363495440688a94cad914be0f2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0f5d3d5c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119073) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:18:47.909762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Releasing lock "refresh_cache-1255db25-bef6-4811-911c-9ce729d641ea" {{(pid=119073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:18:47.910912 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bff34a41-28b3-4d18-b3ba-67d563dbb083 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action" status: 202 len: 0 microversion: 2.1 time: 4.510257 May 19 08:18:47.915607 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 458/974] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:43 2022] POST /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea/action => generated 0 bytes in 4517 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:18:47.926564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:47.930260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:47.944167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.945060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:47.946378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:47.949174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.093875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:48.112242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-901b3679-f8fc-433a-87b1-d5ada06f1745 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1315 microversion: 2.1 time: 0.347446 May 19 08:18:48.114061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 517/975] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:47 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:48.120734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": true, "disk_over_commit": false}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:48.122563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:48.137078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.138394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.139335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.140652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.188053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lazy-loading 'flavor' on Instance uuid 62299986-c4dc-49cf-9f63-fccde1b436ed {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:18:48.202450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Going to try to live migrate instance to chh1-842464-2 {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:18:48.266175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:48.283449 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a5fb3f70-12c3-4de7-9f4b-90c156bbe59c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1462 microversion: 2.1 time: 0.361181 May 19 08:18:48.284545 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 459/976] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:47 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1462 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:48.290594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:48.291457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:48.305737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.310481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.311464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.311987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.589835 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:48.599652 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3a95bdb5-dffd-4b1b-ba0a-9bccceaeb89c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.313632 May 19 08:18:48.600250 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 460/977] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:48 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:48.609130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:48.617934 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:48.626867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.627321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.628111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.628555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.660095 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] HTTP exception thrown: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Request method failure captured: May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a HTTP/1.1 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0WIx3w5OZqHBybWAbSari5awYTUwam4x7D5pNj20YHzo_3l9VSx8HoT6xhXQT3sPys42_B1NNiw0tArBrg6zB4nAnT3ppBOkxQ2_Dz_FkBozTTgg_gpeYpJsvcOhKTW3gQgkLhxywiqtgxXF-BDok302ThPjdi4MwE6vu6SOvnnz4 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d1c48363495440688a94cad914be0f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d1c48363495440688a94cad914be0f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 9eb7e9176a904e8a97f21e31b54c631e May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'a6be73c7-debf-40af-bcab-064bae60410a'} May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:48.661932 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Returning 404 to user: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9326d00c-10fc-460b-a009-c76c56d58c84 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 404 len: 111 microversion: 2.1 time: 0.062003 May 19 08:18:48.667630 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 461/978] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:48 2022] DELETE /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:48.672236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-4fe4d5de-e044-4eb6-9b2b-eed26e7ccdd6 req-23009ebe-e5fd-44e1-babc-0d174cc6d6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5216e7ca-110f-409a-b2ba-ccc1d6d756eb", "name": "network-vif-plugged", "status": "completed", "tag": "43314f32-b4bc-4c20-832e-93bd97e30852"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:48.682134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4fe4d5de-e044-4eb6-9b2b-eed26e7ccdd6 req-23009ebe-e5fd-44e1-babc-0d174cc6d6f4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.682552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4fe4d5de-e044-4eb6-9b2b-eed26e7ccdd6 req-23009ebe-e5fd-44e1-babc-0d174cc6d6f4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.695294 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-4fe4d5de-e044-4eb6-9b2b-eed26e7ccdd6 req-23009ebe-e5fd-44e1-babc-0d174cc6d6f4 service nova] Creating event network-vif-plugged:43314f32-b4bc-4c20-832e-93bd97e30852 for instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb on chh1-842464-2 May 19 08:18:48.700489 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-4fe4d5de-e044-4eb6-9b2b-eed26e7ccdd6 req-23009ebe-e5fd-44e1-babc-0d174cc6d6f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 May 19 08:18:48.701153 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 462/979] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:48.910441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-afb6eb36-7766-4994-9dab-c610033c0f95 tempest-InstanceUsageAuditLogTestJSON-1317518042 tempest-InstanceUsageAuditLogTestJSON-1317518042-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:48.911959 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:48.911959 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:48.935431 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-afb6eb36-7766-4994-9dab-c610033c0f95 tempest-InstanceUsageAuditLogTestJSON-1317518042 tempest-InstanceUsageAuditLogTestJSON-1317518042-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19 08:18:48" status: 200 len: 318 microversion: 2.1 time: 0.232678 May 19 08:18:48.944061 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 463/980] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:18:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-19%2008%3A18%3A48 => generated 318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:48.950438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:48.951404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:48.959340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.960013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:48.961088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:48.961766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.108982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:49.117910 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f92332e2-a041-48d7-b136-a8cc7f26718c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1462 microversion: 2.1 time: 0.172387 May 19 08:18:49.118591 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 464/981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:48 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1462 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:49.124977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.126077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:49.132611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.133133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.133973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.134435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.283716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:49.293209 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e9f62894-c582-4133-9939-77e35044ff04 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.173362 May 19 08:18:49.303389 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 465/982] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:49.303389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.303389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:49.307112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.307572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.308359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.308804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.442114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:49.458022 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a0eb6d9-da1a-49c2-b0cb-6a4f2157fc4e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.162940 May 19 08:18:49.458672 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 466/983] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:49.463546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.464165 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: a6be73c7-debf-40af-bcab-064bae60410a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:49.473896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.474345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.475875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.476287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.492267 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] HTTP exception thrown: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Request method failure captured: May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a HTTP/1.1 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0WIx3w5OZqHBybWAbSari5awYTUwam4x7D5pNj20YHzo_3l9VSx8HoT6xhXQT3sPys42_B1NNiw0tArBrg6zB4nAnT3ppBOkxQ2_Dz_FkBozTTgg_gpeYpJsvcOhKTW3gQgkLhxywiqtgxXF-BDok302ThPjdi4MwE6vu6SOvnnz4 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d1c48363495440688a94cad914be0f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d1c48363495440688a94cad914be0f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 9eb7e9176a904e8a97f21e31b54c631e May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'a6be73c7-debf-40af-bcab-064bae60410a'} May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.493944 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Returning 404 to user: Instance a6be73c7-debf-40af-bcab-064bae60410a could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-afe74aaa-5568-42cd-8f6e-7f481b267774 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a" status: 404 len: 111 microversion: 2.1 time: 0.035784 May 19 08:18:49.498423 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 467/984] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/servers/a6be73c7-debf-40af-bcab-064bae60410a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:49.500521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.502062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:49.508749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.509199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.510041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.510477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.543188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-844ed162-49b3-43b5-b2b7-4276b937a7a8 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 May 19 08:18:49.543768 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 468/985] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:49.548077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-03422a70-6622-412e-b6a7-05f85b9284d9 tempest-InstanceUsageAuditLogTestJSON-1317518042 tempest-InstanceUsageAuditLogTestJSON-1317518042-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.548825 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:49.548825 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:18:49.561252 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-03422a70-6622-412e-b6a7-05f85b9284d9 tempest-InstanceUsageAuditLogTestJSON-1317518042 tempest-InstanceUsageAuditLogTestJSON-1317518042-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.016283 May 19 08:18:49.561747 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 469/986] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:49.567888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.567888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:49.575647 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.576280 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.577070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.577582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.873048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:49.886849 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3e9ee0ee-83cb-4c53-a576-7709c1259bdd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1315 microversion: 2.1 time: 0.324026 May 19 08:18:49.896925 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 470/987] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:49.902046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c1466295-5dd7-4930-a5e6-f74c0437f5de tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '.version_select at 0x7f321219cd30>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:49.906199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c1466295-5dd7-4930-a5e6-f74c0437f5de tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:49.907079 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c1466295-5dd7-4930-a5e6-f74c0437f5de tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:49.922536 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c1466295-5dd7-4930-a5e6-f74c0437f5de tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1907 microversion: 2.1 time: 0.023992 May 19 08:18:49.931397 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 471/988] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:18:49 2022] GET /compute/v2.1/os-migrations => generated 1907 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:49.944595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1d86e1e1-5a52-48ac-821a-6444bed9b045 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1801818576", "metadata": {"": ""}}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1d86e1e1-5a52-48ac-821a-6444bed9b045 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action HTTP/1.1 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 107 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1801818576", "metadata": {"": ""}}} May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1801818576', 'metadata': {'': ''}}}} May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise error May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi {'': ''} May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:49.948011 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:49.952125 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:49.956204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1d86e1e1-5a52-48ac-821a-6444bed9b045 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:49.958779 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1d86e1e1-5a52-48ac-821a-6444bed9b045 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action" status: 400 len: 170 microversion: 2.1 time: 0.024627 May 19 08:18:49.959388 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 472/989] 10.222.0.78 () {60 vars in 1278 bytes} [Thu May 19 08:18:49 2022] POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action => generated 170 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:18:49.973378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cd2f05e1-c49d-40d9-9b42-0cd35eaf819f tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '.version_select at 0x7f321214da60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:50.610023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ff4b55b-00d3-4b46-8793-0e9ad6a7e259 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/action" status: 202 len: 0 microversion: 2.1 time: 2.494521 May 19 08:18:50.614181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 518/990] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:48 2022] POST /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/action => generated 0 bytes in 2496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:50.615534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae51c223-fc2f-480b-99a6-dd3067b9e85f tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:50.639893 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae51c223-fc2f-480b-99a6-dd3067b9e85f tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027773 May 19 08:18:50.640658 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 519/991] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:18:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:50.658901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:50.659845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:50.667848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:50.668789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:50.669773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:50.670379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:51.303152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:51.315171 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e71da2d1-e4e6-4cfb-8a5f-1d98dfbf60bc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.661415 May 19 08:18:51.316206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 520/992] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:50 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:51.336229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:51.337146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:51.347510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:51.350240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:51.354176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:51.354996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:51.862741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:51.875016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2ee5c55-f2c0-49d9-82fe-5c6f9cdd974f tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.557443 May 19 08:18:51.877154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 521/993] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:51 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:51.882578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:51.883798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:51.890526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:51.891355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:51.892449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:51.893600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:51.929124 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59dbee2b-8ecb-4711-bcef-0e534b7c6e87 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050653 May 19 08:18:51.929818 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 522/994] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:51 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:51.934684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:51.935921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:51.957811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:51.959802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:51.962502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:51.963449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.392979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:52.404537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3e2bef1-5e6c-4401-a41d-0c3a891aa5d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.473463 May 19 08:18:52.406250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 523/995] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:51 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:52.425256 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cd2f05e1-c49d-40d9-9b42-0cd35eaf819f tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/7f0ef12a-4ce5-4425-ac98-44c5e7655ed3" status: 202 len: 0 microversion: 2.1 time: 2.464550 May 19 08:18:52.428111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-68fb2b04-e8fe-419c-94ae-6f8e1cfacb2d tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-853551262", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:52.428744 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 473/996] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:18:49 2022] DELETE /compute/v2.1/os-floating-ips/7f0ef12a-4ce5-4425-ac98-44c5e7655ed3 => generated 0 bytes in 2468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:18:52.430275 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:18:52.430275 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:18:52.445382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6c4f0be1-6fb8-4bab-bcaa-26c66850cfe9 req-42fbc6f7-db03-4698-9cd5-f2b00ddf79bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d39a76-db81-4bb9-9e41-4e434ef59341", "name": "network-vif-plugged", "status": "completed", "tag": "4a11627b-afc0-4edd-a386-a6068f747e6a"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:52.451491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-68fb2b04-e8fe-419c-94ae-6f8e1cfacb2d tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.029880 May 19 08:18:52.452584 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 524/997] 10.222.0.78 () {60 vars in 1145 bytes} [Thu May 19 08:18:52 2022] POST /compute/v2.1/flavors => generated 498 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:52.458294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:52.458922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:52.466906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.467407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.468411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.469016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.486590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6c4f0be1-6fb8-4bab-bcaa-26c66850cfe9 req-42fbc6f7-db03-4698-9cd5-f2b00ddf79bf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.487851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6c4f0be1-6fb8-4bab-bcaa-26c66850cfe9 req-42fbc6f7-db03-4698-9cd5-f2b00ddf79bf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.536403 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6c4f0be1-6fb8-4bab-bcaa-26c66850cfe9 req-42fbc6f7-db03-4698-9cd5-f2b00ddf79bf service nova] Creating event network-vif-plugged:4a11627b-afc0-4edd-a386-a6068f747e6a for instance 24d39a76-db81-4bb9-9e41-4e434ef59341 on chh2-842464-2 May 19 08:18:52.546637 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6c4f0be1-6fb8-4bab-bcaa-26c66850cfe9 req-42fbc6f7-db03-4698-9cd5-f2b00ddf79bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116508 May 19 08:18:52.558082 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 474/998] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:52.564767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:52.565681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:52.575282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.576625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.578504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.580596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.705789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:52.717618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b22193b-29fe-4bfc-abea-e9bb142276ec tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1502 microversion: 2.1 time: 0.263896 May 19 08:18:52.718209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 525/999] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:52 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:52.726035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:52.727025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:52.762620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.763557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.764519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.765953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.833289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:18:52.835520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:52.843377 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d5397c13-b521-46e7-a0a2-9af71253adc3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.283723 May 19 08:18:52.843967 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 475/1000] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:52 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:52.850521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2f98a22e-0cb1-4c28-8d52-bdc373920192 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:52.862348 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2f98a22e-0cb1-4c28-8d52-bdc373920192 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015331 May 19 08:18:52.863189 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 476/1001] 10.222.0.78 () {58 vars in 1181 bytes} [Thu May 19 08:18:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:18:52.874669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:52.875043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:52.891486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.893732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:52.894881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:52.908760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.023183 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1fe9db0a-abc1-4ba7-96af-d1a96e605f92 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 204 len: 0 microversion: 2.1 time: 0.298879 May 19 08:18:53.025714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 526/1002] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:52 2022] DELETE /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:53.046097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-151af4df-8e24-41b8-8866-c10f0bfd7ba9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1872143993", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-151af4df-8e24-41b8-8866-c10f0bfd7ba9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action HTTP/1.1 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 619 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1872143993", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1872143993', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:18:53.058968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:18:53.061782 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:53.069438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-151af4df-8e24-41b8-8866-c10f0bfd7ba9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:53.075283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-151af4df-8e24-41b8-8866-c10f0bfd7ba9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action" status: 400 len: 938 microversion: 2.1 time: 0.045792 May 19 08:18:53.077976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 527/1003] 10.222.0.78 () {60 vars in 1278 bytes} [Thu May 19 08:18:53 2022] POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action => generated 938 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:18:53.099165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:53.100480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:53.118612 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a0dd4a63-e44d-4a85-be59-097df722f6ba tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.252076 May 19 08:18:53.120643 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 477/1004] 10.222.0.78 () {58 vars in 1295 bytes} [Thu May 19 08:18:52 2022] DELETE /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb/os-server-password => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:53.122669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.123243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.124202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.125628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.137160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:53.137373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:53.138247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:53.155062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.158651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.159815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.160582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.224689 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f8ec5432-a5f8-4663-8652-807307e13221 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102692 May 19 08:18:53.230594 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 478/1005] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:53 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:53.236838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:53.237273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:53.260550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.260999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.261808 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.262242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.291757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:53.464129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:53.480150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f36cb3f6-2970-4b74-9fae-f97b4c535403 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.396040 May 19 08:18:53.482051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 528/1006] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:53 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:53.488947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:53.489892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:53.497524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.498591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.499482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.499863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.567214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:53.578421 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-abd5d86b-baeb-45e4-b28f-ff7e1d72ca33 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1526 microversion: 2.1 time: 0.346598 May 19 08:18:53.579022 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 479/1007] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:53 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1526 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:53.590456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:53.591266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:53.603087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.604162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.604952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.605481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.643373 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de44adba-02d6-4cc0-a42a-dd3cae2a22bd tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.061393 May 19 08:18:53.644558 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 480/1008] 10.222.0.78 () {58 vars in 1292 bytes} [Thu May 19 08:18:53 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:18:53.650170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-161898359", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "217805d7-62ff-4d0f-9a2e-f76f91db43f5"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:53.720858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:18:53.803424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:53.818551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3f0dd23-50e2-4d6c-8ee6-648ee450b3b0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.334783 May 19 08:18:53.823101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 529/1009] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:53 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:53.838027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:53.839295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:53.849632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.850362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:53.851306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:53.852043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.116639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:54.125341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08634141-8dcb-45ad-a3cc-2780020d5809 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.300855 May 19 08:18:54.137367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 530/1010] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:53 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:54.146645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:54.148921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:54.157586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.159397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.160516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.162355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.196234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:18:54.287951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:18:54.288491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:18:54.289061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:18:54.289728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:18:54.290246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:18:54.302205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.302893 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.303917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.304635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.336965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f18ef4c-1b15-4c06-b269-9cecd59a0a45 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 204 len: 0 microversion: 2.1 time: 0.194938 May 19 08:18:54.339118 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 531/1011] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:18:54 2022] DELETE /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:18:54.358180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:54.360191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:54.371141 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:18:54.382509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for user f40ef4d25a474b3c83a3c2808a87a30d and project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:18:54.389557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.390836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.393259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.394374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.410451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:18:54.420432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:18:54.544312 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-626e434c-709f-493f-ace7-9bc147b9a111 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898266 May 19 08:18:54.555620 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 481/1012] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:18:54.561133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:54.562470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:54.571951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.573535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.574568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.575432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.618113 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1b1fd5a5-262c-463f-a8ff-d52f4d27e7ae tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060863 May 19 08:18:54.619234 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 482/1013] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:54 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:54.626047 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:54.627377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:54.640547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.641388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.646746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.647808 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.667847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:54.685448 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-048ab77d-b2b1-437d-a88b-8b70a77c3e12 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.337821 May 19 08:18:54.688209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 532/1014] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:54 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:54.701068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:54.702279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:54.710697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.711291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.712256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:54.712697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:54.988723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:54.991010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:55.000377 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dcad0d2f-58d3-4a3d-a9da-918cf5acbe1e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1293 microversion: 2.1 time: 0.310175 May 19 08:18:55.000831 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9d65f777-a003-40e1-b37c-e405e4d0d499 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1508 microversion: 2.1 time: 0.379619 May 19 08:18:55.012321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 533/1015] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:54 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1293 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:55.013806 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 483/1016] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:54 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1508 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:55.018454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b36e2eab-f7d5-4c71-9df8-160ed1720646 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:55.019114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b36e2eab-f7d5-4c71-9df8-160ed1720646 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:55.022238 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:55.023879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:55.031902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:55.032777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:55.034288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:55.035015 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:55.118270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b36e2eab-f7d5-4c71-9df8-160ed1720646 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:55.132945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b36e2eab-f7d5-4c71-9df8-160ed1720646 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1278 microversion: 2.1 time: 0.115894 May 19 08:18:55.143314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 534/1017] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:55 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1278 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:55.146209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6d770c6-720c-47b6-a5ce-6119bf70a766 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6d770c6-720c-47b6-a5ce-6119bf70a766 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action HTTP/1.1 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 285 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.152099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6d770c6-720c-47b6-a5ce-6119bf70a766 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:55.155467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6d770c6-720c-47b6-a5ce-6119bf70a766 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action" status: 400 len: 619 microversion: 2.1 time: 0.017829 May 19 08:18:55.162176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 535/1018] 10.222.0.78 () {60 vars in 1278 bytes} [Thu May 19 08:18:55 2022] POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:18:55.169521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:55.170195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:55.191731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:55.192246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:55.195412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:55.195917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:55.305287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:55.313559 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-391c7c71-831a-41ac-b5b5-922c24629ae3 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1526 microversion: 2.1 time: 0.297130 May 19 08:18:55.331257 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 484/1019] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:55 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1526 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:55.336849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:55.337714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:55.354948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:55.355283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:55.356055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:55.356488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:56.002032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:56.029531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-256b7059-ad9c-4d2e-9398-76f92b69fd5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.866173 May 19 08:18:56.041254 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 536/1020] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:55 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:56.048006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:56.055165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:56.074767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:56.077663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:56.078633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:56.081724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:56.157760 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e1775c6-7978-4bf3-89f8-4d864415d25c tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114788 May 19 08:18:56.158589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 537/1021] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:18:56 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:18:56.190084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:56.190987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:56.208630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:56.244147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:56.244943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:56.255152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:56.255932 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5da2ced0-82a7-49b1-a760-844f3c846714 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.923074 May 19 08:18:56.256332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:56.257222 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 485/1022] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:55 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:56.271861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:56.272912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:56.293611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:56.294341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:56.295459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:56.296088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.051195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:57.062083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39a981ca-4078-4769-99e1-8047421e50e3 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1485 microversion: 2.1 time: 0.894531 May 19 08:18:57.063467 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 538/1023] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:56 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1485 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:57.070162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:57.071100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:57.080387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.081163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.083025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.083794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.123541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581c4b6e41864dec9aaef13792c0a487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94ddeb7ac414580a4388699435ac103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:57.136964 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9f296557-d658-4999-8358-950e2b2efa11 tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 200 len: 1508 microversion: 2.1 time: 0.878377 May 19 08:18:57.137803 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 486/1024] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:56 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 1508 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:57.143298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:57.144237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:57.152418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.153084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.154220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.154809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.245417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:57.254432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0da1b9a2-b6e3-42e0-aa7b-1b8f996c4160 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1336 microversion: 2.1 time: 0.188648 May 19 08:18:57.255612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 539/1025] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:57 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1336 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:57.260507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:57.261338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:57.268673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.269516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.270579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.271283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.666599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:57.682180 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9098abb9-0306-4293-be86-2c2f2ab8488c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.542922 May 19 08:18:57.684323 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 487/1026] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:57 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:57.747780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eb7e9176a904e8a97f21e31b54c631e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1c48363495440688a94cad914be0f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:57.758576 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d33a49c-af72-4ed6-a6bd-11b8aa64cbda tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 200 len: 1526 microversion: 2.1 time: 0.501721 May 19 08:18:57.770793 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 540/1027] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:57 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 1526 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:57.775940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:57.776849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:57.786760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.787654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.788781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:57.789577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:57.903481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1170229380", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:57.969022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] validate_networks() for [('b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:18:58.284252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:18:58.320097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a87aebbd-2eda-4bb1-a494-4a686bec119d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.547856 May 19 08:18:58.325339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 541/1028] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:57 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:18:58.334045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:58.338483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:58.347795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:58.348615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:58.350467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:58.350467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:58.680666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75aec2d5-23ab-4398-8cd1-efc3d64207ae tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.358179 May 19 08:18:58.681660 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 542/1029] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:18:58 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341/os-interface => generated 285 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:58.698177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-473786132"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:58.699584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:58.716147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:58.716592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:58.717406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:58.717832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:58.967407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:18:58.969159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:18:58.970465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:18:58.971232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:18:58.971819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:18:58.993081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:58.993584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:58.997160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.001885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.060316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:18:59.071150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for user 024724b24b274d7db1c43874767de143 and project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:18:59.095925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:18:59.103597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:18:59.139643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:59.178952 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-59e42b4d-b21f-41ba-bad5-a524a606ec9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.493062 May 19 08:18:59.181523 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 488/1030] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:18:59.191345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-90b6c49a-b5e3-4855-8145-5a3df9918afb req-50fa1186-26fc-45b4-ab90-ed885fd0906e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5216e7ca-110f-409a-b2ba-ccc1d6d756eb", "name": "network-vif-deleted", "tag": "43314f32-b4bc-4c20-832e-93bd97e30852"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:59.216838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-90b6c49a-b5e3-4855-8145-5a3df9918afb req-50fa1186-26fc-45b4-ab90-ed885fd0906e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.218503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-90b6c49a-b5e3-4855-8145-5a3df9918afb req-50fa1186-26fc-45b4-ab90-ed885fd0906e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.237590 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-90b6c49a-b5e3-4855-8145-5a3df9918afb req-50fa1186-26fc-45b4-ab90-ed885fd0906e service nova] Creating event network-vif-deleted:43314f32-b4bc-4c20-832e-93bd97e30852 for instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb on chh1-842464-2 May 19 08:18:59.256017 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-90b6c49a-b5e3-4855-8145-5a3df9918afb req-50fa1186-26fc-45b4-ab90-ed885fd0906e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069810 May 19 08:18:59.261805 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 489/1031] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:18:59.269838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:59.274580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] [instance: 5216e7ca-110f-409a-b2ba-ccc1d6d756eb] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:59.308837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.309047 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.315412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.316277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.362775 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] HTTP exception thrown: Instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb could not be found. May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Request method failure captured: May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb HTTP/1.1 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1V7pmXYSm5NQ09kvcebdj0h_cFmvMN_s-x4lpTVmJcT4W8-nSYLvDXqxRkH4K-Yq2D2GvwJyY_YzzLLY0Y8zvG2uGq7t9fMMMaLrt3HY1Lw40ZgpqlY6y8bPGVp37SHa4RRb8iI3q-KiiqVY4EXi9wvRHztSC7QvEra2S8ctKoxqU May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: a94ddeb7ac414580a4388699435ac103 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServerPasswordTestJSON-405825729 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a94ddeb7ac414580a4388699435ac103"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a94ddeb7ac414580a4388699435ac103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a94ddeb7ac414580a4388699435ac103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a94ddeb7ac414580a4388699435ac103"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServerPasswordTestJSON-405825729 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: a94ddeb7ac414580a4388699435ac103 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServerPasswordTestJSON-405825729 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServerPasswordTestJSON-405825729-project May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 581c4b6e41864dec9aaef13792c0a487 May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServerPasswordTestJSON-405825729-project May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb could not be found. May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '5216e7ca-110f-409a-b2ba-ccc1d6d756eb'} May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb could not be found. May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb could not be found. May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.371064 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb could not be found. May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] Returning 404 to user: Instance 5216e7ca-110f-409a-b2ba-ccc1d6d756eb could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:59.375728 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-77e0127a-57c8-41de-9ec9-3e90687a1e3a tempest-ServerPasswordTestJSON-405825729 tempest-ServerPasswordTestJSON-405825729-project] 10.222.0.78 "GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb" status: 404 len: 111 microversion: 2.1 time: 0.109402 May 19 08:18:59.401423 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 490/1032] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:59 2022] GET /compute/v2.1/servers/5216e7ca-110f-409a-b2ba-ccc1d6d756eb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:59.406853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:59.408287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:59.415553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.416414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.417136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.417601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.509194 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7266b3d0-211b-414c-bde7-848827544ac3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action" status: 202 len: 0 microversion: 2.1 time: 0.820649 May 19 08:18:59.510987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 543/1033] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:18:58 2022] POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:18:59.534574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:59.535352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] [instance: 1255db25-bef6-4811-911c-9ce729d641ea] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:59.565579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.570131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.577339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.578833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.590622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:18:59.622088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] HTTP exception thrown: Instance 1255db25-bef6-4811-911c-9ce729d641ea could not be found. May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Request method failure captured: May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea HTTP/1.1 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0WIx3w5OZqHBybWAbSari5awYTUwam4x7D5pNj20YHzo_3l9VSx8HoT6xhXQT3sPys42_B1NNiw0tArBrg6zB4nAnT3ppBOkxQ2_Dz_FkBozTTgg_gpeYpJsvcOhKTW3gQgkLhxywiqtgxXF-BDok302ThPjdi4MwE6vu6SOvnnz4 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6d1c48363495440688a94cad914be0f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6d1c48363495440688a94cad914be0f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6d1c48363495440688a94cad914be0f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6d1c48363495440688a94cad914be0f2 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-426894756 May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9eb7e9176a904e8a97f21e31b54c631e May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-426894756-project May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1255db25-bef6-4811-911c-9ce729d641ea could not be found. May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1255db25-bef6-4811-911c-9ce729d641ea'} May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1255db25-bef6-4811-911c-9ce729d641ea could not be found. May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1255db25-bef6-4811-911c-9ce729d641ea could not be found. May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.624540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1255db25-bef6-4811-911c-9ce729d641ea could not be found. May 19 08:18:59.630345 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.633517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] Returning 404 to user: Instance 1255db25-bef6-4811-911c-9ce729d641ea could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:59.635099 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b48e39d0-e018-417d-a958-01d9d8400111 tempest-FloatingIPsAssociationTestJSON-426894756 tempest-FloatingIPsAssociationTestJSON-426894756-project] 10.222.0.78 "GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea" status: 404 len: 111 microversion: 2.1 time: 0.120631 May 19 08:18:59.636192 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 544/1034] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:59 2022] GET /compute/v2.1/servers/1255db25-bef6-4811-911c-9ce729d641ea => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:59.646969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7d25146b-3635-4fc3-96d6-296c743245de"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:18:59.649247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:18:59.658008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.658948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.659974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:18:59.660651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:18:59.856028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] HTTP exception thrown: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Request method failure captured: May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/536a3d66-933b-45c7-bd43-ce0069d8fd38 HTTP/1.1 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 74 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0TR7wN2J00beanNtfC_ApopYiASn3-jZOd5Bgh7RbAZM_QYfTHlVvZVmC1Yzc2tR-T1L1-pCWxk9yVYp6f3ACsXh5_5vvPlF5JnyFIppOO-W0cdnfjEy2XfTJqAdqCZG2uxbLM4jPr05tLmV9EguB5cAFAFdjxthWdvfJP8yghLeQ May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: cde2b2b3156340bdbb9052535de4a4ef May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesAdminNegativeTest-1144541637 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cde2b2b3156340bdbb9052535de4a4ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesAdminNegativeTest-1144541637 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: cde2b2b3156340bdbb9052535de4a4ef May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1144541637 May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesAdminNegativeTest-1144541637-project-admin May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1b77e50b5d54490da53219ce51de362d May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesAdminNegativeTest-1144541637-project-admin May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: {"volumeAttachment": {"volumeId": "7d25146b-3635-4fc3-96d6-296c743245de"}} May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: exception: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '743a356d-1eac-4730-8979-0734df0b9685', 'id': '536a3d66-933b-45c7-bd43-ce0069d8fd38', 'body': {'volumeAttachment': {'volumeId': '7d25146b-3635-4fc3-96d6-296c743245de'}}} May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. (HTTP 404) (Request-ID: req-321e4740-634a-4b92-8faf-f6ff12317641) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:18:59.858564 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:18:59.863815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] Returning 404 to user: Volume 536a3d66-933b-45c7-bd43-ce0069d8fd38 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:18:59.867887 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11aa5420-2c70-4046-a544-0e749c3c775f tempest-VolumesAdminNegativeTest-1144541637 tempest-VolumesAdminNegativeTest-1144541637-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/536a3d66-933b-45c7-bd43-ce0069d8fd38" status: 404 len: 109 microversion: 2.1 time: 0.230386 May 19 08:18:59.868601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 545/1035] 10.222.0.78 () {60 vars in 1432 bytes} [Thu May 19 08:18:59 2022] PUT /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685/os-volume_attachments/536a3d66-933b-45c7-bd43-ce0069d8fd38 => generated 109 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:18:59.882062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3082794c-db6b-484e-8900-1d17d64ed0ce tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:18:59.883122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3082794c-db6b-484e-8900-1d17d64ed0ce tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:00.032319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:00.046011 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-151fce09-6410-4cfa-88f0-476ad8621aa8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.642948 May 19 08:19:00.056456 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 491/1036] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:18:59 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:00.062280 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:00.067218 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:00.084546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:00.086790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:00.087895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:00.088557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:00.118200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3082794c-db6b-484e-8900-1d17d64ed0ce tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:00.132242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3082794c-db6b-484e-8900-1d17d64ed0ce tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:00.135463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3082794c-db6b-484e-8900-1d17d64ed0ce tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:00.136785 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3082794c-db6b-484e-8900-1d17d64ed0ce tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1262 microversion: 2.25 time: 0.265908 May 19 08:19:00.145471 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 546/1037] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:18:59 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1262 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:00.177267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-686450068"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:00.186473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:00.211660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:00.213951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:00.219471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:00.221997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:00.311120 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Cannot 'createImage' instance 156034f8-d24a-47cd-acac-ae7e5c589acf while it is in task_state image_snapshot May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action HTTP/1.1 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 84 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-686450068"}} May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'createImage' instance 156034f8-d24a-47cd-acac-ae7e5c589acf while it is in task_state image_snapshot May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-686450068'}}} May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf in task_state image_snapshot. Cannot snapshot while the instance is in this state. May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:19:00.317058 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 156034f8-d24a-47cd-acac-ae7e5c589acf while it is in task_state image_snapshot May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 156034f8-d24a-47cd-acac-ae7e5c589acf while it is in task_state image_snapshot May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 409 to user: Cannot 'createImage' instance 156034f8-d24a-47cd-acac-ae7e5c589acf while it is in task_state image_snapshot {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7235ff83-4833-40be-8a34-7a4da5438860 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action" status: 409 len: 159 microversion: 2.1 time: 0.171649 May 19 08:19:00.324255 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 547/1038] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:19:00 2022] POST /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf/action => generated 159 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:19:00.329055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a5b55bc-0d0d-4c5c-ae4b-6df893f71d80 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '.version_select at 0x7f3211f01ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:00.620902 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a5b55bc-0d0d-4c5c-ae4b-6df893f71d80 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/images/07f9c74f-c202-4ca7-bad1-e7208f1644b7" status: 204 len: 0 microversion: 2.1 time: 0.296841 May 19 08:19:00.621582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 548/1039] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:00 2022] DELETE /compute/v2.1/images/07f9c74f-c202-4ca7-bad1-e7208f1644b7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:19:00.631092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:00.631715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:00.639902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:00.640358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:00.641197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:00.642582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:01.731239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:01.748053 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-279074c9-4321-4402-b3f1-34463ac2cbd3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 1.690198 May 19 08:19:01.759726 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 492/1040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:00 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:01.759936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:01.768599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:01.770648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:01.780021 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c5e96e4-aaf5-4b52-b07c-0c354bfbea85 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1533 microversion: 2.1 time: 1.152746 May 19 08:19:01.782239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 549/1041] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:00 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1533 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:01.803621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:01.804704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:01.807095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:01.807585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:01.808344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:01.808947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:01.874237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:01.876663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:01.878336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:01.878957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:02.572773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:02.586115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94a7bfbe-180c-4093-9b97-fe2a064d7f42 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.800303 May 19 08:19:02.586710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 550/1042] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:01 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:02.595708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a6f27c76-fde4-44e9-9051-c88203d82e8d req-f8be6fea-a42c-47c2-bbe1-34d6d6bfcc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d39a76-db81-4bb9-9e41-4e434ef59341", "tag": "4a11627b-afc0-4edd-a386-a6068f747e6a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:02.599748 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:02.608885 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1b998907-fe9f-422e-926e-f92a0953c33a tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1485 microversion: 2.1 time: 0.847302 May 19 08:19:02.615156 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 493/1043] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:01 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1485 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:02.623014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:02.624911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:02.643606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:02.644266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:02.645418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:02.648575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:02.658901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a6f27c76-fde4-44e9-9051-c88203d82e8d req-f8be6fea-a42c-47c2-bbe1-34d6d6bfcc11 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:02.664971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a6f27c76-fde4-44e9-9051-c88203d82e8d req-f8be6fea-a42c-47c2-bbe1-34d6d6bfcc11 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:02.694323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a6f27c76-fde4-44e9-9051-c88203d82e8d req-f8be6fea-a42c-47c2-bbe1-34d6d6bfcc11 service nova] Creating event network-changed:4a11627b-afc0-4edd-a386-a6068f747e6a for instance 24d39a76-db81-4bb9-9e41-4e434ef59341 on chh2-842464-2 May 19 08:19:02.708781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a6f27c76-fde4-44e9-9051-c88203d82e8d req-f8be6fea-a42c-47c2-bbe1-34d6d6bfcc11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120564 May 19 08:19:02.710150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 551/1044] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:02.729756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-27bc5bc3-c5fe-47e0-b802-d0ad5217e52a req-8f99c937-c0f2-4a2e-ac95-eadbdfed0789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1255db25-bef6-4811-911c-9ce729d641ea", "name": "network-vif-deleted", "tag": "0f5d3d5c-c55f-44ea-8092-60df41f1febb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:02.760336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27bc5bc3-c5fe-47e0-b802-d0ad5217e52a req-8f99c937-c0f2-4a2e-ac95-eadbdfed0789 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:02.760987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27bc5bc3-c5fe-47e0-b802-d0ad5217e52a req-8f99c937-c0f2-4a2e-ac95-eadbdfed0789 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:02.810051 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-27bc5bc3-c5fe-47e0-b802-d0ad5217e52a req-8f99c937-c0f2-4a2e-ac95-eadbdfed0789 service nova] Creating event network-vif-deleted:0f5d3d5c-c55f-44ea-8092-60df41f1febb for instance 1255db25-bef6-4811-911c-9ce729d641ea on chh1-842464-2 May 19 08:19:02.824107 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-27bc5bc3-c5fe-47e0-b802-d0ad5217e52a req-8f99c937-c0f2-4a2e-ac95-eadbdfed0789 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111104 May 19 08:19:02.830121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 552/1045] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:02.844196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:02.848513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:02.861333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:02.863142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:02.865593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:02.867090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:03.185095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:03.210028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:03.211535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:03.223417 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-be556c26-fe49-4b0f-99a7-3243b55721bc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1320 microversion: 2.25 time: 0.606416 May 19 08:19:03.224253 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 494/1046] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:02 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:03.241071 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:03.242006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:03.272728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:03.273685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:03.276208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:03.276951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:04.070659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:04.084376 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d1d10892-77a1-45c9-aaca-875db7bed37c tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1521 microversion: 2.1 time: 0.855162 May 19 08:19:04.101408 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 495/1047] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:03 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1521 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:04.140107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:04.157035 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4ffc2ae-60f1-453a-a21d-10cfc3587e91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 1.319040 May 19 08:19:04.158084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 553/1048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:02 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:04.165637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:04.168101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:04.182680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:04.186704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:04.191793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:04.195884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:04.328241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9530fac7-6e04-4124-ba8e-8e297433ff64 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Action: 'create', calling method: .version_select at 0x7f32121b0c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1704537708"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:04.911946 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9530fac7-6e04-4124-ba8e-8e297433ff64 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.809020 May 19 08:19:04.913773 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 496/1049] 10.222.0.78 () {60 vars in 1154 bytes} [Thu May 19 08:19:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 811 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 08:19:04.920177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:04.921237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:04.929712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:04.930470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:04.931709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:04.932319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:04.966185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:19:04.968872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:04.986555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64fe4f5c-6e87-4d3f-8d9a-be7ac24b3691 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.826478 May 19 08:19:04.987942 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 554/1050] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:04 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:04.992775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:04.993893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:05.008249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:05.018153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:05.019508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:05.020182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:05.142005 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ca0403f8-b71c-4ca2-9d46-f4cc27ef34f0 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 204 len: 0 microversion: 2.1 time: 0.226072 May 19 08:19:05.143326 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 497/1051] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:04 2022] DELETE /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:19:05.159551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-429f539f-fbe6-41fa-a7ba-e114fbd15f71 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121b04c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:05.258978 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-429f539f-fbe6-41fa-a7ba-e114fbd15f71 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 345 microversion: 2.1 time: 0.112849 May 19 08:19:05.259889 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 498/1052] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:05 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:05.264670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-4c9ff4dc-15c0-49ba-ae2d-b20e0ca317e9 req-f8610c5e-c646-462d-9239-77228fd21def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:05.288084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4c9ff4dc-15c0-49ba-ae2d-b20e0ca317e9 req-f8610c5e-c646-462d-9239-77228fd21def service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:05.288539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4c9ff4dc-15c0-49ba-ae2d-b20e0ca317e9 req-f8610c5e-c646-462d-9239-77228fd21def service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:05.314217 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-4c9ff4dc-15c0-49ba-ae2d-b20e0ca317e9 req-f8610c5e-c646-462d-9239-77228fd21def service nova] Creating event network-changed:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:19:05.326498 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-4c9ff4dc-15c0-49ba-ae2d-b20e0ca317e9 req-f8610c5e-c646-462d-9239-77228fd21def service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064142 May 19 08:19:05.327748 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 499/1053] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:05.338251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:05.343169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:05.352284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:05.353379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:05.355072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:05.355766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:05.406696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:06.101654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:06.117613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:06.119270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:06.120437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15acbf68-5067-44b6-a19c-a30582491d27 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 1.131350 May 19 08:19:06.120980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 555/1054] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:04 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:06.132612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:06.135875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:06.147489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:06.148217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:06.149189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:06.149861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:06.338170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:06.352779 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-57895a6c-ce51-425e-af25-fcce8172b799 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1527 microversion: 2.1 time: 1.018925 May 19 08:19:06.354405 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 500/1055] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:05 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1527 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:06.367470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6b1f665e-9a28-4011-b933-67b63f2eaf79 req-936528a6-4d83-4a33-bd6e-7a41adc6cc68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156034f8-d24a-47cd-acac-ae7e5c589acf", "name": "network-vif-plugged", "status": "completed", "tag": "a6930316-a7a2-4ed4-9a0d-8c099101e88b"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:06.393013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6b1f665e-9a28-4011-b933-67b63f2eaf79 req-936528a6-4d83-4a33-bd6e-7a41adc6cc68 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:06.393832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6b1f665e-9a28-4011-b933-67b63f2eaf79 req-936528a6-4d83-4a33-bd6e-7a41adc6cc68 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:06.418799 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6b1f665e-9a28-4011-b933-67b63f2eaf79 req-936528a6-4d83-4a33-bd6e-7a41adc6cc68 service nova] Creating event network-vif-plugged:a6930316-a7a2-4ed4-9a0d-8c099101e88b for instance 156034f8-d24a-47cd-acac-ae7e5c589acf on chh1-842464-2 May 19 08:19:06.429520 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6b1f665e-9a28-4011-b933-67b63f2eaf79 req-936528a6-4d83-4a33-bd6e-7a41adc6cc68 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069771 May 19 08:19:06.437351 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 501/1056] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:06.449761 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:06.450878 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:06.459754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:06.460503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:06.461546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:06.463045 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:06.841737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:06.855452 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-065ffa7a-cd1c-4c91-a654-3ea2b2f146a6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.733069 May 19 08:19:06.858443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 556/1057] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:06 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:06.871179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-721214ba-c7c8-4e31-a955-2b89a9e0a0c3 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211f02820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:06.993132 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-721214ba-c7c8-4e31-a955-2b89a9e0a0c3 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 345 microversion: 2.1 time: 0.126492 May 19 08:19:06.994057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 557/1058] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:06 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:07.139830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:07.140547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:07.157438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:07.157710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:07.163446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:07.164322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:07.319827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:07.334087 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d254ab52-bbfd-467d-947b-fcd6e698b2f7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.894607 May 19 08:19:07.335873 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 502/1059] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:06 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:07.372327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:07.373119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:07.384763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:07.385278 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:07.388575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:07.389130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:07.788604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:07.809424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:07.811735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:07.815330 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-059ecf6d-c53a-4cb7-8148-0948e22c1e78 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.679493 May 19 08:19:07.828252 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 558/1060] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:07 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:19:07.877462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:07.879147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:07.889370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:07.890861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:07.894359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:07.895627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:07.950121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:07.978119 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a9ec949-c758-4926-a3d8-9ecda14f4636 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1527 microversion: 2.1 time: 0.595482 May 19 08:19:07.992283 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 503/1061] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:07 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1527 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:08.007421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-15594461-4a45-4e90-b695-84bec5d883d2 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121b0550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:08.074910 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-15594461-4a45-4e90-b695-84bec5d883d2 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 346 microversion: 2.1 time: 0.071265 May 19 08:19:08.075797 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 504/1062] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:08 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:08.087702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cb111c38-7370-45d5-9743-96a6872cfdd3 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Action: 'create', calling method: .version_select at 0x7f3212153940>, body: {"snapshot": {"volume_id": "3b3fcf80-47c7-461f-8d23-9fb18882b4a5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2141651753"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:08.366091 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cb111c38-7370-45d5-9743-96a6872cfdd3 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.282096 May 19 08:19:08.373335 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 505/1063] 10.222.0.78 () {60 vars in 1161 bytes} [Thu May 19 08:19:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:08.378810 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:08.379429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:08.404637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:08.405093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:08.405917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:08.406337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:08.994223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:09.022083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a04f476-1026-4845-922e-803d0f89e5ad tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 1.150210 May 19 08:19:09.023966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 559/1064] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:07 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:09.026061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:09.030427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a1780b0-70ab-4a1b-86a1-ec5aad4bf0cd tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211e6e160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:09.085894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=20 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:09.123874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:09.140269 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-79a1da46-9d9a-412f-ac1f-2594c1cd2cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.764410 May 19 08:19:09.142365 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 506/1065] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:08 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:09.155596 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a1780b0-70ab-4a1b-86a1-ec5aad4bf0cd tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.129940 May 19 08:19:09.162300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:09.162851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:09.163964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 560/1066] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:09 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:09.170158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:09.171161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:09.174667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:09.175360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:09.176318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:09.176921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:09.186009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:09.186466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:09.187248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:09.187685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:09.732211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:09.744615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f63c258-1679-47b2-a1bc-94565090a20a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1485 microversion: 2.1 time: 0.579019 May 19 08:19:09.758773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 561/1067] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:09 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1485 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:09.772064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ab3973d-0b57-4d4e-9ce7-b09215efb93c tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211fcdc10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:09.824950 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ab3973d-0b57-4d4e-9ce7-b09215efb93c tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064856 May 19 08:19:09.827151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 562/1068] 10.222.0.78 () {58 vars in 1139 bytes} [Thu May 19 08:19:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:09.838158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2bda1b6-f1b7-4acd-9e02-33eea587c52d tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211e04940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:09.872411 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2bda1b6-f1b7-4acd-9e02-33eea587c52d tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.038152 May 19 08:19:09.885705 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 563/1069] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:09 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:09.943334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-45b57a9e-87eb-49be-b6ec-c94498b2a034 req-e61f4abe-033d-41b5-9ead-92541fac0df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156034f8-d24a-47cd-acac-ae7e5c589acf", "name": "network-vif-deleted", "tag": "a6930316-a7a2-4ed4-9a0d-8c099101e88b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:09.949868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:09.965091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-45b57a9e-87eb-49be-b6ec-c94498b2a034 req-e61f4abe-033d-41b5-9ead-92541fac0df9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:09.965977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-45b57a9e-87eb-49be-b6ec-c94498b2a034 req-e61f4abe-033d-41b5-9ead-92541fac0df9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:09.997643 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-45b57a9e-87eb-49be-b6ec-c94498b2a034 req-e61f4abe-033d-41b5-9ead-92541fac0df9 service nova] Creating event network-vif-deleted:a6930316-a7a2-4ed4-9a0d-8c099101e88b for instance 156034f8-d24a-47cd-acac-ae7e5c589acf on chh1-842464-2 May 19 08:19:10.041910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-45b57a9e-87eb-49be-b6ec-c94498b2a034 req-e61f4abe-033d-41b5-9ead-92541fac0df9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103451 May 19 08:19:10.061241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 564/1070] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:10.082900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:10.083519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:10.096019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.099716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.099923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:10.100733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.101181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.113653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:10.117356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:10.121711 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-275d8288-239c-4c07-b70e-8ac583b6c540 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.976851 May 19 08:19:10.126989 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 507/1071] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:09 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:10.147061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:10.159359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:10.160374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:10.175959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.177710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.180036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.182028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.714597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:10.729320 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:10.734087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e4cee0a-98e1-4216-a9fb-f0cc2ec6327f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.671250 May 19 08:19:10.741531 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c4378cb4-a7f8-438a-ba19-0a610969a088 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.582855 May 19 08:19:10.753220 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 508/1072] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:10 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:10.753974 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 565/1073] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:10 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:10.771574 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:10.785937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:10.807463 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.821602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.823029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.828465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.887436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c11accbc-e040-4510-9f40-f802df2480b9 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211e04790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:10.959912 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c11accbc-e040-4510-9f40-f802df2480b9 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.078388 May 19 08:19:10.960529 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 566/1074] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:10 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:10.977909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:10.978284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:10.978753 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lazy-loading 'fault' on Instance uuid 156034f8-d24a-47cd-acac-ae7e5c589acf {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:11.145210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:11.146477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:11.159722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:11.165070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:11.166196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:11.168251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:11.197027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:11.205868 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-153709d1-6782-443f-99fc-20a448697c70 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 200 len: 1314 microversion: 2.1 time: 0.438879 May 19 08:19:11.208597 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 509/1075] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:10 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:11.630398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:11.663506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:11.666970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:11.668921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-125a28a5-305f-452d-9222-530da4ee1c36 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.528754 May 19 08:19:11.670372 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 567/1076] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:11 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:11.765624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:11.767897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:11.776703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:11.777868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:11.785064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:11.789360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:11.796646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:11.798606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:11.801094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:11.804203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:11.805581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:11.809769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:12.248393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:12.260356 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-00667661-8642-4678-b2f3-c42023be734e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.505448 May 19 08:19:12.260967 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 510/1077] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:11 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:12.281501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d70f0330-b1d4-4816-8843-616f7a231888 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121530d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:12.315573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:12.340941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90aceee6-4df6-4e7c-8be6-e99366cb457c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.568216 May 19 08:19:12.351788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 568/1078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:11 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:12.352219 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d70f0330-b1d4-4816-8843-616f7a231888 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.082593 May 19 08:19:12.352315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bc297713-9bb5-46a7-89d8-11683b377ea8 req-d1de7fde-0cae-402b-91da-4a1bc079a0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3328b332-2732-47e8-a2df-098724caaa6a", "tag": "1fa7a994-faa2-4307-98b0-8e35a44d1fa1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:12.352413 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 511/1079] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:12 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:12.358018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:12.359021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:12.365557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bc297713-9bb5-46a7-89d8-11683b377ea8 req-d1de7fde-0cae-402b-91da-4a1bc079a0f2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:12.366303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bc297713-9bb5-46a7-89d8-11683b377ea8 req-d1de7fde-0cae-402b-91da-4a1bc079a0f2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:12.367603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:12.369028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:12.369857 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:12.370481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:12.382878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bc297713-9bb5-46a7-89d8-11683b377ea8 req-d1de7fde-0cae-402b-91da-4a1bc079a0f2 service nova] Creating event network-changed:1fa7a994-faa2-4307-98b0-8e35a44d1fa1 for instance 3328b332-2732-47e8-a2df-098724caaa6a on chh1-842464-2 May 19 08:19:12.389522 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bc297713-9bb5-46a7-89d8-11683b377ea8 req-d1de7fde-0cae-402b-91da-4a1bc079a0f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044905 May 19 08:19:12.390397 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 569/1080] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:12.403468 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf HTTP/1.1 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf'} May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:12.405875 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:12.411536 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-14954a3a-0dba-4bb8-8ebb-1743c66bab97 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 404 len: 111 microversion: 2.1 time: 0.056407 May 19 08:19:12.417210 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 512/1081] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:12 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:12.422365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c2d38e1-a3ef-4145-a282-e1814ada32a7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'create', calling method: .version_select at 0x7f3211f01dc0>, body: {"keypair": {"name": "tempest-keypair-954280065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtzK1NqZ02Bm05lTK7oCb0VzSbzOxGZgIhI2ljd8sDVUIBjFuYIcENVR6QmQZ95c9yZ0h45ybMwTtONdnOlLPniyj8BWwCZAJZvvoAxhE+SVH0MnmOYFOOdc2W0p/J+gg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:12.446593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7c2d38e1-a3ef-4145-a282-e1814ada32a7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for project d36e395d75dd44ce8e9852bb61c14193. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:19:12.453437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7c2d38e1-a3ef-4145-a282-e1814ada32a7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for user ec18a0cd947847b6a084c3eed533e74e and project d36e395d75dd44ce8e9852bb61c14193. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:19:12.469587 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c2d38e1-a3ef-4145-a282-e1814ada32a7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 08:19:12.699430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:12.700505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:12.708774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:12.709506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:12.710457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:12.711071 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:13.095272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:13.106061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:13.115184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:13.119074 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d522f040-d3a8-4cea-a1bf-2bb04bfc5331 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.423663 May 19 08:19:13.131741 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 513/1082] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:12 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:13.276024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-1efe9d74-16d9-46f5-8fa6-728ff7834b69 req-d9ae6265-a059-49c7-93f8-1f68dfd896fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "name": "network-vif-plugged", "status": "completed", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:13.291266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1efe9d74-16d9-46f5-8fa6-728ff7834b69 req-d9ae6265-a059-49c7-93f8-1f68dfd896fe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:13.291631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1efe9d74-16d9-46f5-8fa6-728ff7834b69 req-d9ae6265-a059-49c7-93f8-1f68dfd896fe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:13.320935 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-1efe9d74-16d9-46f5-8fa6-728ff7834b69 req-d9ae6265-a059-49c7-93f8-1f68dfd896fe service nova] Creating event network-vif-plugged:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:19:13.327214 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-1efe9d74-16d9-46f5-8fa6-728ff7834b69 req-d9ae6265-a059-49c7-93f8-1f68dfd896fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056004 May 19 08:19:13.327980 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 514/1083] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:13.334077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:13.335020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:13.342233 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:13.342898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:13.343824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:13.344410 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:13.480211 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c2d38e1-a3ef-4145-a282-e1814ada32a7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53750. May 19 08:19:13.508419 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c2d38e1-a3ef-4145-a282-e1814ada32a7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.089782 May 19 08:19:13.509170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 570/1084] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:19:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:13.523309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:13.524331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:13.541862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:13.545939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:13.548273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:13.551742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:13.824549 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:13.841497 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7ad55ac5-f565-4940-9e1e-7b7097bda214 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.511394 May 19 08:19:13.850265 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 515/1085] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:13 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:13.859096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a186c9cf-19bb-4531-8d3e-40190943a16b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121aa4c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:13.896188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a186c9cf-19bb-4531-8d3e-40190943a16b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 288 microversion: 2.1 time: 0.043987 May 19 08:19:13.897546 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 516/1086] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:13 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:13.900688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:13.910194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a1171325-f406-443b-9d85-b25ed907e79d tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32124eeb80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:13.911924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4fcc69eb-f659-43b0-9601-096337a495f0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.401100 May 19 08:19:13.916721 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 571/1087] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:13 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:13.996363 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a1171325-f406-443b-9d85-b25ed907e79d tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 202 len: 0 microversion: 2.1 time: 0.091812 May 19 08:19:13.997592 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 517/1088] 10.222.0.78 () {58 vars in 1253 bytes} [Thu May 19 08:19:13 2022] DELETE /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:19:14.006208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d25c7a29-a711-4482-b0f0-affd810e5ac0 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211f01f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:14.056359 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d25c7a29-a711-4482-b0f0-affd810e5ac0 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.053863 May 19 08:19:14.057140 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 572/1089] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:14 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:14.137651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:14.138360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:14.151205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:14.152033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:14.155458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:14.156400 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:14.587453 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:14.603902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:14.607008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:14.626580 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf92d36f-2d9a-4f98-8e2a-6c3f18696bea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.492051 May 19 08:19:14.627543 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 518/1090] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:14 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:14.862393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:14.863785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:14.890790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:14.891258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:14.892623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:14.893066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:14.932155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:14.933372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:14.949147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:14.951818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:14.952708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:14.954993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:14.955794 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:15.338520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:15.355420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-506d6480-802c-443d-b931-e0457b9166a6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1378 microversion: 2.1 time: 0.499502 May 19 08:19:15.359790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 573/1091] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:14 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1378 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:15.372418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-346fde70-56c9-4f1e-8677-45af8ac027fb tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211e12670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:15.453351 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-346fde70-56c9-4f1e-8677-45af8ac027fb tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.083401 May 19 08:19:15.453351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 574/1092] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:15 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:15.455069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:15.467562 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6613d63b-3263-48fd-b329-9ab4b7f1e17a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.540097 May 19 08:19:15.468154 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 519/1093] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:14 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:15.648338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:15.648980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:15.684903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:15.686382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:15.689402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:15.689930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:16.171788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:16.182203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:16.187138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:16.189751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e7bba1b-1b5c-41df-a11f-b7af8b7ec7cb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.548068 May 19 08:19:16.205888 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 575/1094] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:15 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:16.215908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1797283588", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:16.311625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] validate_networks() for [('220be69f-b0ca-49aa-856a-990da7941ef6', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:19:16.347143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1413518048", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:16.403919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:19:16.895789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:19:16.897287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:19:16.898623 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:19:16.899277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:19:16.901504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:19:16.916746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:16.917592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:16.918931 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:16.919902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:16.960229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Getting quotas for project 71ecd42c62b541ac92b9154a285e284c. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:19:16.968459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Getting quotas for user 6b90ec07f04c4d42a6ee0f0b508695b1 and project 71ecd42c62b541ac92b9154a285e284c. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:19:16.991231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:19:16.994821 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:19:17.103484 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f1a8f794-d1ca-4976-9602-ab32f43da02a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985107 May 19 08:19:17.106727 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 520/1095] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:19:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:19:17.136635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:17.141125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:17.155527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:19:17.155993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:19:17.159518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:19:17.161233 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:17.161843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:19:17.161982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:17.163700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:19:17.164740 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:17.165259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:17.236858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:17.237535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:17.240862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:17.241333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:17.308963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for project d36e395d75dd44ce8e9852bb61c14193. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:19:17.334507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for user ec18a0cd947847b6a084c3eed533e74e and project d36e395d75dd44ce8e9852bb61c14193. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:19:17.373552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:19:17.376476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:19:17.484272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2d419ad-3825-429d-8c7a-bea5cebbbc91 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.276816 May 19 08:19:17.484941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 576/1096] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:19:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:19:17.505019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61b28eed-4ec6-4eba-a762-75605824426b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211ebc310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:17.584118 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61b28eed-4ec6-4eba-a762-75605824426b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 200 len: 287 microversion: 2.1 time: 0.083042 May 19 08:19:17.584720 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 577/1097] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:17 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:17.592305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:17.593475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:17.607621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:17.608396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:17.609738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:17.610404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.148749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.158845 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a9516b9-6537-49c3-9624-3ef5fd505c3d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1527 microversion: 2.1 time: 1.049558 May 19 08:19:18.159456 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 521/1098] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:17 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1527 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:18.167440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-2abfc3c3-242a-428f-8262-abbae3ace950 req-ed4e66c2-6e2b-4171-95d5-280280a5580e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62299986-c4dc-49cf-9f63-fccde1b436ed", "name": "network-vif-unplugged", "status": "completed", "tag": "a6ce6c6f-2f39-4049-bf13-b32836bd3d67"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:18.178822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.191310 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-566d751f-a4d9-455d-a5fe-af5713198f03 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.605248 May 19 08:19:18.192487 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 578/1099] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:17 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:18.197607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:18.198739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:18.205889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.206548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.207357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.207633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2abfc3c3-242a-428f-8262-abbae3ace950 req-ed4e66c2-6e2b-4171-95d5-280280a5580e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.208209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2abfc3c3-242a-428f-8262-abbae3ace950 req-ed4e66c2-6e2b-4171-95d5-280280a5580e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.208744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.237757 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-2abfc3c3-242a-428f-8262-abbae3ace950 req-ed4e66c2-6e2b-4171-95d5-280280a5580e service nova] Creating event network-vif-unplugged:a6ce6c6f-2f39-4049-bf13-b32836bd3d67 for instance 62299986-c4dc-49cf-9f63-fccde1b436ed on chh2-842464-2 May 19 08:19:18.253471 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-2abfc3c3-242a-428f-8262-abbae3ace950 req-ed4e66c2-6e2b-4171-95d5-280280a5580e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092720 May 19 08:19:18.255753 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 522/1100] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:18.261398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:18.263319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:18.272043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.272873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.273949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.274558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.377411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.390170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0454669-bfac-494c-bb93-5fe66af2eac1 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1212 microversion: 2.1 time: 0.196142 May 19 08:19:18.391103 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 579/1101] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:18 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1212 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:18.397893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:18.398626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:18.406552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.408070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.409156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.410776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.443838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:19:18.553868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b203c76a-9423-4f99-92a2-f1c308c588c5 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "DELETE /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 204 len: 0 microversion: 2.1 time: 0.160830 May 19 08:19:18.554748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 580/1102] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:18 2022] DELETE /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:19:18.560511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.567427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:18.568306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:18.570576 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.572687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.574816 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e9700539-295b-439b-9547-72a399292f1a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.317496 May 19 08:19:18.575839 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 523/1103] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:18 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:18.577174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.577787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.578729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.579860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.586937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-1fd115dd-f466-4f12-9aa9-2afba7e1e8b8 req-217e4a51-321a-44dd-9980-ff7a91d70269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3328b332-2732-47e8-a2df-098724caaa6a", "name": "network-vif-plugged", "status": "completed", "tag": "1fa7a994-faa2-4307-98b0-8e35a44d1fa1"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:18.601564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1fd115dd-f466-4f12-9aa9-2afba7e1e8b8 req-217e4a51-321a-44dd-9980-ff7a91d70269 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.602378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1fd115dd-f466-4f12-9aa9-2afba7e1e8b8 req-217e4a51-321a-44dd-9980-ff7a91d70269 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.619782 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-1fd115dd-f466-4f12-9aa9-2afba7e1e8b8 req-217e4a51-321a-44dd-9980-ff7a91d70269 service nova] Creating event network-vif-plugged:1fa7a994-faa2-4307-98b0-8e35a44d1fa1 for instance 3328b332-2732-47e8-a2df-098724caaa6a on chh1-842464-2 May 19 08:19:18.627320 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-1fd115dd-f466-4f12-9aa9-2afba7e1e8b8 req-217e4a51-321a-44dd-9980-ff7a91d70269 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049323 May 19 08:19:18.629460 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 524/1104] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:18.638506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:18.639337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:18.649896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.650719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.651776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.652439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.667686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:18.674119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:18.682186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-000e6856-8c5d-4132-976e-95a1cecd2490 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1221 microversion: 2.1 time: 0.125813 May 19 08:19:18.682834 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 581/1105] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:18 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1221 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:18.691242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:18.692229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:18.709254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.709918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:18.712982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:18.713989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.009720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:19.019224 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-29baed8c-7acc-41fd-8805-4b3f5235cdd5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1527 microversion: 2.1 time: 0.387933 May 19 08:19:19.020815 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 525/1106] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:18 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1527 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:19.032700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9874e642-bac1-437b-8014-08f4a5be687b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121b0160>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.045134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:19.062388 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-9874e642-bac1-437b-8014-08f4a5be687b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] HTTP exception thrown: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. May 19 08:19:19.065003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4caf3aeb-f370-4610-ac8c-724ff008d823 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1514 microversion: 2.1 time: 0.380765 May 19 08:19:19.066137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 582/1107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:18 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1514 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9874e642-bac1-437b-8014-08f4a5be687b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Request method failure captured: May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 HTTP/1.1 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf132hlSHxwxCytRnX3Bkiz1Ku0czBmauZqKyli9YrUCQZY_apWvgxdbIFuHtZHK0qc9LPoPiOw5a7zKsT6HP9YqNj0EKYBGW49qbfQWFizLQFebrfaMLQZbbv1SBxdHInm9fxHNlGxb6jB1gEIdSiz4sPbfp8aOaHhRaNdzsHghPDQ May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 48c12dc1acc54256b72c2661e480f954 May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: exception: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '39c68b70-75a0-4f75-9c61-2b02254b2bb5'} May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. (HTTP 404) (Request-ID: req-879397f2-bd24-423e-b716-0b196ac6ad79) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:19:19.066611 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9874e642-bac1-437b-8014-08f4a5be687b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Returning 404 to user: Snapshot 39c68b70-75a0-4f75-9c61-2b02254b2bb5 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:19.070805 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9874e642-bac1-437b-8014-08f4a5be687b tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5" status: 404 len: 111 microversion: 2.1 time: 0.045286 May 19 08:19:19.073784 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 526/1108] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/os-snapshots/39c68b70-75a0-4f75-9c61-2b02254b2bb5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:19.077066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b9e94662-8d39-4a3b-a7ea-0c3d7c06bc64 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121141f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.079239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1ec996a-b852-4227-b58b-d43ba28e4ee9 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.080159 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:19:19.080159 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:19:19.100463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1ec996a-b852-4227-b58b-d43ba28e4ee9 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/217805d7-62ff-4d0f-9a2e-f76f91db43f5" status: 202 len: 0 microversion: 2.1 time: 0.023669 May 19 08:19:19.101147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 583/1109] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:19 2022] DELETE /compute/v2.1/flavors/217805d7-62ff-4d0f-9a2e-f76f91db43f5 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:19:19.109801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e6197c4-047b-4d6b-a1a4-23f728ee13fc tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.132514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e6197c4-047b-4d6b-a1a4-23f728ee13fc tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026643 May 19 08:19:19.133121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 584/1110] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:19.149886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:19.151278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:19.163680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.163680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.163680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.163680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.170013 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b9e94662-8d39-4a3b-a7ea-0c3d7c06bc64 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 202 len: 0 microversion: 2.1 time: 0.096758 May 19 08:19:19.171211 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 527/1111] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:19:19 2022] DELETE /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:19:19.180993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a065f6a9-a22b-4a99-a08f-26811fe45a95 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f32121aa9d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.252576 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a065f6a9-a22b-4a99-a08f-26811fe45a95 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 345 microversion: 2.1 time: 0.074960 May 19 08:19:19.253332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:19.254091 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 528/1112] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:19.259946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.262176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:19.275688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Old instance type tempest-test_resize_flavor_-853551262, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 08:19:19.277818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.278580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.279817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.280420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.288406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:19:19.290160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:19:19.291058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:19:19.291728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:19:19.299005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:19:19.445678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43d90a4e-3fc6-4a23-8f32-d1f58dfe8759 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868/action" status: 202 len: 0 microversion: 2.1 time: 0.300395 May 19 08:19:19.447960 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 585/1113] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:19:19 2022] POST /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:19:19.458640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.459287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:19.475386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.475864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.480202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.480774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.632315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:19.646251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf0f8e60-b7b8-412c-8f0f-0e6437c45605 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1274 microversion: 2.1 time: 0.195911 May 19 08:19:19.649093 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 586/1114] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:19.660690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.663070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:19.663993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:19.676909 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9f7e510e-397c-413c-88a7-0ebe9bf4350a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.419226 May 19 08:19:19.681918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.683051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.684428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.685387 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 529/1115] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:19.687485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.700968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:19.701911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:19.709982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.710684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:19.711859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:19.712573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.069038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.082343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.083861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.085010 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eaa895bb-2f0c-4c11-90a8-adac00079ed5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1362 microversion: 2.25 time: 0.397592 May 19 08:19:20.093979 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 530/1116] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:20.116804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:20.117471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:20.132883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.138667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.139375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.140363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.140905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.141064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-736336a6-030a-4f02-83cf-811f7f349860 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1536 microversion: 2.1 time: 0.490457 May 19 08:19:20.169016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 587/1117] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:19 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1536 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:20.181544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:20.185742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:20.196183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.196637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.202629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.203522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.310192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.328672 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ec9b959a-54f0-4512-8a13-c8a3e6862b3f tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1283 microversion: 2.1 time: 0.211519 May 19 08:19:20.346216 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 531/1118] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:20 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1283 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:20.372247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-76ed3761-48a0-485f-b991-738ac1d93dd0 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3212153af0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:20.472289 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-76ed3761-48a0-485f-b991-738ac1d93dd0 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 345 microversion: 2.1 time: 0.124607 May 19 08:19:20.478419 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 532/1119] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:20 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:20.484025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-40a14d87-4bad-406b-828b-e738fe2e58cf req-3f9c0639-bd37-4210-badf-ee0961aebd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62299986-c4dc-49cf-9f63-fccde1b436ed", "tag": "a6ce6c6f-2f39-4049-bf13-b32836bd3d67"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:20.495465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-40a14d87-4bad-406b-828b-e738fe2e58cf req-3f9c0639-bd37-4210-badf-ee0961aebd91 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.496201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-40a14d87-4bad-406b-828b-e738fe2e58cf req-3f9c0639-bd37-4210-badf-ee0961aebd91 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.521869 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-40a14d87-4bad-406b-828b-e738fe2e58cf req-3f9c0639-bd37-4210-badf-ee0961aebd91 service nova] Creating event network-changed:a6ce6c6f-2f39-4049-bf13-b32836bd3d67 for instance 62299986-c4dc-49cf-9f63-fccde1b436ed on chh2-842464-2 May 19 08:19:20.535935 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-40a14d87-4bad-406b-828b-e738fe2e58cf req-3f9c0639-bd37-4210-badf-ee0961aebd91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055769 May 19 08:19:20.537284 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 533/1120] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:20.669503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:20.670689 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:20.689627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.690523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.692099 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.695805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.874619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.885716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbd7a0e6-82a1-4bdf-b0c3-831c76e78123 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1514 microversion: 2.1 time: 0.713589 May 19 08:19:20.891748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 588/1121] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:20 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1514 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:20.897390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:20.898376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:20.906385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.906840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.907850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:20.908822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:20.942774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:20.964366 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-414958f5-b56c-468a-b659-c158beef6897 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1274 microversion: 2.1 time: 0.301230 May 19 08:19:20.968487 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 534/1122] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:20 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:21.114665 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:21.115288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:21.124757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:21.125183 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:21.126886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:21.127338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:21.531335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:21.545551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-490d9e21-6b09-4456-b119-54b31b870175 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.658134 May 19 08:19:21.548383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 589/1123] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:20 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:21.582287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:21.583370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:21.598758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:21.599601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:21.600643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:21.601238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:21.748510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:21.758153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:21.760035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:21.761511 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1270f22c-67a5-454a-b9da-08e7662480e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1559 microversion: 2.25 time: 0.652761 May 19 08:19:21.762686 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 535/1124] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:21 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1559 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:19:21.769112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:21.770068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:21.779017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:21.782983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:21.786599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:21.787606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:22.129041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:22.142567 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b6d3dfdd-1cfe-4a71-ad04-a1e633a2ea87 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1325 microversion: 2.1 time: 0.378084 May 19 08:19:22.143658 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 536/1125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:21 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:22.155698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:22.162228 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4312465f-dbb7-45a6-afdc-fc37f9264a8d tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3212125a60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:22.170041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-306fd896-0a25-44e9-abf4-a0763214dfa0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1536 microversion: 2.1 time: 0.596682 May 19 08:19:22.174192 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 590/1126] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:21 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1536 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:22.271875 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4312465f-dbb7-45a6-afdc-fc37f9264a8d tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 345 microversion: 2.1 time: 0.126359 May 19 08:19:22.272766 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 537/1127] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:22 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:22.285911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:22.287015 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:22.295059 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:22.299377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:22.300426 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:22.301770 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:22.303198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:22.480084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:22.480639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:22.496035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:22.496502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:22.499932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:22.503214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.157992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:23.170212 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-543a56c5-ac46-4f44-aed4-cf7a5160c62d tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1514 microversion: 2.1 time: 0.888745 May 19 08:19:23.172320 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 538/1128] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:22 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1514 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:23.180114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:23.180842 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:23.190171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.191365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.192413 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.193054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.347707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:23.352366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 3328b332-2732-47e8-a2df-098724caaa6a {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:23.464512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:23.473217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4df0aa54-53b7-4197-ae46-7c5c61c8f790 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 2052 microversion: 2.25 time: 1.297220 May 19 08:19:23.473895 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6d85f997-ac82-4f7b-ba62-90b33893d032 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.299430 May 19 08:19:23.474221 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 591/1129] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:22 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 2052 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:23.479253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7499649a-6931-424f-8f86-8e011104eca9 req-1b92e84e-d19d-461a-b2e0-074db2037d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b32e99-5c8c-4efd-9ef6-c3dd50404b72", "tag": "f21812b8-52c8-4373-b031-f62176b4522d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:23.484989 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 539/1130] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:23 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:23.499089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:23.500150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:23.501283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7499649a-6931-424f-8f86-8e011104eca9 req-1b92e84e-d19d-461a-b2e0-074db2037d04 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.502688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7499649a-6931-424f-8f86-8e011104eca9 req-1b92e84e-d19d-461a-b2e0-074db2037d04 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.511078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.511944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.513170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.513859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.522492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7499649a-6931-424f-8f86-8e011104eca9 req-1b92e84e-d19d-461a-b2e0-074db2037d04 service nova] Creating event network-changed:f21812b8-52c8-4373-b031-f62176b4522d for instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 on chh1-842464-2 May 19 08:19:23.527951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7499649a-6931-424f-8f86-8e011104eca9 req-1b92e84e-d19d-461a-b2e0-074db2037d04 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052210 May 19 08:19:23.528760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 592/1131] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:23.535869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:23.536767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:23.545439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.546185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.547213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.548038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.785937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:23.789340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:23.799515 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-da853604-dcb7-4429-a119-249d1fc16339 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.308489 May 19 08:19:23.800122 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 540/1132] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:23 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:23.801345 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49427b76-5565-4529-9586-fe04a53176f6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1325 microversion: 2.1 time: 0.271187 May 19 08:19:23.805536 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:23.806448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:23.810762 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 593/1133] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:23 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1325 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:23.815337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.816024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.816417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b4f0213-263e-43a8-bd62-3500204f8e61 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3211f015e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:23.817257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.817917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.883757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b4f0213-263e-43a8-bd62-3500204f8e61 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 200 len: 345 microversion: 2.1 time: 0.071760 May 19 08:19:23.884705 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 594/1134] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:23 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:23.892724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9dd55807-909c-4974-9b31-5c4d92aee673 req-4b414b9d-18ad-4e21-b382-f958a0bd8060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743a356d-1eac-4730-8979-0734df0b9685", "name": "network-vif-deleted", "tag": "b6c92392-c4e2-4fc2-ba09-f4ab93f4ecc9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:23.903625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9dd55807-909c-4974-9b31-5c4d92aee673 req-4b414b9d-18ad-4e21-b382-f958a0bd8060 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.903978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9dd55807-909c-4974-9b31-5c4d92aee673 req-4b414b9d-18ad-4e21-b382-f958a0bd8060 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.919706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9dd55807-909c-4974-9b31-5c4d92aee673 req-4b414b9d-18ad-4e21-b382-f958a0bd8060 service nova] Creating event network-vif-deleted:b6c92392-c4e2-4fc2-ba09-f4ab93f4ecc9 for instance 743a356d-1eac-4730-8979-0734df0b9685 on chh2-842464-2 May 19 08:19:23.927020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9dd55807-909c-4974-9b31-5c4d92aee673 req-4b414b9d-18ad-4e21-b382-f958a0bd8060 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037956 May 19 08:19:23.927773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 595/1135] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:23.933369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:23.934149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:23.941094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.941588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:23.942388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:23.942825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.054913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:24.063998 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-69fb8100-3ae3-4fae-bad9-dbee3e729127 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.262499 May 19 08:19:24.065249 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 541/1136] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:23 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:24.191126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:24.194608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:24.208967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.212393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.213555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.214641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.227101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 3328b332-2732-47e8-a2df-098724caaa6a {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:24.254546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-064a72ea-c84a-4925-8e72-72b7885f57fa tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 2052 microversion: 2.25 time: 0.325451 May 19 08:19:24.255116 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 596/1137] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:23 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 2052 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:24.278124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3cacc0e5-79ea-456d-aeee-b6bd96f35251 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:24.279440 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:19:24.279440 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:19:24.280660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cacc0e5-79ea-456d-aeee-b6bd96f35251 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.281107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cacc0e5-79ea-456d-aeee-b6bd96f35251 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.281248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.281777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.281973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cacc0e5-79ea-456d-aeee-b6bd96f35251 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.282802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lazy-loading 'fault' on Instance uuid 743a356d-1eac-4730-8979-0734df0b9685 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:24.283337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cacc0e5-79ea-456d-aeee-b6bd96f35251 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.337565 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3cacc0e5-79ea-456d-aeee-b6bd96f35251 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.063223 May 19 08:19:24.338503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 597/1138] 10.222.0.78 () {60 vars in 1216 bytes} [Thu May 19 08:19:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:19:24.349058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-842464-2", "block_migration": "auto"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:24.350216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:24.353252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:24.376923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9102338976074e61ad6b552baf015229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75983445eabf4515a84869f1af0f0b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:24.381504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.381959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.382747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.383184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.386158 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3544ca51-c787-4184-852d-7733b69dfb24 tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 200 len: 1307 microversion: 2.1 time: 0.202023 May 19 08:19:24.397273 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 542/1139] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:24 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:24.445786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'flavor' on Instance uuid 3328b332-2732-47e8-a2df-098724caaa6a {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:24.487398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Going to try to live migrate instance to chh2-842464-2 {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:19:24.503491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:24.504386 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:24.517792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.518272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.519084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.519578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.932667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:24.951313 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-190780be-b091-4c61-bb31-5a326486b376 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.452615 May 19 08:19:24.961737 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 543/1140] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:24 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:24.961737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:24.961737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:24.975873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.979902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:24.980793 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:24.981249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:25.229977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:25.246984 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-005fe021-67c9-4ddb-a96d-c9d01a11f092 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.293200 May 19 08:19:25.248266 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 544/1141] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:24 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:25.258943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:25.259622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:25.280648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:25.281097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:25.281917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:25.283000 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:25.604669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:25.616376 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e49284eb-74e7-41d4-af46-6a28e6daa1e8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1325 microversion: 2.1 time: 0.366572 May 19 08:19:25.617667 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 545/1142] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:25 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1325 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:25.622983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cf2d6378-da77-4822-8a45-d78aaf21ad76 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3212272a60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:25.661227 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-cf2d6378-da77-4822-8a45-d78aaf21ad76 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] HTTP exception thrown: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cf2d6378-da77-4822-8a45-d78aaf21ad76 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Request method failure captured: May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 HTTP/1.1 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf132hlSHxwxCytRnX3Bkiz1Ku0czBmauZqKyli9YrUCQZY_apWvgxdbIFuHtZHK0qc9LPoPiOw5a7zKsT6HP9YqNj0EKYBGW49qbfQWFizLQFebrfaMLQZbbv1SBxdHInm9fxHNlGxb6jB1gEIdSiz4sPbfp8aOaHhRaNdzsHghPDQ May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 48c12dc1acc54256b72c2661e480f954 May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: exception: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '3b3fcf80-47c7-461f-8d23-9fb18882b4a5'} May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. (HTTP 404) (Request-ID: req-de4f8538-b2eb-48c4-ac9d-4840fca6b421) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:19:25.664056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cf2d6378-da77-4822-8a45-d78aaf21ad76 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Returning 404 to user: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cf2d6378-da77-4822-8a45-d78aaf21ad76 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 404 len: 109 microversion: 2.1 time: 0.048221 May 19 08:19:25.668243 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 546/1143] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:25 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:25.673499 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:25.678432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:25.697848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:25.698294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:25.699340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:25.699771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.056612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:26.067080 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1051654c-f95a-47a0-bc6f-1bdc0d76a9b8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.398052 May 19 08:19:26.074104 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 547/1144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:25 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:26.087363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:26.088383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] [instance: 743a356d-1eac-4730-8979-0734df0b9685] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:26.097642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.098512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.099744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.100735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.120355 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] HTTP exception thrown: Instance 743a356d-1eac-4730-8979-0734df0b9685 could not be found. May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Request method failure captured: May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 HTTP/1.1 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf0PYytRhwADFCFXnuE0TXSO3x7OiEYk8b_ykdT3nZvd7i-DrWTowHT0uTCxpaO5JLkHkFPEIaamPJrw9T3SYP9dJRwSFhRDGjnWhsPIWSSj9BWrQWw3FbhZbjADfGhuyVNDoDPX9q6kYQyH6cGBAMACV6iXchYJZHeseAKjCau_8DM May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 75983445eabf4515a84869f1af0f0b43 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-VolumesAdminNegativeTest-1478049441 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/75983445eabf4515a84869f1af0f0b43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/75983445eabf4515a84869f1af0f0b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_75983445eabf4515a84869f1af0f0b43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/75983445eabf4515a84869f1af0f0b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-VolumesAdminNegativeTest-1478049441 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 75983445eabf4515a84869f1af0f0b43 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1478049441 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-VolumesAdminNegativeTest-1478049441-project May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 9102338976074e61ad6b552baf015229 May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-VolumesAdminNegativeTest-1478049441-project May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 743a356d-1eac-4730-8979-0734df0b9685 could not be found. May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '743a356d-1eac-4730-8979-0734df0b9685'} May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743a356d-1eac-4730-8979-0734df0b9685 could not be found. May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743a356d-1eac-4730-8979-0734df0b9685 could not be found. May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.122948 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743a356d-1eac-4730-8979-0734df0b9685 could not be found. May 19 08:19:26.128113 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.130239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] Returning 404 to user: Instance 743a356d-1eac-4730-8979-0734df0b9685 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:26.131434 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-53e85e3e-880f-4a82-a17f-464e62128bdd tempest-VolumesAdminNegativeTest-1478049441 tempest-VolumesAdminNegativeTest-1478049441-project] 10.222.0.78 "GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685" status: 404 len: 111 microversion: 2.1 time: 0.056151 May 19 08:19:26.153487 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 548/1145] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:26 2022] GET /compute/v2.1/servers/743a356d-1eac-4730-8979-0734df0b9685 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:26.160032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc047503-91ea-4826-8357-0f4e9a7a06aa tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3212153dc0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:26.230564 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-fc047503-91ea-4826-8357-0f4e9a7a06aa tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] HTTP exception thrown: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc047503-91ea-4826-8357-0f4e9a7a06aa tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Request method failure captured: May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 HTTP/1.1 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf132hlSHxwxCytRnX3Bkiz1Ku0czBmauZqKyli9YrUCQZY_apWvgxdbIFuHtZHK0qc9LPoPiOw5a7zKsT6HP9YqNj0EKYBGW49qbfQWFizLQFebrfaMLQZbbv1SBxdHInm9fxHNlGxb6jB1gEIdSiz4sPbfp8aOaHhRaNdzsHghPDQ May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 48c12dc1acc54256b72c2661e480f954 May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: exception: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '3b3fcf80-47c7-461f-8d23-9fb18882b4a5'} May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. (HTTP 404) (Request-ID: req-0657919d-e5b8-4283-9b26-222d3e37361d) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:19:26.232572 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc047503-91ea-4826-8357-0f4e9a7a06aa tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Returning 404 to user: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc047503-91ea-4826-8357-0f4e9a7a06aa tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 404 len: 109 microversion: 2.1 time: 0.078966 May 19 08:19:26.238001 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 549/1146] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:19:26 2022] DELETE /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:26.245229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:26.245229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:26.271675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.272043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.275107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.275700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.284377 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:26.606819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:26.615535 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d5705569-decd-4b4e-a7dc-d0cf3e04c744 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.379260 May 19 08:19:26.622617 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 550/1147] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:26 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:26.642072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-170d53ff-a4fd-4eed-a3de-27859da80a3a req-c98069f6-7232-4afd-86f0-f950d9f3addd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f10a9b7-7386-4d30-8a57-cef8d2c54c93", "tag": "8cfaaf4e-31ee-45df-a83c-2f950cc1cd35"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:26.650806 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-170d53ff-a4fd-4eed-a3de-27859da80a3a req-c98069f6-7232-4afd-86f0-f950d9f3addd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.651325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-170d53ff-a4fd-4eed-a3de-27859da80a3a req-c98069f6-7232-4afd-86f0-f950d9f3addd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.673686 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-170d53ff-a4fd-4eed-a3de-27859da80a3a req-c98069f6-7232-4afd-86f0-f950d9f3addd service nova] Creating event network-changed:8cfaaf4e-31ee-45df-a83c-2f950cc1cd35 for instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 on chh1-842464-2 May 19 08:19:26.690631 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-170d53ff-a4fd-4eed-a3de-27859da80a3a req-c98069f6-7232-4afd-86f0-f950d9f3addd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066531 May 19 08:19:26.691636 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 551/1148] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:26.696810 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a7bab9f-4bb6-4b19-bbc4-6d684066d4d1 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Calling method '.version_select at 0x7f3212153820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:26.749287 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-9a7bab9f-4bb6-4b19-bbc4-6d684066d4d1 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] HTTP exception thrown: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a7bab9f-4bb6-4b19-bbc4-6d684066d4d1 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Request method failure captured: May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 HTTP/1.1 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf132hlSHxwxCytRnX3Bkiz1Ku0czBmauZqKyli9YrUCQZY_apWvgxdbIFuHtZHK0qc9LPoPiOw5a7zKsT6HP9YqNj0EKYBGW49qbfQWFizLQFebrfaMLQZbbv1SBxdHInm9fxHNlGxb6jB1gEIdSiz4sPbfp8aOaHhRaNdzsHghPDQ May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c699c7402dc14f7b84e70263f1359e37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: c699c7402dc14f7b84e70263f1359e37 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-853105878 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 48c12dc1acc54256b72c2661e480f954 May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-853105878-project May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: exception: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '3b3fcf80-47c7-461f-8d23-9fb18882b4a5'} May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. (HTTP 404) (Request-ID: req-abdb1b84-97ab-42df-9955-dd6c8f0b4eea) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:19:26.751580 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a7bab9f-4bb6-4b19-bbc4-6d684066d4d1 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] Returning 404 to user: Volume 3b3fcf80-47c7-461f-8d23-9fb18882b4a5 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a7bab9f-4bb6-4b19-bbc4-6d684066d4d1 tempest-VolumesSnapshotsTestJSON-853105878 tempest-VolumesSnapshotsTestJSON-853105878-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5" status: 404 len: 109 microversion: 2.1 time: 0.060358 May 19 08:19:26.756381 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 552/1149] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:26 2022] GET /compute/v2.1/os-volumes/3b3fcf80-47c7-461f-8d23-9fb18882b4a5 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:26.765462 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:26.768828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:26.779606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.780152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.792158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.792684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.821622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efde0220-c7f8-4c2b-b98f-26047a3c598e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a/action" status: 202 len: 0 microversion: 2.25 time: 2.475131 May 19 08:19:26.827174 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 598/1150] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:19:24 2022] POST /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a/action => generated 0 bytes in 2482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 08:19:26.845941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:26.848087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:26.882427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.882898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.883708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:26.885955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:26.941513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:26.983098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:27.178214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:27.188167 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4d94143b-db2e-4377-9240-6ba3cde3421a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.432898 May 19 08:19:27.202723 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 553/1151] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:26 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:27.208343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:27.209393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:27.224890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.226317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:27.227395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.228037 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:27.361330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=10 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:27.676921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:27.695279 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c3bf9d9-e6b1-4d7e-9ae2-cc4af267278e tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1325 microversion: 2.1 time: 0.866133 May 19 08:19:27.696644 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 599/1152] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:26 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1325 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:27.704847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:27.706057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:27.720878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.724050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:27.728553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.729501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:27.843772 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:27.856673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:27.858672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:27.860578 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1302bb19-0121-4d44-b91d-dcfa608799c4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.656391 May 19 08:19:27.885126 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 554/1153] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:27 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:27.891955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-827a7264-156d-4ea7-b609-ca9099b22988 req-12883d99-a9e6-4976-91de-135883c3faae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b32e99-5c8c-4efd-9ef6-c3dd50404b72", "name": "network-vif-plugged", "status": "completed", "tag": "f21812b8-52c8-4373-b031-f62176b4522d"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:27.903077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-827a7264-156d-4ea7-b609-ca9099b22988 req-12883d99-a9e6-4976-91de-135883c3faae service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.903972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-827a7264-156d-4ea7-b609-ca9099b22988 req-12883d99-a9e6-4976-91de-135883c3faae service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:27.931982 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-827a7264-156d-4ea7-b609-ca9099b22988 req-12883d99-a9e6-4976-91de-135883c3faae service nova] Creating event network-vif-plugged:f21812b8-52c8-4373-b031-f62176b4522d for instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 on chh1-842464-2 May 19 08:19:27.940313 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-827a7264-156d-4ea7-b609-ca9099b22988 req-12883d99-a9e6-4976-91de-135883c3faae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052725 May 19 08:19:27.941636 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 555/1154] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:27.959328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:27.960815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:27.974865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.975666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:27.977729 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:27.978565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:28.202882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:28.235115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06b2b58b-52a0-4c07-9cba-b9d1f0651f6e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.536871 May 19 08:19:28.238136 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 600/1155] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:27 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:28.245183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:28.246242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:28.260290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:28.260997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:28.262227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:28.262911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:28.570344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:28.585232 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-65ab4c44-64cd-4804-84f7-eb2b69e6d64c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.641864 May 19 08:19:28.586249 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 556/1156] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:27 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:28.714773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:28.715429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:28.729084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:28.729561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:28.730400 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:28.730904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:28.883183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:28.898239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-766ac79f-6237-49e8-ba72-63e236d8e8e2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.657952 May 19 08:19:28.899415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 601/1157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:28 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:28.905871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:28.906930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:28.921980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:28.922510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:28.924293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:28.924943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:29.140038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:29.159090 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b7c7536a-0244-4be3-bf34-ba8400efc32b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1325 microversion: 2.1 time: 0.448327 May 19 08:19:29.159592 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 557/1158] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:28 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1325 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:29.256512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:29.257132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:29.275364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:29.275826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:29.276638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:29.277084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:29.340232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:29.356132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:29.357645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:29.358811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce933301-a323-4517-9010-b6048a7deea1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.458227 May 19 08:19:29.359686 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 602/1159] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:28 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:29.607590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:29.608221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:29.621879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:29.622331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:29.623168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:29.623566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:30.432691 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:30.446913 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b171a02b-5ed8-4a07-82d7-5ff25ad7597b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 1.194032 May 19 08:19:30.452500 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 558/1160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:29 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:30.467937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:30.482347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:30.490501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:30.491026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:30.491990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:30.492435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:30.555306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:30.565242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-602eaa8f-7395-4b0f-8107-97af1646708a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.959124 May 19 08:19:30.565894 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 603/1161] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:29 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:30.581112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:30.581981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:30.600158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:30.601214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:30.602055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:30.602487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:30.959586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:30.979773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bfedbb6c-7ace-4e96-87be-9519c7b24144 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1523 microversion: 2.1 time: 0.412107 May 19 08:19:30.987860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 604/1162] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:30 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:30.992934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:31.000498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:31.033173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:31.038954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.039968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.041436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.042497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.057345 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d4e932c6-3d2d-40c8-9dc9-cfcb8ad45f4d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.603451 May 19 08:19:31.058336 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 559/1163] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:30 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:31.065526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:31.067414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:31.076471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.077230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.078303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.079450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.479128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:31.494287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:31.498040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:31.503531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7703e37b-fa11-43c7-8870-61dd1b215d01 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.510824 May 19 08:19:31.506154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 605/1164] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:30 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:31.528392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-18179e9e-ce2e-413c-8c0f-ee9699b45870 req-370babfa-fcf0-4c3e-a4a7-9542da251001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3328b332-2732-47e8-a2df-098724caaa6a", "name": "network-vif-unplugged", "status": "completed", "tag": "1fa7a994-faa2-4307-98b0-8e35a44d1fa1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:31.540129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18179e9e-ce2e-413c-8c0f-ee9699b45870 req-370babfa-fcf0-4c3e-a4a7-9542da251001 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.540808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18179e9e-ce2e-413c-8c0f-ee9699b45870 req-370babfa-fcf0-4c3e-a4a7-9542da251001 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.556824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-18179e9e-ce2e-413c-8c0f-ee9699b45870 req-370babfa-fcf0-4c3e-a4a7-9542da251001 service nova] Creating event network-vif-unplugged:1fa7a994-faa2-4307-98b0-8e35a44d1fa1 for instance 3328b332-2732-47e8-a2df-098724caaa6a on chh1-842464-2 May 19 08:19:31.568067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-18179e9e-ce2e-413c-8c0f-ee9699b45870 req-370babfa-fcf0-4c3e-a4a7-9542da251001 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059665 May 19 08:19:31.569563 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 606/1165] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:31.578066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:31.580897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:31.592878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.595461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.598031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.598750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.738006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:31.746958 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ac46394b-4201-413e-89a9-236b8bfe2acc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1523 microversion: 2.1 time: 0.687418 May 19 08:19:31.760490 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 560/1166] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:31 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1523 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:31.767995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:31.771088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:31.787532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.788615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.791561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.792406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.873915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:31.907699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54d5447e-b782-402c-9efe-a4c4db07efe1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.335902 May 19 08:19:31.908525 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 607/1167] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:31 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:31.925200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-208786287"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:31.928824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:31.939713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.940574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:31.950103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:31.950775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.202881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:32.212759 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-08a7838e-5c49-4990-a1a9-ed4a4bcd749c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.450675 May 19 08:19:32.217632 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 561/1168] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:31 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:32.230955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:32.232007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:32.243088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.247298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.248722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.249494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.473458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:32.516937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9910f448-11b9-465f-b4b4-d1e9eaeb531d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72/action" status: 202 len: 0 microversion: 2.1 time: 0.606393 May 19 08:19:32.518249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 608/1169] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:19:31 2022] POST /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:19:32.529258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9717f2d-e592-4028-8956-71fd431f19ba tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '.version_select at 0x7f3211e1e700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:32.548161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:32.558942 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-27db2d7c-ec91-4a5e-8acd-45bb6e9602c7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.339745 May 19 08:19:32.560353 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 562/1170] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:32 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:32.567403 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:32.568594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:32.577999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.578715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.580342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.582384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.758803 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9717f2d-e592-4028-8956-71fd431f19ba tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342" status: 204 len: 0 microversion: 2.1 time: 0.234691 May 19 08:19:32.759446 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 609/1171] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:32 2022] DELETE /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:19:32.768758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6265ad7-d33d-41a4-878f-e72e078186f9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '.version_select at 0x7f3211d845e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:32.802138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d6265ad7-d33d-41a4-878f-e72e078186f9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Image not found. May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6265ad7-d33d-41a4-878f-e72e078186f9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342 HTTP/1.1 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'cfeb043d-9248-4f08-b591-5f4493c23342'} May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cfeb043d-9248-4f08-b591-5f4493c23342 May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:19:32.804446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cfeb043d-9248-4f08-b591-5f4493c23342 could not be found. May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6265ad7-d33d-41a4-878f-e72e078186f9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6265ad7-d33d-41a4-878f-e72e078186f9 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342" status: 404 len: 62 microversion: 2.1 time: 0.042165 May 19 08:19:32.809225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 610/1172] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:19:32 2022] GET /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:19:32.815314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:32.816797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:32.824691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.825181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.827073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.827758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.896712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:32.908189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:32.910074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:32.911961 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2b554448-8fb7-400e-9650-1b1a3ab9c3fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.350174 May 19 08:19:32.912615 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 563/1173] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:32 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:32.929285 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:32.930361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:32.937488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.938155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:32.939349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:32.939976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.134004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:33.143318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec11265a-8643-45a2-8839-b37772c64947 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1535 microversion: 2.1 time: 0.331408 May 19 08:19:33.144223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 611/1174] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:32 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1535 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:33.234160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:33.236497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:33.244645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.246296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.247126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.247783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.265598 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:33.276735 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-292e2903-3562-43dd-a5d8-b2390a94d4a7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.351659 May 19 08:19:33.290623 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 564/1175] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:32 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:33.362604 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2c9e5ba7-9bae-42f5-96ec-1475b05ea65c tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3212125430>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:33.428590 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2c9e5ba7-9bae-42f5-96ec-1475b05ea65c tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b0e27fa1-6dfa-4fa7-813a-d6660fa6933a" status: 200 len: 350 microversion: 2.1 time: 0.074446 May 19 08:19:33.438994 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 565/1176] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:33 2022] GET /compute/v2.1/os-volumes/b0e27fa1-6dfa-4fa7-813a-d6660fa6933a => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:33.525498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:33.539018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-745ecad8-b2e4-4cb9-93b8-17ecd065f805 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.308722 May 19 08:19:33.540656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 612/1177] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:33 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:33.578553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:33.579741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:33.591787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7692fffe-48be-4ab8-9061-5468ffa94045 req-82758643-ae69-40ec-b405-362251fab8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3328b332-2732-47e8-a2df-098724caaa6a", "tag": "1fa7a994-faa2-4307-98b0-8e35a44d1fa1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:33.601191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.602909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.605100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7692fffe-48be-4ab8-9061-5468ffa94045 req-82758643-ae69-40ec-b405-362251fab8de service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.606432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.607238 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.610001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7692fffe-48be-4ab8-9061-5468ffa94045 req-82758643-ae69-40ec-b405-362251fab8de service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.639906 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7692fffe-48be-4ab8-9061-5468ffa94045 req-82758643-ae69-40ec-b405-362251fab8de service nova] Creating event network-changed:1fa7a994-faa2-4307-98b0-8e35a44d1fa1 for instance 3328b332-2732-47e8-a2df-098724caaa6a on chh1-842464-2 May 19 08:19:33.649984 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7692fffe-48be-4ab8-9061-5468ffa94045 req-82758643-ae69-40ec-b405-362251fab8de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060493 May 19 08:19:33.652427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 613/1178] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:33.747851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-61baca88-9b85-4092-a9e1-e3364eb1cb29 req-8c46fdd6-d7c0-4e4a-88a2-6b9915df1e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f10a9b7-7386-4d30-8a57-cef8d2c54c93", "name": "network-vif-plugged", "status": "completed", "tag": "8cfaaf4e-31ee-45df-a83c-2f950cc1cd35"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:33.765800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-61baca88-9b85-4092-a9e1-e3364eb1cb29 req-8c46fdd6-d7c0-4e4a-88a2-6b9915df1e19 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.768762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-61baca88-9b85-4092-a9e1-e3364eb1cb29 req-8c46fdd6-d7c0-4e4a-88a2-6b9915df1e19 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.789264 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-61baca88-9b85-4092-a9e1-e3364eb1cb29 req-8c46fdd6-d7c0-4e4a-88a2-6b9915df1e19 service nova] Creating event network-vif-plugged:8cfaaf4e-31ee-45df-a83c-2f950cc1cd35 for instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 on chh1-842464-2 May 19 08:19:33.796413 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-61baca88-9b85-4092-a9e1-e3364eb1cb29 req-8c46fdd6-d7c0-4e4a-88a2-6b9915df1e19 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054615 May 19 08:19:33.798802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 614/1179] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:19:33.918932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:33.931620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:33.932311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:33.934491 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-db0faa2a-0192-40a7-94a3-4c7f3721a704 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.360789 May 19 08:19:33.936396 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 566/1180] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:33 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:33.950581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.951303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:33.952311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:33.952944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.162468 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:34.163647 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:34.178367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.179173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.180388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.182138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.294587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:34.474619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:34.484228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:34.486767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:34.488501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b8f653a-c248-45ef-8938-2c5df8fddfc5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.561530 May 19 08:19:34.489382 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 615/1181] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:33 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:34.505872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:34.506872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:34.515871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.516635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.518227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.518907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.603764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:34.621653 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-32c17765-cde5-421a-ae6d-f6cc4f645c55 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1541 microversion: 2.1 time: 0.465322 May 19 08:19:34.625880 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 567/1182] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:34 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1541 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:34.640785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:34.647267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:34.658705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.663412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.665457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.668192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.915045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:34.926189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96ce09af-69e4-4426-8bee-0b453562a694 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.424000 May 19 08:19:34.926785 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 616/1183] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:34 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:34.957688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:34.959050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:34.970999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.971458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:34.972923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:34.974484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:35.045001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:35.057172 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b87f356f-bd04-40a1-95e4-afe27a3465db tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.426481 May 19 08:19:35.067947 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 568/1184] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:34 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:35.200427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:35.215940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-943165d4-0ba8-47d1-90d7-d007f450b515 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.266065 May 19 08:19:35.217190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 617/1185] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:34 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:35.513366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:35.514008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:35.527742 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:35.528619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:35.529761 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:35.530537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:35.643460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:35.644016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:35.660291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:35.665048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:35.666061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:35.673976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.113555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.120086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.123618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74259683-5103-4ad7-90f1-816ca7689e22 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1541 microversion: 2.1 time: 0.484637 May 19 08:19:36.135084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 618/1186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:35 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1541 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:36.140625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:36.140946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.142491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:36.143415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.144913 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bc11d0ed-d109-4afa-8971-f23badb231e1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.641389 May 19 08:19:36.146462 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 569/1187] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:35 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:36.150154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:36.150742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.151663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:36.152220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.185182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:36.187289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:36.204752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:36.206070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.207301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:36.208046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.216236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:36.402236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.411110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab59885e-23f1-41b7-a1db-6e9f23ad2445 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.274371 May 19 08:19:36.411769 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 619/1188] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:36 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:36.425736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:36.426358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:36.432554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:36.433006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.433821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:36.434250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:36.462788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.488037 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ac94bac0-fd3d-42fc-9347-f0a3d3cd02a3 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1316 microversion: 2.1 time: 0.339843 May 19 08:19:36.491420 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 570/1189] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:36 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:36.513999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f180b8d-19fc-411a-a0d0-83ff2e2b1e9f tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3212114e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:36.640626 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9f180b8d-19fc-411a-a0d0-83ff2e2b1e9f tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/db7e3f2d-3b8a-4e5a-82b3-efbd968747f4" status: 200 len: 351 microversion: 2.1 time: 0.146483 May 19 08:19:36.641957 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 571/1190] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:36 2022] GET /compute/v2.1/os-volumes/db7e3f2d-3b8a-4e5a-82b3-efbd968747f4 => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:36.760280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:36.773927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0eacce62-3362-4f48-a79c-99eb2e1009c4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1550 microversion: 2.1 time: 0.349121 May 19 08:19:36.776462 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 620/1191] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:36 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1550 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:37.143784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:37.144409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:37.151076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:37.151961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:37.153122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:37.153778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:37.164265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:37.165565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:37.180125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:37.181039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:37.182148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:37.183093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:37.944249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:37.953146 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:37.957993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:37.962309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:37.963495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2cebfc9-4df3-4cbf-af70-3e55634a4043 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.803141 May 19 08:19:37.966982 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d4d7541d-b6c7-4f65-b0ed-d9f35053c6c2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1523 microversion: 2.1 time: 0.828352 May 19 08:19:37.970194 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 572/1192] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:37 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1523 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:37.982630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 621/1193] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:37 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:37.983632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:37.984429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:37.988868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:37.989510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:37.998621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.007644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.007919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.008086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.008873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.009392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.010249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.012397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.490738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:38.508257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91422536-4651-4405-af64-17fcdfc9897c tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1465 microversion: 2.1 time: 0.523464 May 19 08:19:38.511134 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 622/1194] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:37 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1465 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:38.523529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:38.530601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:38.580412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.586443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.589399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.591546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.866768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:38.878258 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a5ee85a6-6c85-4c74-9085-de0f03cbc083 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.905962 May 19 08:19:38.883478 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 573/1195] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:37 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:38.888888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-441d0fe3-ef2d-475b-bc88-b76652868156 req-e1b8b175-a81d-4185-9c07-2196ce30c448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b32e99-5c8c-4efd-9ef6-c3dd50404b72", "name": "network-vif-plugged", "status": "completed", "tag": "f21812b8-52c8-4373-b031-f62176b4522d"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:38.899455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-441d0fe3-ef2d-475b-bc88-b76652868156 req-e1b8b175-a81d-4185-9c07-2196ce30c448 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.900186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-441d0fe3-ef2d-475b-bc88-b76652868156 req-e1b8b175-a81d-4185-9c07-2196ce30c448 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.919747 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-441d0fe3-ef2d-475b-bc88-b76652868156 req-e1b8b175-a81d-4185-9c07-2196ce30c448 service nova] Creating event network-vif-plugged:f21812b8-52c8-4373-b031-f62176b4522d for instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 on chh1-842464-2 May 19 08:19:38.927458 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-441d0fe3-ef2d-475b-bc88-b76652868156 req-e1b8b175-a81d-4185-9c07-2196ce30c448 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042072 May 19 08:19:38.928669 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 574/1196] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:38.935458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:38.936038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:38.946011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.946868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.948103 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:38.948981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:38.956139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:38.984972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:19:38.998835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d455c5f9-c06c-4383-b7a6-50f8d788b673 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1540 microversion: 2.1 time: 0.485955 May 19 08:19:39.017619 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 623/1197] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:38 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1540 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:39.023994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:39.028702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:39.043265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.044044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.045259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.045933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.128524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:19:39.164595 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-59be2f63-ba31-4b8a-9e11-e9fe4a1ad5a2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 204 len: 0 microversion: 2.1 time: 0.233192 May 19 08:19:39.165843 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 575/1198] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:38 2022] DELETE /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:19:39.291578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53cc2c60-9a4f-4370-b15b-d2eb4d061a19 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 204 len: 0 microversion: 2.1 time: 0.270111 May 19 08:19:39.295179 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 624/1199] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:39 2022] DELETE /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:19:39.309764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:39.310490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:39.339411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.342375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.343494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.344127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.351057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d810bf64-3fe5-4204-92a1-76a12e28490f tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Calling method '.version_select at 0x7f3212153e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:39.757512 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d810bf64-3fe5-4204-92a1-76a12e28490f tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.590088 May 19 08:19:39.764649 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 576/1200] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:19:39 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:19:39.765181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3c91c5ab-f379-4e03-8788-3546e6d2e4f0 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '.version_select at 0x7f32121b0550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:39.767894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c91c5ab-f379-4e03-8788-3546e6d2e4f0 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.768611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c91c5ab-f379-4e03-8788-3546e6d2e4f0 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.781349 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3c91c5ab-f379-4e03-8788-3546e6d2e4f0 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.021488 May 19 08:19:39.782525 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 577/1201] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:19:39 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:39.787413 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:39.788452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:39.796201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.797163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.798942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.800501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.910748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:39.920662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:39.927245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:39.928637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d0cf8ec-5487-425f-b6c9-bd5ff1639f6d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.632754 May 19 08:19:39.929936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 625/1202] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:39 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:39.934686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:39.935628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:39.943396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.944331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.945345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:39.945799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:39.967188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:40.023955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:40.036619 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-16eeecda-52b8-4a9f-b377-2b987e00c9ab tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1529 microversion: 2.1 time: 0.252776 May 19 08:19:40.037607 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 578/1203] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:39 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1529 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:40.046851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-545558a8-7355-428a-a44f-596fad96f89e tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Action: 'create', calling method: .version_select at 0x7f32121aa550>, body: {"pool": "non_exist_pool"} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:40.118470 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-545558a8-7355-428a-a44f-596fad96f89e tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] HTTP exception thrown: Floating IP pool not found. May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-545558a8-7355-428a-a44f-596fad96f89e tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Request method failure captured: May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 26 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2a7OlI0vLRyYZQX_MibrFPVhuQE9PGXW73mJ29F5Y0zmSifvblEo9H1EaZ8prJ4y4e65uRU6m3nLjeZ0ezA04mm4yKvnK1HV2klV2UFjhlOsPlOgThi0Y-vDpu7dbAelF6f4Lqvm7lGbpOMyZuKDE0VWPcJnTsj0iqr8LH81H3ibQ May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 59026bb9a2a848dea03678d501f2eed4 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1409764616 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1409764616 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 59026bb9a2a848dea03678d501f2eed4 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1409764616 May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsNegativeTestJSON-1409764616-project May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a5cf89abeed44c989bf76c71c9589ecf May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1409764616-project May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: {"pool": "non_exist_pool"} May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: exception: Floating IP pool not found. May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'pool': 'non_exist_pool'}} May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2957, in allocate_floating_ip May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2947, in _get_floating_ip_pool_id_by_name_or_id May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:40.120226 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-545558a8-7355-428a-a44f-596fad96f89e tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Returning 404 to user: Floating IP pool not found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-545558a8-7355-428a-a44f-596fad96f89e tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.083635 May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 579/1204] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:19:40 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.132004 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:40.154097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.154682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.155327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.160340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.196541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:40.206714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9096ac08-7963-4cc9-a555-f58383f04507 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1471 microversion: 2.1 time: 0.275237 May 19 08:19:40.213841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 626/1205] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:39 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:40.219121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.220977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:40.229045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.229537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.230328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.230764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.384187 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c08ec0d8-a80c-48d7-b5bc-256dc5bf769e tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1691 microversion: 2.1 time: 0.254770 May 19 08:19:40.386076 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 580/1206] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:40 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1691 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:40.400663 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ebc92c9-d439-4299-b71d-ab8e5e70efc0 tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Calling method '.version_select at 0x7f32121140d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.462246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-9ebc92c9-d439-4299-b71d-ab8e5e70efc0 tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 869057e6-6af7-42f9-9910-0f0317ebefa2 could not be found", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:19:40.463329 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-9ebc92c9-d439-4299-b71d-ab8e5e70efc0 tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] HTTP exception thrown: Floating IP not found for ID 869057e6-6af7-42f9-9910-0f0317ebefa2 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ebc92c9-d439-4299-b71d-ab8e5e70efc0 tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Request method failure captured: May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-floating-ips/869057e6-6af7-42f9-9910-0f0317ebefa2 HTTP/1.1 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2a7OlI0vLRyYZQX_MibrFPVhuQE9PGXW73mJ29F5Y0zmSifvblEo9H1EaZ8prJ4y4e65uRU6m3nLjeZ0ezA04mm4yKvnK1HV2klV2UFjhlOsPlOgThi0Y-vDpu7dbAelF6f4Lqvm7lGbpOMyZuKDE0VWPcJnTsj0iqr8LH81H3ibQ May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 59026bb9a2a848dea03678d501f2eed4 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1409764616 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59026bb9a2a848dea03678d501f2eed4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1409764616 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 59026bb9a2a848dea03678d501f2eed4 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1409764616 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-FloatingIPsNegativeTestJSON-1409764616-project May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: a5cf89abeed44c989bf76c71c9589ecf May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1409764616-project May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: exception: Floating IP not found for ID 869057e6-6af7-42f9-9910-0f0317ebefa2 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '869057e6-6af7-42f9-9910-0f0317ebefa2'} May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 869057e6-6af7-42f9-9910-0f0317ebefa2 could not be found May 19 08:19:40.465619 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d965d476-b734-4bb9-8a43-fdd9e92117b0'] May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 869057e6-6af7-42f9-9910-0f0317ebefa2. May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 869057e6-6af7-42f9-9910-0f0317ebefa2 May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 869057e6-6af7-42f9-9910-0f0317ebefa2 May 19 08:19:40.471108 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:40.478326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ebc92c9-d439-4299-b71d-ab8e5e70efc0 tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] Returning 404 to user: Floating IP not found for ID 869057e6-6af7-42f9-9910-0f0317ebefa2 {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:40.479503 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9ebc92c9-d439-4299-b71d-ab8e5e70efc0 tempest-FloatingIPsNegativeTestJSON-1409764616 tempest-FloatingIPsNegativeTestJSON-1409764616-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/869057e6-6af7-42f9-9910-0f0317ebefa2" status: 404 len: 111 microversion: 2.1 time: 0.091737 May 19 08:19:40.481858 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 581/1207] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:19:40 2022] DELETE /compute/v2.1/os-floating-ips/869057e6-6af7-42f9-9910-0f0317ebefa2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:40.519236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.522022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:40.550320 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.551206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.552158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.553473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.592797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:40.607505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65678b3a-3317-49ac-bea3-790c58277a9b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1541 microversion: 2.1 time: 0.398235 May 19 08:19:40.621533 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 627/1208] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:40 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1541 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:40.621533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4e477fa-351a-4b66-9d70-42dabc904e6a tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211f01f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.745299 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4e477fa-351a-4b66-9d70-42dabc904e6a tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/691b9089-f16e-444d-a9e8-f20c8f989d04" status: 200 len: 350 microversion: 2.1 time: 0.130653 May 19 08:19:40.745913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 628/1209] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:19:40 2022] GET /compute/v2.1/os-volumes/691b9089-f16e-444d-a9e8-f20c8f989d04 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:40.757411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8fd0c5b-7929-46ab-9c88-ebdb9d3b7de1 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211d551f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.937658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8fd0c5b-7929-46ab-9c88-ebdb9d3b7de1 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.184165 May 19 08:19:40.938435 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 629/1210] 10.222.0.78 () {58 vars in 1133 bytes} [Thu May 19 08:19:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:40.954254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:40.955049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:40.974482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.975584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:40.976412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:40.976863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:41.155835 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0ae25252-8908-4c57-a3ee-8e689542ebfe tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1691 microversion: 2.1 time: 0.672496 May 19 08:19:41.158277 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 582/1211] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:40 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1691 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:41.163812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5036607b-701f-4c62-8658-4c8422b02187 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3212114b80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:41.286421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:41.302185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:41.307188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:41.311520 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a12f7e28-366a-478d-bbac-6225a891823c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.361155 May 19 08:19:41.315057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 630/1212] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:40 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:41.340759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:41.344030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:41.369987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:41.371359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:41.376438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:41.376935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:41.457159 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5036607b-701f-4c62-8658-4c8422b02187 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.297402 May 19 08:19:41.458123 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 583/1213] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:19:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:41.463236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:41.464198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:41.478104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:41.482520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:41.483674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:41.484337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.179558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:42.237938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3350820-f67d-49c1-83e7-c368087064cb tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1529 microversion: 2.1 time: 0.905995 May 19 08:19:42.239577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 631/1214] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:41 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1529 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:42.253420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:42.253901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:42.257347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:42.273355 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-af20177d-308a-46aa-a55d-f8e45e328085 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1471 microversion: 2.1 time: 0.813574 May 19 08:19:42.276275 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 584/1215] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:41 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1471 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:42.286940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:42.287417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.288265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:42.288631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.292368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:42.304993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:42.305671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Searching by: {'deleted': False, 'project_id': '36fdc1b726454b47a508f87d2af575d2'} {{(pid=119073) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:19:42.342770 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:42.343921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.346199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:42.348267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.493978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lazy-loading 'services' on Instance uuid 62299986-c4dc-49cf-9f63-fccde1b436ed {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:42.589372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.multi_cell_list [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:19:42.721798 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb07a439-c0cb-4b1e-a03f-68f414a0149a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments/86cc03c1-e0ba-419d-a7e0-35ffe13be8b9" status: 202 len: 0 microversion: 2.1 time: 0.477002 May 19 08:19:42.741630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 632/1216] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:19:42 2022] DELETE /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments/86cc03c1-e0ba-419d-a7e0-35ffe13be8b9 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:19:42.751509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7eb84a0d-4af9-4a5a-aa7a-58062be5f33e tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211d550d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:42.878199 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7aaf18bc-209d-4977-beea-62b47587b3aa tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.599527 May 19 08:19:42.880027 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 585/1217] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:19:42 2022] GET /compute/v2.1/servers => generated 344 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:42.885755 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:42.892221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:42.903994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:42.904448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.905239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:42.909690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:42.989131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7eb84a0d-4af9-4a5a-aa7a-58062be5f33e tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.245303 May 19 08:19:42.990561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 633/1218] 10.222.0.78 () {58 vars in 1133 bytes} [Thu May 19 08:19:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:42.996571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-eddc42d8-3b5a-4de9-bbd8-2fd4fd947bbb req-9bc96264-90a7-471e-889b-49ee3da0aad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b32e99-5c8c-4efd-9ef6-c3dd50404b72", "name": "network-vif-unplugged", "status": "completed", "tag": "f21812b8-52c8-4373-b031-f62176b4522d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:43.008770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-eddc42d8-3b5a-4de9-bbd8-2fd4fd947bbb req-9bc96264-90a7-471e-889b-49ee3da0aad5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.010105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-eddc42d8-3b5a-4de9-bbd8-2fd4fd947bbb req-9bc96264-90a7-471e-889b-49ee3da0aad5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.025463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-eddc42d8-3b5a-4de9-bbd8-2fd4fd947bbb req-9bc96264-90a7-471e-889b-49ee3da0aad5 service nova] Creating event network-vif-unplugged:f21812b8-52c8-4373-b031-f62176b4522d for instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 on chh1-842464-2 May 19 08:19:43.033886 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-eddc42d8-3b5a-4de9-bbd8-2fd4fd947bbb req-9bc96264-90a7-471e-889b-49ee3da0aad5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041144 May 19 08:19:43.034763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 634/1219] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:43.042637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:43.043536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:43.053048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.053925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.055018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.055744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.567565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:43.584355 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f78a5eb5-4954-47b5-9dc2-19bdc5501307 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1540 microversion: 2.1 time: 0.702902 May 19 08:19:43.585401 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 586/1220] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:42 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1540 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:43.590276 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:43.594648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:43.607353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.611744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.612919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.613558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.725024 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-195e909f-71ec-48c3-8a60-957deffd1655 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134526 May 19 08:19:43.726280 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 587/1221] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:43 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:43.734041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:43.747601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:43.754021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Searching by: {'deleted': False, 'project_id': '36fdc1b726454b47a508f87d2af575d2'} {{(pid=119073) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:19:43.774201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.780005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.782627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:43.791646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:43.841881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:43.852720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:43.862272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:43.863529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-687a7daf-1c53-410c-ada3-f014a560d765 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.827452 May 19 08:19:43.881697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 635/1222] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:43 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:43.886966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63ff6fd6-721d-4063-bed5-28040a27c0ad tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211e1eb80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:44.075290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.multi_cell_list [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:19:44.135217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63ff6fd6-721d-4063-bed5-28040a27c0ad tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.252260 May 19 08:19:44.140283 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 636/1223] 10.222.0.78 () {58 vars in 1166 bytes} [Thu May 19 08:19:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:44.145659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:44.146277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:44.178453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:44.178952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:44.188854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:44.189973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:44.268805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:44.301804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:44.302130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:44.756721 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d535a594-d58c-4162-95b9-042c97ccd160 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 1.028953 May 19 08:19:44.757281 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 588/1224] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:19:43 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:44.776064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:44.784740 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:44.787294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:44.792862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98d5dd56-01a5-429d-85b6-1df42e0389b7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 200 len: 1529 microversion: 2.1 time: 0.651404 May 19 08:19:44.800784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 637/1225] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:44 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 1529 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:44.807557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:44.808259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:44.809241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:44.809853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:44.815074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-14cd875c-d597-41bc-91e7-28bdfa8bfe02 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211df7dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:44.859066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:44.859853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:44.860615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lazy-loading 'fault' on Instance uuid 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:44.983984 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-14cd875c-d597-41bc-91e7-28bdfa8bfe02 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.181064 May 19 08:19:44.986376 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 638/1226] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:19:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:44.993520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1d2dbdbb-4afc-433c-bbec-6cf6dfba73e6 req-2fd82746-80fb-4184-8922-0fd297cd4803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f10a9b7-7386-4d30-8a57-cef8d2c54c93", "name": "network-vif-deleted", "tag": "8cfaaf4e-31ee-45df-a83c-2f950cc1cd35"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:45.008847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1d2dbdbb-4afc-433c-bbec-6cf6dfba73e6 req-2fd82746-80fb-4184-8922-0fd297cd4803 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.011420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1d2dbdbb-4afc-433c-bbec-6cf6dfba73e6 req-2fd82746-80fb-4184-8922-0fd297cd4803 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.017698 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b90ec07f04c4d42a6ee0f0b508695b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71ecd42c62b541ac92b9154a285e284c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:45.030284 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-19454918-9b8c-4827-99d3-1d0e7bbf7fd6 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 200 len: 1306 microversion: 2.1 time: 0.255388 May 19 08:19:45.042726 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 589/1227] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:44 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 1306 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:45.048434 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.049333 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:45.056451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.057166 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.058698 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.059368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.064250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1d2dbdbb-4afc-433c-bbec-6cf6dfba73e6 req-2fd82746-80fb-4184-8922-0fd297cd4803 service nova] Creating event network-vif-deleted:8cfaaf4e-31ee-45df-a83c-2f950cc1cd35 for instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 on chh1-842464-2 May 19 08:19:45.075748 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:45.080778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1d2dbdbb-4afc-433c-bbec-6cf6dfba73e6 req-2fd82746-80fb-4184-8922-0fd297cd4803 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091653 May 19 08:19:45.088907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 639/1228] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:45.105149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.121472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:45.135744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.136578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.137631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.140369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.197353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f14e92d4-241b-4ae4-8710-44b947852730 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103252 May 19 08:19:45.198665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 640/1229] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:45.207252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb26f80f-71ab-4d03-8858-52ffb8902fb6 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.216463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb26f80f-71ab-4d03-8858-52ffb8902fb6 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016212 May 19 08:19:45.221682 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 641/1230] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:45.229751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.230782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:45.239782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.242323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.243454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.244058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.427615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:45.440339 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de488cb7-afef-4a00-8578-960b7175c075 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1472 microversion: 2.1 time: 0.396127 May 19 08:19:45.442470 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 590/1231] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:45.455540 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ef8f654c-3011-4a95-bf9d-fecba046c2a9 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211febf70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.552004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:45.568863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:45.570898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:45.572656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c1732908-7e93-4a56-97b6-02bd5994c837 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1569 microversion: 2.25 time: 0.349610 May 19 08:19:45.584018 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 642/1232] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1569 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:45.595979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-51882a28-fc8a-4e08-b2d6-96a6cc802b46 req-5a948c2e-1dd7-4dd3-aebe-aaa6838c5dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b32e99-5c8c-4efd-9ef6-c3dd50404b72", "name": "network-vif-deleted", "tag": "f21812b8-52c8-4373-b031-f62176b4522d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:45.617360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51882a28-fc8a-4e08-b2d6-96a6cc802b46 req-5a948c2e-1dd7-4dd3-aebe-aaa6838c5dea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.617813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51882a28-fc8a-4e08-b2d6-96a6cc802b46 req-5a948c2e-1dd7-4dd3-aebe-aaa6838c5dea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.621999 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ef8f654c-3011-4a95-bf9d-fecba046c2a9 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.176594 May 19 08:19:45.623890 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 591/1233] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:45.643830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a243f06e-035a-4757-83cd-238d4a2bd672 req-e4c5f61e-08c7-4ecb-9e0c-a7d289444504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "name": "network-vif-unplugged", "status": "completed", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:45.650310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a243f06e-035a-4757-83cd-238d4a2bd672 req-e4c5f61e-08c7-4ecb-9e0c-a7d289444504 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.650932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a243f06e-035a-4757-83cd-238d4a2bd672 req-e4c5f61e-08c7-4ecb-9e0c-a7d289444504 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.663431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-51882a28-fc8a-4e08-b2d6-96a6cc802b46 req-5a948c2e-1dd7-4dd3-aebe-aaa6838c5dea service nova] Creating event network-vif-deleted:f21812b8-52c8-4373-b031-f62176b4522d for instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 on chh1-842464-2 May 19 08:19:45.668912 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a243f06e-035a-4757-83cd-238d4a2bd672 req-e4c5f61e-08c7-4ecb-9e0c-a7d289444504 service nova] Creating event network-vif-unplugged:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:19:45.677431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [req-a243f06e-035a-4757-83cd-238d4a2bd672 req-e4c5f61e-08c7-4ecb-9e0c-a7d289444504 service nova] Instance 71559f46-8d38-4dbc-9a75-2f520a839868 is migrating within the same cell, copying events to all relevant hosts: {'chh2-842464-2'} {{(pid=119073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:19:45.680769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-51882a28-fc8a-4e08-b2d6-96a6cc802b46 req-5a948c2e-1dd7-4dd3-aebe-aaa6838c5dea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095061 May 19 08:19:45.681412 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 643/1234] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:45.692852 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a243f06e-035a-4757-83cd-238d4a2bd672 req-e4c5f61e-08c7-4ecb-9e0c-a7d289444504 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066958 May 19 08:19:45.697505 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 592/1235] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:45.705275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e3e7ff96-7df3-4dea-93fb-0a4236c310fc tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211f39f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.709929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.716704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:45.727357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.727695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.728485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.728927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.798692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:19:45.920101 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e3e7ff96-7df3-4dea-93fb-0a4236c310fc tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.221035 May 19 08:19:45.920816 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 593/1236] 10.222.0.78 () {58 vars in 1187 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:45.927944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.929755 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:45.959194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:45.961537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.962289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.963310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:45.963920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:45.987016 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:19:45.987445 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5833cadf-7198-4aee-a9ca-a0e016bac5bf tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 204 len: 0 microversion: 2.1 time: 0.291154 May 19 08:19:45.987945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 644/1237] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:45 2022] DELETE /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 HTTP/1.1 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '11b32e99-5c8c-4efd-9ef6-c3dd50404b72'} May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:45.991337 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:19:45.995474 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:45.996205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c4a2eab-55ea-4fdb-bf8b-4db78aced3a2 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] Calling method '.version_select at 0x7f3211d920d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:45.999698 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:46.002037 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-802c69d8-f20a-4a19-9264-d9192ef482fe tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 404 len: 111 microversion: 2.1 time: 0.080045 May 19 08:19:46.003642 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 594/1238] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:46.036761 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:46.037512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:46.061858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.062317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.063204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.068140 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.159803 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c4a2eab-55ea-4fdb-bf8b-4db78aced3a2 tempest-VolumesTestJSON-96846929 tempest-VolumesTestJSON-96846929-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.167260 May 19 08:19:46.160411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 645/1239] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:19:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:46.167201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:46.168687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:46.181683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.193026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.194133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.195458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.246536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 HTTP/1.1 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9f10a9b7-7386-4d30-8a57-cef8d2c54c93'} May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:46.248891 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8ec29c0-ed02-458d-a3ff-ca2b3a4c14ae tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 404 len: 111 microversion: 2.1 time: 0.090318 May 19 08:19:46.255018 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 646/1240] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:46 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:46.262625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2015899947", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:46.361697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:46.372614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] validate_networks() for [('220be69f-b0ca-49aa-856a-990da7941ef6', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:19:46.375160 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a47ef7a7-3a0c-46ab-b6b4-5f980a052621 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1610 microversion: 2.1 time: 0.370108 May 19 08:19:46.375812 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 595/1241] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:46 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1610 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:46.394777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:46.395992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:46.412974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.413459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.414252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.414692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.520123 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6845a90d-38ed-495d-8104-d160e5a3da9b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138857 May 19 08:19:46.535860 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 596/1242] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:46 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:46.541428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1918086595", "metadata": {"image_type": "test"}}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:46.542543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:46.556933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.562529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.563580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.564039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.608455 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93/action HTTP/1.1 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 112 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1918086595", "metadata": {"image_type": "test"}}} May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '9f10a9b7-7386-4d30-8a57-cef8d2c54c93', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1918086595', 'metadata': {'image_type': 'test'}}}} May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:19:46.611545 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:46.615627 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de41f382-8dcf-4c53-9479-4da20aa750d2 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "POST /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93/action" status: 404 len: 111 microversion: 2.1 time: 0.075771 May 19 08:19:46.622147 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 597/1243] 10.222.0.78 () {60 vars in 1278 bytes} [Thu May 19 08:19:46 2022] POST /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:46.633696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:46.634328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:46.644374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.645115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:46.646115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:46.646719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.156307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:19:47.157448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:19:47.158620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:19:47.159247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:19:47.159668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:19:47.175869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.179082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.180169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.182582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.194744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:47.209919 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9c82b733-6069-4ee2-ba6a-0f1cacefb5f6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1469 microversion: 2.1 time: 0.586518 May 19 08:19:47.217884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:47.222951 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 598/1244] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:46 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1469 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:47.229791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:47.230705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:47.239041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.239742 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.240706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.241448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.242825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for project d36e395d75dd44ce8e9852bb61c14193. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:19:47.259015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Getting quotas for user ec18a0cd947847b6a084c3eed533e74e and project d36e395d75dd44ce8e9852bb61c14193. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:19:47.289125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:19:47.294002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:19:47.423027 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8fdd44aa-8957-4508-b00a-0025ff58d771 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.168027 May 19 08:19:47.426401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 647/1245] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:19:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:19:47.437509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-483e8be5-b03f-4985-b033-344bcef50b7a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1189932505", "metadata": {"image_type": "test"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:47.443635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-483e8be5-b03f-4985-b033-344bcef50b7a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Failed to fetch instance by id tempest-invalid-620242708 {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:19:47.444736 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-483e8be5-b03f-4985-b033-344bcef50b7a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance tempest-invalid-620242708 could not be found. May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-483e8be5-b03f-4985-b033-344bcef50b7a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/tempest-invalid-620242708/action HTTP/1.1 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 112 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1189932505", "metadata": {"image_type": "test"}}} May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance tempest-invalid-620242708 could not be found. May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'tempest-invalid-620242708', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1189932505', 'metadata': {'image_type': 'test'}}}} May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-620242708 could not be found. May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:47.456723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-620242708 could not be found. May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-620242708 could not be found. May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-483e8be5-b03f-4985-b033-344bcef50b7a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance tempest-invalid-620242708 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:47.460951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-483e8be5-b03f-4985-b033-344bcef50b7a tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "POST /compute/v2.1/servers/tempest-invalid-620242708/action" status: 404 len: 100 microversion: 2.1 time: 0.030634 May 19 08:19:47.473865 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 648/1246] 10.222.0.78 () {60 vars in 1245 bytes} [Thu May 19 08:19:47 2022] POST /compute/v2.1/servers/tempest-invalid-620242708/action => generated 100 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:47.487087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:47.487643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:47.505899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.506623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.507438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.507882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.561731 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:47.572237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:47.582908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:47.585461 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fe6e71ad-d0c5-43ed-9f54-a606b010d8c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1559 microversion: 2.25 time: 0.361357 May 19 08:19:47.587271 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 599/1247] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:47 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1559 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:47.598202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:47.599268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:47.629913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.629913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.629913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.629913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.632233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.632233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.632233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:47.632233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:47.730958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:19:47.742388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for user f40ef4d25a474b3c83a3c2808a87a30d and project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:19:47.918906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:48.015105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96c38685-a659-40b4-b7d3-36f702e75147 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868/action" status: 202 len: 0 microversion: 2.1 time: 0.539806 May 19 08:19:48.015922 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 649/1248] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:19:47 2022] POST /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:19:48.047164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bb351fc-ac78-4197-8d40-058acc538c94 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:48.050264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2bb351fc-ac78-4197-8d40-058acc538c94 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:48.790571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:48.800364 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4d664bc0-26d3-420f-a64c-6914e3b25bc8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1610 microversion: 2.1 time: 1.211273 May 19 08:19:48.807201 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 600/1249] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:47 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1610 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:48.821498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0e2a80b2-7807-44dc-a8f0-db6e9be28057 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-367157878"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:48.824754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0e2a80b2-7807-44dc-a8f0-db6e9be28057 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:19:48.827941 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-0e2a80b2-7807-44dc-a8f0-db6e9be28057 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0e2a80b2-7807-44dc-a8f0-db6e9be28057 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 56 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: {"createImage": {"name": "tempest-test-snap-367157878"}} May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-367157878'}}} May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:48.832107 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:48.837571 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:48.842325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0e2a80b2-7807-44dc-a8f0-db6e9be28057 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:48.845725 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0e2a80b2-7807-44dc-a8f0-db6e9be28057 tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.036469 May 19 08:19:48.847715 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 601/1250] 10.222.0.78 () {60 vars in 1274 bytes} [Thu May 19 08:19:48 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:48.862251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2bb351fc-ac78-4197-8d40-058acc538c94 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:48.864317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:48.866309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:48.911361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:48.911822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:48.912620 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:48.913060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:48.927696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2bb351fc-ac78-4197-8d40-058acc538c94 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1225 microversion: 2.1 time: 0.909541 May 19 08:19:48.938347 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 650/1251] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:48 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1225 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:48.987782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04fe09f4-24dd-4853-b260-aee5e111d913 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '.version_select at 0x7f3211ebcaf0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:48.990772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04fe09f4-24dd-4853-b260-aee5e111d913 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:48.992169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04fe09f4-24dd-4853-b260-aee5e111d913 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.003272 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2ca96d9c-6ba8-41cd-9d36-797c8e73f560 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150656 May 19 08:19:49.004096 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 602/1252] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:48 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:49.005624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04fe09f4-24dd-4853-b260-aee5e111d913 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2962 microversion: 2.25 time: 0.055058 May 19 08:19:49.006593 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 651/1253] 10.222.0.78 () {60 vars in 1183 bytes} [Thu May 19 08:19:48 2022] GET /compute/v2.1/os-migrations => generated 2962 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:49.008842 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:49.015292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:49.020518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fed63787-4a37-4705-a6c0-e1e844c524be tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1356061336"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:49.025792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fed63787-4a37-4705-a6c0-e1e844c524be tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:19:49.027521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.028000 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-fed63787-4a37-4705-a6c0-e1e844c524be tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fed63787-4a37-4705-a6c0-e1e844c524be tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 57 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: {"createImage": {"name": "tempest-test-snap-1356061336"}} May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1356061336'}}} May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:49.033335 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fed63787-4a37-4705-a6c0-e1e844c524be tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:49.038304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fed63787-4a37-4705-a6c0-e1e844c524be tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.026469 May 19 08:19:49.039837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.040839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.041472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.045605 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 652/1254] 10.222.0.78 () {60 vars in 1280 bytes} [Thu May 19 08:19:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:49.056134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:49.057899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:49.074964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.075431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.076225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.076694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.810372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:49.820850 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ff083ec3-12d4-4428-b048-b25a31b93ade tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1468 microversion: 2.1 time: 0.815607 May 19 08:19:49.827335 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 603/1255] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:49 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1468 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:49.833091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:49.837927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:49.842140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 3328b332-2732-47e8-a2df-098724caaa6a {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:19:49.852515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.853197 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.854171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.854611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.863954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36738e23-e2b8-41aa-8117-b61e6ab148a2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 2052 microversion: 2.25 time: 0.817159 May 19 08:19:49.882055 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 653/1256] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:49 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 2052 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:49.883751 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 HTTP/1.1 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '9f10a9b7-7386-4d30-8a57-cef8d2c54c93'} May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:49.885530 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:49.889869 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:19:49.892796 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:49.900123 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-63300c40-d06f-418c-a743-7324d0341d1b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 404 len: 111 microversion: 2.1 time: 0.071565 May 19 08:19:49.901170 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 604/1257] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:19:49 2022] DELETE /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:49.906512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:49.909808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5536164e-3c7c-40db-895a-73b998616248 req-06ba9c3e-794b-41bb-b502-2a5fb7cc79b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "name": "network-vif-plugged", "status": "completed", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:49.910997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:49.928830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.929382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.930171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.930603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:49.963889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5536164e-3c7c-40db-895a-73b998616248 req-06ba9c3e-794b-41bb-b502-2a5fb7cc79b5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:49.965568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5536164e-3c7c-40db-895a-73b998616248 req-06ba9c3e-794b-41bb-b502-2a5fb7cc79b5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.005924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5536164e-3c7c-40db-895a-73b998616248 req-06ba9c3e-794b-41bb-b502-2a5fb7cc79b5 service nova] Creating event network-vif-plugged:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:19:50.021031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-5536164e-3c7c-40db-895a-73b998616248 req-06ba9c3e-794b-41bb-b502-2a5fb7cc79b5 service nova] Instance 71559f46-8d38-4dbc-9a75-2f520a839868 is migrating within the same cell, copying events to all relevant hosts: {'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:19:50.035603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5536164e-3c7c-40db-895a-73b998616248 req-06ba9c3e-794b-41bb-b502-2a5fb7cc79b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148365 May 19 08:19:50.039413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 654/1258] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:50.055843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:50.056791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] [instance: 9f10a9b7-7386-4d30-8a57-cef8d2c54c93] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:50.073173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:50.075974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.077193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:50.081065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.124885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] HTTP exception thrown: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Request method failure captured: May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 HTTP/1.1 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2DCrzaBHKNHuJ70twPFoH5yDEP03IjyYnq_wrpALMlnzfR73q_ETJ9kbFeHXXTCrVQY0opSIZ_Pudek5NPRJswwB4Ly0myFAfiUUwUgGyP1RnDFYX2M6X1mLJqhZ9YrQKlv6yGHCKoXJSxa2jhCBQdIOMl4i81drV_HudzoaRRjVk May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/71ecd42c62b541ac92b9154a285e284c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 71ecd42c62b541ac92b9154a285e284c May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1316304079 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6b90ec07f04c4d42a6ee0f0b508695b1 May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesNegativeTestJSON-1316304079-project May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9f10a9b7-7386-4d30-8a57-cef8d2c54c93'} May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:19:50.130843 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. May 19 08:19:50.135461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:19:50.140990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] Returning 404 to user: Instance 9f10a9b7-7386-4d30-8a57-cef8d2c54c93 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:19:50.143665 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1866ad9-e4e5-47ad-9a61-3bcf0b217a2b tempest-ImagesNegativeTestJSON-1316304079 tempest-ImagesNegativeTestJSON-1316304079-project] 10.222.0.78 "GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93" status: 404 len: 111 microversion: 2.1 time: 0.101848 May 19 08:19:50.144478 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 655/1259] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:50 2022] GET /compute/v2.1/servers/9f10a9b7-7386-4d30-8a57-cef8d2c54c93 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:19:50.155165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:50.158276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:50.173161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:50.175140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.179055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:50.180069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.366763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:50.390659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1787f1c-8945-4869-81d0-d2d586e47f3a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1283 microversion: 2.1 time: 0.243928 May 19 08:19:50.391642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 656/1260] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:50 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:50.408186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:50.409450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:50.427760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:50.428463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.429787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:50.430534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:50.551840 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47cce0af-e18b-4095-a523-f166374bcd9d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158824 May 19 08:19:50.553077 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 657/1261] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:50 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:50.586116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-782426447", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:50.691813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] validate_networks() for [('b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:19:50.716416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:50.737379 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-90253476-c4cb-4fd1-b422-add0d88276c8 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1610 microversion: 2.1 time: 0.834496 May 19 08:19:50.745216 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 605/1262] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:49 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1610 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:51.127514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-74940557-6de0-4635-bea1-533623bafb88 tempest-ListImagesTestJSON-2000520327 tempest-ListImagesTestJSON-2000520327-project] Calling method '.version_select at 0x7f32121b0280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:51.211749 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-74940557-6de0-4635-bea1-533623bafb88 tempest-ListImagesTestJSON-2000520327 tempest-ListImagesTestJSON-2000520327-project] 10.222.0.78 "GET /compute/v2.1/images/666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff" status: 200 len: 784 microversion: 2.1 time: 0.465106 May 19 08:19:51.215555 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 606/1263] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:19:50 2022] GET /compute/v2.1/images/666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff => generated 784 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:51.228203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:51.229093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:51.246712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:51.247446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:51.249076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:51.249719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.328210 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:52.346288 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-25ad178b-cb6a-4eed-8b04-8b1474fccb8f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1468 microversion: 2.1 time: 1.129207 May 19 08:19:52.346895 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 607/1264] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:51 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1468 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:52.354051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8a129988-7dc1-499e-8f5c-e44a76503fa3 tempest-ListImagesTestJSON-2000520327 tempest-ListImagesTestJSON-2000520327-project] Calling method '.version_select at 0x7f32120f6af0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:52.506491 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8a129988-7dc1-499e-8f5c-e44a76503fa3 tempest-ListImagesTestJSON-2000520327 tempest-ListImagesTestJSON-2000520327-project] 10.222.0.78 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.156502 May 19 08:19:52.507111 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 608/1265] 10.222.0.78 () {58 vars in 1121 bytes} [Thu May 19 08:19:52 2022] GET /compute/v2.1/images => generated 445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:52.512812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:52.517930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:52.526519 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:52.530348 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.540779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:52.543925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.625738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:19:52.626892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:19:52.627676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:19:52.628292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:19:52.628938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:19:52.666948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:52.673186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.674903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:52.675341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.739979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:19:52.770128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for user 024724b24b274d7db1c43874767de143 and project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:19:52.814349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:19:52.816757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:19:52.893873 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20fe8120-7b95-40d2-b2f6-b25e24f9326d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.339637 May 19 08:19:52.895251 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 658/1266] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:19:52.900995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:52.902924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:52.912034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:52.912853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.913918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:52.914519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:52.997193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48e7f859-c58b-4d62-806b-0f56a995fa12 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099839 May 19 08:19:52.997862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 659/1267] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:52 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:53.018476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:53.019852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:53.041897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:53.043241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:53.045929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:53.052773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:53.601516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:53.614417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e4040d9-5a3d-4490-bb8d-ec83de5750b1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1543 microversion: 2.1 time: 0.614863 May 19 08:19:53.615002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 660/1268] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:52 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1543 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:53.629434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8de4144d-0463-4cd9-8163-13b359158050 tempest-ListImagesTestJSON-2000520327 tempest-ListImagesTestJSON-2000520327-project] Calling method '.version_select at 0x7f3211fcd700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:53.762763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8de4144d-0463-4cd9-8163-13b359158050 tempest-ListImagesTestJSON-2000520327 tempest-ListImagesTestJSON-2000520327-project] 10.222.0.78 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.146729 May 19 08:19:53.763645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 661/1269] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:19:53 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:53.775212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:53.775823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:53.790160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:53.790612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:53.791400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:53.791835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:53.880651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:53.899744 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b79aa3ec-7e70-4c68-80df-759f3e3b5dcc tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 1.391252 May 19 08:19:53.900528 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 609/1270] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:52 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:53.912177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:53.912980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:53.930779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:53.931603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:53.944743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:53.945687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:53.947150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:53.981641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:54.001203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:54.011498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:54.015103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c7cb9e1-45b3-4578-aff5-eca5e62cd427 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1265 microversion: 2.25 time: 0.250351 May 19 08:19:54.015912 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 662/1271] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:53 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:54.030178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:54.033011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:54.050483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.053441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:54.057088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.059376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:54.133212 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef648cd8-d8dc-4eeb-8568-1c0b7be2f11b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112708 May 19 08:19:54.144407 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 663/1272] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:54 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:54.262294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:54.619711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-48cc779e-6f85-4d36-8907-8e1bbfb6c5c3 req-3fe3dad8-f351-4fb9-a1e4-88afbbf5099b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d39a76-db81-4bb9-9e41-4e434ef59341", "name": "network-vif-deleted", "tag": "4a11627b-afc0-4edd-a386-a6068f747e6a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:54.639317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-48cc779e-6f85-4d36-8907-8e1bbfb6c5c3 req-3fe3dad8-f351-4fb9-a1e4-88afbbf5099b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.639978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-48cc779e-6f85-4d36-8907-8e1bbfb6c5c3 req-3fe3dad8-f351-4fb9-a1e4-88afbbf5099b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:54.693100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-48cc779e-6f85-4d36-8907-8e1bbfb6c5c3 req-3fe3dad8-f351-4fb9-a1e4-88afbbf5099b service nova] Creating event network-vif-deleted:4a11627b-afc0-4edd-a386-a6068f747e6a for instance 24d39a76-db81-4bb9-9e41-4e434ef59341 on chh2-842464-2 May 19 08:19:54.698387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:54.700416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-48cc779e-6f85-4d36-8907-8e1bbfb6c5c3 req-3fe3dad8-f351-4fb9-a1e4-88afbbf5099b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084368 May 19 08:19:54.702659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 664/1273] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:54.722122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:54.723108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:54.737708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.740966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:54.742011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.742637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:54.783712 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8bb0974c-f5b9-4f5b-ad76-1e062ef70e66 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1468 microversion: 2.1 time: 0.879543 May 19 08:19:54.807297 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 610/1274] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:53 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1468 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:54.900678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:54.909001 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21b7a47f-d68d-430b-9163-7db5ba84795c tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1543 microversion: 2.1 time: 0.205131 May 19 08:19:54.909631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 665/1275] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:54 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1543 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:54.923591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:54.924374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:54.935536 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.935979 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:54.936752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:54.956542 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:55.033536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:55.034223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:55.042732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:55.043178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:55.043974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:55.065878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:55.369191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:55.380919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:55.384303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:55.387626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7ddd614-812d-4d2c-be61-1f64de67ed17 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1313 microversion: 2.25 time: 0.356071 May 19 08:19:55.388259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 666/1276] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:55 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:55.411035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:55.418992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:55.430489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:55.444450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:55.445589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:55.446189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:55.542919 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-739afc55-ba58-45b7-a18c-614e35aaebee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143924 May 19 08:19:55.543431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 667/1277] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:55 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:55.819730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:55.820741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:55.851309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:55.852239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:55.854895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:55.859288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.117574 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:56.140742 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-05c6517e-877f-4b08-bf9a-6ad8522acbf8 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 1.223100 May 19 08:19:56.155085 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 611/1278] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:54 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:56.179517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:56.180491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:56.200736 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:56.202018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.203366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:56.207475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.621325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:56.639619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f312ec35-9892-4ecb-9a73-6a608ae502bb tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1534 microversion: 2.1 time: 0.828349 May 19 08:19:56.640427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 668/1279] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:55 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1534 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:56.651417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e63cd268-1cde-49d2-8e04-e646853ce1e0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211e6ec10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:56.756011 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e63cd268-1cde-49d2-8e04-e646853ce1e0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/faaddad8-68b7-4c27-8442-9a01485c0a54" status: 200 len: 660 microversion: 2.1 time: 0.114208 May 19 08:19:56.756930 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 669/1280] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:19:56 2022] GET /compute/v2.1/images/faaddad8-68b7-4c27-8442-9a01485c0a54 => generated 660 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:56.770274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:56.773811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:56.788235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:56.789405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.792676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:56.793628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.803578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:56.826712 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-af5d815f-d4ad-4315-b68e-6a0229cec4ee tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.661309 May 19 08:19:56.827688 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 612/1281] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:56 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:56.839960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:56.841140 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:56.858283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:56.858730 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.859638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:56.860750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:56.942302 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9ef5190e-58f1-45bd-a080-de347ca55364 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110555 May 19 08:19:56.943225 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 613/1282] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:56 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:56.947745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-24ea874d-6b95-4c84-a6e6-c0eac8fbd3eb tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f394c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:57.012832 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-24ea874d-6b95-4c84-a6e6-c0eac8fbd3eb tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/faaddad8-68b7-4c27-8442-9a01485c0a54" status: 200 len: 660 microversion: 2.1 time: 0.068475 May 19 08:19:57.014010 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 614/1283] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:19:56 2022] GET /compute/v2.1/images/faaddad8-68b7-4c27-8442-9a01485c0a54 => generated 660 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:57.043526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:57.061599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:57.063335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:57.064676 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4337f6e9-1d93-4ab9-bb1a-8a2d4e7d33bd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1319 microversion: 2.25 time: 0.305309 May 19 08:19:57.073520 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 670/1284] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:56 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:57.160602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:57.161941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:57.168456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:57.169365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:57.170361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:57.171000 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:57.174594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:57.658945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:57.660182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:57.676109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:57.677878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:57.686507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:57.687265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:57.745398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:57.757385 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b3ae91be-4687-41ca-89a2-d386cabfe358 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 0.599829 May 19 08:19:57.759375 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 615/1285] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:57 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:57.843773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:57.844863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:57.857899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:57.858571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:57.859721 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:57.862954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.095226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:58.107235 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b8ddd71e-d706-44e8-b292-c30f088fa052 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.266856 May 19 08:19:58.107844 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 616/1286] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:57 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:58.124476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:58.130575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:58.141520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.142606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.144986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.145801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.293878 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-323712cd-17e0-40c6-b54b-09c439ffc399 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184734 May 19 08:19:58.294559 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 617/1287] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:58 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:58.306650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:58.307271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:58.324838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.334032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.337871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.337871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.349873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:58.365887 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b23e868-8a61-45d5-acd6-98666977ee11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1534 microversion: 2.1 time: 0.712480 May 19 08:19:58.375817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 671/1288] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:57 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1534 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:19:58.381444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b5b43d8a-59d8-489b-b0fe-a840b990ed7f req-f25acfa3-7b7e-4a95-9308-4eb5a9c12b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8192ded0-5bdd-4cf0-aaa0-d64e78cb1642", "tag": "83e5442f-ab25-46f3-a93e-e3533c69077d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:58.402915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b5b43d8a-59d8-489b-b0fe-a840b990ed7f req-f25acfa3-7b7e-4a95-9308-4eb5a9c12b98 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.403358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b5b43d8a-59d8-489b-b0fe-a840b990ed7f req-f25acfa3-7b7e-4a95-9308-4eb5a9c12b98 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.436290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b5b43d8a-59d8-489b-b0fe-a840b990ed7f req-f25acfa3-7b7e-4a95-9308-4eb5a9c12b98 service nova] Creating event network-changed:83e5442f-ab25-46f3-a93e-e3533c69077d for instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 on chh1-842464-2 May 19 08:19:58.463790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b5b43d8a-59d8-489b-b0fe-a840b990ed7f req-f25acfa3-7b7e-4a95-9308-4eb5a9c12b98 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086528 May 19 08:19:58.464396 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 672/1289] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:58.615683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:58.623789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:58.625271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:58.626443 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d1f65635-7972-4f54-8868-ac6d1cbf2c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1319 microversion: 2.25 time: 0.327291 May 19 08:19:58.627009 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 618/1290] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:58 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:19:58.778197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:58.779019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:58.815799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.816257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.817191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:58.821976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:58.833593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:19:58.842066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4f25b1d2-5e19-45a6-9c8f-9fff7039ecc2 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211febe50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:58.913110 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4f25b1d2-5e19-45a6-9c8f-9fff7039ecc2 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/ce2e3124-2e6a-42e1-ac51-6800d4b17253" status: 200 len: 661 microversion: 2.1 time: 0.076342 May 19 08:19:58.913998 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 619/1291] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:19:58 2022] GET /compute/v2.1/images/ce2e3124-2e6a-42e1-ac51-6800d4b17253 => generated 661 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:59.095751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-35191023-d841-414c-a27f-39a538d2e760 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211f39550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-458384784", "description": "tempest-description-2084453421"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:59.312222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:59.327075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd0c1cd0-31a1-4523-8358-499ed0033e5d tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 0.553987 May 19 08:19:59.332207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 673/1292] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:58 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:59.343022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dca14fef-741b-4e76-bd09-425a4c7a151f tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211dbce50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:59.404929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dca14fef-741b-4e76-bd09-425a4c7a151f tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/ce2e3124-2e6a-42e1-ac51-6800d4b17253" status: 200 len: 661 microversion: 2.1 time: 0.071276 May 19 08:19:59.412291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 674/1293] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:19:59 2022] GET /compute/v2.1/images/ce2e3124-2e6a-42e1-ac51-6800d4b17253 => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:59.423514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:59.424829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:59.468825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.469284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.475543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.476285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.634490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:59.648443 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-35191023-d841-414c-a27f-39a538d2e760 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.733180 May 19 08:19:59.663018 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 620/1294] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:19:58 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:59.673514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e12f1892-c193-426b-8393-a00b55af6852 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.263205 May 19 08:19:59.674130 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 675/1295] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:59 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:59.674666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:59.676237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:59.687316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.689106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:59.689448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.689772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:59.691073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.691645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.697547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.698280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.699071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.699768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.724517 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-92074d7c-6655-4fe9-abcb-b6cb9f61b93a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060029 May 19 08:19:59.725735 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 621/1296] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:19:59 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:59.730662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9301357e-29cd-4492-852b-dce95eafe1b2 req-a7406d9c-d4aa-4ebe-b82c-66d1d93a0965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "name": "network-vif-unplugged", "status": "completed", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:19:59.740353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9301357e-29cd-4492-852b-dce95eafe1b2 req-a7406d9c-d4aa-4ebe-b82c-66d1d93a0965 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.741064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9301357e-29cd-4492-852b-dce95eafe1b2 req-a7406d9c-d4aa-4ebe-b82c-66d1d93a0965 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.758963 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9301357e-29cd-4492-852b-dce95eafe1b2 req-a7406d9c-d4aa-4ebe-b82c-66d1d93a0965 service nova] Creating event network-vif-unplugged:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:19:59.765283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [req-9301357e-29cd-4492-852b-dce95eafe1b2 req-a7406d9c-d4aa-4ebe-b82c-66d1d93a0965 service nova] Instance 71559f46-8d38-4dbc-9a75-2f520a839868 is migrating within the same cell, copying events to all relevant hosts: {'chh2-842464-2'} {{(pid=119073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:19:59.775690 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9301357e-29cd-4492-852b-dce95eafe1b2 req-a7406d9c-d4aa-4ebe-b82c-66d1d93a0965 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048491 May 19 08:19:59.777531 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 622/1297] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:19:59.785886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:19:59.786915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:19:59.795230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.795987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.796965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:19:59.798188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:19:59.882759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:19:59.895613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87259ba5-0dae-4abe-ab0a-23b87155fcf0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1534 microversion: 2.1 time: 0.211184 May 19 08:19:59.897685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 676/1298] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:19:59 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1534 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:19:59.913923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c35d19e0-0555-4873-808a-717727cd9824 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211dbce50>, body: {"security_group_rule": {"parent_group_id": "0c88d2c3-94f6-45da-bac2-4bbe39577112", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:00.005649 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:00.016901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:00.019084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:00.020863 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3acb86d7-97a6-4250-aed6-36d9be178fbe tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1361 microversion: 2.25 time: 0.241966 May 19 08:20:00.022280 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 623/1299] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:19:59 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:00.179497 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c35d19e0-0555-4873-808a-717727cd9824 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.280258 May 19 08:20:00.182542 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 677/1300] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:19:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:00.193221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc4803c2-7e77-4596-925e-d0a1a235f985 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211febe50>, body: {"security_group_rule": {"parent_group_id": "0c88d2c3-94f6-45da-bac2-4bbe39577112", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:00.256425 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-fc4803c2-7e77-4596-925e-d0a1a235f985 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: This rule already exists in group 0c88d2c3-94f6-45da-bac2-4bbe39577112 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc4803c2-7e77-4596-925e-d0a1a235f985 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 138 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: {"security_group_rule": {"parent_group_id": "0c88d2c3-94f6-45da-bac2-4bbe39577112", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: exception: This rule already exists in group 0c88d2c3-94f6-45da-bac2-4bbe39577112 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0c88d2c3-94f6-45da-bac2-4bbe39577112', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0c88d2c3-94f6-45da-bac2-4bbe39577112 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0c88d2c3-94f6-45da-bac2-4bbe39577112 May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:00.258056 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0c88d2c3-94f6-45da-bac2-4bbe39577112 May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc4803c2-7e77-4596-925e-d0a1a235f985 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 400 to user: This rule already exists in group 0c88d2c3-94f6-45da-bac2-4bbe39577112 {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc4803c2-7e77-4596-925e-d0a1a235f985 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.070150 May 19 08:20:00.266903 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 624/1301] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:00 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 08:20:00.274855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b31d8e86-ba0d-4e8a-a9fe-3fb04a3f53d9 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211d569d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:00.349150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:00.350726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:00.361035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:00.362074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:00.364096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:00.365445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.334356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:01.348528 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e342b0ec-2eac-4ce2-8a57-72a6813f44d7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 1.005154 May 19 08:20:01.349137 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 625/1302] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:00 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:01.363814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:01.364771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:01.371776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.372537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.373514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.374199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.587742 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b31d8e86-ba0d-4e8a-a9fe-3fb04a3f53d9 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/b85a324b-f95f-4f38-997f-d53144deaf74" status: 202 len: 0 microversion: 2.1 time: 1.317604 May 19 08:20:01.589249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 678/1303] 10.222.0.78 () {58 vars in 1286 bytes} [Thu May 19 08:20:00 2022] DELETE /compute/v2.1/os-security-group-rules/b85a324b-f95f-4f38-997f-d53144deaf74 => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:01.596966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:01.600005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:01.602530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:01.614715 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e908504b-dc60-4021-8b71-4525716e5e7d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.251102 May 19 08:20:01.617078 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 626/1304] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:01 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:01.626929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fed538ff-8caa-4e70-9c84-51aac93339bf tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212114ca0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:01.630941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.635266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.639423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.640090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.707277 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fed538ff-8caa-4e70-9c84-51aac93339bf tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c2403744-668d-4750-831a-59a57e63cff3" status: 200 len: 661 microversion: 2.1 time: 0.088402 May 19 08:20:01.709158 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 627/1305] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:01 2022] GET /compute/v2.1/images/c2403744-668d-4750-831a-59a57e63cff3 => generated 661 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:01.725466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:01.726942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f700332a-c613-4d2b-a4d2-62cc1fa956f8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136199 May 19 08:20:01.728060 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 679/1306] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:20:01 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:20:01.730718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:01.737563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:01.739427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:01.747168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.749501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.750525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.752476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.754304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.756241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:01.758239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:01.760199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:02.528847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:02.538909 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f3a5087d-4ca8-473e-a6d9-5871ef8d7938 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1527 microversion: 2.1 time: 0.827846 May 19 08:20:02.544810 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 628/1307] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:01 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1527 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:02.551126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fded7885-8b19-48a3-80af-b10e7dc7990b tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211feb670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1006776188", "description": "tempest-description-1502214349"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:02.560675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:02.586493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:02.589294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:02.589979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea69b7a6-1204-47ea-924f-6c6933404ccf tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1361 microversion: 2.25 time: 0.860015 May 19 08:20:02.601877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 680/1308] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:01 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1361 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:02.607125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-039920cd-9444-4ea9-8ab6-cba35d165a4b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d295e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:02.664655 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-039920cd-9444-4ea9-8ab6-cba35d165a4b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c2403744-668d-4750-831a-59a57e63cff3" status: 200 len: 661 microversion: 2.1 time: 0.061239 May 19 08:20:02.667032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 681/1309] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:02 2022] GET /compute/v2.1/images/c2403744-668d-4750-831a-59a57e63cff3 => generated 661 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:02.699570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:02.707916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:02.717287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:02.739831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:02.740288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:02.741089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:02.741559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:02.821601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:03.192842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:03.211429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-693f8988-3f8b-4eb5-806e-9246426db36a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 0.543061 May 19 08:20:03.224513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 682/1310] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:02 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:03.232179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:03.234717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:03.252839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:03.254983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:03.258391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:03.259570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:03.573914 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fded7885-8b19-48a3-80af-b10e7dc7990b tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.027341 May 19 08:20:03.574777 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 629/1311] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:20:02 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:03.587988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:03.588894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:03.614076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:03.614531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:03.615317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:03.615754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:03.834095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:03.843401 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d2eca80c-5146-4c70-b0c8-21fbe201a017 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.259609 May 19 08:20:03.856836 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 630/1312] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:03 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:03.862911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1420982893", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:04.020062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:20:04.094208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:04.113176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccc53143-177d-43f5-ad9a-c31d974107ce tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1527 microversion: 2.1 time: 0.886571 May 19 08:20:04.115778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 683/1313] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:03 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1527 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:04.125150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-504838e2-4f13-43fb-a382-47fddfce536d req-4072efcb-2928-44fa-8ac1-3a68fad371c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59435f3-2190-4c2e-9a1f-3867ed3a0735", "tag": "e69c3e55-7457-4d7f-a710-f82f4c5fe599"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:04.154723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-504838e2-4f13-43fb-a382-47fddfce536d req-4072efcb-2928-44fa-8ac1-3a68fad371c2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:04.161714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-504838e2-4f13-43fb-a382-47fddfce536d req-4072efcb-2928-44fa-8ac1-3a68fad371c2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:04.191578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-504838e2-4f13-43fb-a382-47fddfce536d req-4072efcb-2928-44fa-8ac1-3a68fad371c2 service nova] Creating event network-changed:e69c3e55-7457-4d7f-a710-f82f4c5fe599 for instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 on chh2-842464-2 May 19 08:20:04.198160 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-504838e2-4f13-43fb-a382-47fddfce536d req-4072efcb-2928-44fa-8ac1-3a68fad371c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079909 May 19 08:20:04.199130 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 684/1314] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:04.212569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a65d766-ff32-499b-b6b4-5a7d729d9094 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211df7430>, body: {"security_group_rule": {"parent_group_id": "62375d75-43b6-4bd8-9ea8-08c7f1a5258f", "ip_protocol": "tcp", "from_port": 347634276, "to_port": 22}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:04.472621 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9a65d766-ff32-499b-b6b4-5a7d729d9094 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Invalid port range 347634276:22. Former value cannot be greater than the later May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a65d766-ff32-499b-b6b4-5a7d729d9094 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 145 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: {"security_group_rule": {"parent_group_id": "62375d75-43b6-4bd8-9ea8-08c7f1a5258f", "ip_protocol": "tcp", "from_port": 347634276, "to_port": 22}} May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid port range 347634276:22. Former value cannot be greater than the later May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'security_group_rule': {'parent_group_id': '62375d75-43b6-4bd8-9ea8-08c7f1a5258f', 'ip_protocol': 'tcp', 'from_port': 347634276, 'to_port': 22}}} May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 347634276:22. Former value cannot be greater than the later May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 347634276:22. Former value cannot be greater than the later May 19 08:20:04.474947 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 347634276:22. Former value cannot be greater than the later May 19 08:20:04.480101 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:04.483281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a65d766-ff32-499b-b6b4-5a7d729d9094 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 400 to user: Invalid port range 347634276:22. Former value cannot be greater than the later {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:04.485257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a65d766-ff32-499b-b6b4-5a7d729d9094 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.282202 May 19 08:20:04.487019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 685/1315] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:04 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:20:04.495545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:04.498010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:04.520860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:04.524023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:04.532812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:04.532812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:04.693786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:20:04.694388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:20:04.694771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:20:04.695181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:20:04.696055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:20:04.725153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:04.725899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:04.727727 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:04.728686 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:04.772515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Getting quotas for project f2e7072c37ad4f5383d767905c98c9bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:20:04.780078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Getting quotas for user 5cb3f20962a948f2ab2f403bb1d9680c and project f2e7072c37ad4f5383d767905c98c9bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:20:04.811349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:20:04.823971 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:20:04.904998 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc382deb-9926-4c13-9056-2eeca8b264b6 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042035 May 19 08:20:04.908637 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 631/1316] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:20:04.934918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-8381b5c7-9a63-4650-a2b0-4e5d4cd92ab7 req-23396740-bd63-45e0-978c-ea926a30c239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "name": "network-vif-plugged", "status": "completed", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:04.962379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8381b5c7-9a63-4650-a2b0-4e5d4cd92ab7 req-23396740-bd63-45e0-978c-ea926a30c239 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:04.964897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8381b5c7-9a63-4650-a2b0-4e5d4cd92ab7 req-23396740-bd63-45e0-978c-ea926a30c239 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:04.994613 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-8381b5c7-9a63-4650-a2b0-4e5d4cd92ab7 req-23396740-bd63-45e0-978c-ea926a30c239 service nova] Creating event network-vif-plugged:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:20:05.013806 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-8381b5c7-9a63-4650-a2b0-4e5d4cd92ab7 req-23396740-bd63-45e0-978c-ea926a30c239 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103820 May 19 08:20:05.023416 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 632/1317] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:05.037149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a564e27c-ff4a-48e0-91a8-0448ce47ea69 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:05.041527 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:20:05.041527 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:20:05.060592 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-a564e27c-ff4a-48e0-91a8-0448ce47ea69 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] HTTP exception thrown: Flavor 217805d7-62ff-4d0f-9a2e-f76f91db43f5 could not be found. May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a564e27c-ff4a-48e0-91a8-0448ce47ea69 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Request method failure captured: May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/flavors/217805d7-62ff-4d0f-9a2e-f76f91db43f5 HTTP/1.1 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfze7wOxaXOVC8hKlxKlKWWfX6_T0A0d6PdxFvOEa1BEqsxefluzoIveZ8fO81qRhaySrmiNv5bhcW4nB7AYinvlSgkwRCwrapmnx0Kgj4fvlhCBXz1j3IVnTgFSLuPZqobyfOmv9tHScrmuDBSh05tg2txiF9KrmfCjfIw-t2ckBC0 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: a205947cb26041d6b85f67a6455e9a9d May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-MigrationsAdminTest-14507451 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Role: reader,member,admin May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: reader,member,admin May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a205947cb26041d6b85f67a6455e9a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a205947cb26041d6b85f67a6455e9a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a205947cb26041d6b85f67a6455e9a9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a205947cb26041d6b85f67a6455e9a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-MigrationsAdminTest-14507451 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: a205947cb26041d6b85f67a6455e9a9d May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-MigrationsAdminTest-14507451 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-MigrationsAdminTest-14507451-project-admin May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: d03b03867165463f85b38f2b927cdab1 May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-MigrationsAdminTest-14507451-project-admin May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: exception: Flavor 217805d7-62ff-4d0f-9a2e-f76f91db43f5 could not be found. May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '217805d7-62ff-4d0f-9a2e-f76f91db43f5'} May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi flavor.destroy() May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 217805d7-62ff-4d0f-9a2e-f76f91db43f5 could not be found. May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 217805d7-62ff-4d0f-9a2e-f76f91db43f5 could not be found. May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:05.068039 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 217805d7-62ff-4d0f-9a2e-f76f91db43f5 could not be found. May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:05.074314 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a564e27c-ff4a-48e0-91a8-0448ce47ea69 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Returning 404 to user: Flavor 217805d7-62ff-4d0f-9a2e-f76f91db43f5 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:05.078559 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a564e27c-ff4a-48e0-91a8-0448ce47ea69 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/217805d7-62ff-4d0f-9a2e-f76f91db43f5" status: 404 len: 109 microversion: 2.1 time: 0.052593 May 19 08:20:05.079288 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 633/1318] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:20:05 2022] DELETE /compute/v2.1/flavors/217805d7-62ff-4d0f-9a2e-f76f91db43f5 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:05.090133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:05.100015 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:05.100246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:05.100751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:05.104552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:05.110559 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70a3b389-ab3c-42d2-a960-8998364c6c77 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1361 microversion: 2.25 time: 0.620832 May 19 08:20:05.113272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 686/1319] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:04 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1361 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:05.119331 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:05.119783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:05.120761 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:05.121673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:05.130064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbf6f427-0da6-45b7-ab90-3ecccb47a97c tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211d1b4c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2027189999", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:05.141947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-fbf6f427-0da6-45b7-ab90-3ecccb47a97c tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Security group id should be uuid May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbf6f427-0da6-45b7-ab90-3ecccb47a97c tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 131 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2027189999", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group id should be uuid May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2027189999', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:05.144327 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:05.148898 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 19 08:20:05.148898 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:05.151070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbf6f427-0da6-45b7-ab90-3ecccb47a97c tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 400 to user: Security group id should be uuid {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:05.154543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbf6f427-0da6-45b7-ab90-3ecccb47a97c tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.040115 May 19 08:20:05.156409 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 687/1320] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:05 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:20:05.190726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:05.194138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:05.199217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:05.230498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:05.230974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:05.233180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:05.235473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:05.401675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:05.411725 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d0ec35d-1f68-464a-9436-3510e591e4cc tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.253319 May 19 08:20:05.426166 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 688/1321] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:05 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:05.437005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1172151596", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:05.501984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:05.512952 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-827670fb-138e-4922-b40c-99d2a64c8de3 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 0.431440 May 19 08:20:05.516867 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 634/1322] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:05 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:05.522458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cb51475b-a234-4ab4-8044-371b296a03a9 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211f39550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1164158707", "description": "tempest-description-102034507"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:05.556636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:20:05.960917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:20:05.961359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:20:05.961835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:20:05.962245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:20:05.962656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:20:05.978976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:05.979442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:05.980290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:05.980731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:06.027008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Getting quotas for project f2e7072c37ad4f5383d767905c98c9bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:20:06.050159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Getting quotas for user 5cb3f20962a948f2ab2f403bb1d9680c and project f2e7072c37ad4f5383d767905c98c9bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:20:06.088632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:20:06.096475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:20:06.136308 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cb51475b-a234-4ab4-8044-371b296a03a9 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.616995 May 19 08:20:06.136993 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 635/1323] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:20:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:06.148295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-225825665", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:06.220401 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5980251-cdc7-4066-b52f-51fef88b410e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792516 May 19 08:20:06.226171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 689/1324] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:20:06.232006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:06.232625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:06.262667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:20:06.273476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:06.273476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:06.273476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:06.287785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:06.604461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:06.622315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:06.627975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:06.629455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-170a314f-2c4f-4085-a6c1-6750c7b63a32 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1361 microversion: 2.25 time: 0.401834 May 19 08:20:06.631856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 690/1325] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:06 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:06.647252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5997db1-40e6-41f6-b018-34c1aff5c5a4 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211d20700>, body: {"security_group_rule": {"parent_group_id": "34cc28cd-2c30-4360-b22f-72d2a16a1af5", "ip_protocol": "tempest-999-480564845", "from_port": 22, "to_port": 22}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:06.982571 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:20:06.983049 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:20:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! May 19 08:20:07.034087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e5997db1-40e6-41f6-b018-34c1aff5c5a4 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Invalid IP protocol tempest-999-480564845. May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5997db1-40e6-41f6-b018-34c1aff5c5a4 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 156 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: {"security_group_rule": {"parent_group_id": "34cc28cd-2c30-4360-b22f-72d2a16a1af5", "ip_protocol": "tempest-999-480564845", "from_port": 22, "to_port": 22}} May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid IP protocol tempest-999-480564845. May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'security_group_rule': {'parent_group_id': '34cc28cd-2c30-4360-b22f-72d2a16a1af5', 'ip_protocol': 'tempest-999-480564845', 'from_port': 22, 'to_port': 22}}} May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-480564845. May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-480564845. May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:07.039792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-480564845. May 19 08:20:07.044557 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:07.050210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5997db1-40e6-41f6-b018-34c1aff5c5a4 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 400 to user: Invalid IP protocol tempest-999-480564845. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:07.051658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5997db1-40e6-41f6-b018-34c1aff5c5a4 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.414903 May 19 08:20:07.053066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 691/1326] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:06 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 420 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:20:07.059791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:20:07.060327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:20:07.060915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:20:07.061506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:20:07.062043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:20:07.063192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:07.064388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:07.080364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.082450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.083996 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.085859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.090293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.090771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.093867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.095023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.120339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:20:07.136699 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Getting quotas for user f40ef4d25a474b3c83a3c2808a87a30d and project 2b95a24d08874740a500ff176d819cf6. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:20:07.174417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:20:07.191883 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:20:07.305634 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a632934f-9203-4f44-beea-d3635e689a4a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167312 May 19 08:20:07.314809 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 636/1327] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:20:07.325886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:07.332612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:07.369573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.370247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.374899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.384434 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.681531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:07.690501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d9ca573-a807-4101-ae7d-b28177280416 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1222 microversion: 2.1 time: 0.635829 May 19 08:20:07.708126 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 692/1328] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:07 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1222 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:07.712324 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:07.715443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:07.722281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:07.731384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.736787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.737809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.738870 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d475a52e-e888-437c-800e-3a03a904b11e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.414517 May 19 08:20:07.739526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.753678 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 637/1329] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:07 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:07.775347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-30abb045-d10e-4a71-b084-46f8e3297b08 req-c7af53a5-4934-408a-a77c-794211e8b369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8192ded0-5bdd-4cf0-aaa0-d64e78cb1642", "name": "network-vif-plugged", "status": "completed", "tag": "83e5442f-ab25-46f3-a93e-e3533c69077d"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:07.814382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-30abb045-d10e-4a71-b084-46f8e3297b08 req-c7af53a5-4934-408a-a77c-794211e8b369 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:07.825509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-30abb045-d10e-4a71-b084-46f8e3297b08 req-c7af53a5-4934-408a-a77c-794211e8b369 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:07.880903 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-30abb045-d10e-4a71-b084-46f8e3297b08 req-c7af53a5-4934-408a-a77c-794211e8b369 service nova] Creating event network-vif-plugged:83e5442f-ab25-46f3-a93e-e3533c69077d for instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 on chh1-842464-2 May 19 08:20:07.904410 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-30abb045-d10e-4a71-b084-46f8e3297b08 req-c7af53a5-4934-408a-a77c-794211e8b369 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144702 May 19 08:20:07.906799 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 638/1330] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:07.946095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4cdd8647-a5ef-4fc3-af83-250db1eccddd tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211efb430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-612767772", "description": "tempest-description-1994149048"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:08.230460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:08.272583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0eec071f-ad23-4c37-b736-e61fe9ccd785 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1325 microversion: 2.1 time: 0.559184 May 19 08:20:08.276800 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 693/1331] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:07 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:08.302764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:08.304089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:08.323303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:08.324899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:08.326557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:08.327811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:08.824101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:08.854089 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-14884b45-55db-4666-82b5-bb6c76a78bb7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1208 microversion: 2.1 time: 0.568485 May 19 08:20:08.856418 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 694/1332] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:08 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1208 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:08.871851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:08.872732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:08.880012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:08.880900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:08.881912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:08.882525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.214744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:10.230178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:10.231610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:10.232835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8be1c7c0-2ffb-48f9-b56a-3974a6cc040d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1361 microversion: 2.25 time: 1.364985 May 19 08:20:10.233379 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 695/1333] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:08 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1361 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:10.244745 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4cdd8647-a5ef-4fc3-af83-250db1eccddd tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.316997 May 19 08:20:10.246079 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 639/1334] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:20:07 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:10.248725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:10.249611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:10.261122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:10.267511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:10.270699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.274417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.275406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.278822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.286666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.294336 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.300983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.301470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.493792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:10.512296 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ae70451b-5526-426f-9c9b-f61740ff3dc1 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.260080 May 19 08:20:10.517507 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 640/1335] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:10 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:10.528789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:10.531847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:10.535337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:10.553675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.554258 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.557023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.557619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.693940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:10.703933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b028aa75-053a-41ad-93a7-092beff7cbd0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1276 microversion: 2.1 time: 0.469388 May 19 08:20:10.704778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 696/1336] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:10 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1276 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:10.710236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:10.711219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:10.718306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.719204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:10.725934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:10.726491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:11.128523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:11.147322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8af1c3bd-31c9-4050-bf59-5e4bd4f47544 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1270 microversion: 2.1 time: 0.441300 May 19 08:20:11.153361 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 697/1337] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:10 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1270 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:11.173285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a15ec7f4-b683-47cf-9789-6e4ea6762aea req-404fde9e-9b0b-422d-8964-9a017f3fb9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59435f3-2190-4c2e-9a1f-3867ed3a0735", "name": "network-vif-plugged", "status": "completed", "tag": "e69c3e55-7457-4d7f-a710-f82f4c5fe599"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:11.187153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a15ec7f4-b683-47cf-9789-6e4ea6762aea req-404fde9e-9b0b-422d-8964-9a017f3fb9f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:11.189063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a15ec7f4-b683-47cf-9789-6e4ea6762aea req-404fde9e-9b0b-422d-8964-9a017f3fb9f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:11.196893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:11.216390 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a15ec7f4-b683-47cf-9789-6e4ea6762aea req-404fde9e-9b0b-422d-8964-9a017f3fb9f3 service nova] Creating event network-vif-plugged:e69c3e55-7457-4d7f-a710-f82f4c5fe599 for instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 on chh2-842464-2 May 19 08:20:11.234122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a15ec7f4-b683-47cf-9789-6e4ea6762aea req-404fde9e-9b0b-422d-8964-9a017f3fb9f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078470 May 19 08:20:11.237098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 698/1338] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:11.255714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d41223e-7ce3-4530-b114-0eaf1379c244 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211fcd4c0>, body: {"security_group_rule": {"parent_group_id": "cbbbc94b-5808-49cd-a882-9b126228a57a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:11.505972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1d41223e-7ce3-4530-b114-0eaf1379c244 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d41223e-7ce3-4530-b114-0eaf1379c244 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 138 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: {"security_group_rule": {"parent_group_id": "cbbbc94b-5808-49cd-a882-9b126228a57a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbbbc94b-5808-49cd-a882-9b126228a57a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 19 08:20:11.508515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 19 08:20:11.513400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:11.514093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:11.514551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d41223e-7ce3-4530-b114-0eaf1379c244 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:11.515212 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d41223e-7ce3-4530-b114-0eaf1379c244 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.276512 May 19 08:20:11.515910 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 699/1339] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:20:11.518670 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a62881b6-26cf-4f19-840a-3bc15474381a tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1522 microversion: 2.1 time: 0.999531 May 19 08:20:11.526393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:11.527610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:11.528295 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 641/1340] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:10 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1522 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:11.548325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:11.550584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:11.551968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:11.553899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:11.571028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ba1babec-378b-4360-8ffb-5001b11fbe6e tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211efb1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1153640295", "description": "tempest-description-637039469"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:12.805886 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ba1babec-378b-4360-8ffb-5001b11fbe6e tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.274551 May 19 08:20:12.824069 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 642/1341] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:20:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:12.830567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:12.832125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:12.853470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:12.858662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:12.870180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:12.872672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.038934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:13.051262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:13.053651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:13.058387 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f94fa4d1-14b7-4b49-bd64-49b59f8ae354 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1361 microversion: 2.25 time: 1.540745 May 19 08:20:13.061068 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 700/1342] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:11 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1361 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:13.073455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:13.087561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:13.096915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.099335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.100341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.105459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.177000 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:13.192562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:13.196931 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b1e76a8e-a3e6-49ed-bdf6-2df5ec3bec6e tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.371191 May 19 08:20:13.207885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:20:13.209485 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 643/1343] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:12 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:13.219765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:13.220834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:13.231639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.232439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.233516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.234419 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.425908 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6caf1e91-e4c3-4e8c-bc06-e6683b9d4011 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 204 len: 0 microversion: 2.1 time: 0.358504 May 19 08:20:13.426662 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 701/1344] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:20:13 2022] DELETE /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:20:13.444127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:13.446822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:13.470700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.471553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.472595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.473256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.694877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:13.739378 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a6341c5-d236-4a18-86ca-8d9c0dae8cf6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1270 microversion: 2.1 time: 0.310244 May 19 08:20:13.744589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 702/1345] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:13 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1270 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:13.771539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80ca9402-1bbd-4612-9481-868d81cd426d tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f3211d1ba60>, body: {"security_group_rule": {"parent_group_id": "378758f3-fa69-47da-8695-2653058895fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 1228756934}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:13.863829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:13.872377 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c38c6d60-a6c4-4610-9168-03d3ff3d6c5e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1318 microversion: 2.1 time: 0.658068 May 19 08:20:13.881058 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 644/1346] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:13 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:13.886104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:13.886891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:13.898606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.910069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:13.911171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:13.911927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:14.198856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-80ca9402-1bbd-4612-9481-868d81cd426d tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Invalid port range 22:1228756934. Valid TCP ports should be between 1-65535 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80ca9402-1bbd-4612-9481-868d81cd426d tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 146 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: {"security_group_rule": {"parent_group_id": "378758f3-fa69-47da-8695-2653058895fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 1228756934}} May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid port range 22:1228756934. Valid TCP ports should be between 1-65535 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'security_group_rule': {'parent_group_id': '378758f3-fa69-47da-8695-2653058895fc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1228756934}}} May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1228756934. Valid TCP ports should be between 1-65535 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1228756934. Valid TCP ports should be between 1-65535 May 19 08:20:14.201699 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1228756934. Valid TCP ports should be between 1-65535 May 19 08:20:14.206255 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:14.211886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80ca9402-1bbd-4612-9481-868d81cd426d tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 400 to user: Invalid port range 22:1228756934. Valid TCP ports should be between 1-65535 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:14.213083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80ca9402-1bbd-4612-9481-868d81cd426d tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.465927 May 19 08:20:14.220088 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 703/1347] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:13 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:20:14.226319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:14.232052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:14.255713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:14.257677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:14.259696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:14.260479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.004428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:15.014207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:15.022867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:15.024337 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15591e7b-5071-48a1-a33e-681b36ef6fc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1557 microversion: 2.25 time: 0.802732 May 19 08:20:15.037642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 704/1348] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:14 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1557 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:15.043144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:15.044181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:15.052042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.053136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.054160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.054811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.061495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:15.073965 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-afa1dde3-0962-4f28-ae50-9a291790a8b2 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1528 microversion: 2.1 time: 1.191468 May 19 08:20:15.084445 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 645/1349] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:13 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1528 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:15.090091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Action: 'create', calling method: .version_select at 0x7f32121b0670>, body: {"security_group_rule": {"parent_group_id": "3befb145-7118-4f01-bbd8-e80cb6e7aecb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:15.301481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:15.334061 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb4d5ac0-419c-4a07-ad5d-ce2edae4a822 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.283032 May 19 08:20:15.334715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 705/1350] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:15 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:15.343389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:15.352053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:15.385728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.388137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.389530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.392418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.878925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:20:15.879590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Neutron security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb not found {{(pid=119073) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:20:15.880132 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.880132 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 138 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: {"security_group_rule": {"parent_group_id": "3befb145-7118-4f01-bbd8-e80cb6e7aecb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3befb145-7118-4f01-bbd8-e80cb6e7aecb', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:20:15.882181 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 404 to user: Security group 3befb145-7118-4f01-bbd8-e80cb6e7aecb does not exist May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-7ee6fbaa-23aa-40cc-9e87-75695c98f180'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-841f2d50-d0c1-4af4-869c-384493337723 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.797973 May 19 08:20:15.886167 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 646/1351] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:20:15 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 799 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:15.889192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-77701fb1-b58b-4f92-98ac-3150162e1a53 req-5fea81db-4f14-4d6d-b197-cc995eb4ca17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d08df6ba-4511-436a-859a-055e37e683d3", "tag": "2a4fb41a-95d0-439a-bbb4-06fd760f83be"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:15.909631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-77701fb1-b58b-4f92-98ac-3150162e1a53 req-5fea81db-4f14-4d6d-b197-cc995eb4ca17 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.910068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-77701fb1-b58b-4f92-98ac-3150162e1a53 req-5fea81db-4f14-4d6d-b197-cc995eb4ca17 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.921280 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-77701fb1-b58b-4f92-98ac-3150162e1a53 req-5fea81db-4f14-4d6d-b197-cc995eb4ca17 service nova] Creating event network-changed:2a4fb41a-95d0-439a-bbb4-06fd760f83be for instance d08df6ba-4511-436a-859a-055e37e683d3 on chh2-842464-2 May 19 08:20:15.930192 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-77701fb1-b58b-4f92-98ac-3150162e1a53 req-5fea81db-4f14-4d6d-b197-cc995eb4ca17 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044412 May 19 08:20:15.931070 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 647/1352] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:15.943790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:15.945771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:15.963288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.963860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:15.965284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:15.965778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.004261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:16.041884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:16.050460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12775c1d-a4c4-45f2-857b-dc8b51e205f5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 0.712988 May 19 08:20:16.054145 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 706/1353] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:15 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:16.060007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:16.070242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:16.076563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:16.079874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.080578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.081741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.082501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.808181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:16.811984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:16.830230 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-be3a070b-8e38-486c-8b30-2368e4b8149b tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1318 microversion: 2.1 time: 0.897691 May 19 08:20:16.831883 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 648/1354] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:15 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1318 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:16.838613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211efb550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:16.849428 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-660f18b4-7136-453a-a801-28b91869535f tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 2049 microversion: 2.25 time: 0.793890 May 19 08:20:16.850221 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 707/1355] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:16 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 2049 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:16.858490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:16.860802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:16.867723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.868519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.869712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.870447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.913024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.913875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.915879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lazy-loading 'fault' on Instance uuid 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:16.917193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:20:16.918070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Neutron security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 not found {{(pid=119073) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 19 08:20:16.918763 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] HTTP exception thrown: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.918763 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Request method failure captured: May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-security-group-rules/f918c21e-1f89-4cde-ba04-65c916b25a32 HTTP/1.1 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2uaGEtsWx8u9xbUiDMlTEwk5zghX7eipBZH1o1q5_MqZjbY8ORSf9weO1XMqAHOu21Pa-8xOwMsVnV-PBUXH4qD7ypBfnGqrSV0HIKnkQLzc_ooEJbUcp3DXgq93ekEdMTmxDUPJ3ggXLCr379xL1dEQLKN1EFIEWUmn6_fJeGNmg May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2cebfafbc1584519a7486a88b76a046b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 2cebfafbc1584519a7486a88b76a046b May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: cc657d02bce948ff94a855663b06c620 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'f918c21e-1f89-4cde-ba04-65c916b25a32'} May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:20:16.921359 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Returning 404 to user: Security group rule f918c21e-1f89-4cde-ba04-65c916b25a32 does not exist May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-f6733e98-dce5-4b59-bb90-243118f5cedd'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-41929bf4-84d9-4b3a-82ae-17f25b2fe520 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/f918c21e-1f89-4cde-ba04-65c916b25a32" status: 404 len: 199 microversion: 2.1 time: 0.091505 May 19 08:20:16.925557 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 649/1356] 10.222.0.78 () {58 vars in 1286 bytes} [Thu May 19 08:20:16 2022] DELETE /compute/v2.1/os-security-group-rules/f918c21e-1f89-4cde-ba04-65c916b25a32 => generated 199 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:16.930789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:16.932029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:16.939962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.940654 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:16.941780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:16.942381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:17.033576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec18a0cd947847b6a084c3eed533e74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36e395d75dd44ce8e9852bb61c14193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:17.043094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75820e66-107e-43a5-bd54-64d9fe0d6a29 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 200 len: 1315 microversion: 2.1 time: 0.192023 May 19 08:20:17.044558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 708/1357] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:16 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:17.051026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:17.051634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:17.058356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:17.059062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:17.060145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:17.060785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:17.081204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7124c7ef587a474b900d252885eb7e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36fdc1b726454b47a508f87d2af575d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:17.101695 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cc04c100-452d-484f-b630-e86742b4f7d5 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 200 len: 1253 microversion: 2.1 time: 0.175029 May 19 08:20:17.103859 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 650/1358] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:16 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 1253 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:17.108711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-34e0013e-9f6e-44f1-80a4-c76a7f4c2cb8 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211efbe50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:17.115824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:17.162010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=12 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:18.127079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:18.151680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a5cc2a8-cc3f-48b5-89aa-a74cbdd88c8b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 2049 microversion: 2.25 time: 1.104707 May 19 08:20:18.165339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 709/1359] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:17 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 2049 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:18.177295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:18.178622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:18.197493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:18.198295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:18.199489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:18.200379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:18.655773 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-34e0013e-9f6e-44f1-80a4-c76a7f4c2cb8 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/378758f3-fa69-47da-8695-2653058895fc" status: 202 len: 0 microversion: 2.1 time: 1.550604 May 19 08:20:18.656342 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 651/1360] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:20:17 2022] DELETE /compute/v2.1/os-security-groups/378758f3-fa69-47da-8695-2653058895fc => generated 0 bytes in 1552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:18.661991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-25c24c2e-d655-4768-8f85-a65d45e22667 req-f363c34f-2405-4382-bebd-1d468a951dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:18.678809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-25c24c2e-d655-4768-8f85-a65d45e22667 req-f363c34f-2405-4382-bebd-1d468a951dbe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:18.683525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-25c24c2e-d655-4768-8f85-a65d45e22667 req-f363c34f-2405-4382-bebd-1d468a951dbe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:18.715756 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-25c24c2e-d655-4768-8f85-a65d45e22667 req-f363c34f-2405-4382-bebd-1d468a951dbe service nova] Creating event network-changed:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:20:18.731704 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-25c24c2e-d655-4768-8f85-a65d45e22667 req-f363c34f-2405-4382-bebd-1d468a951dbe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064396 May 19 08:20:18.733007 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 652/1361] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:18.739352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:18.740375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:18.755484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:18.759877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:18.760951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:18.761988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:18.926160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:18.936920 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-502e1258-5200-4556-b4b9-48903b42beff tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 0.769859 May 19 08:20:18.939897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 710/1362] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:18 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:18.956941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1bda0dd0-6739-43cd-99ec-a63c07786600 req-7d7543f9-9f9c-43fd-ad49-c24c74f7e962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8192ded0-5bdd-4cf0-aaa0-d64e78cb1642", "name": "network-vif-deleted", "tag": "83e5442f-ab25-46f3-a93e-e3533c69077d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:18.971691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1bda0dd0-6739-43cd-99ec-a63c07786600 req-7d7543f9-9f9c-43fd-ad49-c24c74f7e962 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:18.972137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1bda0dd0-6739-43cd-99ec-a63c07786600 req-7d7543f9-9f9c-43fd-ad49-c24c74f7e962 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:18.992246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bda0dd0-6739-43cd-99ec-a63c07786600 req-7d7543f9-9f9c-43fd-ad49-c24c74f7e962 service nova] Creating event network-vif-deleted:83e5442f-ab25-46f3-a93e-e3533c69077d for instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 on chh1-842464-2 May 19 08:20:19.022001 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1bda0dd0-6739-43cd-99ec-a63c07786600 req-7d7543f9-9f9c-43fd-ad49-c24c74f7e962 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078121 May 19 08:20:19.023646 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 711/1363] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:19.032788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.040000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:19.049621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.050382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.051584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.052217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.070154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 could not be found. May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 HTTP/1.1 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 could not be found. May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8192ded0-5bdd-4cf0-aaa0-d64e78cb1642'} May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 could not be found. May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 could not be found. May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.072741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 could not be found. May 19 08:20:19.077627 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.080604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:19.081872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3149d2a6-f990-4ec2-8c57-3c9685d49306 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642" status: 404 len: 111 microversion: 2.1 time: 0.054914 May 19 08:20:19.085802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 712/1364] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:19 2022] GET /compute/v2.1/servers/8192ded0-5bdd-4cf0-aaa0-d64e78cb1642 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:19.092144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.093129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] [instance: 24d39a76-db81-4bb9-9e41-4e434ef59341] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:19.115960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.116590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.117455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.117895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.150295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] HTTP exception thrown: Instance 24d39a76-db81-4bb9-9e41-4e434ef59341 could not be found. May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Request method failure captured: May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 HTTP/1.1 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf0ULSspa4hVGOyFFHn89ASjflWZYm4gewj_IS8u1GUwSnR2RhEM3N7SwM5QCu9TuKCkKtf5yJCDca6Y6rZ1yn-HQne0bxJw34SjGMlKKmFz48B5fGFqs_D37vfNktZojbxjAu_67IbQzuDZguU3bMyzwbsZDuqGXAuv1ZflXndq1lM May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 36fdc1b726454b47a508f87d2af575d2 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestBootFromVolume-415498190 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36fdc1b726454b47a508f87d2af575d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36fdc1b726454b47a508f87d2af575d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36fdc1b726454b47a508f87d2af575d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36fdc1b726454b47a508f87d2af575d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestBootFromVolume-415498190 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 36fdc1b726454b47a508f87d2af575d2 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestBootFromVolume-415498190 May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestBootFromVolume-415498190-project May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7124c7ef587a474b900d252885eb7e2e May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestBootFromVolume-415498190-project May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 24d39a76-db81-4bb9-9e41-4e434ef59341 could not be found. May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '24d39a76-db81-4bb9-9e41-4e434ef59341'} May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d39a76-db81-4bb9-9e41-4e434ef59341 could not be found. May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d39a76-db81-4bb9-9e41-4e434ef59341 could not be found. May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.152543 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d39a76-db81-4bb9-9e41-4e434ef59341 could not be found. May 19 08:20:19.156744 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.159261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Returning 404 to user: Instance 24d39a76-db81-4bb9-9e41-4e434ef59341 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:19.160514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79467f4c-97a9-4799-a0da-a5e939322857 tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341" status: 404 len: 111 microversion: 2.1 time: 0.073295 May 19 08:20:19.161675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 713/1365] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:19 2022] GET /compute/v2.1/servers/24d39a76-db81-4bb9-9e41-4e434ef59341 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:19.168098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3bd650ab-bb51-4eac-a213-0537160c535b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.170660 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:20:19.170660 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:20:19.172834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bd650ab-bb51-4eac-a213-0537160c535b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.173994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bd650ab-bb51-4eac-a213-0537160c535b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.175056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bd650ab-bb51-4eac-a213-0537160c535b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.175718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bd650ab-bb51-4eac-a213-0537160c535b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.178359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:19.187591 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-50d5bf45-8852-4757-aa0e-35365a9b02b5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1318 microversion: 2.1 time: 0.452425 May 19 08:20:19.188835 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 653/1366] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:18 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:19.203681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2acb355d-4667-4058-84fd-d2b4ddc28672 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211feb940>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.226988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3bd650ab-bb51-4eac-a213-0537160c535b tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.063907 May 19 08:20:19.228640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 714/1367] 10.222.0.78 () {60 vars in 1216 bytes} [Thu May 19 08:20:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:20:19.244894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82bfa282-74e3-4769-a309-f27548a3d3ee tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '.version_select at 0x7f3211d31040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.287281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-82bfa282-74e3-4769-a309-f27548a3d3ee tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Image not found. May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82bfa282-74e3-4769-a309-f27548a3d3ee tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342 HTTP/1.1 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'cfeb043d-9248-4f08-b591-5f4493c23342'} May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cfeb043d-9248-4f08-b591-5f4493c23342 to delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cfeb043d-9248-4f08-b591-5f4493c23342 could not be found. May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.289294 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82bfa282-74e3-4769-a309-f27548a3d3ee tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82bfa282-74e3-4769-a309-f27548a3d3ee tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342" status: 404 len: 62 microversion: 2.1 time: 0.060920 May 19 08:20:19.295658 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 715/1368] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:19 2022] DELETE /compute/v2.1/images/cfeb043d-9248-4f08-b591-5f4493c23342 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:20:19.303352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa5e5aae-eda4-49bf-80b4-ae351bf4714d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] Calling method '.version_select at 0x7f3211ccfa60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.338036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa5e5aae-eda4-49bf-80b4-ae351bf4714d tempest-ServersTestBootFromVolume-415498190 tempest-ServersTestBootFromVolume-415498190-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558659763" status: 202 len: 0 microversion: 2.1 time: 0.042691 May 19 08:20:19.338902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 716/1369] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558659763 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:19.344933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:19.345559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:19.354031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.354701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.355678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.356288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.506985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f0ce6a5-9bcd-49fd-b7ed-b4ad43e64680 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735/action" status: 202 len: 0 microversion: 2.25 time: 0.155380 May 19 08:20:19.510086 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 717/1370] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:20:19 2022] POST /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:20:19.521692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.525476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:19.557651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.558121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.567942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.568922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.602640 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 HTTP/1.1 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '11b32e99-5c8c-4efd-9ef6-c3dd50404b72'} May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:20:19.604321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f64f640e-f2d3-4223-b359-d3c7b21fc5a6 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 404 len: 111 microversion: 2.1 time: 0.094260 May 19 08:20:19.608329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 718/1371] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:20:19 2022] DELETE /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:19.623819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.624438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:19.631138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.631601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.632536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.632867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.635925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:19.925063 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2acb355d-4667-4058-84fd-d2b4ddc28672 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cbbbc94b-5808-49cd-a882-9b126228a57a" status: 202 len: 0 microversion: 2.1 time: 0.725896 May 19 08:20:19.925685 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 654/1372] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:20:19 2022] DELETE /compute/v2.1/os-security-groups/cbbbc94b-5808-49cd-a882-9b126228a57a => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:19.930214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:19.930900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 11b32e99-5c8c-4efd-9ef6-c3dd50404b72] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:19.958803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.959261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.960051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:19.960487 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:19.986485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:20.026999 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:20.035155 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b3befbd-3664-4146-9f5b-6e3ddee26501 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 2054 microversion: 2.25 time: 0.427400 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 HTTP/1.1 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '11b32e99-5c8c-4efd-9ef6-c3dd50404b72'} May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:20.038678 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. May 19 08:20:20.045666 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:20.056331 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 11b32e99-5c8c-4efd-9ef6-c3dd50404b72 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:20.056932 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 719/1373] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:19 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 2054 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:20.063140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1930f3a4-1160-413f-846f-490348500f85 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211ccf790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:20.063927 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-023247fd-6213-4590-8677-1fdf8d1990ff tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72" status: 404 len: 111 microversion: 2.1 time: 0.137220 May 19 08:20:20.067886 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 655/1374] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:19 2022] GET /compute/v2.1/servers/11b32e99-5c8c-4efd-9ef6-c3dd50404b72 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:20.075451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:20.078119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:20.103253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:20.108716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:20.109876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:20.111399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:20.811576 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:20.819439 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc357892-07d0-4bb4-9aaf-8da9de40ca9c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 0.750167 May 19 08:20:20.838505 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 656/1375] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:20 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:20.848825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dcab58f8-266a-4734-b805-8d141edf78c7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '.version_select at 0x7f3211ec5790>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:20.894999 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dcab58f8-266a-4734-b805-8d141edf78c7 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954280065" status: 202 len: 0 microversion: 2.1 time: 0.055179 May 19 08:20:20.895786 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 657/1376] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954280065 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:20.900384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:20.900942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:20.915496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:20.915944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:20.916716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:20.917545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:20.970583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1930f3a4-1160-413f-846f-490348500f85 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/34cc28cd-2c30-4360-b22f-72d2a16a1af5" status: 202 len: 0 microversion: 2.1 time: 0.909082 May 19 08:20:20.973259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 720/1377] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:20:20 2022] DELETE /compute/v2.1/os-security-groups/34cc28cd-2c30-4360-b22f-72d2a16a1af5 => generated 0 bytes in 915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:20.984334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1f2e4705-ece9-49d6-98ff-01d290023d40 req-f5647828-5f36-4fb3-9424-7fc259094a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08df6ba-4511-436a-859a-055e37e683d3", "name": "network-vif-plugged", "status": "completed", "tag": "2a4fb41a-95d0-439a-bbb4-06fd760f83be"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:21.004600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1f2e4705-ece9-49d6-98ff-01d290023d40 req-f5647828-5f36-4fb3-9424-7fc259094a4d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:21.005501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1f2e4705-ece9-49d6-98ff-01d290023d40 req-f5647828-5f36-4fb3-9424-7fc259094a4d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:21.075716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1f2e4705-ece9-49d6-98ff-01d290023d40 req-f5647828-5f36-4fb3-9424-7fc259094a4d service nova] Creating event network-vif-plugged:2a4fb41a-95d0-439a-bbb4-06fd760f83be for instance d08df6ba-4511-436a-859a-055e37e683d3 on chh2-842464-2 May 19 08:20:21.105470 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1f2e4705-ece9-49d6-98ff-01d290023d40 req-f5647828-5f36-4fb3-9424-7fc259094a4d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130834 May 19 08:20:21.113135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 721/1378] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:21.131343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5610ba32-170b-4b32-9869-c30a4df1cf8c req-44f0e184-3f2b-4da9-9ad4-786ea33cf0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:21.156541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5610ba32-170b-4b32-9869-c30a4df1cf8c req-44f0e184-3f2b-4da9-9ad4-786ea33cf0cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:21.160703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5610ba32-170b-4b32-9869-c30a4df1cf8c req-44f0e184-3f2b-4da9-9ad4-786ea33cf0cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:21.197391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5610ba32-170b-4b32-9869-c30a4df1cf8c req-44f0e184-3f2b-4da9-9ad4-786ea33cf0cc service nova] Creating event network-changed:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:20:21.204853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5610ba32-170b-4b32-9869-c30a4df1cf8c req-44f0e184-3f2b-4da9-9ad4-786ea33cf0cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090094 May 19 08:20:21.218326 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 722/1379] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:21.241137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:21.250161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be241811-9c03-455f-8696-6e8d609755a3 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211ccf820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:21.264317 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-374c446d-09ea-4c2f-954e-30a0976966b1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1318 microversion: 2.1 time: 0.367407 May 19 08:20:21.264925 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 658/1380] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:20 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:21.275771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:21.285270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:21.309857 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:21.310651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:21.311691 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:21.315944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:21.986530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:22.124606 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3bb064dc-b08e-4a8e-b9a0-1ffeb10aa58e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 2034 microversion: 2.25 time: 0.858359 May 19 08:20:22.137875 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 659/1381] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:21 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 2034 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:22.145962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:22.146983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:22.154072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:22.154875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:22.156191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:22.157603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:22.888152 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be241811-9c03-455f-8696-6e8d609755a3 tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/62375d75-43b6-4bd8-9ea8-08c7f1a5258f" status: 202 len: 0 microversion: 2.1 time: 1.650412 May 19 08:20:22.889761 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 723/1382] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:20:21 2022] DELETE /compute/v2.1/os-security-groups/62375d75-43b6-4bd8-9ea8-08c7f1a5258f => generated 0 bytes in 1671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:22.895293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": "auto"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:22.898370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:22.913371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:22.921992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:22.923717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:22.924641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:22.983703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'flavor' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:23.022037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Going to try to live migrate instance to chh1-842464-2 {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:20:23.143771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:23.154808 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a645525e-5acf-4470-bcea-0736d8ab7db0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 1.015803 May 19 08:20:23.158577 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 660/1383] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:22 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:23.181043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:23.186525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:23.214589 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:23.217134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:23.218350 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:23.223250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:23.888762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:23.907522 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a85f2315-44ad-4b44-96ff-4fdf5a688888 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1468 microversion: 2.1 time: 0.741550 May 19 08:20:23.909798 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 661/1384] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:23 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1468 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:23.920943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69ea719e-c6ce-4fbc-956a-8304a8a0da2a tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] Calling method '.version_select at 0x7f3211febf70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:24.528693 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-69ea719e-c6ce-4fbc-956a-8304a8a0da2a tempest-SecurityGroupRulesNegativeTestJSON-1827478858 tempest-SecurityGroupRulesNegativeTestJSON-1827478858-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/0c88d2c3-94f6-45da-bac2-4bbe39577112" status: 202 len: 0 microversion: 2.1 time: 0.617768 May 19 08:20:24.530010 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 662/1385] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:20:23 2022] DELETE /compute/v2.1/os-security-groups/0c88d2c3-94f6-45da-bac2-4bbe39577112 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:24.534894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a66338e9-64d4-47f8-8cb8-f747f7203038 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '.version_select at 0x7f32121b0ee0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-a66338e9-64d4-47f8-8cb8-f747f7203038 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Image not found. May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a66338e9-64d4-47f8-8cb8-f747f7203038 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/images/07f9c74f-c202-4ca7-bad1-e7208f1644b7 HTTP/1.1 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: exception: Image not found. May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '07f9c74f-c202-4ca7-bad1-e7208f1644b7'} May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 07f9c74f-c202-4ca7-bad1-e7208f1644b7 to delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:20:24.602588 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 07f9c74f-c202-4ca7-bad1-e7208f1644b7 could not be found. May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:20:24.606927 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:24.611338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a66338e9-64d4-47f8-8cb8-f747f7203038 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Image not found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:24.611338 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a66338e9-64d4-47f8-8cb8-f747f7203038 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/images/07f9c74f-c202-4ca7-bad1-e7208f1644b7" status: 404 len: 62 microversion: 2.1 time: 0.078832 May 19 08:20:24.613696 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 663/1386] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:24 2022] DELETE /compute/v2.1/images/07f9c74f-c202-4ca7-bad1-e7208f1644b7 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:20:24.617179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:24.626735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:24.649451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:24.650173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:24.650675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:24.651114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:25.213812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:25.224881 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6fdc55f5-d9e9-47c6-804e-85b8a942494c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1318 microversion: 2.1 time: 0.611747 May 19 08:20:25.242345 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 664/1387] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:24 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:25.268131 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:25.278932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:25.297013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:25.298345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:25.302779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:25.305097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.419969 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:26.432617 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a55ff8ab-54fa-46a9-8f8d-9a6abe23d371 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 1.188792 May 19 08:20:26.444858 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 665/1388] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:25 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:26.465125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:26.465775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:26.476784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.489967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.492352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.493921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.539083 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf HTTP/1.1 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf'} May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:20:26.545817 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.553138 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.556778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:26.561982 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-54189499-8f5d-4028-9eae-c4c2789b370b tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "DELETE /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 404 len: 111 microversion: 2.1 time: 0.110781 May 19 08:20:26.564087 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 666/1389] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:20:26 2022] DELETE /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:26.580924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-1cf1b1c9-6324-4e09-b38b-836a01340454 req-ab9891f6-0523-4187-b53d-89e6af84efc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "name": "network-vif-plugged", "status": "completed", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:26.608667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1cf1b1c9-6324-4e09-b38b-836a01340454 req-ab9891f6-0523-4187-b53d-89e6af84efc1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.614436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1cf1b1c9-6324-4e09-b38b-836a01340454 req-ab9891f6-0523-4187-b53d-89e6af84efc1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.656165 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-1cf1b1c9-6324-4e09-b38b-836a01340454 req-ab9891f6-0523-4187-b53d-89e6af84efc1 service nova] Creating event network-vif-plugged:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:20:26.680398 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b6adca2-15ad-4793-93fa-8ecdb4eb5559 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735/action" status: 202 len: 0 microversion: 2.25 time: 3.789277 May 19 08:20:26.684173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 724/1390] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:20:22 2022] POST /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735/action => generated 0 bytes in 3791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:20:26.687636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:26.688763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:26.695853 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-1cf1b1c9-6324-4e09-b38b-836a01340454 req-ab9891f6-0523-4187-b53d-89e6af84efc1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128824 May 19 08:20:26.696494 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 667/1391] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:26.741571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.742069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.746239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.746644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:26.748914 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] [instance: 156034f8-d24a-47cd-acac-ae7e5c589acf] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:26.750302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.775244 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.776099 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.778560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.782468 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.823023 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] HTTP exception thrown: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Request method failure captured: May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf HTTP/1.1 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1RbZCS1MfR2qgUdWouxziMSVVnMN8oTFaLx4ddGlgT6Ogw64tM8njIygCIQzUqCluAWnkY0aNHeWc1wZXgOfsjw7c4vSPKPmF9YX_zGpmz7dG9-IAvqXhcR9oRMN8WuzeZTiQAD7MiHH2stVqxSSkMUIvVW4BYaYRlQa_8ZqODK5g May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d36e395d75dd44ce8e9852bb61c14193"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: d36e395d75dd44ce8e9852bb61c14193 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-749807338 May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: ec18a0cd947847b6a084c3eed533e74e May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-749807338-project May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '156034f8-d24a-47cd-acac-ae7e5c589acf'} May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.829262 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. May 19 08:20:26.834406 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:20:26.859001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] Returning 404 to user: Instance 156034f8-d24a-47cd-acac-ae7e5c589acf could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:20:26.863198 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4630e2a0-f88e-48e3-a640-72d8fc101c20 tempest-ImagesOneServerNegativeTestJSON-749807338 tempest-ImagesOneServerNegativeTestJSON-749807338-project] 10.222.0.78 "GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf" status: 404 len: 111 microversion: 2.1 time: 0.149044 May 19 08:20:26.870160 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 668/1392] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:26 2022] GET /compute/v2.1/servers/156034f8-d24a-47cd-acac-ae7e5c589acf => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:20:26.884387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:26.885033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:26.902478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.904110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:26.905397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:26.906012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:27.397891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:27.417423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:27.424159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:27.426509 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-70030f43-dc32-4a89-b03a-5553196521e9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.555340 May 19 08:20:27.429354 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 669/1393] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:26 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:27.452834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:27.454254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:27.466211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:27.466807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:27.467701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:27.468829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:28.440328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:28.442465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:28.450843 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-13b8cf17-c9e4-43dc-a178-68157eb8f4ea tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 1.002016 May 19 08:20:28.451437 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 670/1394] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:27 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:28.462864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:28.467619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:28.471810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0b73553-0abc-4183-8032-b1a9d15807e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1318 microversion: 2.1 time: 1.789097 May 19 08:20:28.473170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 725/1395] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:26 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1318 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:28.486231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:28.486889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:28.488027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:28.488652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:28.553937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:28.717897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-96f55a5a-e242-4585-a732-34099b398835 req-037994bd-d4e5-463c-8970-eec630c4868e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "name": "network-vif-plugged", "status": "completed", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:28.741749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-96f55a5a-e242-4585-a732-34099b398835 req-037994bd-d4e5-463c-8970-eec630c4868e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:28.745653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-96f55a5a-e242-4585-a732-34099b398835 req-037994bd-d4e5-463c-8970-eec630c4868e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:28.777181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-96f55a5a-e242-4585-a732-34099b398835 req-037994bd-d4e5-463c-8970-eec630c4868e service nova] Creating event network-vif-plugged:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:20:28.800965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-96f55a5a-e242-4585-a732-34099b398835 req-037994bd-d4e5-463c-8970-eec630c4868e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089453 May 19 08:20:28.801874 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 726/1396] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:29.375907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:29.389587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:29.392054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:29.396567 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c4672d47-b06e-40c9-82ca-ae103bb07c2b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.941131 May 19 08:20:29.405856 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 671/1397] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:28 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:29.469564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:29.471386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:29.473919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:29.492148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:29.493009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:29.518348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:29.521214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:29.522440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:29.525359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:29.526551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:29.527974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:29.531249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:29.532531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:30.684714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:30.698013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6f4ff48-b4b4-4c10-ab45-dbcc992395d9 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1312 microversion: 2.1 time: 1.230538 May 19 08:20:30.700414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:30.711768 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 727/1398] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:29 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1312 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:30.718872 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-503752b8-e19e-4600-b051-bf0c993899ac tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1467 microversion: 2.1 time: 1.232254 May 19 08:20:30.720531 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 672/1399] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:29 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1467 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:30.740920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:30.743770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:30.747639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2127766688"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:30.754431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:30.759137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:30.759911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:30.760946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:30.762730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:30.767840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:30.771708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:30.775637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:30.778507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:31.575291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:31.589948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:31.601563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:31.604636 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b16dc1d9-e8d2-4c82-92ec-282ce797ec19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.888901 May 19 08:20:31.607294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 728/1400] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:30 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:31.661821 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-233e6858-be7b-4d62-87bd-94fe226a503e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "POST /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444/action" status: 202 len: 0 microversion: 2.1 time: 0.917928 May 19 08:20:31.665178 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 673/1401] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:20:30 2022] POST /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:20:32.155594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01822524-2865-4654-96e9-ba9a0b897abb tempest-AZV2TestJSON-229817494 tempest-AZV2TestJSON-229817494-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:32.158939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01822524-2865-4654-96e9-ba9a0b897abb tempest-AZV2TestJSON-229817494 tempest-AZV2TestJSON-229817494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.159706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01822524-2865-4654-96e9-ba9a0b897abb tempest-AZV2TestJSON-229817494 tempest-AZV2TestJSON-229817494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:32.160693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01822524-2865-4654-96e9-ba9a0b897abb tempest-AZV2TestJSON-229817494 tempest-AZV2TestJSON-229817494-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.161576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01822524-2865-4654-96e9-ba9a0b897abb tempest-AZV2TestJSON-229817494 tempest-AZV2TestJSON-229817494-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:32.207954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:32.236959 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01822524-2865-4654-96e9-ba9a0b897abb tempest-AZV2TestJSON-229817494 tempest-AZV2TestJSON-229817494-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.621556 May 19 08:20:32.240362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 729/1402] 10.222.0.78 () {58 vars in 1163 bytes} [Thu May 19 08:20:31 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:20:32.253143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab190afb-f4a8-40f0-88ea-06357f1dd993 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211e985e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:32.294049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-0a592cbc-46e1-453a-8004-7a5f65a0bb20 req-0ac9c841-88a3-444c-b397-3bd49ee2a970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59435f3-2190-4c2e-9a1f-3867ed3a0735", "name": "network-vif-unplugged", "status": "completed", "tag": "e69c3e55-7457-4d7f-a710-f82f4c5fe599"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:32.306375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0a592cbc-46e1-453a-8004-7a5f65a0bb20 req-0ac9c841-88a3-444c-b397-3bd49ee2a970 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.306823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0a592cbc-46e1-453a-8004-7a5f65a0bb20 req-0ac9c841-88a3-444c-b397-3bd49ee2a970 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:32.341486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab190afb-f4a8-40f0-88ea-06357f1dd993 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.095386 May 19 08:20:32.348685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 730/1403] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:32 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:32.364850 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-0a592cbc-46e1-453a-8004-7a5f65a0bb20 req-0ac9c841-88a3-444c-b397-3bd49ee2a970 service nova] Creating event network-vif-unplugged:e69c3e55-7457-4d7f-a710-f82f4c5fe599 for instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 on chh2-842464-2 May 19 08:20:32.366086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:32.366715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:32.379874 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-0a592cbc-46e1-453a-8004-7a5f65a0bb20 req-0ac9c841-88a3-444c-b397-3bd49ee2a970 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.712761 May 19 08:20:32.380496 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 674/1404] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:32.383857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.399827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:32.405584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.408025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:32.627673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:32.629278 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:32.642985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.644023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:32.644983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:32.646070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:33.195700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:33.210581 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d142e5c8-a900-4937-bf05-de78c39eb69e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1462 microversion: 2.1 time: 0.855631 May 19 08:20:33.212013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 731/1405] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:32 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1462 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:33.237487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:33.240340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:33.259100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:33.260270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:33.261947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:33.263300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:33.581579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:33.596236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:33.598949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:33.600771 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-17fbdc9d-4639-4f7f-9a02-3f2ecac6c8f9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.978548 May 19 08:20:33.602632 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 675/1406] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:32 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:33.609428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ec2113b2-6c1d-40b8-b8e6-2a07134f8527 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211feb820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:33.626424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81f83264-300d-48f4-9066-db9f77fc5aad tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1613 microversion: 2.1 time: 0.399965 May 19 08:20:33.629429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 732/1407] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:33 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1613 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:20:33.654211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:33.656459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:33.670420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:33.671282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:33.672445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:33.673710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:33.711772 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ec2113b2-6c1d-40b8-b8e6-2a07134f8527 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.107311 May 19 08:20:33.712783 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 676/1408] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:33 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:33.741867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd03b03867165463f85b38f2b927cdab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a205947cb26041d6b85f67a6455e9a9d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:33.743169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] flavor_id is None. Assuming migration. {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 08:20:33.744637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 08:20:34.434573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-89af99d3-1e1b-4bff-99ab-7242e3b38985 req-f814f5b6-e208-427d-bc0b-e5bb15c7a5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59435f3-2190-4c2e-9a1f-3867ed3a0735", "tag": "e69c3e55-7457-4d7f-a710-f82f4c5fe599"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:34.447060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-89af99d3-1e1b-4bff-99ab-7242e3b38985 req-f814f5b6-e208-427d-bc0b-e5bb15c7a5d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:34.447507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-89af99d3-1e1b-4bff-99ab-7242e3b38985 req-f814f5b6-e208-427d-bc0b-e5bb15c7a5d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:34.474671 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-89af99d3-1e1b-4bff-99ab-7242e3b38985 req-f814f5b6-e208-427d-bc0b-e5bb15c7a5d3 service nova] Creating event network-changed:e69c3e55-7457-4d7f-a710-f82f4c5fe599 for instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 on chh2-842464-2 May 19 08:20:34.492443 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-89af99d3-1e1b-4bff-99ab-7242e3b38985 req-f814f5b6-e208-427d-bc0b-e5bb15c7a5d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062899 May 19 08:20:34.493402 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 677/1409] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:20:34.622884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:34.623585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:34.643157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:34.652391 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:34.655473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:34.656135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:35.027290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:35.047044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:35.053057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:35.057582 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8d5db484-0dc1-4168-a2d2-e3aa3a13999b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.436140 May 19 08:20:35.081639 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 678/1410] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:34 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:35.086980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1beab08a-b46a-4ab4-b0fc-7ef57df84428 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39040>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:35.181139 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1beab08a-b46a-4ab4-b0fc-7ef57df84428 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.097924 May 19 08:20:35.183738 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 679/1411] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:35 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:35.338777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ceeeb29-9143-4e61-bd8a-c1185c49fe86 tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197/action" status: 202 len: 0 microversion: 2.1 time: 1.689661 May 19 08:20:35.347144 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 733/1412] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:20:33 2022] POST /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197/action => generated 0 bytes in 1703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:20:35.348992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:35.349634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:35.368312 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:35.370153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:35.376122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:35.376649 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:35.843938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:35.861961 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a4c50f76-2d7e-4838-b280-e500111d814f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1471 microversion: 2.1 time: 0.517479 May 19 08:20:35.864365 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 680/1413] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:35 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1471 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:36.088566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:36.089642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:36.102885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:36.106517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:36.108754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:36.111741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:36.195502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c2c164f2-0bb0-4dbb-8194-14bf0112755d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121b0040>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:36.296890 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c2c164f2-0bb0-4dbb-8194-14bf0112755d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.105263 May 19 08:20:36.303552 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 681/1414] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:36 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:36.383945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:36.396331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:36.399221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:36.400897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7f3eeb1-420b-46aa-8818-139e48f9aea7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.316547 May 19 08:20:36.413968 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 734/1415] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:36 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:36.485590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-def22a4b-724d-4c76-9643-19e53bf36885 req-c2b38cb1-99c3-48be-bd84-2d0a3cd4ff0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "name": "network-vif-plugged", "status": "completed", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:36.502698 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-def22a4b-724d-4c76-9643-19e53bf36885 req-c2b38cb1-99c3-48be-bd84-2d0a3cd4ff0f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:36.503147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-def22a4b-724d-4c76-9643-19e53bf36885 req-c2b38cb1-99c3-48be-bd84-2d0a3cd4ff0f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:36.516281 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-def22a4b-724d-4c76-9643-19e53bf36885 req-c2b38cb1-99c3-48be-bd84-2d0a3cd4ff0f service nova] Creating event network-vif-plugged:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:20:36.523495 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-def22a4b-724d-4c76-9643-19e53bf36885 req-c2b38cb1-99c3-48be-bd84-2d0a3cd4ff0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042528 May 19 08:20:36.525020 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 682/1416] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:36.881361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:36.882875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:36.913286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:36.914847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:36.916603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:36.926899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:37.395132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:37.403079 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9319e110-08d7-4f42-83dd-f2e454e5f79a tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1471 microversion: 2.1 time: 0.526603 May 19 08:20:37.418216 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 683/1417] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:36 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1471 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:37.424824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3016dcb3-d985-4608-8afa-46f32ae752e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:37.543233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-827457469", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "5cd8d735-7e64-4a47-aa48-e0dddb7b372f"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:37.565232 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3016dcb3-d985-4608-8afa-46f32ae752e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.145761 May 19 08:20:37.565885 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 684/1418] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:37 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:37.596519 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:37.597394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:37.624337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:37.624801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:37.625822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:37.626310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:37.711710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] validate_networks() for [('5cd8d735-7e64-4a47-aa48-e0dddb7b372f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:20:39.073251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:39.089185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:39.097582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:39.099325 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3c8d5f98-e317-4062-bb29-716486fcd192 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 1.532503 May 19 08:20:39.101840 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 685/1419] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:37 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:39.111456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:39.114739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:39.142545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:39.145955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:39.150656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:39.151791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:39.510895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:39.537520 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0edf2105-9cc7-41c0-b9b3-1daa4bba6370 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1471 microversion: 2.1 time: 0.434306 May 19 08:20:39.546331 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 686/1420] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:39 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1471 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:39.557365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f34b50f1-1b9b-4413-8c73-9cd00335421c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39b80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:39.656314 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f34b50f1-1b9b-4413-8c73-9cd00335421c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.104468 May 19 08:20:39.658426 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 687/1421] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:39 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:39.924184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:20:39.925290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:20:39.925705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:20:39.926188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:20:39.926869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:20:39.949545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:39.952686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:39.964858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:39.965633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:40.001375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Getting quotas for project ff49ea2c1efc41f685b496815d13bc09. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:20:40.027244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Getting quotas for user 5e7cc48a60f14daa825d66600fe1dd92 and project ff49ea2c1efc41f685b496815d13bc09. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:20:40.067439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:20:40.070862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:20:40.121468 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:40.122366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:40.146330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:40.147340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:40.149556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:40.150562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:40.248062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1edbb059-3f17-4f66-bd07-8167add87787 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.595989 May 19 08:20:40.249732 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 735/1422] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:20:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:20:40.266363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19cc3f62-ebd2-4f1c-bfbb-d16341a185a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:40.274455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19cc3f62-ebd2-4f1c-bfbb-d16341a185a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:40.525489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19cc3f62-ebd2-4f1c-bfbb-d16341a185a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:40.544512 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19cc3f62-ebd2-4f1c-bfbb-d16341a185a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1217 microversion: 2.1 time: 0.286417 May 19 08:20:40.547013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 736/1423] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:40 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:40.570027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:40.571406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:40.590295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:40.608475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:40.611322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:40.616203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:41.316586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:41.359621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:41.379406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65e77fea-fc4a-4f9d-9517-d8f3131c2a4d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1471 microversion: 2.1 time: 0.796066 May 19 08:20:41.380066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 737/1424] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:40 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1471 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:41.387074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29e76120-7709-4178-a074-61710c4464cd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d55c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:41.389822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:41.403445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:41.404691 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ce0cc765-249c-4d0a-8293-49f998f4eb19 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 1.288415 May 19 08:20:41.411319 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 688/1425] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:40 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:20:41.445601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-29e76120-7709-4178-a074-61710c4464cd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.064028 May 19 08:20:41.446694 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 738/1426] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:41 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:41.568903 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5bbcae8b-51c9-4cd8-a704-e5e2b4f891a4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:41.569593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5bbcae8b-51c9-4cd8-a704-e5e2b4f891a4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:41.580768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:42.354276 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5bbcae8b-51c9-4cd8-a704-e5e2b4f891a4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:42.367888 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5bbcae8b-51c9-4cd8-a704-e5e2b4f891a4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1217 microversion: 2.1 time: 0.802013 May 19 08:20:42.384274 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 689/1427] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:41 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1217 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:42.401662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:42.402581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:42.426029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:42.426861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:42.432721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:42.433177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:42.438840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:42.439509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:42.441731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:42.442217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:42.443079 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:42.444189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:43.498201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:43.507678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c90d823d-2706-49cf-98d1-097c45f161cf tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 1.113142 May 19 08:20:43.512427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 739/1428] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:42 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:43.522777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f403a81-703d-46f7-a405-300361f3008e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d554c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:43.592342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f403a81-703d-46f7-a405-300361f3008e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.074934 May 19 08:20:43.593338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 740/1429] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:43 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:43.602630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:43.604704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:43.624253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:43.626645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:43.627651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:43.630693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:43.641872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:43.648383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:43.670399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:43.672534 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:43.701245 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ba830dba-ad44-4568-a724-ac38bb307524 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 1.261101 May 19 08:20:43.704687 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 690/1430] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:42 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:43.883967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:43.898660 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab8b01bd-76a4-44c1-8dcc-41f8d12b59b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1275 microversion: 2.1 time: 0.304069 May 19 08:20:43.899508 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 741/1431] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:43 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:44.528716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:44.529990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:44.542932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:44.544411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:44.552803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:44.553251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:44.607179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ba70477-2c7c-44da-8195-80788bbdf653 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211ce0af0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:44.686405 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ba70477-2c7c-44da-8195-80788bbdf653 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.083102 May 19 08:20:44.687090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 742/1432] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:44 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:20:44.723304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:44.723936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:44.744848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:44.745326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:44.746145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:44.746554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:45.507559 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:45.521863 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2ed38344-2513-446b-a3d6-3f2a02236974 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 0.995871 May 19 08:20:45.523167 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 691/1433] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:44 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:45.529623 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:45.530594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:45.553348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:45.556842 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:45.557735 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:45.558987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:45.561009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:45.593227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:45.597958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:45.626280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0eb12e76-db10-400c-b9d4-9888834fb84a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1567 microversion: 2.25 time: 0.902981 May 19 08:20:45.627673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 743/1434] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:44 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1567 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:45.700032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0443efd-9422-46c7-b3db-214b1107c447 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d55f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:45.788849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:45.803334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0443efd-9422-46c7-b3db-214b1107c447 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.104967 May 19 08:20:45.805722 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 744/1435] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:45 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:45.816518 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d395deb9-0aef-4125-a389-1dee1cafddd7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1275 microversion: 2.1 time: 0.291139 May 19 08:20:45.832091 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 692/1436] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:45 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:46.545786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:46.548357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:46.580274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:46.580742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:46.583445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:46.583923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:46.645191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:46.646552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:46.663968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:46.664689 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:46.676257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:46.685599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:47.866094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:47.893470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:47.902380 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:47.909388 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d6b91b63-d046-465e-bddd-c8be08a4b7d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1542 microversion: 2.25 time: 1.266703 May 19 08:20:47.913704 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 693/1437] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:46 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1542 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:47.933946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-84208d78-78c1-4167-8d5a-349a4d73534e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211efb4c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:48.072310 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-84208d78-78c1-4167-8d5a-349a4d73534e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.157133 May 19 08:20:48.079558 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 694/1438] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:47 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:48.089693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:48.091370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:48.124723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:48.125247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:48.130008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:48.130780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:48.214227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:48.269410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:48.290527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8134360a-22cb-4cb1-b374-d953adf20a26 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 1.752176 May 19 08:20:48.291290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 745/1439] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:46 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:48.339320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-826807569", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f89cd20d-715f-4022-9b3a-1a63b86ac1fd"}], "block_device_mapping_v2": [{"uuid": "22fa3ba6-94f2-487f-a32d-3be7e0cb829f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:48.459597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] validate_networks() for [('f89cd20d-715f-4022-9b3a-1a63b86ac1fd', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:20:49.971154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:49.977772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:49.994133 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8df69e69-5431-4ea2-849d-f1828a79e11e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 1.905621 May 19 08:20:49.995280 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 695/1440] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:48 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:50.008805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1aa3209d-019a-46c8-bb71-0a562257a2d3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '.version_select at 0x7f32121aa550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:50.013261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1aa3209d-019a-46c8-bb71-0a562257a2d3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:50.014313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1aa3209d-019a-46c8-bb71-0a562257a2d3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:50.030897 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1aa3209d-019a-46c8-bb71-0a562257a2d3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3805 microversion: 2.25 time: 0.034168 May 19 08:20:50.032610 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 696/1441] 10.222.0.78 () {60 vars in 1183 bytes} [Thu May 19 08:20:49 2022] GET /compute/v2.1/os-migrations => generated 3805 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:50.038212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ade76464-f54d-4706-a756-392464b6143f tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121b09d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:50.103083 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ade76464-f54d-4706-a756-392464b6143f tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.069024 May 19 08:20:50.104329 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 697/1442] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:50 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:50.110694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:50.112371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:50.122575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:50.123449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:50.124496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:50.125144 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:50.531315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:50.601582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:50.629203 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2bb2acf4-44fe-4b63-9142-8cc0da164a87 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 0.523512 May 19 08:20:50.632861 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 698/1443] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:50 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:50.644845 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:50.647905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:50.674724 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:50.676992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:50.679162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:50.680244 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:51.345176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:20:51.368728 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8421d5d3-6cf5-4532-ada9-f059104631d8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 2034 microversion: 2.25 time: 0.733177 May 19 08:20:51.369610 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 699/1444] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:50 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 2034 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:51.409394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6cd8b396-8c6e-4edf-b822-5e3e545cd20b req-67c4e815-aa16-44d1-9d00-57cb93237d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec2d470-ea96-4789-b133-75e40f3ad85d", "tag": "3decf769-deaf-4196-bfcd-c90b1b5b8bea"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:51.426339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6cd8b396-8c6e-4edf-b822-5e3e545cd20b req-67c4e815-aa16-44d1-9d00-57cb93237d7b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:51.427151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6cd8b396-8c6e-4edf-b822-5e3e545cd20b req-67c4e815-aa16-44d1-9d00-57cb93237d7b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:51.442557 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6cd8b396-8c6e-4edf-b822-5e3e545cd20b req-67c4e815-aa16-44d1-9d00-57cb93237d7b service nova] Creating event network-changed:3decf769-deaf-4196-bfcd-c90b1b5b8bea for instance 2ec2d470-ea96-4789-b133-75e40f3ad85d on chh1-842464-2 May 19 08:20:51.449048 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6cd8b396-8c6e-4edf-b822-5e3e545cd20b req-67c4e815-aa16-44d1-9d00-57cb93237d7b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044338 May 19 08:20:51.450063 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 700/1445] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:20:51.457164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:51.458250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:51.471076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:51.472079 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:51.474194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:51.476229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:51.520930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:20:51.521416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:20:51.521863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:20:51.522284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:20:51.522723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:20:51.556654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:51.557096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:51.558372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:51.561716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:51.644925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:20:51.667752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Getting quotas for user 57e320171eec44a8bdb1dcd9e0039226 and project 6704bb799559404288e26a24be6625c7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:20:51.867766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:20:51.870179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22fa3ba6-94f2-487f-a32d-3be7e0cb829f',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:20:52.111009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:52.124279 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7633e81f-955c-438c-9120-3c439544d8d8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 0.672281 May 19 08:20:52.125694 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 701/1446] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:51 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:52.131840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-df7d6128-58d8-45bf-a411-71a0a8ba2bcd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211efbee0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:52.205683 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4751aa2e-dc46-4722-a6f4-5106089b3c7a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.902006 May 19 08:20:52.206341 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 746/1447] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:20:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:20:52.216589 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-df7d6128-58d8-45bf-a411-71a0a8ba2bcd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.089536 May 19 08:20:52.217247 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 702/1448] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:52 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:52.233273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2014061006", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:20:52.236076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:52.243866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:52.266916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:52.273762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:52.275844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:52.276606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:52.359997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:20:52.379211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] validate_networks() for [('b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:20:53.264600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:53.290097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6b7ea56-9016-4507-ac55-213d8e95d41f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 1.073884 May 19 08:20:53.292033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 747/1449] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:52 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:53.304534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:53.309273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:53.334614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:53.336531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:53.339539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:53.342297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:53.495196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:53.505571 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be30c225-baad-4d7f-b556-ba027533676b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1102 microversion: 2.1 time: 0.210991 May 19 08:20:53.510789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 748/1450] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:53 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1102 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:53.532670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:53.535067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:53.549127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:53.553582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:53.554926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:53.555605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:53.983624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:20:53.984197 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:20:53.984503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:20:53.985013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:20:53.985639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:20:54.011491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:54.011948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:54.014115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:54.014550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:54.063743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:20:54.090220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for user 024724b24b274d7db1c43874767de143 and project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:20:54.119865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:20:54.123734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:20:54.311527 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-43805049-810e-4666-9ac8-74dcc78cd4f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.093139 May 19 08:20:54.330948 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 703/1451] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:20:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:20:54.335831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-76494b02-09a1-41d3-8e8d-83e37d2775e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f393a0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:54.480640 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-76494b02-09a1-41d3-8e8d-83e37d2775e7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.148542 May 19 08:20:54.481225 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 704/1452] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:54 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:54.486525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:54.503330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:54.529395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:54.529861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:54.530728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:54.531162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:54.659640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:54.671101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aee27202-d2dc-47a3-a3f4-8b84261d7d14 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 1.153406 May 19 08:20:54.676571 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 749/1453] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:53 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:54.694913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54a7b8d5-c0f4-49bd-9cd2-c2f3e1facd63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:54.697725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54a7b8d5-c0f4-49bd-9cd2-c2f3e1facd63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:55.304621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54a7b8d5-c0f4-49bd-9cd2-c2f3e1facd63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:55.315297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54a7b8d5-c0f4-49bd-9cd2-c2f3e1facd63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:55.324442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54a7b8d5-c0f4-49bd-9cd2-c2f3e1facd63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:55.326441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54a7b8d5-c0f4-49bd-9cd2-c2f3e1facd63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1262 microversion: 2.25 time: 0.648229 May 19 08:20:55.340685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 750/1454] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:54 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1262 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:55.355107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:55.356113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:55.388540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:55.389297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:55.391722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:55.392449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:55.748594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:55.773001 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-42a39e77-6eec-4288-b7c2-d8f4f4a5bc82 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1168 microversion: 2.1 time: 0.430541 May 19 08:20:55.777645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 751/1455] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:55 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1168 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:55.788960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96542d5a-c912-4492-b2ad-e2870d1f6307 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211feff70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:56.002486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96542d5a-c912-4492-b2ad-e2870d1f6307 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.216719 May 19 08:20:56.020351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 752/1456] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:55 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:56.046897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:56.048113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:56.068719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:56.069513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:56.070808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:56.073128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:56.295262 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:56.316652 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1617a4ae-0b01-4a54-8ab4-dd2c9b18e373 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 1.834114 May 19 08:20:56.323939 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 705/1457] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:54 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:56.349211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:56.349882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:56.365436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:56.365939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:56.366880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:56.367440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:57.449596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:57.470555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:57.472560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:57.481886 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-97df39c6-b551-467b-baab-67723bb34a9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1314 microversion: 2.25 time: 1.138511 May 19 08:20:57.485321 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 706/1458] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:56 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1314 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:57.493405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:57.500193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:57.521469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:57.522716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:57.537083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:57.538123 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:57.825641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:57.835515 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b11d2b28-acf7-4ad6-bf4a-5a723607906d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1168 microversion: 2.1 time: 0.345812 May 19 08:20:57.836120 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 707/1459] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:57 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1168 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:57.862288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7d191bcf-58a5-45be-849a-0fc9c9948e17 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217c42c10>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:57.949126 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7d191bcf-58a5-45be-849a-0fc9c9948e17 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.090796 May 19 08:20:57.951906 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 708/1460] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:57 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:57.991717 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:57.995826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:58.008518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:58.030097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ad8971f-0ba8-47ed-ad7e-fbe2b5514949 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 2.005215 May 19 08:20:58.032969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 753/1461] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:56 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:58.055002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:58.055563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:58.059252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:58.060455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:58.420710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:58.444671 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1ae4135b-9044-41c7-bad1-7adabd89d911 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1476 microversion: 2.1 time: 0.489369 May 19 08:20:58.448480 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 709/1462] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:57 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:58.504533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:58.505161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:58.521925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:58.522380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:58.523241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:58.523700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:58.699398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:58.728865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:58.741340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:58.748366 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-265cab38-4eaf-4f73-80cb-8c30536dc5f8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1320 microversion: 2.25 time: 0.246575 May 19 08:20:58.750099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 754/1463] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:58 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:20:58.855361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:58.856746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:58.875692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:58.878788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:58.880528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:58.886713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:58.963318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fa8afc3-198d-465f-b3b5-6ca35cb61a21 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211fef310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:59.090069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fa8afc3-198d-465f-b3b5-6ca35cb61a21 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.130860 May 19 08:20:59.091915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 755/1464] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:20:58 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:20:59.104803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:59.105769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:59.124652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:59.126440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:59.127467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:59.128082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:59.597967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:59.614358 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-065095d5-3ca5-4c74-bd0f-7a9e715f5428 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 0.764459 May 19 08:20:59.615533 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 710/1465] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:58 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:59.620673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:59.623890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:59.633026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:59.634100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:59.635074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:59.635669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:59.706455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:20:59.717573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f800664a-659e-4718-ab74-caa952ddf056 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 0.621270 May 19 08:20:59.718513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 756/1466] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:59 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:20:59.769700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:20:59.770629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:20:59.786586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:59.787327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:20:59.788954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:20:59.789786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:01.563624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:01.575414 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-28e80e6d-3a49-494a-8b42-c0c45ffa05e1 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1475 microversion: 2.1 time: 1.958648 May 19 08:21:01.590515 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 711/1467] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:20:59 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1475 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:01.592157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:01.606356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:01.615076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-30d66b89-ffbf-4edf-b46b-f54f34c12f00 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39ee0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:01.626742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:01.631755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:01.633459 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-809be227-7377-4c68-8a5e-aa8851624bd7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 1.868347 May 19 08:21:01.640537 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 757/1468] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:20:59 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:01.671404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:01.678529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:01.721807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:01.722372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:01.723395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:01.728408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:01.779054 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-30d66b89-ffbf-4edf-b46b-f54f34c12f00 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.186754 May 19 08:21:01.786088 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 712/1469] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:01 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:01.791922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:01.812334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:01.848835 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:01.849441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:01.850325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:01.850826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:02.256018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:02.263995 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c567469c-648f-4966-981c-e05626e12b15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 0.476524 May 19 08:21:02.271771 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 713/1470] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:01 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:02.726556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-12deb691-9315-46a8-8c51-76a3b0156cce req-7350b684-375a-40ac-ad2f-5d51bfb2091a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec2d470-ea96-4789-b133-75e40f3ad85d", "name": "network-vif-plugged", "status": "completed", "tag": "3decf769-deaf-4196-bfcd-c90b1b5b8bea"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:02.755132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:02.757091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-12deb691-9315-46a8-8c51-76a3b0156cce req-7350b684-375a-40ac-ad2f-5d51bfb2091a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:02.760791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-12deb691-9315-46a8-8c51-76a3b0156cce req-7350b684-375a-40ac-ad2f-5d51bfb2091a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:02.774562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04772695-9f92-4b80-a778-c2526514da21 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 1.131287 May 19 08:21:02.782957 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 758/1471] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:01 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:02.811865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:02.813246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:02.822577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:02.827259 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-12deb691-9315-46a8-8c51-76a3b0156cce req-7350b684-375a-40ac-ad2f-5d51bfb2091a service nova] Creating event network-vif-plugged:3decf769-deaf-4196-bfcd-c90b1b5b8bea for instance 2ec2d470-ea96-4789-b133-75e40f3ad85d on chh1-842464-2 May 19 08:21:02.838529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:02.838980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:02.844982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:02.854763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:02.860287 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-12deb691-9315-46a8-8c51-76a3b0156cce req-7350b684-375a-40ac-ad2f-5d51bfb2091a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.582829 May 19 08:21:02.868221 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 714/1472] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:02.887114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:02.896505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:02.925141 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:02.928325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:02.931851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:02.935412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:03.519500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:03.528696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b90aab3c-0f79-4e7f-bf72-673d0e515515 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1475 microversion: 2.1 time: 0.742422 May 19 08:21:03.536743 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 759/1473] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:02 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1475 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:03.552177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf85fddd-9b87-4046-8cb4-99688c361b7e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d55e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:03.701585 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf85fddd-9b87-4046-8cb4-99688c361b7e tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.162966 May 19 08:21:03.708460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 760/1474] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:03 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:03.718382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-adf015f9-2c26-4683-9fa5-96cc1e2deb56 req-790fd49f-6e90-44a4-b8e8-d9f344d603c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "name": "network-vif-unplugged", "status": "completed", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:03.746494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-adf015f9-2c26-4683-9fa5-96cc1e2deb56 req-790fd49f-6e90-44a4-b8e8-d9f344d603c0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:03.749656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-adf015f9-2c26-4683-9fa5-96cc1e2deb56 req-790fd49f-6e90-44a4-b8e8-d9f344d603c0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:03.771942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-adf015f9-2c26-4683-9fa5-96cc1e2deb56 req-790fd49f-6e90-44a4-b8e8-d9f344d603c0 service nova] Creating event network-vif-unplugged:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh2-842464-2 May 19 08:21:03.797918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-adf015f9-2c26-4683-9fa5-96cc1e2deb56 req-790fd49f-6e90-44a4-b8e8-d9f344d603c0 service nova] Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:21:03.907023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-adf015f9-2c26-4683-9fa5-96cc1e2deb56 req-790fd49f-6e90-44a4-b8e8-d9f344d603c0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182573 May 19 08:21:03.908050 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 761/1475] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:03.934231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:03.940499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:03.964733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:03.967624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:03.969777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:03.972924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:04.029459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:04.114821 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:05.312497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:05.649579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:05.658643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:05.660236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:05.661444 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-75958ad1-ddb9-41f2-835d-42022c332de5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 2.791487 May 19 08:21:05.677149 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 715/1476] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:02 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:05.693747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:05.694905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:05.729938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:05.731599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:05.733769 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:05.742748 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:06.209965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:06.226233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f635747-e19a-4899-b8b7-0ec9522c2536 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1317 microversion: 2.1 time: 2.314425 May 19 08:21:06.227520 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 762/1477] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:03 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1317 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:06.244188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:06.256133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:06.295101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:06.295573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:06.296388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:06.298364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:06.517148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:06.534419 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9e42fa1c-7de3-4a0a-ae3a-5052a9fa02a9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 0.847783 May 19 08:21:06.539402 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 716/1478] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:05 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:06.576800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dd5c3870-0f1e-44cf-9331-4d290c0c939c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121b0670>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:06.697402 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dd5c3870-0f1e-44cf-9331-4d290c0c939c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1453 microversion: 2.1 time: 0.152629 May 19 08:21:06.699426 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 717/1479] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:06 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:06.720170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6e7d458d-fa64-4132-bf3c-3f93d1747c7a req-5c344105-e19e-4bef-933f-8a1a6abda4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:06.772600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6e7d458d-fa64-4132-bf3c-3f93d1747c7a req-5c344105-e19e-4bef-933f-8a1a6abda4ab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:06.774530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6e7d458d-fa64-4132-bf3c-3f93d1747c7a req-5c344105-e19e-4bef-933f-8a1a6abda4ab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:06.824156 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6e7d458d-fa64-4132-bf3c-3f93d1747c7a req-5c344105-e19e-4bef-933f-8a1a6abda4ab service nova] Creating event network-changed:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh2-842464-2 May 19 08:21:06.856630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [req-6e7d458d-fa64-4132-bf3c-3f93d1747c7a req-5c344105-e19e-4bef-933f-8a1a6abda4ab service nova] Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119073) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:21:06.901613 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6e7d458d-fa64-4132-bf3c-3f93d1747c7a req-5c344105-e19e-4bef-933f-8a1a6abda4ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196092 May 19 08:21:06.907782 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 718/1480] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:07.395420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:07.413352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6d917fe4-6ad7-4e16-bf7c-cbe4011cffed req-15a43d14-91cb-4067-b47d-9970a92f6803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cdd443-b415-48e2-aa1c-63d2c9995854", "tag": "e5709540-bb04-426d-8ff7-f2ddb7a8d8f8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:07.418782 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7278547-f485-45c8-907b-5bd306b259ef tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1475 microversion: 2.1 time: 1.188468 May 19 08:21:07.424083 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 763/1481] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:06 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1475 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:07.440128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6d917fe4-6ad7-4e16-bf7c-cbe4011cffed req-15a43d14-91cb-4067-b47d-9970a92f6803 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:07.441558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6d917fe4-6ad7-4e16-bf7c-cbe4011cffed req-15a43d14-91cb-4067-b47d-9970a92f6803 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:07.450411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:07.450411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:07.470982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:07.471324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:07.478825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:07.479362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:07.480652 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6d917fe4-6ad7-4e16-bf7c-cbe4011cffed req-15a43d14-91cb-4067-b47d-9970a92f6803 service nova] Creating event network-changed:e5709540-bb04-426d-8ff7-f2ddb7a8d8f8 for instance 74cdd443-b415-48e2-aa1c-63d2c9995854 on chh2-842464-2 May 19 08:21:07.491111 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6d917fe4-6ad7-4e16-bf7c-cbe4011cffed req-15a43d14-91cb-4067-b47d-9970a92f6803 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.580074 May 19 08:21:07.493657 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 719/1482] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:07.500927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:07.503114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:07.518802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:07.523637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:07.529220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:07.529938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:08.949437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:08.959384 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ebecfc86-d26f-4958-91e0-d5c77cc448a8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1507 microversion: 2.1 time: 1.464277 May 19 08:21:08.959980 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 720/1483] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:07 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1507 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:08.977032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:08.988702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:09.008673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:09.009122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:09.009951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:09.010384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:09.087047 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:11.586161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:11.590064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:11.635426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:11.640126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:11.653898 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bcf0229c-1b1d-49a6-ac31-fa7345423ffc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 4.226801 May 19 08:21:11.656545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 764/1484] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:07 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 4232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:11.665869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-275fca2b-2254-4610-afe9-50ea95936238 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f8c280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:11.766723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-275fca2b-2254-4610-afe9-50ea95936238 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1462 microversion: 2.1 time: 0.106821 May 19 08:21:11.768127 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 765/1485] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:11 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:11.777323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:11.783115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:11.804718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:11.807751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:11.810168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:11.815144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:11.862124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:11.875639 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-98e5429a-d9a7-48c0-bf78-90cea4b8d55f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 2.903490 May 19 08:21:11.887389 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 721/1486] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:08 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 2922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:11.901557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:11.902796 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:11.915341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:11.945799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:11.946552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:11.947552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:11.948672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:12.155552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:12.167018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36291739-c5c2-479c-8aa6-a698b6a0e31d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1473 microversion: 2.1 time: 0.397421 May 19 08:21:12.174040 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 766/1487] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:11 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1473 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:12.180344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-931a926d-91ae-4a9e-9f3f-88ccf867fc9c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121121f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:12.245354 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:12.269500 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-62529cc0-b832-465e-b74e-82483ad808ab tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1507 microversion: 2.1 time: 0.384388 May 19 08:21:12.270894 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-931a926d-91ae-4a9e-9f3f-88ccf867fc9c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 200 len: 1462 microversion: 2.1 time: 0.095520 May 19 08:21:12.271766 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 767/1488] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:12 2022] GET /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:12.276636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-eeb38d04-e11f-4949-8744-341ff7e33821 req-8126cfe4-1d68-4c08-aba9-0168a3acd4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee67616-6551-4084-9ed3-cdaf5574749f", "tag": "713a5191-8215-4c48-aede-a41292a8add6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:12.282179 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 722/1489] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:11 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:12.287545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1786977613", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b7dc5f35-eca1-49e0-8b3b-8195db369c3c"}, {"uuid": "098969fd-4d0f-4837-b5f1-2c77cbe36073"}, {"uuid": "b7dc5f35-eca1-49e0-8b3b-8195db369c3c"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:12.288133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-eeb38d04-e11f-4949-8744-341ff7e33821 req-8126cfe4-1d68-4c08-aba9-0168a3acd4d2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:12.288805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-eeb38d04-e11f-4949-8744-341ff7e33821 req-8126cfe4-1d68-4c08-aba9-0168a3acd4d2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:12.302096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-eeb38d04-e11f-4949-8744-341ff7e33821 req-8126cfe4-1d68-4c08-aba9-0168a3acd4d2 service nova] Creating event network-changed:713a5191-8215-4c48-aede-a41292a8add6 for instance 9ee67616-6551-4084-9ed3-cdaf5574749f on chh2-842464-2 May 19 08:21:12.307739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-eeb38d04-e11f-4949-8744-341ff7e33821 req-8126cfe4-1d68-4c08-aba9-0168a3acd4d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034564 May 19 08:21:12.308737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 768/1490] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:12.322409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:12.323981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:12.333602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:12.334066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:12.334866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:12.335330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:12.368563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] validate_networks() for [('b7dc5f35-eca1-49e0-8b3b-8195db369c3c', None, None, None, None, None), ('098969fd-4d0f-4837-b5f1-2c77cbe36073', None, None, None, None, None), ('b7dc5f35-eca1-49e0-8b3b-8195db369c3c', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:21:12.668543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:12.681437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c47e0efd-92f6-4b55-9a9c-c7f67e71f264 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1467 microversion: 2.1 time: 0.363773 May 19 08:21:12.684611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 769/1491] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:12 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1467 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:12.704569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:12.709779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:12.730565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:12.731308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:12.732264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:12.736227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:12.956130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:21:12.957482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:21:12.958250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:21:12.958922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:21:12.959558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:21:13.212893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:13.223993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:13.224498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:13.225352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:13.225804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:13.286825 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d3ce9a8-323f-45e1-95a6-1e42610bed7c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "POST /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d/action" status: 202 len: 1109 microversion: 2.1 time: 0.599914 May 19 08:21:13.296654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 770/1492] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:21:12 2022] POST /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d/action => generated 1109 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 08:21:13.302890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:13.303711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:13.313424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:13.314155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:13.315140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:13.315753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:13.965260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:13.982504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:13.984016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:13.985214 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91e92c96-c74d-4457-8075-21782f31d4d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 0.687103 May 19 08:21:13.986174 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 771/1493] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:13 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:13.990847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1043166797"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:13.991930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:14.010698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:14.011155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:14.011974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:14.012414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:14.733835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a3f389c-46d8-4bbf-aa8d-0e5e3f253534 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "POST /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3/action" status: 202 len: 0 microversion: 2.1 time: 0.745688 May 19 08:21:14.734570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 772/1494] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:21:13 2022] POST /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:21:14.744110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:14.745147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:14.755590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:14.756340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:14.757385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:14.757986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:15.542575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:15.550772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a44ad514-715f-4b01-96f1-6b3cd8fefc88 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 0.814995 May 19 08:21:15.555728 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 773/1495] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:14 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:15.575592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:15.583677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:15.608405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:15.614397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:15.615320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:15.615848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:15.859949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:21:15.861072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:21:15.861801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:21:15.862395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:21:15.863231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:21:15.894383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:15.897105 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:15.898426 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:15.900295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:15.954775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Getting quotas for project 9315d3e582f8468a92b56b0b4ee2120b. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:21:15.964530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Getting quotas for user 70ba771be4f9469085cb6ed8b1feef61 and project 9315d3e582f8468a92b56b0b4ee2120b. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:21:16.000239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:21:16.016630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:21:16.124351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:16.133632 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7eccdc98-672d-4d7a-a55a-6e35095da907 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1470 microversion: 2.1 time: 0.575768 May 19 08:21:16.149772 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 774/1496] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:15 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1470 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:16.165355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:16.166532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:16.184308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:16.190498 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-30ac78b0-7fa7-4a27-a664-89cd98b3ebb6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.906520 May 19 08:21:16.192000 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 723/1497] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:21:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:21:16.200049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:16.201172 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c28fb2f7-d335-4074-a41e-e4e9f3352310 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32120f6790>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:16.202510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:16.203816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:16.332394 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c28fb2f7-d335-4074-a41e-e4e9f3352310 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 200 len: 1453 microversion: 2.1 time: 0.138806 May 19 08:21:16.334499 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 724/1498] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:16 2022] GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:16.340029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:16.344530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:16.358871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:16.361973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:16.366139 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:16.366998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:16.845769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:16.860312 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2a059df-45c9-4bc4-b11f-4ce70d86ee72 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1514 microversion: 2.1 time: 0.710810 May 19 08:21:16.871806 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 775/1499] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:16 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1514 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:16.877873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:16.882567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:16.897413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:16.899698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:16.900748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:16.901965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:16.966084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:16.977245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:16.979108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:16.980790 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a8e348d9-4084-4790-8a6a-5d108928b5d9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 0.644839 May 19 08:21:16.981608 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 725/1500] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:16 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:16.988989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-22d96717-eb9e-41ed-a0a5-539a84c1e11c tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:16.989922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-22d96717-eb9e-41ed-a0a5-539a84c1e11c tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:17.090588 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-22d96717-eb9e-41ed-a0a5-539a84c1e11c tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:17.100044 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-22d96717-eb9e-41ed-a0a5-539a84c1e11c tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1213 microversion: 2.1 time: 0.117195 May 19 08:21:17.105483 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 726/1501] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:16 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1213 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:17.119018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-c67d810f-3e5d-440e-9e0e-b793eb646c35 req-20b5c6d1-008d-4fc0-aa66-ed0b31dbbfd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:17.148039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c67d810f-3e5d-440e-9e0e-b793eb646c35 req-20b5c6d1-008d-4fc0-aa66-ed0b31dbbfd3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:17.148763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c67d810f-3e5d-440e-9e0e-b793eb646c35 req-20b5c6d1-008d-4fc0-aa66-ed0b31dbbfd3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:17.170030 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-c67d810f-3e5d-440e-9e0e-b793eb646c35 req-20b5c6d1-008d-4fc0-aa66-ed0b31dbbfd3 service nova] Creating event network-vif-unplugged:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:21:17.175695 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-c67d810f-3e5d-440e-9e0e-b793eb646c35 req-20b5c6d1-008d-4fc0-aa66-ed0b31dbbfd3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064486 May 19 08:21:17.176869 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 727/1502] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:17.202357 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd505eea-43c3-4606-9acd-b0c09008e427 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "POST /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197/action" status: 202 len: 0 microversion: 2.1 time: 0.326467 May 19 08:21:17.203203 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 776/1503] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:21:16 2022] POST /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:21:17.233004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:17.236866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:17.276638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:17.277344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:17.278294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:17.278842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:17.565896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:17.566626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:17.598846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:17.599248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:17.602170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:17.603616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:17.979432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:17.998330 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad8ee321-a1d0-49e5-b0cc-4d9192ecc54b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1469 microversion: 2.1 time: 0.782267 May 19 08:21:17.999035 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 777/1504] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:17 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1469 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:18.007313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9578c2d3-8c71-4897-8c7e-702edc0a6ec8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211fef310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:18.081093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9578c2d3-8c71-4897-8c7e-702edc0a6ec8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 200 len: 1453 microversion: 2.1 time: 0.080927 May 19 08:21:18.089590 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 778/1505] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:17 2022] GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:18.096557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:18.097328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:18.106501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:18.107164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:18.107978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:18.108797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:18.290467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:18.302584 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6e184a18-9b00-4867-bac4-4046117723b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 1.124074 May 19 08:21:18.312075 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 728/1506] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:17 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:18.314855 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:18.315489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:18.335093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:18.335561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:18.336428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:18.336874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:18.638573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:18.643905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:18.659524 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec77e5cc-cc2a-42b1-ac25-92a98698a72c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1514 microversion: 2.1 time: 0.562186 May 19 08:21:18.661057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 779/1507] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:18 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1514 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:18.673733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:18.680386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:18.698359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:18.701390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:18.703815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:18.707937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:19.278561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:19.292936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea112060-68e3-4b7b-ae69-7cc80d8f0229 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1271 microversion: 2.1 time: 0.630368 May 19 08:21:19.303761 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 780/1508] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:18 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1271 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:19.314488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:19.314488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:19.337008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:19.337508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:19.338314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:19.338761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:20.030736 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:20.055176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:20.061030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:20.069987 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cea28a55-0f2d-4755-8a59-cf186f147ee1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 1.765034 May 19 08:21:20.071310 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 729/1509] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:18 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:20.106226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1ceab3fa-40f2-41d9-b2cd-badc078acbe7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f393a0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:20.322581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:20.341655 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5677e5ca-e34e-47cf-88fd-60f2ef009af5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1469 microversion: 2.1 time: 1.040757 May 19 08:21:20.344518 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 781/1510] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:19 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1469 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:20.360524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:20.362168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:20.412139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:20.417116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:20.423198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:20.426026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:22.253461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:22.267247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e51add9c-4b11-48f7-9c9e-8ba1ff871205 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1210 microversion: 2.1 time: 1.921257 May 19 08:21:22.271151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 782/1511] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:20 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1210 bytes in 1926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:22.283063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:22.285828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:22.318459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:22.322664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:22.331087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:22.333997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:23.111544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:23.148856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46ce9085-46f4-4ff8-b108-efbf7785c557 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1514 microversion: 2.1 time: 0.869460 May 19 08:21:23.150614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 783/1512] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:22 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1514 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:23.179850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:23.184456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:23.211408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:23.216254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:23.226605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:23.228004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:23.694571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:23.711643 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3070dc25-dbaf-4c5a-978d-ac92d53d2870 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1313 microversion: 2.1 time: 0.556206 May 19 08:21:23.715465 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 784/1513] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:23 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:23.728886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:23.738916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:23.746070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:23.746812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:23.748282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:23.748897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:24.042051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:24.070126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:24.073735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:24.083528 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-864b5a2a-6800-4578-93f6-56de2973f77a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 0.366083 May 19 08:21:24.101617 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 785/1514] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:23 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:24.132046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:24.141245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:24.185933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:24.187465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:24.189520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:24.190220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:24.641831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:24.654883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0573fba6-aaab-41c2-b0b9-e77719140482 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1469 microversion: 2.1 time: 0.547128 May 19 08:21:24.662521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 786/1515] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:24 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1469 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:24.696770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:24.698681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:24.725452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:24.725994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:24.733998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:24.742643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:25.255171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:25.281969 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21e7f695-6bca-4add-91b2-809e4b0e7eac tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1198 microversion: 2.1 time: 0.617262 May 19 08:21:25.289945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 787/1516] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:24 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1198 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:25.297068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:25.297741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:25.304491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:25.307910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:25.308880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:25.311514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:25.931209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:25.938445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:25.953651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6676940f-b843-4301-a7e7-d3f734408e53 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1514 microversion: 2.1 time: 0.660596 May 19 08:21:25.956001 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 788/1517] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:25 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1514 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:25.987446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:26.001239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:26.033360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:26.035217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:26.037483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:26.039376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:26.678685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:26.696502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-635fa310-bf07-4bb4-8573-7206d5c7f70b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1334 microversion: 2.1 time: 0.719021 May 19 08:21:26.698932 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 789/1518] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:25 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1334 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:26.722341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d678b089-10f1-44b5-ba0e-b04e791997a3 req-26659f2c-1c02-4cb7-a562-97cc2c723632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "name": "network-vif-plugged", "status": "completed", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:26.757347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d678b089-10f1-44b5-ba0e-b04e791997a3 req-26659f2c-1c02-4cb7-a562-97cc2c723632 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:26.760856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d678b089-10f1-44b5-ba0e-b04e791997a3 req-26659f2c-1c02-4cb7-a562-97cc2c723632 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:26.802530 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d678b089-10f1-44b5-ba0e-b04e791997a3 req-26659f2c-1c02-4cb7-a562-97cc2c723632 service nova] Creating event network-vif-plugged:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:21:26.824016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-d678b089-10f1-44b5-ba0e-b04e791997a3 req-26659f2c-1c02-4cb7-a562-97cc2c723632 service nova] Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:21:26.847385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d678b089-10f1-44b5-ba0e-b04e791997a3 req-26659f2c-1c02-4cb7-a562-97cc2c723632 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140994 May 19 08:21:26.848665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 790/1519] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:26.855043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:26.856180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:26.866485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:26.867765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:26.868843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:26.869519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:27.097288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=8 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:27.317028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:27.329582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:27.333483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:27.337887 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04717adf-4376-4d58-bbbf-9c33a36b39f1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 0.487667 May 19 08:21:27.340439 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 791/1520] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:26 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:27.355318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:27.357106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:27.378093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:27.378586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:27.379412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:27.379859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:28.264933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:28.273637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e86ef1a9-325a-4f25-8f25-2bd656b5a647 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1469 microversion: 2.1 time: 0.931702 May 19 08:21:28.274247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 792/1521] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:27 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1469 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:28.288827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:28.289764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:28.308713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:28.309169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:28.311130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:28.312740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:28.335442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:28.946408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:28.966314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-154428d0-ddc5-4e78-be7c-298cb64a7dd4 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1198 microversion: 2.1 time: 0.687626 May 19 08:21:28.976079 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 793/1522] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:28 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1198 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:28.990944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:29.007966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:29.030503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:29.037805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:29.039131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:29.039855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:29.795232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:29.810522 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-336459f0-0583-4ee8-a405-d1fc82a9e81c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1514 microversion: 2.1 time: 0.838854 May 19 08:21:29.823256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 794/1523] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:28 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1514 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:29.829734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:29.830697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:29.838982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:29.840033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:29.841439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:29.842217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:30.047485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=31 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:31.255357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:31.271365 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8edd9738-b7a3-4e9c-9271-b991b98d7782 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 1.446187 May 19 08:21:31.271996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 795/1524] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:29 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:31.286095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:31.286719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:31.323608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:31.324076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:31.324939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:31.325409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:32.647871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:32.652597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:32.665528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:32.674777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:32.684088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc50224a-a65c-4617-8500-d0beb87e469b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1362 microversion: 2.25 time: 1.409872 May 19 08:21:32.686401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 796/1525] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:31 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1362 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:32.711022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9ac2ad09-4044-45fa-afb5-dcd7b69d0f78 req-281a50ca-6707-45b3-a276-d0aaa454e8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "name": "network-vif-unplugged", "status": "completed", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:32.741913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9ac2ad09-4044-45fa-afb5-dcd7b69d0f78 req-281a50ca-6707-45b3-a276-d0aaa454e8cd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:32.750806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9ac2ad09-4044-45fa-afb5-dcd7b69d0f78 req-281a50ca-6707-45b3-a276-d0aaa454e8cd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:32.786852 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9ac2ad09-4044-45fa-afb5-dcd7b69d0f78 req-281a50ca-6707-45b3-a276-d0aaa454e8cd service nova] Creating event network-vif-unplugged:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:21:32.810291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-9ac2ad09-4044-45fa-afb5-dcd7b69d0f78 req-281a50ca-6707-45b3-a276-d0aaa454e8cd service nova] Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:21:32.838555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9ac2ad09-4044-45fa-afb5-dcd7b69d0f78 req-281a50ca-6707-45b3-a276-d0aaa454e8cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147773 May 19 08:21:32.839172 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 797/1526] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:32.856793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7f6596bb-1026-4467-b7bd-5d79cde3a6d3 req-8cb6cbeb-76ab-4769-9959-ee3e8d5df7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee67616-6551-4084-9ed3-cdaf5574749f", "name": "network-vif-plugged", "status": "completed", "tag": "713a5191-8215-4c48-aede-a41292a8add6"}, {"server_uuid": "d08df6ba-4511-436a-859a-055e37e683d3", "name": "network-vif-plugged", "status": "completed", "tag": "2a4fb41a-95d0-439a-bbb4-06fd760f83be"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:32.882324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7f6596bb-1026-4467-b7bd-5d79cde3a6d3 req-8cb6cbeb-76ab-4769-9959-ee3e8d5df7d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:32.884779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7f6596bb-1026-4467-b7bd-5d79cde3a6d3 req-8cb6cbeb-76ab-4769-9959-ee3e8d5df7d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:32.916897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7f6596bb-1026-4467-b7bd-5d79cde3a6d3 req-8cb6cbeb-76ab-4769-9959-ee3e8d5df7d5 service nova] Creating event network-vif-plugged:713a5191-8215-4c48-aede-a41292a8add6 for instance 9ee67616-6551-4084-9ed3-cdaf5574749f on chh2-842464-2 May 19 08:21:32.923260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7f6596bb-1026-4467-b7bd-5d79cde3a6d3 req-8cb6cbeb-76ab-4769-9959-ee3e8d5df7d5 service nova] Creating event network-vif-plugged:2a4fb41a-95d0-439a-bbb4-06fd760f83be for instance d08df6ba-4511-436a-859a-055e37e683d3 on chh2-842464-2 May 19 08:21:32.956193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7f6596bb-1026-4467-b7bd-5d79cde3a6d3 req-8cb6cbeb-76ab-4769-9959-ee3e8d5df7d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110208 May 19 08:21:32.957715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 798/1527] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:33.589225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:33.590198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:33.614521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=80 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:33.617750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:33.620258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:33.623271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:33.633757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:33.954919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:33.963025 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aba87220-ac18-4c7c-a5b2-d1382b65498e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1469 microversion: 2.1 time: 1.003308 May 19 08:21:33.963622 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 799/1528] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:32 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1469 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:33.975523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:33.983006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:33.994589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:33.995036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:33.995834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:33.996256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:34.287050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:34.297059 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f055e49-98dd-497e-b2c3-915d2932d7fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1198 microversion: 2.1 time: 0.332252 May 19 08:21:34.299021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 800/1529] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:33 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1198 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:34.306925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:34.311029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:34.326649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:34.327654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:34.328503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:34.331357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:34.581935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:34.597109 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6a1bc80-b286-41d2-9959-1f61b52b20f5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1514 microversion: 2.1 time: 0.294173 May 19 08:21:34.601147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 801/1530] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:34 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:34.606390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:34.607142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:34.620021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:34.620472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:34.621249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:34.621745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:34.899879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:34.909416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-069ef1ab-8232-4af6-a58a-1bf2778b7741 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.306950 May 19 08:21:34.910019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 802/1531] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:34 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:34.917683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:34.918259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:34.933611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:34.934322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:34.935137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:34.935580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:35.157180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:35.171678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:35.173336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:35.174726 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7401800-7304-43b6-b804-c35f1a0a6f49 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1558 microversion: 2.25 time: 0.263740 May 19 08:21:35.213961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 803/1532] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:34 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1558 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:35.234931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-335ea723-8c21-4e6e-a404-6d5bd5d2837b req-3ebaa266-a340-43f9-8846-bb21a0fc1dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}, {"name": "network-changed", "server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "tag": "eba7f373-a4f9-4095-b1f1-a87d88d248af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:35.290150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-335ea723-8c21-4e6e-a404-6d5bd5d2837b req-3ebaa266-a340-43f9-8846-bb21a0fc1dfe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:35.292729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-335ea723-8c21-4e6e-a404-6d5bd5d2837b req-3ebaa266-a340-43f9-8846-bb21a0fc1dfe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:35.360189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-335ea723-8c21-4e6e-a404-6d5bd5d2837b req-3ebaa266-a340-43f9-8846-bb21a0fc1dfe service nova] Creating event network-changed:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:21:35.365027 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-335ea723-8c21-4e6e-a404-6d5bd5d2837b req-3ebaa266-a340-43f9-8846-bb21a0fc1dfe service nova] Creating event network-changed:eba7f373-a4f9-4095-b1f1-a87d88d248af for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:21:35.380825 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-335ea723-8c21-4e6e-a404-6d5bd5d2837b req-3ebaa266-a340-43f9-8846-bb21a0fc1dfe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.161148 May 19 08:21:35.383212 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 804/1533] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:35.398208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:35.402209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:35.417434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:35.417943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:35.418861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:35.419726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:36.010918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:36.025103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7def1eff-ea56-43e0-b001-2633a1dfeed0 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1469 microversion: 2.1 time: 0.638523 May 19 08:21:36.025817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 805/1534] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:35 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1469 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:36.037890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:36.039065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:36.060079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:36.062341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:36.063600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:36.066364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:36.546273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 9ee67616-6551-4084-9ed3-cdaf5574749f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:21:36.565475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5223ed77-abaf-4f8d-96a5-504e0c931345 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 2051 microversion: 2.25 time: 0.538288 May 19 08:21:36.569511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 806/1535] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:21:36 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 2051 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:21:36.576927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:36.584117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:36.603698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:36.606140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:36.608887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:36.611368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:37.147812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:37.169563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-725a6148-9c2d-4ed2-b027-ff60d1a4c4d1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1198 microversion: 2.1 time: 0.596561 May 19 08:21:37.170402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 807/1536] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:36 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1198 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:37.181367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-db7397bd-bfc8-475a-8ff2-0b17cbe32fdc req-eb0db06a-45ea-4fc7-a09e-dc7ae0f1d6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cdd443-b415-48e2-aa1c-63d2c9995854", "name": "network-vif-plugged", "status": "completed", "tag": "e5709540-bb04-426d-8ff7-f2ddb7a8d8f8"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:37.211404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-db7397bd-bfc8-475a-8ff2-0b17cbe32fdc req-eb0db06a-45ea-4fc7-a09e-dc7ae0f1d6ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:37.211404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-db7397bd-bfc8-475a-8ff2-0b17cbe32fdc req-eb0db06a-45ea-4fc7-a09e-dc7ae0f1d6ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:37.233133 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-db7397bd-bfc8-475a-8ff2-0b17cbe32fdc req-eb0db06a-45ea-4fc7-a09e-dc7ae0f1d6ee service nova] Creating event network-vif-plugged:e5709540-bb04-426d-8ff7-f2ddb7a8d8f8 for instance 74cdd443-b415-48e2-aa1c-63d2c9995854 on chh2-842464-2 May 19 08:21:37.242079 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-db7397bd-bfc8-475a-8ff2-0b17cbe32fdc req-eb0db06a-45ea-4fc7-a09e-dc7ae0f1d6ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070140 May 19 08:21:37.242704 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 808/1537] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:37.270144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:37.271176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:37.287093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:37.287566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:37.288376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:37.288823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:37.779416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:37.808121 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-401d8e0f-a6b6-4d9c-8ffb-5f1b366375c1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1520 microversion: 2.1 time: 0.557655 May 19 08:21:37.823608 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 809/1538] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:37 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1520 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:37.823608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:37.823608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:37.838413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:37.838978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:37.840090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:37.840533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:38.763956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:38.784591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00dd88b8-9387-4404-ae36-8a6fc58f314b tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.958401 May 19 08:21:38.786304 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 810/1539] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:37 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:38.791323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab9ea5ed-c45b-40c2-928c-026ceea00846 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:38.793577 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:21:38.793577 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:21:38.802276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab9ea5ed-c45b-40c2-928c-026ceea00846 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:38.814819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab9ea5ed-c45b-40c2-928c-026ceea00846 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:38.816307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab9ea5ed-c45b-40c2-928c-026ceea00846 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:38.816760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab9ea5ed-c45b-40c2-928c-026ceea00846 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:38.934833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab9ea5ed-c45b-40c2-928c-026ceea00846 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.144742 May 19 08:21:38.946284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 811/1540] 10.222.0.78 () {60 vars in 1216 bytes} [Thu May 19 08:21:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:21:38.964466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:38.970380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:39.005147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:39.006856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:39.011180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:39.022137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:40.104669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:40.124818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c08d5cf-57ca-4f90-a3f5-41a0e6cc38af tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1462 microversion: 2.1 time: 1.171994 May 19 08:21:40.132843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 812/1541] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:38 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1462 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:40.138798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:40.141958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:40.158930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:40.159550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:40.160456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:40.161027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:40.486842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:40.501891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ca9062c-9767-4026-a026-dd35dec698b0 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1381 microversion: 2.1 time: 0.367656 May 19 08:21:40.502835 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 813/1542] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:40 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1381 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:40.511088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-26eccf50-bb3a-4af4-9a1f-175db3739157 req-3df8e8f4-0039-49c4-8343-20c614627ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "tag": "9c50aa96-f90d-45f6-b67f-8475b7ed204c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:40.531103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-26eccf50-bb3a-4af4-9a1f-175db3739157 req-3df8e8f4-0039-49c4-8343-20c614627ab1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:40.531958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-26eccf50-bb3a-4af4-9a1f-175db3739157 req-3df8e8f4-0039-49c4-8343-20c614627ab1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:40.571438 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-26eccf50-bb3a-4af4-9a1f-175db3739157 req-3df8e8f4-0039-49c4-8343-20c614627ab1 service nova] Creating event network-changed:9c50aa96-f90d-45f6-b67f-8475b7ed204c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:21:40.584704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-26eccf50-bb3a-4af4-9a1f-175db3739157 req-3df8e8f4-0039-49c4-8343-20c614627ab1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074751 May 19 08:21:40.585996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 814/1543] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:40.603883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:40.606046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:40.628654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:40.629973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:40.631018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:40.631635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:41.858881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:41.878882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47dd6015-42be-467a-82bd-0a5a4fb6aba0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1520 microversion: 2.1 time: 1.291422 May 19 08:21:41.879589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 815/1544] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:40 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1520 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:41.888735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d9a08da4-120c-48a6-afa2-fcd1dd317c94 req-a5708406-005c-4f8a-b71d-e2e30f5beffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "name": "network-vif-plugged", "status": "completed", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:41.907477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d9a08da4-120c-48a6-afa2-fcd1dd317c94 req-a5708406-005c-4f8a-b71d-e2e30f5beffb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:41.908006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d9a08da4-120c-48a6-afa2-fcd1dd317c94 req-a5708406-005c-4f8a-b71d-e2e30f5beffb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:41.925161 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d9a08da4-120c-48a6-afa2-fcd1dd317c94 req-a5708406-005c-4f8a-b71d-e2e30f5beffb service nova] Creating event network-vif-plugged:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:21:41.930522 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d9a08da4-120c-48a6-afa2-fcd1dd317c94 req-a5708406-005c-4f8a-b71d-e2e30f5beffb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049668 May 19 08:21:41.931526 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 816/1545] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:41.955049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:41.966258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:41.974662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:41.975335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:41.976576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:41.977071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:42.017612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:42.382298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:42.393748 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-455db747-6e5b-40fc-ad2d-2c502be70b69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.460513 May 19 08:21:42.395674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 817/1546] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:41 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:42.409672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:42.410581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:42.425584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:42.430466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:42.431752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:42.432580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:42.719070 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1ceab3fa-40f2-41d9-b2cd-badc078acbe7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 200 len: 1453 microversion: 2.1 time: 22.643522 May 19 08:21:42.720562 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 730/1547] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:20 2022] GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 1453 bytes in 22649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:42.995729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4d69364-2eb0-4d56-a7f8-a775f697f4aa tempest-MigrationsAdminTest-14507451 tempest-MigrationsAdminTest-14507451-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1613 microversion: 2.1 time: 0.597524 May 19 08:21:42.998432 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 818/1548] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:42 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1613 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:43.023274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-99eeb47b-94d2-42f3-a79d-9c8fc5808001 req-12b19ae6-0fe6-4eca-9946-fb87909b995e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "tag": "ed1acf02-4c4c-43e9-bf64-2191aef9516c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:43.063435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-99eeb47b-94d2-42f3-a79d-9c8fc5808001 req-12b19ae6-0fe6-4eca-9946-fb87909b995e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:43.065944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-99eeb47b-94d2-42f3-a79d-9c8fc5808001 req-12b19ae6-0fe6-4eca-9946-fb87909b995e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:43.091605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-99eeb47b-94d2-42f3-a79d-9c8fc5808001 req-12b19ae6-0fe6-4eca-9946-fb87909b995e service nova] Creating event network-changed:ed1acf02-4c4c-43e9-bf64-2191aef9516c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:21:43.101694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-99eeb47b-94d2-42f3-a79d-9c8fc5808001 req-12b19ae6-0fe6-4eca-9946-fb87909b995e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097087 May 19 08:21:43.117172 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 819/1549] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:43.124078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:43.125276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:43.134056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:43.134957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:43.135963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:43.136611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:43.292909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:43.300568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:43.320177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:43.320997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:43.329671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:43.335467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:43.983584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:44.001021 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-343ed871-d1a1-457d-a931-0e6f51ab86b1 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1520 microversion: 2.1 time: 0.879281 May 19 08:21:44.006641 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 820/1550] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:43 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1520 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:44.038690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:44.040081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:44.060379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.061240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.062315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.062968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.115095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:21:44.303837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f115c2e2-80c6-4e09-8000-0908ed10588f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 204 len: 0 microversion: 2.1 time: 0.286844 May 19 08:21:44.304667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 821/1551] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:21:44 2022] DELETE /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:21:44.316643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:44.324248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:44.348932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.356013 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a1234b60-a072-4311-ab81-444d96229da8 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1532 microversion: 2.1 time: 1.633856 May 19 08:21:44.357483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.359294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.359905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.370198 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 731/1552] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:42 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1532 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:44.381087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f3189385-2085-4490-879d-2610a114cf49 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32120f68b0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:44.670283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:44.705553 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b46dc26-4839-4e10-ba0e-2932c927f330 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.397469 May 19 08:21:44.709162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 822/1553] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:44 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:44.720747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-179f8e1a-d2c3-433d-958e-a3ffc7ab7074 req-deb5aaf8-f4a9-4f80-bb77-453b6fdf847f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec2d470-ea96-4789-b133-75e40f3ad85d", "name": "network-vif-plugged", "status": "completed", "tag": "3decf769-deaf-4196-bfcd-c90b1b5b8bea"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:44.750845 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f3189385-2085-4490-879d-2610a114cf49 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 200 len: 1453 microversion: 2.1 time: 0.379441 May 19 08:21:44.751675 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 732/1554] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:44 2022] GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 1453 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:44.770094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ac88954-3f84-433e-9e7d-596b76d3046b", "device": "/dev/xvdb"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:44.771806 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:44.781523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-179f8e1a-d2c3-433d-958e-a3ffc7ab7074 req-deb5aaf8-f4a9-4f80-bb77-453b6fdf847f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.782166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-179f8e1a-d2c3-433d-958e-a3ffc7ab7074 req-deb5aaf8-f4a9-4f80-bb77-453b6fdf847f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.808551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.814862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.815838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.816288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.819936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-179f8e1a-d2c3-433d-958e-a3ffc7ab7074 req-deb5aaf8-f4a9-4f80-bb77-453b6fdf847f service nova] Creating event network-vif-plugged:3decf769-deaf-4196-bfcd-c90b1b5b8bea for instance 2ec2d470-ea96-4789-b133-75e40f3ad85d on chh1-842464-2 May 19 08:21:44.837833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-179f8e1a-d2c3-433d-958e-a3ffc7ab7074 req-deb5aaf8-f4a9-4f80-bb77-453b6fdf847f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126236 May 19 08:21:44.838846 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 823/1555] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:44.849958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:44.854208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:44.867943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.877919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:44.878996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:44.879606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.110070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:45.119927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-57b21b04-70a1-4600-b38b-84a854e96c0f tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1468 microversion: 2.1 time: 0.279333 May 19 08:21:45.129448 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 824/1556] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:44 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1468 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:45.129448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:45.129448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:45.135206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.135815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.136616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.137070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.365586 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-648fdcd1-c44a-45b7-a18a-79519720119e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "POST /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.606104 May 19 08:21:45.367059 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 733/1557] 10.222.0.78 () {62 vars in 1363 bytes} [Thu May 19 08:21:44 2022] POST /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 194 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:21:45.374148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:45.375108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:45.383184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.384065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.385167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.385787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.400937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f8a9a84-7c97-43ac-ae97-baf41463b821 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1532 microversion: 2.1 time: 0.278675 May 19 08:21:45.417235 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 825/1558] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:45 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1532 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:45.434617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c35ed7f7-b4f9-4725-bf47-b05e5014f381 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:45.437914 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:21:45.437914 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:21:45.452340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c35ed7f7-b4f9-4725-bf47-b05e5014f381 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.452806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c35ed7f7-b4f9-4725-bf47-b05e5014f381 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.453658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c35ed7f7-b4f9-4725-bf47-b05e5014f381 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.454195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c35ed7f7-b4f9-4725-bf47-b05e5014f381 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.512989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c35ed7f7-b4f9-4725-bf47-b05e5014f381 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.082857 May 19 08:21:45.516323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 826/1559] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:21:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:45.528505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": false, "disk_over_commit": false}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:45.530833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:45.551900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.552929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.558192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:45.558688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:45.623348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lazy-loading 'flavor' on Instance uuid 74cdd443-b415-48e2-aa1c-63d2c9995854 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:21:45.643417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Going to try to live migrate instance to chh1-842464-2 {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:21:46.511411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:46.522206 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dfb74ea8-7cf2-452d-ac5b-2bcc557087a3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1520 microversion: 2.1 time: 1.152788 May 19 08:21:46.537051 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 734/1560] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:45 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1520 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:46.553800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:46.554436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:46.585563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:46.591875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:46.594060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:46.597133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:47.212880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:47.227582 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d78e709d-7852-4dee-8725-f3b86d59589a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.689031 May 19 08:21:47.228809 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 735/1561] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:46 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:47.239981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-50b30745-2dbb-4da8-a420-f2c4435f0ddd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32120f6790>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:47.358982 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-50b30745-2dbb-4da8-a420-f2c4435f0ddd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 200 len: 1462 microversion: 2.1 time: 0.127486 May 19 08:21:47.362063 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 736/1562] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:47 2022] GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 1462 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:47.376147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:47.379739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:47.394145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:47.395066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:47.396155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:47.401774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:47.638459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:47.652994 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ee5633c7-11c1-4c1d-955a-d2243b432e7d tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 200 len: 1426 microversion: 2.1 time: 0.282773 May 19 08:21:47.664392 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 737/1563] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:47 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 1426 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:47.670763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-12ef36f0-0bad-4b79-ab3f-6de7ea474645 req-9c98f0fe-6a0b-42b7-a36e-a68257662091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37112c34-ab2c-43a7-8fc5-466eb0c93197", "name": "network-vif-deleted", "tag": "c4342d41-5da0-4c04-95c2-824185ac4c8e"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:47.680246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-12ef36f0-0bad-4b79-ab3f-6de7ea474645 req-9c98f0fe-6a0b-42b7-a36e-a68257662091 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:47.680804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-12ef36f0-0bad-4b79-ab3f-6de7ea474645 req-9c98f0fe-6a0b-42b7-a36e-a68257662091 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:47.713393 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-12ef36f0-0bad-4b79-ab3f-6de7ea474645 req-9c98f0fe-6a0b-42b7-a36e-a68257662091 service nova] Creating event network-vif-deleted:c4342d41-5da0-4c04-95c2-824185ac4c8e for instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 on chh1-842464-2 May 19 08:21:47.728655 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-12ef36f0-0bad-4b79-ab3f-6de7ea474645 req-9c98f0fe-6a0b-42b7-a36e-a68257662091 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062358 May 19 08:21:47.730464 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 738/1564] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:47.741097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6f7dee63-6d27-49f9-9e4a-8b144ab6c683 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217c03430>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:47.864150 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6f7dee63-6d27-49f9-9e4a-8b144ab6c683 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 200 len: 1462 microversion: 2.1 time: 0.132223 May 19 08:21:47.865149 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 739/1565] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:47 2022] GET /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 1462 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:47.872478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:47.873459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:47.881397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:47.882002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:47.883025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:47.883614 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:48.332920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:48.343967 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1293baac-0468-49f2-88f3-3fa4f8a6e1e0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1505 microversion: 2.1 time: 0.477283 May 19 08:21:48.347226 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 740/1566] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:47 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:48.357201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:48.363754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:48.379269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:48.382578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:48.383504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:48.384057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:48.771464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:48.783481 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2a502876-b863-445c-8e11-4763e6065b18 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1468 microversion: 2.1 time: 0.432849 May 19 08:21:48.784425 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 741/1567] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:48 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1468 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:48.796973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:48.798127 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:48.805423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:48.806120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:48.820122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:48.821171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.019645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:49.029532 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cb94d0eb-d6d6-4f6a-9042-ba2cd1340ef6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.243614 May 19 08:21:49.041449 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 742/1568] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:48 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:49.047688 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:49.048326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:49.055603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.056009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.056797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.057474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.258801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a70da1a4-f970-4a09-bdbb-5c0bca15ac13 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854/action" status: 202 len: 0 microversion: 2.1 time: 3.733126 May 19 08:21:49.258801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 827/1569] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:21:45 2022] POST /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854/action => generated 0 bytes in 3735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:21:49.264763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:49.265799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 37112c34-ab2c-43a7-8fc5-466eb0c93197] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:49.303140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.304144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.307838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.313708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.362600 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] HTTP exception thrown: Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 could not be found. May 19 08:21:49.367429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Request method failure captured: May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 HTTP/1.1 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzc1JXj7dArG2eH3xx1x5soQ5r5nPorRhVhF976NusLBXnqdcjLf9KTuVtcNTL_L4aolb81UjWM3stSe09vBU78AIJZWIR8YSsj8kqwl_tvRa2Mp2L8EQgNIqEBY30_-yNhh8hpxoE4oZ2pc6m9rbxv1m9Ixz5WLdg2nB4yyJnHvpc May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b95a24d08874740a500ff176d819cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MigrationsAdminTest-1941838293 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MigrationsAdminTest-1941838293-project May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f40ef4d25a474b3c83a3c2808a87a30d May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MigrationsAdminTest-1941838293-project May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 could not be found. May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '37112c34-ab2c-43a7-8fc5-466eb0c93197'} May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 could not be found. May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 could not be found. May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:21:49.377824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 could not be found. May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Returning 404 to user: Instance 37112c34-ab2c-43a7-8fc5-466eb0c93197 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3590eca4-1a25-43a8-8a74-9ff0e6a1bce6 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197" status: 404 len: 111 microversion: 2.1 time: 0.120024 May 19 08:21:49.384978 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 828/1570] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:49 2022] GET /compute/v2.1/servers/37112c34-ab2c-43a7-8fc5-466eb0c93197 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:21:49.385755 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b5a3c423-2cd7-49d8-86ae-5c353c40e874 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 200 len: 1505 microversion: 2.1 time: 0.342498 May 19 08:21:49.398145 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 743/1571] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:49 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:49.408714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:49.409661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:49.412824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-365530413"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:49.415174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:49.426032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.426510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.431205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.431784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.439350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.439830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.442509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.443833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.723231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:49.743724 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a6222215-b931-4703-9ebe-af52e1178146 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.343489 May 19 08:21:49.745743 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 744/1572] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:49 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:49.759989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:49.761492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:49.778428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.780867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.782088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.782830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.833472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:21:49.964813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-605b5556-2e06-459d-b477-40577a5622bc tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "POST /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444/action" status: 202 len: 0 microversion: 2.1 time: 0.582565 May 19 08:21:49.965665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 829/1573] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:21:49 2022] POST /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:21:49.972566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:49.973266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:49.983503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.984092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:49.984952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:49.985468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:50.054440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:21:50.111410 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fbf881bc-1b93-4111-abb3-4802e419beed tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 204 len: 0 microversion: 2.1 time: 0.363209 May 19 08:21:50.116672 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 745/1574] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:21:49 2022] DELETE /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:21:50.131160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-32035a16-364f-49f5-9f5b-9a030d67f450 req-a7e4e0eb-ee99-4c7e-a58a-135d3fee60af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08df6ba-4511-436a-859a-055e37e683d3", "name": "network-vif-unplugged", "status": "completed", "tag": "2a4fb41a-95d0-439a-bbb4-06fd760f83be"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:50.150758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-32035a16-364f-49f5-9f5b-9a030d67f450 req-a7e4e0eb-ee99-4c7e-a58a-135d3fee60af service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:50.152104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-32035a16-364f-49f5-9f5b-9a030d67f450 req-a7e4e0eb-ee99-4c7e-a58a-135d3fee60af service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:50.169602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:50.184713 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-32035a16-364f-49f5-9f5b-9a030d67f450 req-a7e4e0eb-ee99-4c7e-a58a-135d3fee60af service nova] Creating event network-vif-unplugged:2a4fb41a-95d0-439a-bbb4-06fd760f83be for instance d08df6ba-4511-436a-859a-055e37e683d3 on chh2-842464-2 May 19 08:21:50.199106 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-32035a16-364f-49f5-9f5b-9a030d67f450 req-a7e4e0eb-ee99-4c7e-a58a-135d3fee60af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082054 May 19 08:21:50.202507 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 746/1575] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:50.221923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d2404606-14c1-4727-a0db-e013e2247fe5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b99430>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:50.250815 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53a3f91e-b4d3-4430-af1f-055045441d61 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 204 len: 0 microversion: 2.1 time: 0.282737 May 19 08:21:50.252817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 830/1576] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:21:49 2022] DELETE /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:21:50.266865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:50.267679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:50.277081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:50.277621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:50.278397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:50.278839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:50.312706 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d2404606-14c1-4727-a0db-e013e2247fe5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.106671 May 19 08:21:50.318992 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 747/1577] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:50 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:50.319781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:50.321398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:50.331642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:50.332217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:50.333056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:50.333909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:50.996676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:51.015098 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3c99582-8b6d-40f5-bdd9-6f7cf7ecb990 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.760647 May 19 08:21:51.017494 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 831/1578] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:50 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:51.040673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-194478589", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "5cd8d735-7e64-4a47-aa48-e0dddb7b372f"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:51.054858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:51.066267 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f64a21f4-5a1f-41cd-95a8-3670fc8ccc11 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1533 microversion: 2.1 time: 0.750550 May 19 08:21:51.079410 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 748/1579] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:50 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1533 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:51.087026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:51.088489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:51.097603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:51.098632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:51.100232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:51.100814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:51.144840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] validate_networks() for [('5cd8d735-7e64-4a47-aa48-e0dddb7b372f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:21:51.808001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:51.812656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:51.825150 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-84860993-f26f-4094-9ab0-134f2ae4c290 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.738851 May 19 08:21:51.827154 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 749/1580] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:51 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:51.837447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3dc8a1db-5fe9-452c-a04a-a461b94af092 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:51.933055 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3dc8a1db-5fe9-452c-a04a-a461b94af092 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.104282 May 19 08:21:51.933889 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 750/1581] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:51 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:52.036423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:52.037376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:52.068918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:52.070040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:52.070478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:52.073983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:53.122156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:53.132208 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-784b1167-f5b0-4a5f-a07d-0f73e372b715 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 1.100910 May 19 08:21:53.139898 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 751/1582] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:52 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:21:53.144906 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:53.153457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:53.170573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:53.171326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:53.172278 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:53.172873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.025399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:54.037379 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-db04612b-aa1b-4075-a4ad-b356939af52c tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1533 microversion: 2.1 time: 0.896075 May 19 08:21:54.050387 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 752/1583] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:53 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1533 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:54.064390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-813089a1-46b8-4ca5-b4b1-1a32ea968e01 req-e6968ff5-ff64-4b77-8136-c8ae4f8aac8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec2d470-ea96-4789-b133-75e40f3ad85d", "name": "network-vif-deleted", "tag": "3decf769-deaf-4196-bfcd-c90b1b5b8bea"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:54.085279 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-813089a1-46b8-4ca5-b4b1-1a32ea968e01 req-e6968ff5-ff64-4b77-8136-c8ae4f8aac8a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.085849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-813089a1-46b8-4ca5-b4b1-1a32ea968e01 req-e6968ff5-ff64-4b77-8136-c8ae4f8aac8a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.105729 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-813089a1-46b8-4ca5-b4b1-1a32ea968e01 req-e6968ff5-ff64-4b77-8136-c8ae4f8aac8a service nova] Creating event network-vif-deleted:3decf769-deaf-4196-bfcd-c90b1b5b8bea for instance 2ec2d470-ea96-4789-b133-75e40f3ad85d on chh1-842464-2 May 19 08:21:54.115706 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-813089a1-46b8-4ca5-b4b1-1a32ea968e01 req-e6968ff5-ff64-4b77-8136-c8ae4f8aac8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063636 May 19 08:21:54.116827 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 753/1584] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:54.127422 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:54.134478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:54.146719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.147553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.148742 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.149451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.209970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:21:54.211025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:21:54.211765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:21:54.212434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:21:54.213070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:21:54.234692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.235343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.236550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.237381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.321540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Getting quotas for project ff49ea2c1efc41f685b496815d13bc09. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:21:54.337875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Getting quotas for user 5e7cc48a60f14daa825d66600fe1dd92 and project ff49ea2c1efc41f685b496815d13bc09. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:21:54.383408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:21:54.392260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:21:54.474901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4346ab2b-c7d8-45a8-9680-547da8f2494b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.456139 May 19 08:21:54.477342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 832/1585] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:21:54.483845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-546f50a7-cc3a-4ad1-aac4-855c79ea4080 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121f6820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:54.552197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-546f50a7-cc3a-4ad1-aac4-855c79ea4080 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.073344 May 19 08:21:54.555137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 833/1586] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:54 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:54.562486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:54.565906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:54.570016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:21:54.585551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.586758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:54.588379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:54.589940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:56.172990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:56.202463 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:56.205669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f12cfaf-5e33-4899-8323-3a5243126673 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 1.646266 May 19 08:21:56.210443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 834/1587] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:54 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:56.219082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:56.220195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:56.238533 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b3c8c12a-5c07-4312-aefa-cbe73e602b2c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 2.118616 May 19 08:21:56.243221 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 754/1588] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:54 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:56.246845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:56.258767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:56.260625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:56.261498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:56.286023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:56.291259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:56.331953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:56.336467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:56.338607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:56.342412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:56.452156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:56.464371 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e047b15-2470-4140-abf6-6e57b656badd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1269 microversion: 2.1 time: 0.252653 May 19 08:21:56.468036 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 835/1589] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:56 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1269 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:56.489903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-541cf0d6-be62-4c86-8280-d68f2b35ab1f tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32149985e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:56.649491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-541cf0d6-be62-4c86-8280-d68f2b35ab1f tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.177501 May 19 08:21:56.650564 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 836/1590] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:56 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:56.660608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-40bf0bb8-3220-4549-a809-412cb51e06a1 req-68744eb6-69e1-475f-9f69-c492cd447574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71559f46-8d38-4dbc-9a75-2f520a839868", "name": "network-vif-deleted", "tag": "62a1d050-1d18-4dfc-9de3-7208e5672633"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:56.723074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-40bf0bb8-3220-4549-a809-412cb51e06a1 req-68744eb6-69e1-475f-9f69-c492cd447574 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:56.723540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-40bf0bb8-3220-4549-a809-412cb51e06a1 req-68744eb6-69e1-475f-9f69-c492cd447574 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:56.820876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-40bf0bb8-3220-4549-a809-412cb51e06a1 req-68744eb6-69e1-475f-9f69-c492cd447574 service nova] Creating event network-vif-deleted:62a1d050-1d18-4dfc-9de3-7208e5672633 for instance 71559f46-8d38-4dbc-9a75-2f520a839868 on chh2-842464-2 May 19 08:21:56.859652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-40bf0bb8-3220-4549-a809-412cb51e06a1 req-68744eb6-69e1-475f-9f69-c492cd447574 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203612 May 19 08:21:56.862655 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 837/1591] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:56.972168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:57.004267 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b0fd4627-6e63-498e-809f-f004012f9f01 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 200 len: 1491 microversion: 2.1 time: 0.758575 May 19 08:21:57.007093 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 755/1592] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:56 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 1491 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:57.230807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:57.232488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:57.247439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:57.250163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:57.251146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:57.251606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:57.260943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:57.262355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:57.284082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:57.291223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:57.293803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:57.297344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.053605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:58.068961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21cb578d-8390-4c61-a8f7-93f1b1dace4f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.849992 May 19 08:21:58.071958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 838/1593] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:57 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:58.088355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:58.089401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:58.106614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.111516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.112935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.113714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.326067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:58.337554 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9898958c-0165-47d0-b861-ee31eb695e75 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1275 microversion: 2.1 time: 0.261278 May 19 08:21:58.339546 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 839/1594] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:58 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:58.350832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fff534c1-5ec7-42a1-96d7-33c51161d6f5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f321223be50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:58.459047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fff534c1-5ec7-42a1-96d7-33c51161d6f5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.117641 May 19 08:21:58.462370 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 840/1595] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:58 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:58.470180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-54d3268c-d948-4c89-9866-e2c84c6da4c3 req-bccbba54-0482-4366-9296-abc70a864ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-plugged", "status": "completed", "tag": "ed1acf02-4c4c-43e9-bf64-2191aef9516c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:21:58.492652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-54d3268c-d948-4c89-9866-e2c84c6da4c3 req-bccbba54-0482-4366-9296-abc70a864ff2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.493670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-54d3268c-d948-4c89-9866-e2c84c6da4c3 req-bccbba54-0482-4366-9296-abc70a864ff2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.522529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-54d3268c-d948-4c89-9866-e2c84c6da4c3 req-bccbba54-0482-4366-9296-abc70a864ff2 service nova] Creating event network-vif-plugged:ed1acf02-4c4c-43e9-bf64-2191aef9516c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:21:58.542140 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-54d3268c-d948-4c89-9866-e2c84c6da4c3 req-bccbba54-0482-4366-9296-abc70a864ff2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078169 May 19 08:21:58.543062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 841/1596] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:21:58.552363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:58.554565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 71559f46-8d38-4dbc-9a75-2f520a839868] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:58.579376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.580438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:58.582878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.587324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.591076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.594845 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dc02a044-6e9f-40f4-894e-47999fa66f27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 1.337976 May 19 08:21:58.607777 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 756/1597] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:57 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:58.641220 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] HTTP exception thrown: Instance 71559f46-8d38-4dbc-9a75-2f520a839868 could not be found. May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Request method failure captured: May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 HTTP/1.1 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzc1JXj7dArG2eH3xx1x5soQ5r5nPorRhVhF976NusLBXnqdcjLf9KTuVtcNTL_L4aolb81UjWM3stSe09vBU78AIJZWIR8YSsj8kqwl_tvRa2Mp2L8EQgNIqEBY30_-yNhh8hpxoE4oZ2pc6m9rbxv1m9Ixz5WLdg2nB4yyJnHvpc May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b95a24d08874740a500ff176d819cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MigrationsAdminTest-1941838293 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MigrationsAdminTest-1941838293-project May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f40ef4d25a474b3c83a3c2808a87a30d May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MigrationsAdminTest-1941838293-project May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 71559f46-8d38-4dbc-9a75-2f520a839868 could not be found. May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '71559f46-8d38-4dbc-9a75-2f520a839868'} May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71559f46-8d38-4dbc-9a75-2f520a839868 could not be found. May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71559f46-8d38-4dbc-9a75-2f520a839868 could not be found. May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:21:58.647904 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71559f46-8d38-4dbc-9a75-2f520a839868 could not be found. May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:21:58.653355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Returning 404 to user: Instance 71559f46-8d38-4dbc-9a75-2f520a839868 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:21:58.656541 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48322247-f027-44a1-9bc3-002c3082665e tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868" status: 404 len: 111 microversion: 2.1 time: 0.104799 May 19 08:21:58.658345 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 842/1598] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:58 2022] GET /compute/v2.1/servers/71559f46-8d38-4dbc-9a75-2f520a839868 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:21:58.664519 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:58.665416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:58.683723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.689156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.694798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:58.695702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:58.820293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:21:59.089073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:59.089794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:59.095086 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2d5ce372-80bd-4a8f-8f24-82b997489e82 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 204 len: 0 microversion: 2.1 time: 0.434970 May 19 08:21:59.096755 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 757/1599] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:21:58 2022] DELETE /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:21:59.105952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:59.109493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:59.110697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:59.111312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:59.118020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:59.120314 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:59.135474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:59.137897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:59.138784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:59.140119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:59.666787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:59.680623 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc3991d5-1dab-44df-8d10-a0a18f5b5d24 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 0.596037 May 19 08:21:59.682410 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 843/1600] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:59 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:59.697331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:59.706316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:21:59.721205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:59.721687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:59.736462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:21:59.736935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:21:59.786285 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:21:59.804769 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-42f0185c-1563-4e1a-a021-6718e47c4ca7 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1468 microversion: 2.1 time: 0.702511 May 19 08:21:59.808831 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 758/1601] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:59 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1468 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:59.827039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-07e49f34-1846-4943-bde4-746c6c058820 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b9d550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:59.962941 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-07e49f34-1846-4943-bde4-746c6c058820 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.140575 May 19 08:21:59.963670 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 759/1602] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:21:59 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:21:59.969124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:21:59.981915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:00.008441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.008902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:00.014453 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.018259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:00.602144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:00.633521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1826ddd3-df32-457e-a5d7-16b619d261f4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.944333 May 19 08:22:00.649710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 844/1603] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:59 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:00.665475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:00.692887 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9ed5f7e5-71ed-4705-98b9-897f787202fd tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.726882 May 19 08:22:00.697632 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 760/1604] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:21:59 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:00.717777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:00.721441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:00.735161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-plugged", "status": "completed", "tag": "eba7f373-a4f9-4095-b1f1-a87d88d248af"}, {"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-plugged", "status": "completed", "tag": "9c50aa96-f90d-45f6-b67f-8475b7ed204c"}, {"server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "name": "network-vif-plugged", "status": "completed", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:00.749863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.752551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:00.755709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.757548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:00.761480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.765291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:00.800397 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] Creating event network-vif-plugged:eba7f373-a4f9-4095-b1f1-a87d88d248af for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:22:00.812679 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] Creating event network-vif-plugged:9c50aa96-f90d-45f6-b67f-8475b7ed204c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:22:00.818135 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] Creating event network-vif-plugged:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:22:00.853689 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6d880eb3-fe65-4c1d-a968-ac7062ba32a5 req-603ef90c-ad9b-496e-b9a5-15ee5127ebd7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.122254 May 19 08:22:00.854757 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 761/1605] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:22:00.863035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:00.864230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:00.871193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.872019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:00.874095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:00.874896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:02.004166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:02.014693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d63f9221-cb33-4ae2-879a-361d0c7becf3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1355 microversion: 2.1 time: 1.311307 May 19 08:22:02.018765 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 845/1606] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:00 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1355 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:02.030701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-612982fe-0e8a-4b96-a0a0-7b63243e6bb4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212c084c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:02.117744 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-612982fe-0e8a-4b96-a0a0-7b63243e6bb4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.097341 May 19 08:22:02.126057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 846/1607] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:02 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:02.141384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:02.142333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:02.157154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:02.160986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:02.165587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:02.166385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:02.214564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:02.227157 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-45a33e0d-278f-4f76-9fdd-4bf2591e9895 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1468 microversion: 2.1 time: 1.370916 May 19 08:22:02.228579 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 762/1608] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:00 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1468 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:02.235143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:02.236245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:02.243996 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:02.244883 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:02.245949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:02.250136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:02.760129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:02.777349 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01a83776-54fd-474d-ae4f-fc7c7b15d759 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.647665 May 19 08:22:02.778567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 847/1609] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:02 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:02.916767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:02.934225 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cc2c27d2-2ccf-46af-b33d-e5083c1662c9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.702714 May 19 08:22:02.936432 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 763/1610] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:02 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:03.047547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:03.048178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:03.061820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:03.062673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:03.063578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:03.063970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:03.133883 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0dc8ab0c-db82-4e09-8fdb-8fe8217db9f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b9d310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:03.245496 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0dc8ab0c-db82-4e09-8fdb-8fe8217db9f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.117064 May 19 08:22:03.247134 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 764/1611] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:03 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:03.260393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:03.264339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:03.286627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:03.288494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:03.289766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:03.292592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:03.720364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:03.733549 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e848474d-d19c-44a9-bdf4-010ee62c7dc5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1468 microversion: 2.1 time: 0.479123 May 19 08:22:03.734471 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 765/1612] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:03 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1468 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:03.771580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9449bf3c-49ab-4991-866a-372ab4e5394c req-979bc693-0a2d-4fd0-bfd7-8982bd3a7c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4242f4f6-3fd8-4333-b466-245f42dfc4ce", "tag": "805be888-f989-4ea6-ad31-45f1ff6e61de"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:03.832151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9449bf3c-49ab-4991-866a-372ab4e5394c req-979bc693-0a2d-4fd0-bfd7-8982bd3a7c17 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:03.833682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9449bf3c-49ab-4991-866a-372ab4e5394c req-979bc693-0a2d-4fd0-bfd7-8982bd3a7c17 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:03.897226 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9449bf3c-49ab-4991-866a-372ab4e5394c req-979bc693-0a2d-4fd0-bfd7-8982bd3a7c17 service nova] Creating event network-changed:805be888-f989-4ea6-ad31-45f1ff6e61de for instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce on chh1-842464-2 May 19 08:22:03.917882 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9449bf3c-49ab-4991-866a-372ab4e5394c req-979bc693-0a2d-4fd0-bfd7-8982bd3a7c17 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178019 May 19 08:22:03.925668 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 766/1613] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:03.960148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:03.960148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:03.995315 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:03.999603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:04.004283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:04.007899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:04.186647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:04.202128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2d8b6d48-72b9-4a6b-9fa3-776262501b22 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1804 microversion: 2.1 time: 1.156899 May 19 08:22:04.203129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 848/1614] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:03 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1804 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:04.236108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:04.237030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:04.253135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:04.254153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:04.257622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:04.260316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:04.276321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:04.364085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:04.930873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:04.952103 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f0b33535-aaf0-4992-9fa4-81f433143b43 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 1.023016 May 19 08:22:04.957718 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 767/1615] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:03 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:04.988303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:04.992096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:05.018110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.020534 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.022139 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.026352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.089132 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8f34d17d-fd1d-4ece-9ef8-c2c02b05858a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3/ips" status: 200 len: 217 microversion: 2.1 time: 0.116723 May 19 08:22:05.094573 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 768/1616] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:22:04 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3/ips => generated 217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:05.099475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-247c57f0-14f9-49bc-9657-f2a5e14e2c17 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217ba3550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:05.120419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:05.134321 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03efc592-18a9-4e14-aee1-4cfeac2fc443 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.905407 May 19 08:22:05.138905 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 849/1617] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:04 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:05.163885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:05.166549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:05.191175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.192532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.196932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.199865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.208324 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-247c57f0-14f9-49bc-9657-f2a5e14e2c17 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.112572 May 19 08:22:05.211352 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 769/1618] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:05 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:05.243784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:05.244872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:05.283744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.284486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.288013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.288489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.349863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:22:05.355065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.355517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.355975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lazy-loading 'fault' on Instance uuid e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:22:05.380195 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:05.525216 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-576d6a5e-e25d-41b1-b908-96c25ba3bac3 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "DELETE /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 204 len: 0 microversion: 2.1 time: 0.312318 May 19 08:22:05.526184 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 770/1619] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:22:05 2022] DELETE /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:05.542583 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:05.543864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:05.556424 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.557253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.558833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.559510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.646369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:05.658389 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea0d1b2e-b027-4aab-95eb-791ffb3c7ee8 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 200 len: 1303 microversion: 2.1 time: 0.505761 May 19 08:22:05.660401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 850/1620] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:05 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 1303 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:05.911152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:05.921141 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eccc9e03-7011-4df9-9735-1745333aff2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1810 microversion: 2.1 time: 0.385191 May 19 08:22:05.932383 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 771/1621] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:05 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1810 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:05.976425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:05.977209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:05.988289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.988738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:05.989570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:05.994781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.161104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:06.161104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:06.188626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.192733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:06.199798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.202863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.203364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.203935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5748a9d-aa80-41ae-bcbc-67cbe038fc11 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.232343 May 19 08:22:06.205122 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 851/1622] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:05 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:06.211647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e1bdc283-b607-4c90-a131-0662d3b69c39 req-ca008e74-5d03-4fd0-85b4-639645f96dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732", "name": "network-vif-deleted", "tag": "6e772834-07e5-4353-bb91-c927a7797689"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:06.220955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e1bdc283-b607-4c90-a131-0662d3b69c39 req-ca008e74-5d03-4fd0-85b4-639645f96dad service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.226057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e1bdc283-b607-4c90-a131-0662d3b69c39 req-ca008e74-5d03-4fd0-85b4-639645f96dad service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.270797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e1bdc283-b607-4c90-a131-0662d3b69c39 req-ca008e74-5d03-4fd0-85b4-639645f96dad service nova] Creating event network-vif-deleted:6e772834-07e5-4353-bb91-c927a7797689 for instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 on chh2-842464-2 May 19 08:22:06.288202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e1bdc283-b607-4c90-a131-0662d3b69c39 req-ca008e74-5d03-4fd0-85b4-639645f96dad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081381 May 19 08:22:06.289205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 852/1623] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:06.303402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81b901c6-1a84-47e7-bc25-cdb9b8a242fa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212208a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:06.425863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81b901c6-1a84-47e7-bc25-cdb9b8a242fa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.134991 May 19 08:22:06.426465 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 853/1624] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:06 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:06.529917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:06.543958 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-297c1dd9-d4c3-4c43-ae81-b88911bd71e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.389437 May 19 08:22:06.558114 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 772/1625] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:06 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:06.688801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:06.690820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:06.705843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.711636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.714315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.715905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.752202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] HTTP exception thrown: Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 could not be found. May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Request method failure captured: May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 HTTP/1.1 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzc1JXj7dArG2eH3xx1x5soQ5r5nPorRhVhF976NusLBXnqdcjLf9KTuVtcNTL_L4aolb81UjWM3stSe09vBU78AIJZWIR8YSsj8kqwl_tvRa2Mp2L8EQgNIqEBY30_-yNhh8hpxoE4oZ2pc6m9rbxv1m9Ixz5WLdg2nB4yyJnHvpc May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b95a24d08874740a500ff176d819cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MigrationsAdminTest-1941838293 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MigrationsAdminTest-1941838293-project May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f40ef4d25a474b3c83a3c2808a87a30d May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MigrationsAdminTest-1941838293-project May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 could not be found. May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732'} May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 could not be found. May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 could not be found. May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:22:06.754142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 could not be found. May 19 08:22:06.759979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:06.761094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Returning 404 to user: Instance e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:22:06.763156 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4a93a87-8497-4d26-be53-d4ce660b5cda tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732" status: 404 len: 111 microversion: 2.1 time: 0.082268 May 19 08:22:06.766003 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 854/1626] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:06 2022] GET /compute/v2.1/servers/e48bcf8a-13cf-4fa6-a28f-d5b5bfdd4732 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:22:06.776743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:06.777371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:06.795837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.795837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.795837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.795837 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.861681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:22:06.945647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:06.946391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:06.961084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.965279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:06.968607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:06.970780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.032997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:07.056351 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d4129a48-4809-4df3-90fa-41d2db686e1b tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 204 len: 0 microversion: 2.1 time: 0.284574 May 19 08:22:07.059093 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 773/1627] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:22:06 2022] DELETE /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:07.073188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:07.074560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:07.088802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:07.090013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.092056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:07.093275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.427279 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:07.434825 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9b3554f0-4e25-4897-a4ad-f8393316bf29 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1467 microversion: 2.1 time: 0.370181 May 19 08:22:07.436020 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 774/1628] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:07 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1467 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:07.439611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:07.459248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e43c7821-779b-49e8-907b-e2681dd6bf2e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1810 microversion: 2.1 time: 0.516829 May 19 08:22:07.460362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 855/1629] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:06 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1810 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:07.461877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:07.462505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:07.466258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39633875-6d55-4b0b-a21b-6895276e024a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212e4eb80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:07.496876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:07.497349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.498745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:07.499184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.536386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39633875-6d55-4b0b-a21b-6895276e024a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.074584 May 19 08:22:07.536983 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 856/1630] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:07 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:07.578203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:07.581597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:07.621710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:07.622314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.624039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:07.625508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:07.898177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:07.917863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74fdefc7-ad54-4c4e-9794-d8a1c3c4a4d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.352376 May 19 08:22:07.920505 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 857/1631] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:07 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:07.933860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:07.956479 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-76fc8bc1-afe9-431e-bd49-c29265a3c723 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.496724 May 19 08:22:07.958370 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 775/1632] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:07 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:08.464823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:08.467366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:08.483969 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:08.485999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:08.535836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:08.536926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:08.538475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:08.539347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:08.540126 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:08.543668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:08.550003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:08.551411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:08.551989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:08.926730 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:08.940209 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-41ce17d1-34b2-4fd8-867d-52ec1d4eb62e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1810 microversion: 2.1 time: 0.464593 May 19 08:22:08.949452 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 776/1633] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:08 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1810 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:08.960451 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-21d8ff18-a901-47a3-af29-f18d9a3dea3c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b9d310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:09.034029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:09.046401 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4db2bd0-ed6e-4160-ba46-20085c463b23 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1467 microversion: 2.1 time: 0.592920 May 19 08:22:09.051123 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 858/1634] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:08 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1467 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:09.056235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:09.062717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:09.079916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:09.081646 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-21d8ff18-a901-47a3-af29-f18d9a3dea3c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.130444 May 19 08:22:09.082257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:09.082566 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 777/1635] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:08 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:09.083614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:09.085037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:09.093856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:09.094399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:09.111546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:09.119274 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:09.120498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:09.121189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:09.546369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:09.555274 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f75a3b33-dee9-4a1c-b2bf-3820249ff135 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.502788 May 19 08:22:09.560172 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 859/1636] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:09 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:09.570616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:09.581015 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8b506b2c-137e-45a1-b701-3e80ae6bcb09 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.497317 May 19 08:22:09.599537 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 778/1637] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:09 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:09.963755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:09.964699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:09.985988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:09.986729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:09.987697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:09.988468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:10.068101 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:10.068941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:10.085952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:10.086524 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:10.087643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:10.088122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:10.866069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f40ef4d25a474b3c83a3c2808a87a30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b95a24d08874740a500ff176d819cf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:10.882439 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ca26277e-af0c-447f-bf00-028f1714d0e5 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 200 len: 1467 microversion: 2.1 time: 0.818252 May 19 08:22:10.885877 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 779/1638] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:10 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 1467 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:10.905917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-82d66201-6371-43a1-af2d-f5f246f8e57a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:10.985189 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-82d66201-6371-43a1-af2d-f5f246f8e57a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.097602 May 19 08:22:10.988122 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 780/1639] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:10 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:10.997018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:11.005795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-86675eca-a458-4f17-89d5-a92b1d3d6caf req-c89d0bf8-b4d4-4d2b-9ff5-13a633b22d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-deleted", "tag": "9c50aa96-f90d-45f6-b67f-8475b7ed204c"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:11.021543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-86675eca-a458-4f17-89d5-a92b1d3d6caf req-c89d0bf8-b4d4-4d2b-9ff5-13a633b22d67 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.022365 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-86675eca-a458-4f17-89d5-a92b1d3d6caf req-c89d0bf8-b4d4-4d2b-9ff5-13a633b22d67 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.022680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5fc352a6-342b-42b1-bb97-ff2e34360fa9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1789 microversion: 2.1 time: 1.064570 May 19 08:22:11.037667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 860/1640] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:09 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1789 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:11.046254 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-86675eca-a458-4f17-89d5-a92b1d3d6caf req-c89d0bf8-b4d4-4d2b-9ff5-13a633b22d67 service nova] Creating event network-vif-deleted:9c50aa96-f90d-45f6-b67f-8475b7ed204c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:22:11.049043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:11.063816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:11.078602 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-86675eca-a458-4f17-89d5-a92b1d3d6caf req-c89d0bf8-b4d4-4d2b-9ff5-13a633b22d67 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065202 May 19 08:22:11.082662 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 781/1641] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:11.089159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.089683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.097805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.098563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.114024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:11.117854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:11.138168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.141889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.142745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.143191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.666859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:11.676024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-defaeee3-2d18-4057-b01b-4759937d18ed tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.636805 May 19 08:22:11.676634 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 861/1642] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:11 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:11.692743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-35ccebfa-c695-45c2-80a4-c37e61552f0a req-91c88393-f87a-406d-8ce9-471cad2ac559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-unplugged", "status": "completed", "tag": "ed1acf02-4c4c-43e9-bf64-2191aef9516c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:11.732408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-35ccebfa-c695-45c2-80a4-c37e61552f0a req-91c88393-f87a-406d-8ce9-471cad2ac559 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.732794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-35ccebfa-c695-45c2-80a4-c37e61552f0a req-91c88393-f87a-406d-8ce9-471cad2ac559 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.772197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-35ccebfa-c695-45c2-80a4-c37e61552f0a req-91c88393-f87a-406d-8ce9-471cad2ac559 service nova] Creating event network-vif-unplugged:ed1acf02-4c4c-43e9-bf64-2191aef9516c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:22:11.797172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-35ccebfa-c695-45c2-80a4-c37e61552f0a req-91c88393-f87a-406d-8ce9-471cad2ac559 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117075 May 19 08:22:11.803195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 862/1643] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:11.819566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7a81c372-c732-45ea-988a-cad0121bb2c9 req-7365af7b-c2d3-4120-9445-355ba207de65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e73b117-8cc4-43db-a810-618ca851c6e2", "name": "network-vif-deleted", "tag": "7994c7b7-4412-4f8d-a104-920b64ccfec2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:11.824395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:11.839492 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7b05aa5b-c7c3-440f-82b3-0062b1abfebd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.750864 May 19 08:22:11.849814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7a81c372-c732-45ea-988a-cad0121bb2c9 req-7365af7b-c2d3-4120-9445-355ba207de65 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.849814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7a81c372-c732-45ea-988a-cad0121bb2c9 req-7365af7b-c2d3-4120-9445-355ba207de65 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.850622 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 782/1644] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:11 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:11.882284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7a81c372-c732-45ea-988a-cad0121bb2c9 req-7365af7b-c2d3-4120-9445-355ba207de65 service nova] Creating event network-vif-deleted:7994c7b7-4412-4f8d-a104-920b64ccfec2 for instance 3e73b117-8cc4-43db-a810-618ca851c6e2 on chh1-842464-2 May 19 08:22:11.896344 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7a81c372-c732-45ea-988a-cad0121bb2c9 req-7365af7b-c2d3-4120-9445-355ba207de65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090088 May 19 08:22:11.904408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 863/1645] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:11.905570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:11.906775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] [instance: 3e73b117-8cc4-43db-a810-618ca851c6e2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:11.920662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.921535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.923290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:11.924953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:11.960857 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] HTTP exception thrown: Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 could not be found. May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Request method failure captured: May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 HTTP/1.1 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzc1JXj7dArG2eH3xx1x5soQ5r5nPorRhVhF976NusLBXnqdcjLf9KTuVtcNTL_L4aolb81UjWM3stSe09vBU78AIJZWIR8YSsj8kqwl_tvRa2Mp2L8EQgNIqEBY30_-yNhh8hpxoE4oZ2pc6m9rbxv1m9Ixz5WLdg2nB4yyJnHvpc May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b95a24d08874740a500ff176d819cf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b95a24d08874740a500ff176d819cf6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-MigrationsAdminTest-1941838293 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 2b95a24d08874740a500ff176d819cf6 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-MigrationsAdminTest-1941838293 May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-MigrationsAdminTest-1941838293-project May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: f40ef4d25a474b3c83a3c2808a87a30d May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-MigrationsAdminTest-1941838293-project May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 could not be found. May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '3e73b117-8cc4-43db-a810-618ca851c6e2'} May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 could not be found. May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 could not be found. May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:22:11.962578 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 could not be found. May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] Returning 404 to user: Instance 3e73b117-8cc4-43db-a810-618ca851c6e2 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:22:11.968029 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-230210a0-23cb-400b-9dc3-934400ca8d54 tempest-MigrationsAdminTest-1941838293 tempest-MigrationsAdminTest-1941838293-project] 10.222.0.78 "GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2" status: 404 len: 111 microversion: 2.1 time: 0.067737 May 19 08:22:11.969217 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 783/1646] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:11 2022] GET /compute/v2.1/servers/3e73b117-8cc4-43db-a810-618ca851c6e2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:22:12.001893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55280bc7-c8d8-4a85-bed8-6711e4efdfa1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121f6b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:12.044711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:12.045370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:12.062317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:12.065211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55280bc7-c8d8-4a85-bed8-6711e4efdfa1 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.069759 May 19 08:22:12.067191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:12.068086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:12.068530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:12.072837 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 864/1647] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:11 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:12.371013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:12.389125 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-98bd035e-23c5-4f77-99e0-ae6e8db4ce58 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1610 microversion: 2.1 time: 0.349634 May 19 08:22:12.391206 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 784/1648] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:12 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1610 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:12.694214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:12.694989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:12.714804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:12.715293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:12.721495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:12.722708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:12.858966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:12.859782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:12.882083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:12.882663 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:12.890415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:12.893205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:13.523733 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:13.550542 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-028cf802-192b-4f70-af98-17808dec2522 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.696710 May 19 08:22:13.551171 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 785/1649] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:12 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:13.552066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:13.559437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2fe587cf-051e-4d27-b808-7de1d2ec7c8d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b9d670>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:13.563878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86d44c92-ec28-436e-9724-3519d91d21d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.873909 May 19 08:22:13.564790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 865/1650] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:12 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:13.573608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-80806132-68c5-427c-afd4-3a7d71da7d67 req-e64e84e5-f7ea-4c62-baf3-1565f45e0c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-deleted", "tag": "eba7f373-a4f9-4095-b1f1-a87d88d248af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:13.598837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-80806132-68c5-427c-afd4-3a7d71da7d67 req-e64e84e5-f7ea-4c62-baf3-1565f45e0c82 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:13.599716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-80806132-68c5-427c-afd4-3a7d71da7d67 req-e64e84e5-f7ea-4c62-baf3-1565f45e0c82 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:13.641235 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-80806132-68c5-427c-afd4-3a7d71da7d67 req-e64e84e5-f7ea-4c62-baf3-1565f45e0c82 service nova] Creating event network-vif-deleted:eba7f373-a4f9-4095-b1f1-a87d88d248af for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:22:13.695500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-80806132-68c5-427c-afd4-3a7d71da7d67 req-e64e84e5-f7ea-4c62-baf3-1565f45e0c82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127300 May 19 08:22:13.702142 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 866/1651] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:13.721665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:13.725346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:13.734745 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2fe587cf-051e-4d27-b808-7de1d2ec7c8d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.182369 May 19 08:22:13.751230 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 786/1652] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:13 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:13.758117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:13.765525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:13.766979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:13.768959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:13.828989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9f675997-4e69-47ec-ab27-bab07acb2889 req-128ff63c-f99b-407e-82c0-9f78a502c1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4242f4f6-3fd8-4333-b466-245f42dfc4ce", "name": "network-vif-plugged", "status": "completed", "tag": "805be888-f989-4ea6-ad31-45f1ff6e61de"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:13.854302 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9f675997-4e69-47ec-ab27-bab07acb2889 req-128ff63c-f99b-407e-82c0-9f78a502c1e0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:13.855208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9f675997-4e69-47ec-ab27-bab07acb2889 req-128ff63c-f99b-407e-82c0-9f78a502c1e0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:13.912244 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9f675997-4e69-47ec-ab27-bab07acb2889 req-128ff63c-f99b-407e-82c0-9f78a502c1e0 service nova] Creating event network-vif-plugged:805be888-f989-4ea6-ad31-45f1ff6e61de for instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce on chh1-842464-2 May 19 08:22:13.929966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:13.931293 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9f675997-4e69-47ec-ab27-bab07acb2889 req-128ff63c-f99b-407e-82c0-9f78a502c1e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107586 May 19 08:22:13.937772 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 787/1653] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:22:13.948988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:13.949532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lazy-loading 'fault' on Instance uuid 20af90d1-1a30-431f-a1c2-1919b261cdf3 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:22:14.060975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:14.077491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a217cf6-150c-4c31-b7db-6b9a22aebefb tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 200 len: 1303 microversion: 2.1 time: 0.362236 May 19 08:22:14.078533 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 867/1654] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:13 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 1303 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:14.569480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:14.570191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:14.582942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:14.583542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:14.586849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:14.588749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:14.592294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:14.592926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:14.593769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:14.594188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:14.608472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:14.611491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:14.937185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:14.953703 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aaa7feb8-473a-40f9-b9d9-ef88b309f8d4 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1317 microversion: 2.1 time: 0.381422 May 19 08:22:14.963992 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 788/1655] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:14 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:14.978915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:14.987641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea067f0b-f404-432f-b081-62685f27b5f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.408673 May 19 08:22:14.988235 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 868/1656] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:14 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:14.990441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-37a84b54-971c-4510-9eac-6687aa81dec8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217ba3280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:15.059971 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-37a84b54-971c-4510-9eac-6687aa81dec8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.092417 May 19 08:22:15.060943 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 789/1657] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:14 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:15.096273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:15.097704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:15.112157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:15.112958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:15.115171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:15.115665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:15.132318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] HTTP exception thrown: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Request method failure captured: May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 HTTP/1.1 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3s7ltOKUR4pA4btJFg6ySKYj3L8ORSYN-HAAx15GXI0SsNtfH2ke4KG2eVXImimR5fO4JaB8xSrTRdOxXa3iiBsabZM8KZNJkG6gGuST4Hm2cyeRaSEX46MmFefP-khy8UKcYQ9SoWefv8SoeKUdfasAILdDaxWgs7epXpn4f8jyk May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestMultiNic-1136853225 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestMultiNic-1136853225-project May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 70ba771be4f9469085cb6ed8b1feef61 May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestMultiNic-1136853225-project May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '20af90d1-1a30-431f-a1c2-1919b261cdf3'} May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:22:15.134369 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:22:15.140123 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:22:15.141951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Returning 404 to user: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:22:15.143019 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-def437ae-8f16-4336-ba36-79720b967ce6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 404 len: 111 microversion: 2.1 time: 0.051371 May 19 08:22:15.146718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 869/1658] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:15 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:22:15.971122 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:15.972535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:15.985762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:15.991880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:15.995529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:15.999189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:16.005506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:16.006994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:16.022285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:16.022727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:16.033352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:16.033808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:16.105460 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:16.615198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:16.634435 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eb9f4609-8eae-4f8c-b955-323f0628444f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1507 microversion: 2.1 time: 0.667020 May 19 08:22:16.635045 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 790/1659] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:15 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:16.640277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a14a8ac0-39c2-4f30-a56f-3251105ff73d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b691f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:16.648891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:16.672385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06ff50a8-2816-44d5-9a36-ad68310bd550 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.671139 May 19 08:22:16.689398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 870/1660] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:15 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:16.694458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ede39165-483a-4e3b-93e8-052954d96272 req-25a1def2-2e9d-4dfe-9dd1-908be2abe269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20af90d1-1a30-431f-a1c2-1919b261cdf3", "name": "network-vif-deleted", "tag": "ed1acf02-4c4c-43e9-bf64-2191aef9516c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:16.720847 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a14a8ac0-39c2-4f30-a56f-3251105ff73d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.083728 May 19 08:22:16.722140 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 791/1661] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:16 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:16.737464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:16.738448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:16.742298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ede39165-483a-4e3b-93e8-052954d96272 req-25a1def2-2e9d-4dfe-9dd1-908be2abe269 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:16.742739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ede39165-483a-4e3b-93e8-052954d96272 req-25a1def2-2e9d-4dfe-9dd1-908be2abe269 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:16.751768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:16.752509 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:16.755222 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:16.755879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:16.801159 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ede39165-483a-4e3b-93e8-052954d96272 req-25a1def2-2e9d-4dfe-9dd1-908be2abe269 service nova] Creating event network-vif-deleted:ed1acf02-4c4c-43e9-bf64-2191aef9516c for instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 on chh1-842464-2 May 19 08:22:16.824940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ede39165-483a-4e3b-93e8-052954d96272 req-25a1def2-2e9d-4dfe-9dd1-908be2abe269 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134135 May 19 08:22:16.826084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 871/1662] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:17.319992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:17.331588 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fb1548a5-3d46-4043-bd22-be8698b940a9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1507 microversion: 2.1 time: 0.608118 May 19 08:22:17.342366 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 792/1663] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:16 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:17.355497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:17.357408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:17.385012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:17.385519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:17.386296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:17.386728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:17.611517 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-847d0efc-6050-4a73-8167-a6a25fd79b2d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "PUT /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1079 microversion: 2.1 time: 0.260236 May 19 08:22:17.629338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 872/1664] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:22:17 2022] PUT /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1079 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:17.663827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:17.665767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:17.687615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:17.688518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:17.689606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:17.690214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:17.692404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:17.693277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:17.725003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:17.725632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:17.726677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:17.737256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:18.146830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:18.155151 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf386446-b007-4fd5-9de5-6d7421c832b8 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.467266 May 19 08:22:18.165473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 873/1665] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:17 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:18.166543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae8d0364-c249-4472-9269-7d9b7d51ea26 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212151790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:18.308233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae8d0364-c249-4472-9269-7d9b7d51ea26 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.147569 May 19 08:22:18.308848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 874/1666] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:18 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:18.455848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:18.468050 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b75e7903-5638-463e-9c8a-ab304adcbaa8 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1505 microversion: 2.1 time: 0.832980 May 19 08:22:18.472753 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 793/1667] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:17 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1505 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:18.487354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:18.488796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:18.511818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:18.512282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:18.513754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:18.514205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:18.959708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:18.974502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5067b9d1-b178-4abe-be34-b3676e4d217e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1505 microversion: 2.1 time: 0.493108 May 19 08:22:18.975062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 875/1668] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:18 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:18.991572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:18.993798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:19.015480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.016232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.024931 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.025862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.175708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:19.176361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:19.194100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.194100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.194871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.195319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.205595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:22:19.206025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:22:19.206502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:22:19.206918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:22:19.207335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:22:19.359995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:19.380416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.383411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.386310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.386955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.468395 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-97db5177-ef8f-47b5-9b9f-092d19994df5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "POST /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce/action" status: 202 len: 1111 microversion: 2.1 time: 0.478861 May 19 08:22:19.471833 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 794/1669] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:22:18 2022] POST /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce/action => generated 1111 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 08:22:19.488260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db8d6ba5-c39c-426c-b6a8-7fa0f46065b8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b69dc0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:19.714833 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-db8d6ba5-c39c-426c-b6a8-7fa0f46065b8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.241594 May 19 08:22:19.725575 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 795/1670] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:19 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:19.746308 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:19.751003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:19.771389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.772484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:19.773504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:19.774801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:20.040458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:20.057953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5573c97-c6d5-4760-9bd4-b4442831d5ca tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.881700 May 19 08:22:20.058734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 876/1671] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:19 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:20.470032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:20.494687 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-84420be9-2ace-489d-9ea1-ab4dd23db3c7 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.767349 May 19 08:22:20.506758 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 796/1672] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:19 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:20.599913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1383477413", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:20.714662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:22:20.730288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4dd01088-36c7-46e0-a12d-3aab9fd81f89 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f39820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:20.828384 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4dd01088-36c7-46e0-a12d-3aab9fd81f89 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.103992 May 19 08:22:20.829066 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 797/1673] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:20 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:21.077662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:21.078556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:21.096921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:21.098007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:21.099636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:21.100252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:21.419797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:22:21.420994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:22:21.421698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:22:21.422352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:22:21.422950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:22:21.459440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:21.461955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:21.465907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:21.469096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:21.516963 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:21.527085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Getting quotas for project 6c738a16a46d484f93107c39e225138d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:22:21.536317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Getting quotas for user cff7f11ade014fad83d3020b54a700f0 and project 6c738a16a46d484f93107c39e225138d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:22:21.544178 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-732827d4-45cf-4039-8a15-d4a742bec2ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.461375 May 19 08:22:21.548836 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 798/1674] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:21 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:21.561513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:21.569532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:21.584051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:22:21.590738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:22:21.591189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:21.591876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:21.595351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:21.596685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:21.720620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-536c355b-c0a5-4317-87c6-b5bdd538aef6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660553 May 19 08:22:21.725334 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 877/1675] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:22:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:22:21.842552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-696e21c2-ffa4-43c3-932e-ec65cd5e4e63 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121f63a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:21.954673 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-696e21c2-ffa4-43c3-932e-ec65cd5e4e63 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.116791 May 19 08:22:21.961747 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 878/1676] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:21 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:22.041512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1322059085", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:22.117552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:22.129279 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-38999262-88ab-4dde-b288-6ad472b17191 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.579197 May 19 08:22:22.152170 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 799/1677] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:21 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:22.167553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:22:22.560420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:22.561024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:22.577918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:22.579017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:22.583488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:22.584151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:22.599236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:22:22.600323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:22:22.601041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:22:22.601747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:22:22.602418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:22:22.624200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:22.626404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:22.629551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:22.630442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:22.654519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:22.692906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Getting quotas for project 6c738a16a46d484f93107c39e225138d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:22:22.714531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Getting quotas for user cff7f11ade014fad83d3020b54a700f0 and project 6c738a16a46d484f93107c39e225138d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:22:22.727011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:22.751998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:22:22.755601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:22:22.863574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9be5bfc2-9ea6-41cd-bb39-7f5a185634e9 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825803 May 19 08:22:22.874436 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 879/1678] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:22:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:22:22.892778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a0c7591-9be3-4be0-837f-5a3bf0294bea tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:22.896913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a0c7591-9be3-4be0-837f-5a3bf0294bea tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:23.071105 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:23.085151 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-69700b78-34d4-4fbe-8f62-e39df09d490d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.529247 May 19 08:22:23.086577 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 800/1679] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:22 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:23.093676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-635f2b47-22af-4baf-8ffb-728870a543b7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b99160>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:23.178510 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-635f2b47-22af-4baf-8ffb-728870a543b7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.089857 May 19 08:22:23.179582 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 801/1680] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:23 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:23.184657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a0c7591-9be3-4be0-837f-5a3bf0294bea tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:23.198412 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a0c7591-9be3-4be0-837f-5a3bf0294bea tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1214 microversion: 2.1 time: 0.322019 May 19 08:22:23.204521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:23.209343 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 880/1681] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:22 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1214 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:23.226429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:23.236804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:23.237727 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:23.238765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:23.239711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:23.603382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:23.621563 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-811f9aaa-b14e-485a-bbd7-78e79e61f4b5 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.421573 May 19 08:22:23.622967 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 802/1682] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:23 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:24.124560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:24.128941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:24.162467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:24.163408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:24.164246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:24.164742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:24.195689 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-775ba54f-81b9-4d89-97f3-e7e570abb749 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b9d0d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:24.282402 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-775ba54f-81b9-4d89-97f3-e7e570abb749 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1452 microversion: 2.1 time: 0.092845 May 19 08:22:24.283751 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 803/1683] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:24 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:22:24.294498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:24.295858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:24.304193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:24.305107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:24.309346 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:24.311352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:24.561573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:24.573071 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f079dba1-9dd9-4eb1-b006-20f8e5235895 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1218 microversion: 2.1 time: 0.285640 May 19 08:22:24.586759 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 804/1684] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:24 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1218 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:24.595292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:24.602302 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:24.615291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:24.616479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:24.617492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:24.618093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:25.101500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:25.113922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7f0c87d-9a84-4638-81c6-af333ad76879 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 1.005738 May 19 08:22:25.115380 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 881/1685] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:24 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:25.122506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:25.130271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:25.143793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:25.150098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:25.152015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:25.153102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:25.193881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 9ee67616-6551-4084-9ed3-cdaf5574749f {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:22:25.253794 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5820e04e-9801-418c-acad-7df8b2d0f2ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 2129 microversion: 2.25 time: 0.649706 May 19 08:22:25.254829 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 805/1686] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:24 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 2129 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:25.274925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh1-842464-2", "block_migration": "auto"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:25.276505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:25.290778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:25.291681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:25.297020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:25.298245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:25.359039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'flavor' on Instance uuid 9ee67616-6551-4084-9ed3-cdaf5574749f {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:22:25.385011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Going to try to live migrate instance to chh1-842464-2 {{(pid=119073) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:22:27.431246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:27.464041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2b5edf8-ce01-4c1e-8ebb-f22f5f54a92f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 2.344171 May 19 08:22:27.466024 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 882/1687] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:25 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:27.482159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2845ddf-d8dc-4091-ab30-b1a22567c51c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211df78b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:27.559131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2845ddf-d8dc-4091-ab30-b1a22567c51c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1461 microversion: 2.1 time: 0.091676 May 19 08:22:27.567473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 883/1688] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:27 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:27.582789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:27.589152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:27.610539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:27.611307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:27.614928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:27.615583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:27.832003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:27.846706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3101be51-b037-43c3-aa9c-60cbd7e249c1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1272 microversion: 2.1 time: 0.274874 May 19 08:22:27.847301 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 884/1689] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:27 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:27.857360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:27.869616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:27.889737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:27.890212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:27.891071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:27.891520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:28.449240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:28.459026 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a89a3b6-1fb4-4ff1-ac87-1dcadd2ec335 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.610420 May 19 08:22:28.468066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 885/1690] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:27 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:28.473575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-403558539", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "bd37fac1-f98d-4e9c-81cd-5f33e0337f2c"}, {"uuid": "aa00a800-5064-4374-9bc1-43a3ba6d2774"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:28.564777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] validate_networks() for [('bd37fac1-f98d-4e9c-81cd-5f33e0337f2c', None, None, None, None, None), ('aa00a800-5064-4374-9bc1-43a3ba6d2774', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:22:29.279418 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3f93966f-087c-4801-8182-28c2d23fe2e2 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/action" status: 202 len: 0 microversion: 2.25 time: 4.008903 May 19 08:22:29.280518 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 806/1691] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:22:25 2022] POST /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/action => generated 0 bytes in 4011 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 08:22:29.286034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5613388b-3513-4e23-be36-eef0d03c15a0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217ba38b0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:29.407019 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5613388b-3513-4e23-be36-eef0d03c15a0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 200 len: 1461 microversion: 2.1 time: 0.125173 May 19 08:22:29.407917 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 807/1692] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:29 2022] GET /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 1461 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:29.421034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:29.421935 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:29.434783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:29.435529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:29.436476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:29.437586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:30.224361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:30.232886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:30.236123 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f43dc102-680f-4730-82f1-0d0ea59cc66e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.826978 May 19 08:22:30.236851 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 808/1693] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:29 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:30.252991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:30.254008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:30.263952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:30.265683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:30.267348 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:30.268316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:31.067847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:31.077323 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8c17ad00-8238-4a8f-b19d-003eb803606f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.835147 May 19 08:22:31.081657 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 809/1694] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:30 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:31.096563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:31.097634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:31.104825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:31.105681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:31.106804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:31.107633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:31.838988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:31.850929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:31.853214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:31.854908 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5ebd255b-7c14-4317-abeb-0e891d3e3d8b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.771344 May 19 08:22:31.866361 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 810/1695] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:31 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:31.874539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:31.876516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:31.883570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:31.884355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:31.886763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:31.888120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.105708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:22:32.106443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:22:32.106705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:22:32.107121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:22:32.107538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:22:32.117533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:32.118227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.119207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:32.119824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.149537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Getting quotas for project 9315d3e582f8468a92b56b0b4ee2120b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:22:32.162637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Getting quotas for user 70ba771be4f9469085cb6ed8b1feef61 and project 9315d3e582f8468a92b56b0b4ee2120b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:22:32.188010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:22:32.193502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:22:32.297082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22729189-02e8-4705-b7bf-9667118b7cfe tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.827491 May 19 08:22:32.298110 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 886/1696] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:22:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:22:32.309230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:32.311649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:32.337683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:32.338240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.339031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:32.352317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.504390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:32.512676 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8f3979e2-5ae8-48a3-8a42-84c87750e420 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1467 microversion: 2.1 time: 0.644713 May 19 08:22:32.525751 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 811/1697] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:31 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1467 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:32.540570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:32.543310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:32.558951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:32.562238 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.563432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:32.565774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:32.952781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:32.965136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa53b0f7-bc6c-49a8-8c8e-387a6cfa5baa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.664889 May 19 08:22:32.969004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 887/1698] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:32 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:32.975019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2eba4aff-6f99-48df-a017-c13ae6f347f0 req-3058af8e-4be1-4c46-bc92-e9448c5d899a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "name": "network-vif-unplugged", "status": "completed", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:33.001337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2eba4aff-6f99-48df-a017-c13ae6f347f0 req-3058af8e-4be1-4c46-bc92-e9448c5d899a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.002463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2eba4aff-6f99-48df-a017-c13ae6f347f0 req-3058af8e-4be1-4c46-bc92-e9448c5d899a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:33.026612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2eba4aff-6f99-48df-a017-c13ae6f347f0 req-3058af8e-4be1-4c46-bc92-e9448c5d899a service nova] Creating event network-vif-unplugged:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:22:33.042282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2eba4aff-6f99-48df-a017-c13ae6f347f0 req-3058af8e-4be1-4c46-bc92-e9448c5d899a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070647 May 19 08:22:33.047133 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 888/1699] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:33.069491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:33.070724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:33.104063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.107770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:33.110084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.111741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:33.386049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:33.395689 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f293f037-aee5-4774-b982-6cd91c072d40 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.865829 May 19 08:22:33.396323 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 812/1700] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:32 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:33.425241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:33.426055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:33.446042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.447009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:33.447819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.448268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:33.741738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:33.756483 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2275b540-c093-4a16-89e9-4a8de8528531 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1216 microversion: 2.1 time: 0.351269 May 19 08:22:33.767796 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 813/1701] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:33 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1216 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:33.773324 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-70f7833e-e36b-40eb-b864-8e246d431b3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211f393a0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:33.915135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:33.924973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d0a2bf2-e396-4dbe-a29f-d5c42b27765a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.875859 May 19 08:22:33.928503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 889/1702] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:33 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:33.946652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:33.948926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:33.976419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.979935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:33.986788 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-70f7833e-e36b-40eb-b864-8e246d431b3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?changes-since=2022-05-19T08%3A19%3A59Z" status: 200 len: 2374 microversion: 2.1 time: 0.217284 May 19 08:22:33.987807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:33.988587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:34.009654 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 814/1703] 10.222.0.78 () {58 vars in 1198 bytes} [Thu May 19 08:22:33 2022] GET /compute/v2.1/images?changes-since=2022-05-19T08%3A19%3A59Z => generated 2374 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:34.020991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a98d6090-b98b-4d69-952e-cb6488ff81a4 req-18a5f6ef-03d3-4ba8-8ca5-e026a3ab8e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:34.044943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a98d6090-b98b-4d69-952e-cb6488ff81a4 req-18a5f6ef-03d3-4ba8-8ca5-e026a3ab8e52 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:34.046738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a98d6090-b98b-4d69-952e-cb6488ff81a4 req-18a5f6ef-03d3-4ba8-8ca5-e026a3ab8e52 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:34.077874 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a98d6090-b98b-4d69-952e-cb6488ff81a4 req-18a5f6ef-03d3-4ba8-8ca5-e026a3ab8e52 service nova] Creating event network-changed:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:22:34.084130 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a98d6090-b98b-4d69-952e-cb6488ff81a4 req-18a5f6ef-03d3-4ba8-8ca5-e026a3ab8e52 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072859 May 19 08:22:34.086623 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 815/1704] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:34.092679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:34.093799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:34.101478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:34.102295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:34.103387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:34.104070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:34.906092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:34.921082 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0bc81f78-1735-4e12-9497-2a165fa9548f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.832646 May 19 08:22:34.921995 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 816/1705] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:34 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:34.937008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-939f071e-81b0-429b-9368-b0533571dd74 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211feb160>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:35.077404 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-939f071e-81b0-429b-9368-b0533571dd74 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-18894349" status: 200 len: 483 microversion: 2.1 time: 0.153991 May 19 08:22:35.078439 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 817/1706] 10.222.0.78 () {58 vars in 1226 bytes} [Thu May 19 08:22:34 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-18894349 => generated 483 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:35.087240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-f7dcca58-6f8b-4949-b205-de4cd40cce74 req-1d580d04-e06f-4163-9078-ed067390b7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cdd443-b415-48e2-aa1c-63d2c9995854", "name": "network-vif-unplugged", "status": "completed", "tag": "e5709540-bb04-426d-8ff7-f2ddb7a8d8f8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:35.111504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-f7dcca58-6f8b-4949-b205-de4cd40cce74 req-1d580d04-e06f-4163-9078-ed067390b7ec service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.112849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-f7dcca58-6f8b-4949-b205-de4cd40cce74 req-1d580d04-e06f-4163-9078-ed067390b7ec service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:35.154906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:35.173113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:35.183080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:35.186220 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-f7dcca58-6f8b-4949-b205-de4cd40cce74 req-1d580d04-e06f-4163-9078-ed067390b7ec service nova] Creating event network-vif-unplugged:e5709540-bb04-426d-8ff7-f2ddb7a8d8f8 for instance 74cdd443-b415-48e2-aa1c-63d2c9995854 on chh2-842464-2 May 19 08:22:35.190074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be9702ea-58e2-4283-b3b4-923815611936 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.252836 May 19 08:22:35.193567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 890/1707] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:33 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:35.198639 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-f7dcca58-6f8b-4949-b205-de4cd40cce74 req-1d580d04-e06f-4163-9078-ed067390b7ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118805 May 19 08:22:35.203523 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 818/1708] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:35.214590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:35.215299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:35.222131 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:35.222917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:35.240917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.241411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:35.242213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.242661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:35.254151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.257996 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:35.259939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.264416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:35.933007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:35.943684 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e01cd392-3ae3-468d-81c7-daa1e51b91d2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1270 microversion: 2.1 time: 0.735141 May 19 08:22:35.946364 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 819/1709] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:35 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1270 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:35.954566 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:35.956473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:35.967207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.968161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:35.969401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:35.970069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:36.169493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:36.183968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4eb94a5b-ebf2-4839-afcb-f6a826be6ed0 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.985836 May 19 08:22:36.184827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 891/1710] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:35 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:36.197805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2692c6f-ec84-48e8-b9ea-539bd8f8e9d8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211df73a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:36.335989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2692c6f-ec84-48e8-b9ea-539bd8f8e9d8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?server=62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 957 microversion: 2.1 time: 0.149699 May 19 08:22:36.336645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 892/1711] 10.222.0.78 () {58 vars in 1208 bytes} [Thu May 19 08:22:36 2022] GET /compute/v2.1/images?server=62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 957 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:36.349024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:36.352857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:36.374001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:36.377070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:36.378230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:36.380066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:36.832711 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:36.849148 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-954f14f9-f7ee-4bf8-8e6f-300a0fc40ac4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.895286 May 19 08:22:36.859843 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 820/1712] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:35 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:36.870766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:36.877050 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:36.898356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:36.899406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:36.901029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:36.901849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.070006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:37.087753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-256cc694-413e-4ffb-af70-755f83a854d7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.749455 May 19 08:22:37.088937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 893/1713] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:36 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:37.104620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6c9409da-0070-486d-b6be-d072642e5a9a req-152bb20f-af1f-48a7-9063-26c59047ab2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb4daca-bf3f-4a95-a693-fd3444e52ab2", "tag": "7b487261-76e6-4c5d-b3b7-baa36518fdb6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:37.126232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6c9409da-0070-486d-b6be-d072642e5a9a req-152bb20f-af1f-48a7-9063-26c59047ab2a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.129419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6c9409da-0070-486d-b6be-d072642e5a9a req-152bb20f-af1f-48a7-9063-26c59047ab2a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.161834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6c9409da-0070-486d-b6be-d072642e5a9a req-152bb20f-af1f-48a7-9063-26c59047ab2a service nova] Creating event network-changed:7b487261-76e6-4c5d-b3b7-baa36518fdb6 for instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 on chh2-842464-2 May 19 08:22:37.175238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6c9409da-0070-486d-b6be-d072642e5a9a req-152bb20f-af1f-48a7-9063-26c59047ab2a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084564 May 19 08:22:37.183029 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 894/1714] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:37.191458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1efd9602-4a0d-4d7f-b7dc-326fa36701bf tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d20940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:37.308509 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1efd9602-4a0d-4d7f-b7dc-326fa36701bf tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 485 microversion: 2.1 time: 0.122589 May 19 08:22:37.315952 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 895/1715] 10.222.0.78 () {58 vars in 1316 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3 => generated 485 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:37.322540 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:37.328303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:37.329541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:37.336361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:37.341257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:37.343662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.345494 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-42e20000-eb31-44ed-841d-02a0c7d4b1fc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.483019 May 19 08:22:37.346131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.347089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.349492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.350477 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 821/1716] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:36 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:37.366461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:37.367405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:37.380318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.383535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.384638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.385245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.524131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:37.533556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ad947d5-3fe3-487f-a5c3-156480fa543e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1270 microversion: 2.1 time: 0.216153 May 19 08:22:37.541252 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 896/1717] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:37.547879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2878ca13-678e-4e08-a9ab-d9163df67cc7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211d20e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:37.659287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2878ca13-678e-4e08-a9ab-d9163df67cc7 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 485 microversion: 2.1 time: 0.115497 May 19 08:22:37.660640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 897/1718] 10.222.0.78 () {58 vars in 1302 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3 => generated 485 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:37.675610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eff9b187-6bf1-4abf-9451-2536dfc12ce2 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212025c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:37.686866 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:37.696033 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-38dbf9f1-6f9d-492a-9df1-21d4d89de932 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.344388 May 19 08:22:37.698428 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 822/1719] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:37.727624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-830314c5-0480-422b-b5c1-33feffd7bc72 req-6a0490e7-f275-48ba-8b2f-0ea6c0652f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cdd443-b415-48e2-aa1c-63d2c9995854", "tag": "e5709540-bb04-426d-8ff7-f2ddb7a8d8f8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:37.741472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-830314c5-0480-422b-b5c1-33feffd7bc72 req-6a0490e7-f275-48ba-8b2f-0ea6c0652f2c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.743351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-830314c5-0480-422b-b5c1-33feffd7bc72 req-6a0490e7-f275-48ba-8b2f-0ea6c0652f2c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.771266 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-830314c5-0480-422b-b5c1-33feffd7bc72 req-6a0490e7-f275-48ba-8b2f-0ea6c0652f2c service nova] Creating event network-changed:e5709540-bb04-426d-8ff7-f2ddb7a8d8f8 for instance 74cdd443-b415-48e2-aa1c-63d2c9995854 on chh2-842464-2 May 19 08:22:37.781101 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-830314c5-0480-422b-b5c1-33feffd7bc72 req-6a0490e7-f275-48ba-8b2f-0ea6c0652f2c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057304 May 19 08:22:37.785162 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 823/1720] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:22:37.859807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eff9b187-6bf1-4abf-9451-2536dfc12ce2 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.190611 May 19 08:22:37.861098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 898/1721] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:37.868919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:37.870011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:37.878436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.878890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.879675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:37.880182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:37.881656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fccbb629-2cce-40e5-9bb4-2f6446c1c6be tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32121f63a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.003139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fccbb629-2cce-40e5-9bb4-2f6446c1c6be tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.126920 May 19 08:22:38.006274 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 899/1722] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:38.020655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66bca809-8e58-4402-a552-030672dad30d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212154dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.087542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66bca809-8e58-4402-a552-030672dad30d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.072849 May 19 08:22:38.095549 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 900/1723] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:22:38 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:38.101349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf608ce5-787b-4088-9ea4-c253d74af79c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212627670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.307617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf608ce5-787b-4088-9ea4-c253d74af79c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?changes-since=2022-05-19T08%3A19%3A54Z" status: 200 len: 6325 microversion: 2.1 time: 0.207730 May 19 08:22:38.309973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 901/1724] 10.222.0.78 () {58 vars in 1219 bytes} [Thu May 19 08:22:38 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-19T08%3A19%3A54Z => generated 6325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:38.327340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.328493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:38.335243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:38.335979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:38.336992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:38.337615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:38.738234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:38.751550 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-005468bf-ec84-4558-8293-e13ed303da28 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.887576 May 19 08:22:38.753244 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 824/1725] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:37 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:38.759894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dfea131a-92ee-4873-aed6-354a2c21e33a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217ad55e0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.877509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:38.889240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b143294-78c3-46f4-b6b0-c3c80ccd625c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.566247 May 19 08:22:38.891873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 902/1726] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:38 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:38.899600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.901004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:38.911247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:38.912340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:38.913585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:38.914255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:38.928891 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dfea131a-92ee-4873-aed6-354a2c21e33a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-18894349" status: 200 len: 663 microversion: 2.1 time: 0.174269 May 19 08:22:38.937286 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 825/1727] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:22:38 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-18894349 => generated 663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:38.944528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:38.947994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:38.961814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=80 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:38.971663 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:38.972295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:38.974511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:38.976476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:39.639571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:39.646986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:39.658588 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7541cd12-9617-4301-a24d-0bc375a17308 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1312 microversion: 2.1 time: 0.726607 May 19 08:22:39.662266 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 826/1728] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:38 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1312 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:39.671121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:39.676149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:39.681712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:39.691376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:39.694811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:39.696607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:39.698579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1d5998f-9906-45ab-ac59-b036e2b4c055 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.802789 May 19 08:22:39.700418 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:39.701159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:39.715945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 903/1729] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:38 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:39.742888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1792e548-f66f-43ea-812a-3e19901977d5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211e921f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:39.993198 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1792e548-f66f-43ea-812a-3e19901977d5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1465 microversion: 2.1 time: 0.271063 May 19 08:22:39.993835 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 904/1730] 10.222.0.78 () {58 vars in 1337 bytes} [Thu May 19 08:22:39 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3 => generated 1465 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:40.012596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:40.013230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:40.043054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:40.044055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:40.044864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:40.045348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:40.828623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:40.850970 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f918f42-7771-43cc-8578-0a53e3a48072 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.855988 May 19 08:22:40.853026 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 905/1731] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:39 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:40.878371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:40.883071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:40.896692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:40.925589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:40.931010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:40.932867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:41.409186 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:41.423949 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5fe34c8c-c58a-4649-99c2-984109d4459b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 1.758200 May 19 08:22:41.424943 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 827/1732] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:39 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:41.437985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-26cd991c-5e90-47a5-89ae-6a945b350f49 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b99550>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:41.539351 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-26cd991c-5e90-47a5-89ae-6a945b350f49 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1465 microversion: 2.1 time: 0.110636 May 19 08:22:41.541159 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 828/1733] 10.222.0.78 () {58 vars in 1323 bytes} [Thu May 19 08:22:41 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fd08df6ba-4511-436a-859a-055e37e683d3 => generated 1465 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:41.557616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-21de1dbb-8766-4f8e-be06-e2353ce7a914 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Action: 'create', calling method: .version_select at 0x7f3217b525e0>, body: {"keypair": {"name": "tempest-keypair-297273046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNymnUI+AatfWpQl1slXxo63mb8PScH050EoAHbf8Jf0Vdv0iwagKgHdAHVPJQVQmuV4jgl4YChKotocr1soXqTzNEvZPmfpB39leF3R5djV/H1cftRTtywGKCnb9uKAYQ=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:41.596057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-21de1dbb-8766-4f8e-be06-e2353ce7a914 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Getting quotas for project ca6bf8cecfe44f4895f6dfd6700c2704. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:22:41.611833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-21de1dbb-8766-4f8e-be06-e2353ce7a914 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Getting quotas for user 9d8d29895e4d4ae990b7782be9b19572 and project ca6bf8cecfe44f4895f6dfd6700c2704. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:22:41.667023 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-21de1dbb-8766-4f8e-be06-e2353ce7a914 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.123507 May 19 08:22:41.667650 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 829/1734] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:22:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 08:22:41.679540 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:41.680161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:41.699353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:41.700167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:41.701133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:41.701618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:42.045727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:42.058164 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc4499ac-61f3-4e1e-9083-a3c63ead183b tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 1.200044 May 19 08:22:42.059648 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 906/1735] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:40 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:42.066994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:42.068513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:42.078338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:42.078788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:42.079812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:42.080548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:42.134642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:42.175231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=20 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:42.838523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:42.852991 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bd60b886-bfe0-4d73-8344-441ae3a01068 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 1.183350 May 19 08:22:42.857460 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 830/1736] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:41 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:42.867912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dfbbf703-de05-491a-be16-0caee100cea0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b52310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:43.104200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:43.122806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:43.123250 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dfbbf703-de05-491a-be16-0caee100cea0 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.260785 May 19 08:22:43.136529 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 831/1737] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:22:42 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:43.144521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:43.146997 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20751a97-7a98-4e51-9f2a-752c986dc673 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.083844 May 19 08:22:43.147799 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 907/1738] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:42 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:43.162457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:43.164240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:43.172633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:43.174922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:43.182323 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:43.183055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:43.185848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:43.186506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:43.188444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:43.192335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:43.195870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:43.200353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:43.247115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:43.728113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:43.740719 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6172b5d8-7077-4b05-88f1-6feda9f976cc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.600448 May 19 08:22:43.742824 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 832/1739] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:43 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:43.755513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:43.757904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:43.779439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:43.780355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:43.781985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:43.783665 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:43.857462 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:43.888830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:43.901110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee0d32b1-f9ac-4f6e-b175-11a77779cc5d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.737598 May 19 08:22:43.901821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 908/1740] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:43 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:43.907042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78cc1844-dd5d-4bd8-9300-fe87fd8cba2c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211ef6430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:44.046641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78cc1844-dd5d-4bd8-9300-fe87fd8cba2c tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.143742 May 19 08:22:44.053039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 909/1741] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:22:43 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:44.058038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9b72d20c-f0b9-4bd5-8f66-db79c11dc5a9 req-bb1053a4-55ec-459a-a1fa-5662b746983c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "name": "network-vif-plugged", "status": "completed", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:44.091895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9b72d20c-f0b9-4bd5-8f66-db79c11dc5a9 req-bb1053a4-55ec-459a-a1fa-5662b746983c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:44.095503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9b72d20c-f0b9-4bd5-8f66-db79c11dc5a9 req-bb1053a4-55ec-459a-a1fa-5662b746983c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:44.120556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9b72d20c-f0b9-4bd5-8f66-db79c11dc5a9 req-bb1053a4-55ec-459a-a1fa-5662b746983c service nova] Creating event network-vif-plugged:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:22:44.144535 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9b72d20c-f0b9-4bd5-8f66-db79c11dc5a9 req-bb1053a4-55ec-459a-a1fa-5662b746983c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089973 May 19 08:22:44.145819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 910/1742] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:44.151306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:44.152293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:44.172170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:44.172954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:44.174491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:44.175576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:44.536714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:44.548421 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eb461533-63aa-4090-a5bf-5c4843994f8c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.803996 May 19 08:22:44.550244 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 833/1743] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:43 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:44.557579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c9efed24-e0f0-47cd-a0f2-8319c7941236 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217af9430>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:44.624028 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c9efed24-e0f0-47cd-a0f2-8319c7941236 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff" status: 200 len: 784 microversion: 2.1 time: 0.072354 May 19 08:22:44.633338 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 834/1744] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:22:44 2022] GET /compute/v2.1/images/666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:44.642975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:44.644407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:44.653240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:44.653870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:44.655002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:44.655538 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:44.846998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:44.855009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55cb6318-6dd3-4718-8b7d-6181a559af1e tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.707686 May 19 08:22:44.856268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 911/1745] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:44 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:44.873279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6e8c44d-c3fd-4815-a228-e26dc8d03212 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32122745e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:44.960034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:44.973882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:44.978341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:44.980077 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6af659f5-42fc-4fde-bd76-39a54148972d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.350932 May 19 08:22:44.981833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6e8c44d-c3fd-4815-a228-e26dc8d03212 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.124387 May 19 08:22:44.993580 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 835/1746] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:44 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:44.993886 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 912/1747] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:22:44 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:44.999788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:45.000607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:45.001982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1035138268", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9a23661c-561e-4210-b4d0-9d13905c9d72"}, {"port": "1ade10ca-5a76-44a1-b65c-a3621244ef74", "tag": "port-1"}, {"port": "80c46ebd-c10d-4225-b559-8c49f3a69aee", "tag": "port-2"}, {"uuid": "c0cd93cc-42ae-4968-b5b9-1ec2ab94431c", "tag": "net-1"}, {"uuid": "c0cd93cc-42ae-4968-b5b9-1ec2ab94431c"}, {"uuid": "23cebe53-3005-4bef-a0cc-311dcf995a29", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "23cebe53-3005-4bef-a0cc-311dcf995a29", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c17f36b6-c020-42ff-aa7c-e89b7d2c86d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "31008dc4-440b-4089-9dfa-0f1e8f4e751b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f6337efd-8c52-4286-8ec8-c45f58301ec0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1753239944"}], "key_name": "tempest-keypair-297273046", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:45.008800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:45.009606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:45.011052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:45.014171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:45.315682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] validate_networks() for [('9a23661c-561e-4210-b4d0-9d13905c9d72', None, None, None, None, None), (None, None, '1ade10ca-5a76-44a1-b65c-a3621244ef74', None, None, None), (None, None, '80c46ebd-c10d-4225-b559-8c49f3a69aee', None, None, None), ('c0cd93cc-42ae-4968-b5b9-1ec2ab94431c', None, None, None, None, None), ('c0cd93cc-42ae-4968-b5b9-1ec2ab94431c', None, None, None, None, None), ('23cebe53-3005-4bef-a0cc-311dcf995a29', '10.2.2.100', None, None, None, None), ('23cebe53-3005-4bef-a0cc-311dcf995a29', '10.2.2.200', None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:22:45.779618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:45.794751 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f0b12ce0-4983-486b-88db-77bc18547595 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.794137 May 19 08:22:45.796533 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 836/1748] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:44 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:45.803351 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:45.804110 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:45.826231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:45.826809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:45.827702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:45.828459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:46.169277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:46.177418 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0e209869-4098-409b-ae1c-a62129ab254f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1516 microversion: 2.1 time: 0.378591 May 19 08:22:46.178007 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 837/1749] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:45 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1516 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:46.202966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ef035f9b-4c81-4b03-af0f-04fbcbcb27e5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3217b9d0d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:47.106095 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ef035f9b-4c81-4b03-af0f-04fbcbcb27e5 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f" status: 204 len: 0 microversion: 2.1 time: 0.916508 May 19 08:22:47.107422 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 838/1750] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:46 2022] DELETE /compute/v2.1/images/c7c0c91e-0ae7-411c-b917-9a81519dae7f => generated 0 bytes in 919 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:47.114641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:47.115907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:47.123932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:47.124371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:47.125159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:47.125627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:47.571453 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:47.587260 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d65b8feb-8f18-4979-bf32-b5ffe6132771 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1391 microversion: 2.1 time: 0.478418 May 19 08:22:47.588284 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 839/1751] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:47 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1391 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:47.596330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-d2eed56c-b5b7-482f-8460-ca2da042385e req-ee28f471-ddf1-4123-a70f-1df378d0d212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec2470e-9f8b-4dd9-a863-c275b08371d6", "tag": "8ecb86d3-1430-4f3a-86a4-a7f7620511d6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:47.611007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d2eed56c-b5b7-482f-8460-ca2da042385e req-ee28f471-ddf1-4123-a70f-1df378d0d212 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:47.611612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d2eed56c-b5b7-482f-8460-ca2da042385e req-ee28f471-ddf1-4123-a70f-1df378d0d212 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:47.625230 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-d2eed56c-b5b7-482f-8460-ca2da042385e req-ee28f471-ddf1-4123-a70f-1df378d0d212 service nova] Creating event network-changed:8ecb86d3-1430-4f3a-86a4-a7f7620511d6 for instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 on chh1-842464-2 May 19 08:22:47.630881 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-d2eed56c-b5b7-482f-8460-ca2da042385e req-ee28f471-ddf1-4123-a70f-1df378d0d212 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041125 May 19 08:22:47.631577 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 840/1752] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:47.638761 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:47.639938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:47.654111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:47.654681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:47.655767 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:47.656248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:48.072608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:48.081397 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1a7f896b-c294-4919-8414-95fc8f05f455 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.447996 May 19 08:22:48.086164 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 841/1753] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:47 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:48.091231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:48.092773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:48.100813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:48.101482 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:48.102433 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:48.102971 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:48.529814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:48.542169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:48.544452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:48.545779 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c72a8747-c596-419f-892d-278ef41bdb98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.462375 May 19 08:22:48.556442 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 842/1754] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:48 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:48.556442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-476924db-b39e-47b7-9139-beee8579c63f req-6d3936c7-74ca-4157-88d4-fe20749f2a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb4daca-bf3f-4a95-a693-fd3444e52ab2", "name": "network-vif-plugged", "status": "completed", "tag": "7b487261-76e6-4c5d-b3b7-baa36518fdb6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:48.563104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-476924db-b39e-47b7-9139-beee8579c63f req-6d3936c7-74ca-4157-88d4-fe20749f2a4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:48.563622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-476924db-b39e-47b7-9139-beee8579c63f req-6d3936c7-74ca-4157-88d4-fe20749f2a4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:48.580772 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-476924db-b39e-47b7-9139-beee8579c63f req-6d3936c7-74ca-4157-88d4-fe20749f2a4e service nova] Creating event network-vif-plugged:7b487261-76e6-4c5d-b3b7-baa36518fdb6 for instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 on chh2-842464-2 May 19 08:22:48.586723 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-476924db-b39e-47b7-9139-beee8579c63f req-6d3936c7-74ca-4157-88d4-fe20749f2a4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038617 May 19 08:22:48.588208 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 843/1755] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:48.603461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:48.604179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:48.612829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:48.613477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:48.614336 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:48.615297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:49.501230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:49.510643 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d9196398-77a2-4c32-9e65-e45c43a18031 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1314 microversion: 2.1 time: 0.920688 May 19 08:22:49.513724 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 844/1756] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:48 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:49.519334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a97825b7-8086-4d03-93e6-6490b2ca4997 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32120f61f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:50.224797 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a97825b7-8086-4d03-93e6-6490b2ca4997 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720" status: 204 len: 0 microversion: 2.1 time: 0.709621 May 19 08:22:50.225868 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 845/1757] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:49 2022] DELETE /compute/v2.1/images/c3cb533e-43b0-4d6b-a9ab-d5afad507720 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:50.234724 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:50.236777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:50.248529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:50.249513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:50.251106 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:50.251768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:50.698425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:50.719411 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e88b0369-d0e6-4c38-9b08-b41de0fbe4f3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1522 microversion: 2.1 time: 0.492211 May 19 08:22:50.720003 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 846/1758] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:50 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:50.742143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:50.742781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:50.751442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:50.752308 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:50.753912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:50.754544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.192949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:51.201822 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fdd38e5b-ce03-4169-9478-1d5a150a9b3f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1381 microversion: 2.1 time: 0.472938 May 19 08:22:51.202350 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 847/1759] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:50 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1381 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:51.207094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:51.207704 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:51.214261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.214786 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.216330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.216768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.520888 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:51.528584 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b642fba5-1af3-4352-924d-5aad05156126 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.324973 May 19 08:22:51.529274 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 848/1760] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:51 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:51.534183 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:51.534898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:51.543807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.544353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.545207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.545752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.610679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:22:51.611199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:22:51.612168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:22:51.612621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:22:51.613086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:22:51.623212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.623660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.624463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.624912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.630945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:51.646724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Getting quotas for project ca6bf8cecfe44f4895f6dfd6700c2704. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:22:51.654438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Getting quotas for user 9d8d29895e4d4ae990b7782be9b19572 and project ca6bf8cecfe44f4895f6dfd6700c2704. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:22:51.750437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:51.760636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:51.762372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:51.763563 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a4fe1186-aff8-4062-9900-dfc663ff68df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.233230 May 19 08:22:51.764450 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 849/1761] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:51 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:51.769012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9e3e31d5-a224-4fc7-b40a-8501cee6a195 req-027ddad0-58df-481c-b881-2a123faab889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec2470e-9f8b-4dd9-a863-c275b08371d6", "tag": "d67679cb-9a1c-42d7-b08e-0e3140be38c4"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:51.777498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9e3e31d5-a224-4fc7-b40a-8501cee6a195 req-027ddad0-58df-481c-b881-2a123faab889 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:51.777919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9e3e31d5-a224-4fc7-b40a-8501cee6a195 req-027ddad0-58df-481c-b881-2a123faab889 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:51.793779 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9e3e31d5-a224-4fc7-b40a-8501cee6a195 req-027ddad0-58df-481c-b881-2a123faab889 service nova] Creating event network-changed:d67679cb-9a1c-42d7-b08e-0e3140be38c4 for instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 on chh1-842464-2 May 19 08:22:51.805864 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9e3e31d5-a224-4fc7-b40a-8501cee6a195 req-027ddad0-58df-481c-b881-2a123faab889 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039987 May 19 08:22:51.807519 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 850/1762] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:51.814889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c1f02574-c5ba-4241-ac84-29b49c769544 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f32126154c0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:51.887866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:22:51.892707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c17f36b6-c020-42ff-aa7c-e89b7d2c86d9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='31008dc4-440b-4089-9dfa-0f1e8f4e751b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6337efd-8c52-4286-8ec8-c45f58301ec0',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:22:52.330630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f40b16c-4468-415e-bf69-03a5a8bddf6e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.335356 May 19 08:22:52.336711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 913/1763] 10.222.0.78 () {62 vars in 1188 bytes} [Thu May 19 08:22:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 7339 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:22:52.348211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:52.350090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:52.366235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:52.366818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:52.368075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:52.368922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:52.687959 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c1f02574-c5ba-4241-ac84-29b49c769544 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692" status: 204 len: 0 microversion: 2.1 time: 0.877961 May 19 08:22:52.688762 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 851/1764] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:51 2022] DELETE /compute/v2.1/images/35e4aa13-36e3-4e72-a2b3-ce8c13727692 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:52.700813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-8618f36d-a152-4f48-be31-536756619451 req-8f3122e0-0a96-4b95-be4a-49f73c7afc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4242f4f6-3fd8-4333-b466-245f42dfc4ce", "name": "network-vif-plugged", "status": "completed", "tag": "805be888-f989-4ea6-ad31-45f1ff6e61de"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:52.713876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8618f36d-a152-4f48-be31-536756619451 req-8f3122e0-0a96-4b95-be4a-49f73c7afc2d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:52.715699 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8618f36d-a152-4f48-be31-536756619451 req-8f3122e0-0a96-4b95-be4a-49f73c7afc2d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:52.733402 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-8618f36d-a152-4f48-be31-536756619451 req-8f3122e0-0a96-4b95-be4a-49f73c7afc2d service nova] Creating event network-vif-plugged:805be888-f989-4ea6-ad31-45f1ff6e61de for instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce on chh1-842464-2 May 19 08:22:52.740420 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-8618f36d-a152-4f48-be31-536756619451 req-8f3122e0-0a96-4b95-be4a-49f73c7afc2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050004 May 19 08:22:52.741527 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 852/1765] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:22:52.770333 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-df97ce45-7c4f-4cfe-b0d5-1213a7e90823 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '.version_select at 0x7f3211efb670>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:52.773778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-df97ce45-7c4f-4cfe-b0d5-1213a7e90823 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:52.774630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-df97ce45-7c4f-4cfe-b0d5-1213a7e90823 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:52.791468 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-df97ce45-7c4f-4cfe-b0d5-1213a7e90823 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2706 microversion: 2.1 time: 0.042186 May 19 08:22:52.792500 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 853/1766] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:22:52 2022] GET /compute/v2.1/os-migrations => generated 2706 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:52.800458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:52.801942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:52.810101 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:52.811137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:52.812215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:52.812885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.223737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.232819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eff65eb5-db65-45bc-b4ad-069f8c073e53 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1463 microversion: 2.1 time: 0.898160 May 19 08:22:53.241925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 914/1767] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:52 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1463 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:53.247872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c261e9a-1b8f-43ec-ba84-3ef910b486f6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:53.248431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c261e9a-1b8f-43ec-ba84-3ef910b486f6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:53.252115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:53.275235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.286237 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-00f80d64-e83c-4f64-991a-93b987af2c87 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1522 microversion: 2.1 time: 0.490790 May 19 08:22:53.286877 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 854/1768] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:52 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:53.291671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:53.292523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:53.299270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.299734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.300592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.301014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.403478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c261e9a-1b8f-43ec-ba84-3ef910b486f6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.412417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c261e9a-1b8f-43ec-ba84-3ef910b486f6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.415226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c261e9a-1b8f-43ec-ba84-3ef910b486f6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.417548 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c261e9a-1b8f-43ec-ba84-3ef910b486f6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1285 microversion: 2.32 time: 0.174444 May 19 08:22:53.419083 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 915/1769] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:53 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:53.425827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:53.426631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:53.435409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.435850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.437282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.437919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.482002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:22:53.580217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0c2e393-24d4-4911-b610-57435ab1f4f9 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 204 len: 0 microversion: 2.1 time: 0.158943 May 19 08:22:53.581285 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 916/1770] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:22:53 2022] DELETE /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:53.587909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:53.589135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:53.596995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.597768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.599609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.600212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.788646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.798722 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-72c8eed3-ecba-48fe-870a-dd7b1eb62374 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.510429 May 19 08:22:53.799450 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 855/1771] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:53 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:53.804736 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:53.805523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:53.812787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.813705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.814728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:53.815391 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:53.985492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.995127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.996964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:53.998207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af2c1ef2-f4ed-4305-8d78-ccfa6ce6d361 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.415663 May 19 08:22:53.998787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 917/1772] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:53 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:54.003499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:54.004380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:54.011446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.012352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.013646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.014205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.228473 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bba7eaa9-5305-40e2-9fc0-cdeb3c9e0a70 tempest-LiveMigrationTest-1965235806 tempest-LiveMigrationTest-1965235806-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1532 microversion: 2.1 time: 0.427912 May 19 08:22:54.229084 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 856/1773] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:53 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1532 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:54.240342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:54.240342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:54.240896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.241565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.242511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.242949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.265543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:54.475504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:54.497821 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e684d5f-6b71-48ed-986b-732cdcc2e3d1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1464 microversion: 2.1 time: 0.497935 May 19 08:22:54.499557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 918/1774] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:53 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1464 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:54.506480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:54.509123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:54.517821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.518635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.519835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.521672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.575126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:22:54.602100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:54.622761 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-85a86948-913b-4aae-9ce0-1a55451f9a3a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1474 microversion: 2.1 time: 0.387233 May 19 08:22:54.623462 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 857/1775] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:54 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1474 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:54.628428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:54.634057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:54.659939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.663015 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.666746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.670794 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.737837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea25c8e7-4c61-49f3-a211-d5afcc5d506e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "DELETE /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 204 len: 0 microversion: 2.1 time: 0.234986 May 19 08:22:54.741206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 919/1776] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:22:54 2022] DELETE /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:54.755784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:54.756733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:54.775208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.775816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.776632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:54.777106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:54.950889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:54.963883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:54.974480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:54.977545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73f1c9e5-7681-4d7f-af84-1f30bc8a9c2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1527 microversion: 2.32 time: 0.233641 May 19 08:22:54.978931 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 920/1777] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:54 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1527 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:55.003406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:55.004507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:55.006000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:55.020263 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aa8e4b61-6c2d-4e1e-9e44-6f5012f37e15 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1507 microversion: 2.1 time: 0.395382 May 19 08:22:55.023905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:55.025673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:55.032738 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 858/1778] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:54 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:55.036813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:55.037680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:55.053432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-796630489", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:55.154764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:22:55.529559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:55.540755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f89ea03c-71f9-43e8-bb47-1b2c6565efbb tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1387 microversion: 2.1 time: 0.560359 May 19 08:22:55.541899 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 921/1779] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:54 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1387 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:55.559313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:55.562813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:55.577015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:55.581834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:55.582679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:55.583130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:55.873037 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:22:55.873499 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:22:55.873978 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:22:55.875471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:22:55.875988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:22:55.885768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:55.886676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:55.887879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:55.888492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:55.908629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Getting quotas for project 6c738a16a46d484f93107c39e225138d. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:22:55.915546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Getting quotas for user cff7f11ade014fad83d3020b54a700f0 and project 6c738a16a46d484f93107c39e225138d. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:22:55.931197 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:22:55.934425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:22:55.994118 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-99084ac3-cfa2-403f-a03c-9f98bc1d644e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959858 May 19 08:22:55.995459 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 859/1780] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:22:56.004738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:56.006130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:56.015939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:56.016766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:56.018088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:56.019179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:56.976857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:56.994003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd2b5b2b-28c1-44c1-96c7-391863cf9e72 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 1.450629 May 19 08:22:56.994918 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 922/1781] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:55 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:56.999750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:57.000559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:57.016259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:57.017080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:57.018130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:57.018757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:57.407670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:57.433112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:57.436270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:57.437189 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f3cd44b0-5e13-4ab4-8f7f-808a3b158691 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.439916 May 19 08:22:57.441227 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 860/1782] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:55 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:57.460155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:57.460802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:57.479844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:57.481254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:57.491391 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:57.499636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:57.904979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:57.914840 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2bf5ca6-6dd4-47bb-9de9-40f390ed7c0b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 200 len: 1507 microversion: 2.1 time: 0.918662 May 19 08:22:57.923413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 923/1783] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:56 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 1507 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:57.935022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:57.935958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:57.956385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:57.957134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:57.958151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:57.958806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:58.248103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:58.325228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:58.327169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:58.328992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bec58b7-4231-4000-b0be-ec434134f0bb tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1593 microversion: 2.32 time: 0.403850 May 19 08:22:58.331263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 924/1784] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:57 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1593 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:58.346969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:58.348038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:58.357213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:58.358160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:58.359679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:58.361261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:58.671182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:58.692540 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-290c06af-d476-430f-900c-985d235492a0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1271 microversion: 2.1 time: 0.359495 May 19 08:22:58.694114 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 925/1785] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:58 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1271 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:58.715170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:58.717050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:58.744139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:58.748211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:58.750269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:58.753131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:58.790728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:22:58.901968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:58.923165 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-83af6b9e-599d-4d33-b613-068ca4b7aa81 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 200 len: 1474 microversion: 2.1 time: 1.472399 May 19 08:22:58.938547 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 861/1786] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:57 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 1474 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:58.944403 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:58.945255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:58.973467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:58.976379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:58.979685 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:58.981325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:59.028653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:22:59.256987 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7e686af6-56a6-41d5-89af-6d82b145610c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 204 len: 0 microversion: 2.1 time: 0.316452 May 19 08:22:59.259790 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 862/1787] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:22:58 2022] DELETE /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:22:59.302049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:59.312664 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:59.335175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:59.349092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08f656f1-371e-4260-8bd1-9b2bc39a938a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1345 microversion: 2.1 time: 0.653491 May 19 08:22:59.357070 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 926/1788] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:58 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1345 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:59.360907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:59.365337 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:59.369250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:22:59.369848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:59.371961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:22:59.372923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:59.382044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:59.384009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:59.385561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:59.386199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:59.890611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:59.909228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:59.913699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:59.924646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59a59322-21be-4d85-8548-16f3376937dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.566160 May 19 08:22:59.928600 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 927/1789] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:59 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:22:59.937170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7bae89de-3b6a-4965-ac1d-778196a1c676 req-757c08a4-83cb-4bec-8d0d-6ffe9a378f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d08df6ba-4511-436a-859a-055e37e683d3", "name": "network-vif-deleted", "tag": "2a4fb41a-95d0-439a-bbb4-06fd760f83be"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:22:59.962366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7bae89de-3b6a-4965-ac1d-778196a1c676 req-757c08a4-83cb-4bec-8d0d-6ffe9a378f33 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:22:59.962589 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:22:59.963569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7bae89de-3b6a-4965-ac1d-778196a1c676 req-757c08a4-83cb-4bec-8d0d-6ffe9a378f33 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:22:59.988387 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-19b96865-7c83-4f1b-b25e-b5f915af36c0 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.722564 May 19 08:22:59.991878 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 863/1790] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:22:59 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:22:59.997532 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7bae89de-3b6a-4965-ac1d-778196a1c676 req-757c08a4-83cb-4bec-8d0d-6ffe9a378f33 service nova] Creating event network-vif-deleted:2a4fb41a-95d0-439a-bbb4-06fd760f83be for instance d08df6ba-4511-436a-859a-055e37e683d3 on chh2-842464-2 May 19 08:23:00.008447 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7bae89de-3b6a-4965-ac1d-778196a1c676 req-757c08a4-83cb-4bec-8d0d-6ffe9a378f33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077965 May 19 08:23:00.009628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 928/1791] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:00.019269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:00.019643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2114a1cf-f81d-4669-b25e-52967fd762ce req-de2a9b8b-3b37-4274-bfcb-c7f7a3e518c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec2470e-9f8b-4dd9-a863-c275b08371d6", "name": "network-vif-plugged", "status": "completed", "tag": "d67679cb-9a1c-42d7-b08e-0e3140be38c4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:00.020491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:00.030754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:00.032384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:00.034315 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:00.035584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:00.046099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2114a1cf-f81d-4669-b25e-52967fd762ce req-de2a9b8b-3b37-4274-bfcb-c7f7a3e518c5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:00.046549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2114a1cf-f81d-4669-b25e-52967fd762ce req-de2a9b8b-3b37-4274-bfcb-c7f7a3e518c5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:00.065985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2114a1cf-f81d-4669-b25e-52967fd762ce req-de2a9b8b-3b37-4274-bfcb-c7f7a3e518c5 service nova] Creating event network-vif-plugged:d67679cb-9a1c-42d7-b08e-0e3140be38c4 for instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 on chh1-842464-2 May 19 08:23:00.076851 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2114a1cf-f81d-4669-b25e-52967fd762ce req-de2a9b8b-3b37-4274-bfcb-c7f7a3e518c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065550 May 19 08:23:00.077566 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 929/1792] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:00.092092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-665613242", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "5cd8d735-7e64-4a47-aa48-e0dddb7b372f"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:00.182715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] validate_networks() for [('5cd8d735-7e64-4a47-aa48-e0dddb7b372f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:23:00.698494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:00.710226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:00.719319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:00.722265 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-97ea6c51-6d48-46ce-b53e-9a3278293bef tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1661 microversion: 2.32 time: 0.726633 May 19 08:23:00.738117 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 864/1793] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:22:59 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1661 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:00.744173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:00.745093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:00.754437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:00.755170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:00.756115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:00.756713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.385127 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:01.400225 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2c69ea32-dd89-4a69-b524-f187566e7e1b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 0.660721 May 19 08:23:01.401374 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 865/1794] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:00 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:01.414203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:01.415171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: d08df6ba-4511-436a-859a-055e37e683d3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:01.429892 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.430826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.437256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.438002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.469488 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] HTTP exception thrown: Instance d08df6ba-4511-436a-859a-055e37e683d3 could not be found. May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Request method failure captured: May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 HTTP/1.1 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf2pwTdNfQnHUa3Ag3HLRRVulmLGTRhNmWyctKMrSl7mdiRbZfYbvigNGpOGuoZ7OEl0zVwbPPRZjbX30yPdkg6PqOq0iQdvf0jAANncihUWt037aAv-6yyuqfobBP6AkIPFrYQlR2i961UZg_bpLI8QYQMGQ-oZW0M3amT4rtV1Odk May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: f2e7072c37ad4f5383d767905c98c9bc May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ListImageFiltersTestJSON-140611895 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ListImageFiltersTestJSON-140611895 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: f2e7072c37ad4f5383d767905c98c9bc May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-140611895 May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ListImageFiltersTestJSON-140611895-project May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5cb3f20962a948f2ab2f403bb1d9680c May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ListImageFiltersTestJSON-140611895-project May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance d08df6ba-4511-436a-859a-055e37e683d3 could not be found. May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'd08df6ba-4511-436a-859a-055e37e683d3'} May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d08df6ba-4511-436a-859a-055e37e683d3 could not be found. May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d08df6ba-4511-436a-859a-055e37e683d3 could not be found. May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:01.475592 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d08df6ba-4511-436a-859a-055e37e683d3 could not be found. May 19 08:23:01.480372 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:01.482537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Returning 404 to user: Instance d08df6ba-4511-436a-859a-055e37e683d3 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:01.483657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c0547011-bee3-4659-ba86-ad17038272aa tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3" status: 404 len: 111 microversion: 2.1 time: 0.080887 May 19 08:23:01.484515 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 866/1795] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:01 2022] GET /compute/v2.1/servers/d08df6ba-4511-436a-859a-055e37e683d3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:01.496447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:01.499014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:01.510919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:23:01.513106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:23:01.513854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:23:01.514489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:23:01.515139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:23:01.528813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.532014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.532810 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.534077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.538102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.538917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.543010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.544101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.605591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Getting quotas for project ff49ea2c1efc41f685b496815d13bc09. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:23:01.619617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Getting quotas for user 5e7cc48a60f14daa825d66600fe1dd92 and project ff49ea2c1efc41f685b496815d13bc09. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:23:01.649730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:23:01.657680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:23:01.686141 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:01.704100 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-896300bc-ab55-4b9a-9f62-d0a94a374ca1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.217274 May 19 08:23:01.704601 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 867/1796] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:01 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:01.720395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:01.721831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:01.725632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:01.761622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.761622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.761622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.761622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.829907 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-045857ea-473a-48ef-b17e-8a18bafbbe10 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.747411 May 19 08:23:01.833877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 930/1797] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:23:01.848553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:01.851336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:01.866422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.866869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:01.867650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:01.868073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:02.420208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:02.463893 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:02.466544 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:02.469539 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1cb57f15-538d-4291-affd-ee8344033f71 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.762803 May 19 08:23:02.470910 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 868/1798] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:01 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:02.493578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:02.497233 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:02.509200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:02.510905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:02.512812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:02.513870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:02.561769 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:23:02.563761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:02.578201 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1034e68-abc8-4f4f-9e7f-64701454e472 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.738548 May 19 08:23:02.595184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 931/1799] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:01 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:02.604350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:02.605544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:02.631200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:02.631809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:02.632635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:02.633083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:02.753216 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3b24c289-f6ec-4c62-80de-3a8fa0f6891d tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 204 len: 0 microversion: 2.1 time: 0.278091 May 19 08:23:02.755164 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 869/1800] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:02 2022] DELETE /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:02.781798 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:02.783113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:02.822160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:02.822682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:02.823549 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:02.824563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.555716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:03.565468 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6af99b21-a593-4af6-9e62-dd82534f59b9 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1221 microversion: 2.1 time: 0.801861 May 19 08:23:03.566756 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 870/1801] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:02 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1221 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:03.575956 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6cdca0fa-a918-4715-963a-48272f5a5f25 req-a555899f-dc9f-46cc-a233-3cf04244e7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec2470e-9f8b-4dd9-a863-c275b08371d6", "name": "network-vif-plugged", "status": "completed", "tag": "8ecb86d3-1430-4f3a-86a4-a7f7620511d6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:03.588379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6cdca0fa-a918-4715-963a-48272f5a5f25 req-a555899f-dc9f-46cc-a233-3cf04244e7b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.592039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6cdca0fa-a918-4715-963a-48272f5a5f25 req-a555899f-dc9f-46cc-a233-3cf04244e7b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.607371 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6cdca0fa-a918-4715-963a-48272f5a5f25 req-a555899f-dc9f-46cc-a233-3cf04244e7b4 service nova] Creating event network-vif-plugged:8ecb86d3-1430-4f3a-86a4-a7f7620511d6 for instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 on chh1-842464-2 May 19 08:23:03.609171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:03.614616 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6cdca0fa-a918-4715-963a-48272f5a5f25 req-a555899f-dc9f-46cc-a233-3cf04244e7b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046085 May 19 08:23:03.615834 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 871/1802] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:03.627273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a60cd55b-913c-4402-836c-d568d227d9bb req-04a991b9-c09b-4dda-8bf0-ea23e3e0d39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cdd443-b415-48e2-aa1c-63d2c9995854", "name": "network-vif-deleted", "tag": "e5709540-bb04-426d-8ff7-f2ddb7a8d8f8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:03.632765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:03.636049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:03.640529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8d1d282-2e87-4084-a704-5a41eda666ed tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1708 microversion: 2.32 time: 1.044374 May 19 08:23:03.641854 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 932/1803] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:02 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1708 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:03.643782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a60cd55b-913c-4402-836c-d568d227d9bb req-04a991b9-c09b-4dda-8bf0-ea23e3e0d39d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.644338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a60cd55b-913c-4402-836c-d568d227d9bb req-04a991b9-c09b-4dda-8bf0-ea23e3e0d39d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.647367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:03.648591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:03.655865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.656591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.657694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.658682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.658922 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a60cd55b-913c-4402-836c-d568d227d9bb req-04a991b9-c09b-4dda-8bf0-ea23e3e0d39d service nova] Creating event network-vif-deleted:e5709540-bb04-426d-8ff7-f2ddb7a8d8f8 for instance 74cdd443-b415-48e2-aa1c-63d2c9995854 on chh1-842464-2 May 19 08:23:03.664192 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a60cd55b-913c-4402-836c-d568d227d9bb req-04a991b9-c09b-4dda-8bf0-ea23e3e0d39d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046795 May 19 08:23:03.665511 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 872/1804] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:03.672305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-8bb058a8-5a17-4133-b1c9-7e3d89d2a114 req-b7dcca5b-3cd2-4f00-b7f1-5877c3bbbd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa9990a-e0ce-4fdb-be55-e69b2bd99b37", "tag": "b33161a8-4035-4c00-a655-d973dd0c030d"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:03.683984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8bb058a8-5a17-4133-b1c9-7e3d89d2a114 req-b7dcca5b-3cd2-4f00-b7f1-5877c3bbbd07 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.684750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8bb058a8-5a17-4133-b1c9-7e3d89d2a114 req-b7dcca5b-3cd2-4f00-b7f1-5877c3bbbd07 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.697240 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-8bb058a8-5a17-4133-b1c9-7e3d89d2a114 req-b7dcca5b-3cd2-4f00-b7f1-5877c3bbbd07 service nova] Creating event network-changed:b33161a8-4035-4c00-a655-d973dd0c030d for instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 on chh2-842464-2 May 19 08:23:03.703131 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-8bb058a8-5a17-4133-b1c9-7e3d89d2a114 req-b7dcca5b-3cd2-4f00-b7f1-5877c3bbbd07 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036250 May 19 08:23:03.705688 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 873/1805] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:03.711042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:03.711823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:03.719307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.719870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.720725 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.721241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.727671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:03.820273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:03.830747 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-53bbebfb-40c1-43c5-8f16-f0494b295c72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.123750 May 19 08:23:03.831970 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 874/1806] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:03 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:03.836148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:03.836871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:03.843923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.844514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.845716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.846023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.873763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:03.882217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1ee6661-f068-4e6e-b5f4-fa8192b989e4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 0.238968 May 19 08:23:03.882803 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 933/1807] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:03 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:03.890345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:03.891328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:03.899994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.901113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:03.902307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:03.902937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.255606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:04.265082 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8c304fe5-654d-4093-b713-87bc7e7ae6a8 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1473 microversion: 2.1 time: 0.432340 May 19 08:23:04.266131 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 875/1808] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:03 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:04.271173 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:04.271965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:04.282023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.282656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.283739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.284483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.307005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:04.316525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:04.318477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:04.319857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2dcf76b-ae9e-4d7d-8157-ab742670ebb8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.435725 May 19 08:23:04.320449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 934/1809] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:03 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:04.446471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:04.455307 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d0092fff-b787-4346-9e31-b797d26140a6 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1333 microversion: 2.1 time: 0.188194 May 19 08:23:04.455877 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 876/1810] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:04 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:04.585966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:04.586895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:04.595125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.596012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.597018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.597486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.660362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:04.660783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:04.668189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.668642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.669430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.669866 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.760199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:04.771426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a765585-3433-403c-8604-cf97abefa12c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1275 microversion: 2.1 time: 0.189400 May 19 08:23:04.772599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 935/1811] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:04 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:04.847897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:04.848824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:04.855673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.856495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:04.857538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:04.858151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.023893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.035517 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33443d7a-bdb7-462b-a207-57f80e336fbe tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.191213 May 19 08:23:05.046700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 936/1812] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:04 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:23:05.052552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:05.053555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:05.061107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.062116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.063122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.063981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.171702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.195666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.202923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.206646 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2faf9cf8-f740-401b-b754-cb1c4f8e069c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1755 microversion: 2.32 time: 0.548416 May 19 08:23:05.208065 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 877/1813] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:04 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1755 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:23:05.290116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:05.291043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:05.304993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.305833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.310397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.311189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.493195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.509673 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36c23aa8-b933-42da-9187-7cdbdccbfcab tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 0.460790 May 19 08:23:05.521988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 937/1814] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:05 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:05.529762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:05.530672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:05.539006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.540366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.541481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.542956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.856528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.869039 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-10834280-5afd-4b62-8f57-cb997542f14a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1473 microversion: 2.1 time: 0.588053 May 19 08:23:05.880998 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 878/1815] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:05 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1473 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:23:05.880998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:05.882084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:05.888723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.889849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.891597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:05.892051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:05.900586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:05.925383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:05.986175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:05.999783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.003302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.005729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a75e9c8-cef0-47df-992e-d02038f35e6a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.482317 May 19 08:23:06.015129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 938/1816] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:05 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:06.029818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-240cce24-2c81-42a0-82ad-ea1e075a562e req-6b2c2315-7d54-46c2-9158-32a062cab7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4242f4f6-3fd8-4333-b466-245f42dfc4ce", "name": "network-vif-deleted", "tag": "805be888-f989-4ea6-ad31-45f1ff6e61de"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:06.051141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-240cce24-2c81-42a0-82ad-ea1e075a562e req-6b2c2315-7d54-46c2-9158-32a062cab7de service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.051783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-240cce24-2c81-42a0-82ad-ea1e075a562e req-6b2c2315-7d54-46c2-9158-32a062cab7de service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.073993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-240cce24-2c81-42a0-82ad-ea1e075a562e req-6b2c2315-7d54-46c2-9158-32a062cab7de service nova] Creating event network-vif-deleted:805be888-f989-4ea6-ad31-45f1ff6e61de for instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce on chh1-842464-2 May 19 08:23:06.081821 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-240cce24-2c81-42a0-82ad-ea1e075a562e req-6b2c2315-7d54-46c2-9158-32a062cab7de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063786 May 19 08:23:06.083294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 939/1817] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:06.094836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:06.095651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:06.108464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.112137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.113891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.114368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.288347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.299812 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a441689e-3565-4368-9297-f0f65bbfd1a9 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1666 microversion: 2.1 time: 0.426291 May 19 08:23:06.301601 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 879/1818] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:05 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1666 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:06.308273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:06.309401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:06.318570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.319157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.320885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.321477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.459814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.469431 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e9db34d1-1a8a-4ba8-9761-831385649990 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.165061 May 19 08:23:06.470129 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 880/1819] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:06 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:06.478992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:06.478992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:06.487115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.487992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.488941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.489581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.494659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.507438 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7b7cade-9350-42c4-b2a6-855c8148cd5b tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1317 microversion: 2.1 time: 0.422526 May 19 08:23:06.511095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 940/1820] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:06 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:06.533207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:06.533987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:06.540432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.541135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.542168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.543492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.582826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f93c96c7-2052-4f87-9843-fed86f9ed244 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6/ips" status: 200 len: 177 microversion: 2.1 time: 0.069505 May 19 08:23:06.583988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 941/1821] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:23:06 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6/ips => generated 177 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:06.589715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:06.591199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:06.613446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.614382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.619416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:06.620133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:06.984559 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.995082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.996977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:06.998399 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b02e1035-a9b2-441d-9350-d28b3e79d6b0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1802 microversion: 2.32 time: 0.527216 May 19 08:23:06.999598 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 881/1822] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:06 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1802 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:07.004747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:07.005478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:07.013050 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.013569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.014543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.015142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.046612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:07.058160 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9e13129-f7b6-4be8-9b64-549847017d71 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 0.472203 May 19 08:23:07.067264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 942/1823] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:06 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:07.067264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:07.067264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:07.072343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:23:07.075796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.076259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.079069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.079617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.127660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.127925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.128318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lazy-loading 'fault' on Instance uuid 62e4c305-bcc5-47b3-afc2-23678ef26444 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:23:07.216349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cb3f20962a948f2ab2f403bb1d9680c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e7072c37ad4f5383d767905c98c9bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:07.224165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-554c66c8-fd91-4765-b85a-2cee69db875a tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 200 len: 1308 microversion: 2.1 time: 0.163969 May 19 08:23:07.224758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 943/1824] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:07 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:07.245531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:07.246730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:07.259743 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-41354875-440d-4b60-b2d4-61cfb97ca51a tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 204 len: 0 microversion: 2.1 time: 0.256912 May 19 08:23:07.262471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.262919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.263790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.264094 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 882/1825] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:06 2022] DELETE /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:07.264245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.284183 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:07.285388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:07.303597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.304248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.305194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.305754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.860137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:07.878629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:07.881543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:07.882964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a13da86d-e6f8-4beb-8f01-883809578a82 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.657275 May 19 08:23:07.883888 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 944/1826] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:07 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:07.892086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:07.892927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:07.909749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.910650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.911804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.912424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.944310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:07.953266 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-130679e0-71ab-4be6-a912-8c6e7acda8a2 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1672 microversion: 2.1 time: 0.683645 May 19 08:23:07.955931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:07.966297 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 883/1827] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:07 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1672 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:07.979056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:07.980473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:07.994996 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.996102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:07.996482 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:07.996920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.129454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:08.147867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77ba0955-49c6-46b2-a8d3-4a88de9a3330 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.262073 May 19 08:23:08.154469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 945/1828] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:07 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:08.160285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:08.160907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:08.169513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.169988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.170823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.171264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.241602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:08.263831 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0dc83ff7-55c5-40f8-b93a-37f14fc2e0ec tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1317 microversion: 2.1 time: 0.293766 May 19 08:23:08.264107 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 884/1829] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:07 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:08.272219 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:08.272929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:08.281763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.282225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.283030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.283531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.601912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:08.611994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:08.626155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:08.627752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0018da1b-cfe8-4af1-ba4a-72bbe16582f7 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1849 microversion: 2.32 time: 0.472911 May 19 08:23:08.628556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 946/1830] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:08 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1849 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:08.633388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-375058b8-5768-4d1c-a4a4-acd332cc9d63 req-3611aa4e-eeab-4fba-b359-2782d06deecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4c305-bcc5-47b3-afc2-23678ef26444", "name": "network-vif-deleted", "tag": "fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:08.655450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-375058b8-5768-4d1c-a4a4-acd332cc9d63 req-3611aa4e-eeab-4fba-b359-2782d06deecb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.656283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-375058b8-5768-4d1c-a4a4-acd332cc9d63 req-3611aa4e-eeab-4fba-b359-2782d06deecb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.675534 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-375058b8-5768-4d1c-a4a4-acd332cc9d63 req-3611aa4e-eeab-4fba-b359-2782d06deecb service nova] Creating event network-vif-deleted:fdfc0f73-bdba-44fc-a2bb-0eda0796ed9c for instance 62e4c305-bcc5-47b3-afc2-23678ef26444 on chh2-842464-2 May 19 08:23:08.683728 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-375058b8-5768-4d1c-a4a4-acd332cc9d63 req-3611aa4e-eeab-4fba-b359-2782d06deecb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051865 May 19 08:23:08.684029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:08.685344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 947/1831] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:08.694545 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-00199f11-4491-4ba6-bb84-b89b6a87361a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 0.426903 May 19 08:23:08.696978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:08.699149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] [instance: 62e4c305-bcc5-47b3-afc2-23678ef26444] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:08.701419 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 885/1832] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:08 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:08.709864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.710564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.712361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.713387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.731966 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] HTTP exception thrown: Instance 62e4c305-bcc5-47b3-afc2-23678ef26444 could not be found. May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Request method failure captured: May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 HTTP/1.1 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf2pwTdNfQnHUa3Ag3HLRRVulmLGTRhNmWyctKMrSl7mdiRbZfYbvigNGpOGuoZ7OEl0zVwbPPRZjbX30yPdkg6PqOq0iQdvf0jAANncihUWt037aAv-6yyuqfobBP6AkIPFrYQlR2i961UZg_bpLI8QYQMGQ-oZW0M3amT4rtV1Odk May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f2e7072c37ad4f5383d767905c98c9bc May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListImageFiltersTestJSON-140611895 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2e7072c37ad4f5383d767905c98c9bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListImageFiltersTestJSON-140611895 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f2e7072c37ad4f5383d767905c98c9bc May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-140611895 May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListImageFiltersTestJSON-140611895-project May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cb3f20962a948f2ab2f403bb1d9680c May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListImageFiltersTestJSON-140611895-project May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 62e4c305-bcc5-47b3-afc2-23678ef26444 could not be found. May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '62e4c305-bcc5-47b3-afc2-23678ef26444'} May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e4c305-bcc5-47b3-afc2-23678ef26444 could not be found. May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e4c305-bcc5-47b3-afc2-23678ef26444 could not be found. May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:08.734083 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e4c305-bcc5-47b3-afc2-23678ef26444 could not be found. May 19 08:23:08.738793 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:08.740807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Returning 404 to user: Instance 62e4c305-bcc5-47b3-afc2-23678ef26444 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:08.742100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a181cabe-7fe1-40b3-9765-927b99b585d4 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444" status: 404 len: 111 microversion: 2.1 time: 0.055332 May 19 08:23:08.743003 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 948/1833] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:08 2022] GET /compute/v2.1/servers/62e4c305-bcc5-47b3-afc2-23678ef26444 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:08.752824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-913059fe-7a70-4d2d-b11c-19369816b0fd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212d2ec10>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:08.909452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:08.910965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:08.932538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.935484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:08.936417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:08.936871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:09.264078 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-913059fe-7a70-4d2d-b11c-19369816b0fd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/images/c2403744-668d-4750-831a-59a57e63cff3" status: 204 len: 0 microversion: 2.1 time: 0.515381 May 19 08:23:09.264703 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 886/1834] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:08 2022] DELETE /compute/v2.1/images/c2403744-668d-4750-831a-59a57e63cff3 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:09.270150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:09.270776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:09.280607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:09.281488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:09.282442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:09.283276 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:09.424405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:09.445034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:09.450481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:09.452647 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a46bcab-89c0-4a06-be52-2d88468d67d8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.551963 May 19 08:23:09.455124 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 949/1835] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:08 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:09.469578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:09.470652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:09.473201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:09.482794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:09.483668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:09.487477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:09.488407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:09.687631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:09.702941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b420838b-7743-43f6-89f4-bec33cc0bc9f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.246044 May 19 08:23:09.704385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 950/1836] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:09 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:09.709829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da8b29aa-5b7c-4780-95b0-a41bbc39d394 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3211ccf0d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:09.748950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:09.758575 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4594c45c-a689-47f9-899e-40138e15ce42 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1672 microversion: 2.1 time: 0.492840 May 19 08:23:09.759160 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 887/1837] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:09 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1672 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:09.770610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:09.774688 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:09.801531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:09.802162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:09.803012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:09.803452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.169883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da8b29aa-5b7c-4780-95b0-a41bbc39d394 tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/images/ce2e3124-2e6a-42e1-ac51-6800d4b17253" status: 204 len: 0 microversion: 2.1 time: 0.464172 May 19 08:23:10.171394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 951/1838] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:09 2022] DELETE /compute/v2.1/images/ce2e3124-2e6a-42e1-ac51-6800d4b17253 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:10.179186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ea7c223c-4437-4a1a-b968-a105d82cca45 req-88239944-5f98-4399-8e78-1dd1e2741b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "e8fc8d94-8d22-41a4-9fca-3e3794bcefc1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:10.186658 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:10.195436 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-76e46e4c-e2d3-48c1-b3e0-876846a08b8d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1317 microversion: 2.1 time: 0.433449 May 19 08:23:10.207324 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 888/1839] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:09 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:10.210565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ea7c223c-4437-4a1a-b968-a105d82cca45 req-88239944-5f98-4399-8e78-1dd1e2741b51 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.211019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ea7c223c-4437-4a1a-b968-a105d82cca45 req-88239944-5f98-4399-8e78-1dd1e2741b51 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.212348 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:10.213200 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:10.226230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.228327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.229225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.231307 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.247815 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ea7c223c-4437-4a1a-b968-a105d82cca45 req-88239944-5f98-4399-8e78-1dd1e2741b51 service nova] Creating event network-changed:e8fc8d94-8d22-41a4-9fca-3e3794bcefc1 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:10.258343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ea7c223c-4437-4a1a-b968-a105d82cca45 req-88239944-5f98-4399-8e78-1dd1e2741b51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084393 May 19 08:23:10.260158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 952/1840] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:10.273668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:10.274026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:10.302689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.303494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.304666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.305665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.550438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:10.567617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:10.569104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:10.570724 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-10bea2b2-3c23-4530-a02b-9400b6f1c9f3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1870 microversion: 2.32 time: 0.361924 May 19 08:23:10.570930 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 889/1841] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:10 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1870 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:10.595870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-174be914-d842-45f8-9ffe-6be3268e492b req-8736ff6d-646e-4d33-b4fc-9dd38ad3debb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa9990a-e0ce-4fdb-be55-e69b2bd99b37", "name": "network-vif-plugged", "status": "completed", "tag": "b33161a8-4035-4c00-a655-d973dd0c030d"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:10.609104 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-174be914-d842-45f8-9ffe-6be3268e492b req-8736ff6d-646e-4d33-b4fc-9dd38ad3debb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.609992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-174be914-d842-45f8-9ffe-6be3268e492b req-8736ff6d-646e-4d33-b4fc-9dd38ad3debb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.617495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:10.636744 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-174be914-d842-45f8-9ffe-6be3268e492b req-8736ff6d-646e-4d33-b4fc-9dd38ad3debb service nova] Creating event network-vif-plugged:b33161a8-4035-4c00-a655-d973dd0c030d for instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 on chh2-842464-2 May 19 08:23:10.642364 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-174be914-d842-45f8-9ffe-6be3268e492b req-8736ff6d-646e-4d33-b4fc-9dd38ad3debb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051488 May 19 08:23:10.643873 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 890/1842] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:10.650581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-294a173a-d6d2-4de5-832b-49a8bbec17bd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] Calling method '.version_select at 0x7f3212c3f9d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:10.665115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:10.679672 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b868ae1c-2b7d-4004-a4e6-6548cdf5b9f1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 0.416870 May 19 08:23:10.680606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 953/1843] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:10 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:10.702553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:10.703362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:10.713159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.714777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:10.715910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:10.716563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.028832 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-294a173a-d6d2-4de5-832b-49a8bbec17bd tempest-ListImageFiltersTestJSON-140611895 tempest-ListImageFiltersTestJSON-140611895-project] 10.222.0.78 "DELETE /compute/v2.1/images/faaddad8-68b7-4c27-8442-9a01485c0a54" status: 204 len: 0 microversion: 2.1 time: 0.381702 May 19 08:23:11.030111 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 891/1844] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:10 2022] DELETE /compute/v2.1/images/faaddad8-68b7-4c27-8442-9a01485c0a54 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:11.044582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-55e9d249-6550-4001-9142-efb8258c79fe req-eebe30a5-e38c-41e1-b308-a4d90336cc34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84caa600-527f-4ffc-95dd-c1980eaef3d9", "tag": "b08f4d66-1935-41eb-9bdc-45f96a5ab2f0"}, {"server_uuid": "2ec2470e-9f8b-4dd9-a863-c275b08371d6", "name": "network-vif-deleted", "tag": "8ecb86d3-1430-4f3a-86a4-a7f7620511d6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:11.072288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-55e9d249-6550-4001-9142-efb8258c79fe req-eebe30a5-e38c-41e1-b308-a4d90336cc34 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.078827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-55e9d249-6550-4001-9142-efb8258c79fe req-eebe30a5-e38c-41e1-b308-a4d90336cc34 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.121444 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-55e9d249-6550-4001-9142-efb8258c79fe req-eebe30a5-e38c-41e1-b308-a4d90336cc34 service nova] Creating event network-changed:b08f4d66-1935-41eb-9bdc-45f96a5ab2f0 for instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 on chh1-842464-2 May 19 08:23:11.124193 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-55e9d249-6550-4001-9142-efb8258c79fe req-eebe30a5-e38c-41e1-b308-a4d90336cc34 service nova] Creating event network-vif-deleted:8ecb86d3-1430-4f3a-86a4-a7f7620511d6 for instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 on chh1-842464-2 May 19 08:23:11.138010 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-55e9d249-6550-4001-9142-efb8258c79fe req-eebe30a5-e38c-41e1-b308-a4d90336cc34 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.106270 May 19 08:23:11.143550 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 892/1845] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:11.157030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:11.158212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:11.165745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.166381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.167863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.168555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.224209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:11.249635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:11.251755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:11.253027 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-434b572f-057d-4026-90a9-c9d770a5907a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.571323 May 19 08:23:11.253991 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 954/1846] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:10 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:11.267724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:11.268819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:11.275593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.280976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.282469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.283176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.309846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:11.323273 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cc175d57-cd31-48e9-b2ef-201b3fd4d2f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.176822 May 19 08:23:11.326169 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 893/1847] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:11 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:11.331486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:11.332361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:11.346125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.347568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.348578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.349193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.562012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:11.644420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:11.733678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:11.748636 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd038006-7248-48c4-8481-9880eaa5d96f tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1651 microversion: 2.1 time: 0.493512 May 19 08:23:11.750434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 955/1848] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:11 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1651 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:11.758545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:11.759444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:11.768054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.769021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.770448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.771428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.785283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:11.798974 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-163b45c0-3e56-4272-a184-95821927a187 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1317 microversion: 2.1 time: 0.470772 May 19 08:23:11.799778 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 894/1849] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:11 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:11.806709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:11.814223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:11.825783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.826399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:11.840380 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:11.840844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:12.292592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:12.308254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:12.310447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:12.311938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6df7fa18-ee70-439a-941f-105af1a97220 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.560189 May 19 08:23:12.324247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 956/1850] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:11 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:12.340101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:12.341358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:12.363653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:12.364104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:12.364893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:12.365354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.113179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:13.123350 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-24fb6c09-0c55-4c42-99d5-f1ebfd88ea9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1313 microversion: 2.1 time: 1.322263 May 19 08:23:13.145297 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 895/1851] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:11 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1313 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:13.153625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-c636944b-d332-4741-b3c2-5192cba492a7 req-675b830b-6353-4c40-9bd1-f044a86cd03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "1ade10ca-5a76-44a1-b65c-a3621244ef74"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:13.173710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c636944b-d332-4741-b3c2-5192cba492a7 req-675b830b-6353-4c40-9bd1-f044a86cd03a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.174170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c636944b-d332-4741-b3c2-5192cba492a7 req-675b830b-6353-4c40-9bd1-f044a86cd03a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.210493 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-c636944b-d332-4741-b3c2-5192cba492a7 req-675b830b-6353-4c40-9bd1-f044a86cd03a service nova] Creating event network-changed:1ade10ca-5a76-44a1-b65c-a3621244ef74 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:13.216506 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-c636944b-d332-4741-b3c2-5192cba492a7 req-675b830b-6353-4c40-9bd1-f044a86cd03a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069515 May 19 08:23:13.217677 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 896/1852] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:13.224019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:13.225147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:13.240267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.241493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.242899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.245976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.267107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:13.289773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:13.298753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:13.301229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8388617-3ad8-47ce-82db-69ebfc5021b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.975430 May 19 08:23:13.311105 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 957/1853] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:12 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:13.332760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:13.334092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:13.349486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.350622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.351636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.352993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.471029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.472218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.472854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lazy-loading 'fault' on Instance uuid 2ec2470e-9f8b-4dd9-a863-c275b08371d6 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:23:13.563155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:13.572631 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5c1dcb79-6bc4-43a0-bc39-ba62cec8ad8d tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.353382 May 19 08:23:13.573234 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 897/1854] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:13 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:13.592136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:13.592686 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:13.611148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.611597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.621321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.621811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.710197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba771be4f9469085cb6ed8b1feef61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9315d3e582f8468a92b56b0b4ee2120b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:13.723092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51f5498a-7637-4848-bec1-88eceb430c73 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 200 len: 1302 microversion: 2.1 time: 0.410621 May 19 08:23:13.726711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 958/1855] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:13 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 1302 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:13.739951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7d614748-64c7-4948-b3bd-42b2826c9826 req-3f09cd2b-0fea-411d-b2b3-f9051875128b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec2470e-9f8b-4dd9-a863-c275b08371d6", "name": "network-vif-deleted", "tag": "d67679cb-9a1c-42d7-b08e-0e3140be38c4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:13.761205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7d614748-64c7-4948-b3bd-42b2826c9826 req-3f09cd2b-0fea-411d-b2b3-f9051875128b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.761696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7d614748-64c7-4948-b3bd-42b2826c9826 req-3f09cd2b-0fea-411d-b2b3-f9051875128b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.805915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7d614748-64c7-4948-b3bd-42b2826c9826 req-3f09cd2b-0fea-411d-b2b3-f9051875128b service nova] Creating event network-vif-deleted:d67679cb-9a1c-42d7-b08e-0e3140be38c4 for instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 on chh1-842464-2 May 19 08:23:13.835207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7d614748-64c7-4948-b3bd-42b2826c9826 req-3f09cd2b-0fea-411d-b2b3-f9051875128b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106863 May 19 08:23:13.840788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 959/1856] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:13.869530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:13.870942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:13.893387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.894616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:13.896563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:13.925663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:14.453678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.472722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.476920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.484639 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa8ea4e9-0a52-4108-a74a-756a01fa25d2 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.635814 May 19 08:23:14.497287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 960/1857] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:13 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:14.503254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:14.504087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:14.512701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:14.513484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:14.514495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:14.515104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:14.540795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.552484 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-45fd4098-8b84-46c0-9021-23664f55867e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1317 microversion: 2.1 time: 0.977566 May 19 08:23:14.566022 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 898/1858] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:13 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1317 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:14.571722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:14.572975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:14.582617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:14.583515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:14.585703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:14.587090 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:14.961868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.988246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.989807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:14.991024 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aa2e468b-ac8f-4eb6-93ab-f31631de7613 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.423391 May 19 08:23:14.991592 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 899/1859] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:14 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:15.008454 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:15.009691 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:15.019904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.022896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.023745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.037281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.045383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:15.056212 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfc7f73d-4034-4edc-a69e-56e37ecd56f3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1462 microversion: 2.1 time: 0.557449 May 19 08:23:15.057039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 961/1860] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:14 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1462 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:15.074506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:15.075984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:15.093923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.094367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.095158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.095595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.130429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] HTTP exception thrown: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Request method failure captured: May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 HTTP/1.1 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3s7ltOKUR4pA4btJFg6ySKYj3L8ORSYN-HAAx15GXI0SsNtfH2ke4KG2eVXImimR5fO4JaB8xSrTRdOxXa3iiBsabZM8KZNJkG6gGuST4Hm2cyeRaSEX46MmFefP-khy8UKcYQ9SoWefv8SoeKUdfasAILdDaxWgs7epXpn4f8jyk May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestMultiNic-1136853225 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 70ba771be4f9469085cb6ed8b1feef61 May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2ec2470e-9f8b-4dd9-a863-c275b08371d6'} May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:15.134529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Returning 404 to user: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:15.140537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0698dba3-6305-4a65-8162-981a27696648 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 404 len: 111 microversion: 2.1 time: 0.073780 May 19 08:23:15.157117 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 962/1861] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:15 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:15.223094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:15.235626 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9f651572-9311-4612-93bf-274058391e27 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.242545 May 19 08:23:15.236157 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 900/1862] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:14 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:15.251243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9e8cc201-9e91-403b-a638-c3f3015c57b3 req-e39272fb-0ff3-4067-b3ea-877992b88e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84caa600-527f-4ffc-95dd-c1980eaef3d9", "name": "network-vif-plugged", "status": "completed", "tag": "b08f4d66-1935-41eb-9bdc-45f96a5ab2f0"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:15.271170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9e8cc201-9e91-403b-a638-c3f3015c57b3 req-e39272fb-0ff3-4067-b3ea-877992b88e99 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.272024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9e8cc201-9e91-403b-a638-c3f3015c57b3 req-e39272fb-0ff3-4067-b3ea-877992b88e99 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.294188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9e8cc201-9e91-403b-a638-c3f3015c57b3 req-e39272fb-0ff3-4067-b3ea-877992b88e99 service nova] Creating event network-vif-plugged:b08f4d66-1935-41eb-9bdc-45f96a5ab2f0 for instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 on chh1-842464-2 May 19 08:23:15.306985 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9e8cc201-9e91-403b-a638-c3f3015c57b3 req-e39272fb-0ff3-4067-b3ea-877992b88e99 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065209 May 19 08:23:15.310331 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 901/1863] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:15.504944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:15.506229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:15.517800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.518639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.519673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.519807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:15.520865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.524109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'deleted': False, 'project_id': 'e235fab9f22c4680bdfb296ae1e38037'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:15.540870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.541361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.542315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.543035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.723059 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9856a4a1-6582-453f-82ac-bc20f9b770f8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.564366 May 19 08:23:15.738509 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 963/1864] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:23:15 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:23:15.742520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "80c46ebd-c10d-4225-b559-8c49f3a69aee"}, {"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "b1328560-4eff-4a93-823e-a34547baed16"}, {"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "5d2075ad-5696-49b2-8373-97e00abd0329"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:15.752308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.752765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.766263 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] Creating event network-changed:80c46ebd-c10d-4225-b559-8c49f3a69aee for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:15.766867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] Creating event network-changed:b1328560-4eff-4a93-823e-a34547baed16 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:15.767381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] Creating event network-changed:5d2075ad-5696-49b2-8373-97e00abd0329 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:15.774566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-07a290cc-ea4c-4b91-810f-04ff853f0ee0 req-f0ce7e17-ec15-4a7b-a69b-e994828cbc08 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.035388 May 19 08:23:15.775195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 964/1865] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:15.790950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:15.794246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:15.806621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.807079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:15.808274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:15.808940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:16.256814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:16.266745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:16.273442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:16.285439 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6c12b0bd-4770-46a2-b20f-fca4882b9759 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.774681 May 19 08:23:16.297216 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 902/1866] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:15 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:23:16.304282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:16.309941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'deleted': False} {{(pid=119073) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:16.324367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:16.325112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:16.331743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:16.332203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:16.460014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:16.468654 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23e97931-d863-4671-a87e-45cf28342f45 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1317 microversion: 2.1 time: 0.682016 May 19 08:23:16.469246 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 965/1867] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:15 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:16.485123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:16.485767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:16.507107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:16.507652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:16.508542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:16.508986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:16.567250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.multi_cell_list [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=119073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:23:16.764406 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:16.765381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:17.210014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:17.234597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:17.236593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:17.238009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f391213-b651-4971-a944-5c1d7f2e5068 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.767640 May 19 08:23:17.238704 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 966/1868] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:16 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:17.255864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:17.256537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:17.265220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:17.265748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:17.266597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:17.267033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:17.297400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:17.665405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:17.681611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a50151ac-7b21-4b73-9b8e-3bc43a29d1e3 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.427643 May 19 08:23:17.683556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 967/1869] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:17 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:17.695927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:17.701714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:17.722468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:17.724774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:17.727872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:17.730207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.467619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:18.480795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:18.482616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:18.484028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8f10834-e1d1-4823-83d1-b14f67b7f08a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.797488 May 19 08:23:18.501234 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 968/1870] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:17 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:18.506581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:18.507529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:18.515476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.515921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.517100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.517582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.692956 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-30cbc803-35ec-427a-99bd-b07f53bbfb16 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19408 microversion: 2.1 time: 2.405049 May 19 08:23:18.694201 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 903/1871] 10.222.0.78 () {58 vars in 1170 bytes} [Thu May 19 08:23:16 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19408 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:23:18.700625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-eff54733-a3c0-4657-9156-9066bb9a71b2 req-9defa53a-fe91-4032-ab24-eb5aaebb31a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "16d3d764-2d91-4ed4-9a5f-8f83a9f4f980"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:18.721202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-eff54733-a3c0-4657-9156-9066bb9a71b2 req-9defa53a-fe91-4032-ab24-eb5aaebb31a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.726414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-eff54733-a3c0-4657-9156-9066bb9a71b2 req-9defa53a-fe91-4032-ab24-eb5aaebb31a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.759901 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-eff54733-a3c0-4657-9156-9066bb9a71b2 req-9defa53a-fe91-4032-ab24-eb5aaebb31a1 service nova] Creating event network-changed:16d3d764-2d91-4ed4-9a5f-8f83a9f4f980 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:18.766266 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-eff54733-a3c0-4657-9156-9066bb9a71b2 req-9defa53a-fe91-4032-ab24-eb5aaebb31a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070368 May 19 08:23:18.767298 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 904/1872] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:18.772592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:18.786579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:18.793676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.794239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.795128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.795636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.880515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:18.892711 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61eac9ce-72db-4f9f-9d8b-a1f0a01b5432 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1507 microversion: 2.1 time: 0.389955 May 19 08:23:18.895606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 969/1873] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:18 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:18.911660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:18.914388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:18.930592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.931549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:18.933370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:18.934231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.132783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:19.145747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e8c15be-acab-4b00-ba12-a407a8023a0c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.246997 May 19 08:23:19.154950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 970/1874] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:18 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:19.154950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:19.171439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'deleted': False, 'project_id': 'e235fab9f22c4680bdfb296ae1e38037'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:19.181266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:19.191944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:19.194395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.196954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.198607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.207286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.208420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:19.213591 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-52b4152c-5c32-432d-91ee-cb0ddede87e8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.444936 May 19 08:23:19.215050 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 905/1875] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:18 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:19.233702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:19.241807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:19.257550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.265928 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.267056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.267600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.290836 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da9045d2-30cf-4d81-a40a-951f4fe49a95 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?tenant_id=6c738a16a46d484f93107c39e225138d" status: 200 len: 15 microversion: 2.1 time: 0.135090 May 19 08:23:19.295796 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 971/1876] 10.222.0.78 () {58 vars in 1230 bytes} [Thu May 19 08:23:19 2022] GET /compute/v2.1/servers/detail?tenant_id=6c738a16a46d484f93107c39e225138d => generated 15 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:23:19.311779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:19.324967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'tenant_id': '6c738a16a46d484f93107c39e225138d', 'deleted': False} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:19.341224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.341695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.342485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.342914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.400927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:23:19.486216 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:19.500181 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-672a146f-17ed-4835-a8a8-5d4af6015cee tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1507 microversion: 2.1 time: 0.283731 May 19 08:23:19.502560 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 906/1877] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:19 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:19.516116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:19.517700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:19.536912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.539005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.540217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.542829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:19.550402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:19.550969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.174609 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.205916 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.214681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.216816 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d9cf6267-65c9-4867-924c-8829615eefdc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.709872 May 19 08:23:20.217658 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 907/1878] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:19 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:20.223234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:20.224955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:20.237400 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.238129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.240475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.241156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.261230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b54bce4-3ded-44b8-afc2-2bcc43aea4a9 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6c738a16a46d484f93107c39e225138d" status: 200 len: 4825 microversion: 2.1 time: 0.953237 May 19 08:23:20.262957 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 972/1879] 10.222.0.78 () {58 vars in 1256 bytes} [Thu May 19 08:23:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6c738a16a46d484f93107c39e225138d => generated 4825 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:23:20.282890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:20.284917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:20.303286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.304817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.306140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.306855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.370666 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fbfc5142-7e96-4902-be4c-a7dd7dc5751c tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "PUT /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1079 microversion: 2.1 time: 0.150974 May 19 08:23:20.373030 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 908/1880] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:23:20 2022] PUT /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1079 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:20.387339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:20.388290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:20.398158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.398893 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.399922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.400577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.536946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.559986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfa45bbd-307d-4c4e-aa5a-3a07444f957f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.284655 May 19 08:23:20.582624 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 973/1881] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:20 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:20.584466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:20.594931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'tenant_id': 'e235fab9f22c4680bdfb296ae1e38037', 'deleted': False} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:20.602692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.603436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.605646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.607594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.656774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86817d98-9bd1-430e-b92c-c39bb0962ce1 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e235fab9f22c4680bdfb296ae1e38037" status: 200 len: 15 microversion: 2.1 time: 0.081043 May 19 08:23:20.680651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 974/1882] 10.222.0.78 () {58 vars in 1256 bytes} [Thu May 19 08:23:20 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e235fab9f22c4680bdfb296ae1e38037 => generated 15 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:23:20.698872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:20.699952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:20.712522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.714653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.716157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.716607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:20.910682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.916006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:20.928009 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.929778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:20.943672 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-58faac4d-8759-4119-9871-e4be64b3d40c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.558413 May 19 08:23:20.944543 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 909/1883] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:20 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:20.950102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c71eea60-7d19-4913-860f-0fcda531db9c tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:20.954612 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c71eea60-7d19-4913-860f-0fcda531db9c tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008938 May 19 08:23:20.955604 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 910/1884] 10.222.0.78 () {58 vars in 1188 bytes} [Thu May 19 08:23:20 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:23:20.962946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-e07e4a41-9985-4d7a-a019-2218f584fa98 req-c3a57c7d-5303-4ef1-bf13-dd66635dddf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:20.977212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-e07e4a41-9985-4d7a-a019-2218f584fa98 req-c3a57c7d-5303-4ef1-bf13-dd66635dddf9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:20.978033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-e07e4a41-9985-4d7a-a019-2218f584fa98 req-c3a57c7d-5303-4ef1-bf13-dd66635dddf9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.004407 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-e07e4a41-9985-4d7a-a019-2218f584fa98 req-c3a57c7d-5303-4ef1-bf13-dd66635dddf9 service nova] Creating event network-changed:b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:23:21.013699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:21.017421 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-e07e4a41-9985-4d7a-a019-2218f584fa98 req-c3a57c7d-5303-4ef1-bf13-dd66635dddf9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060406 May 19 08:23:21.025363 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 911/1885] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:21.032362 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc7cf899-6eb2-4345-8f8b-015f678eebbb tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1505 microversion: 2.1 time: 0.342842 May 19 08:23:21.044591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 975/1886] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:20 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:21.051145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:21.052653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:21.055130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:21.058173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:21.064985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.070501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.071343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.072376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.073027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.074244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.076623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.078491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.222467 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-eb7ad457-e40b-4d3a-8b6c-e5897d94ee68 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 0 microversion: 2.1 time: 0.193573 May 19 08:23:21.225415 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 912/1887] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:23:21 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:23:21.251974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:21.267478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:21.271646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6c738a16a46d484f93107c39e225138d'} {{(pid=119073) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:21.284660 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.285137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.286007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.286444 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.452547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.multi_cell_list [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:23:21.619586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:21.634959 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56affef7-3343-4046-b60a-701df5675a84 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1505 microversion: 2.1 time: 0.588839 May 19 08:23:21.636846 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b8c327b0-82ed-4933-8e26-62b985f4569a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.406682 May 19 08:23:21.643955 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 913/1888] 10.222.0.78 () {58 vars in 1149 bytes} [Thu May 19 08:23:21 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:21.645021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 976/1889] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:21 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:21.650077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:21.650547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:21.657427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:21.661931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:21.671710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:21.676053 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.677088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.679982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.680441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.683837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.685408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.686550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.689560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.725012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] HTTP exception thrown: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Request method failure captured: May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 HTTP/1.1 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3s7ltOKUR4pA4btJFg6ySKYj3L8ORSYN-HAAx15GXI0SsNtfH2ke4KG2eVXImimR5fO4JaB8xSrTRdOxXa3iiBsabZM8KZNJkG6gGuST4Hm2cyeRaSEX46MmFefP-khy8UKcYQ9SoWefv8SoeKUdfasAILdDaxWgs7epXpn4f8jyk May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestMultiNic-1136853225 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 70ba771be4f9469085cb6ed8b1feef61 May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2ec2470e-9f8b-4dd9-a863-c275b08371d6'} May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:21.727990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:21.732806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:21.737682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Returning 404 to user: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:21.739528 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca578b35-6d11-48d2-9511-a7bb28e22227 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 404 len: 111 microversion: 2.1 time: 0.092636 May 19 08:23:21.740676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 977/1890] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:21 2022] DELETE /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:21.750590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:21.752710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:21.779484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.780192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:21.781161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:21.782568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.013250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.024686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d44ca18e-0f9b-4d21-9aca-25e4c241411c tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.280091 May 19 08:23:22.027332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 978/1891] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:21 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:22.047713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:22.049910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.065716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.066275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.068171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.070436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.122049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.134877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.137157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.141360 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a556d8f1-00f1-4850-a61f-68516eacd006 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.500032 May 19 08:23:22.155332 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 914/1892] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:21 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:22.160675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:22.164641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.178398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.179171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.180184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.180805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.194192 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7369e00b-2905-4cab-a7bf-863f0242b94a tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 0 microversion: 2.1 time: 0.156157 May 19 08:23:22.195137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 979/1893] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:23:22 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:23:22.206291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:22.207277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 2ec2470e-9f8b-4dd9-a863-c275b08371d6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.221692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.222061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.222858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.223300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.254248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] HTTP exception thrown: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Request method failure captured: May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 HTTP/1.1 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3s7ltOKUR4pA4btJFg6ySKYj3L8ORSYN-HAAx15GXI0SsNtfH2ke4KG2eVXImimR5fO4JaB8xSrTRdOxXa3iiBsabZM8KZNJkG6gGuST4Hm2cyeRaSEX46MmFefP-khy8UKcYQ9SoWefv8SoeKUdfasAILdDaxWgs7epXpn4f8jyk May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestMultiNic-1136853225 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 70ba771be4f9469085cb6ed8b1feef61 May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2ec2470e-9f8b-4dd9-a863-c275b08371d6'} May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:22.255818 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Returning 404 to user: Instance 2ec2470e-9f8b-4dd9-a863-c275b08371d6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-986617de-d153-4cac-a887-1c406ec50d34 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6" status: 404 len: 111 microversion: 2.1 time: 0.060837 May 19 08:23:22.262685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 980/1894] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:22 2022] GET /compute/v2.1/servers/2ec2470e-9f8b-4dd9-a863-c275b08371d6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:22.271046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:22.272028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.281063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.281912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.283558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.284415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.325488 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c5d14eb3-65a0-4be9-a694-eb7be1809b2e tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "PUT /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1081 microversion: 2.1 time: 0.168695 May 19 08:23:22.337431 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 915/1895] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:23:22 2022] PUT /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1081 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:22.343788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:22.344871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.352446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.353262 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.355007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.355776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.626769 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4c93cfb9-22bd-4dbe-9628-2e820702a384 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1615 microversion: 2.1 time: 0.287504 May 19 08:23:22.638544 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 916/1896] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:22 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1615 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:22.647572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:22.648488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.664747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.667081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.668560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.669322 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.685948 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] HTTP exception thrown: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Request method failure captured: May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 HTTP/1.1 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3s7ltOKUR4pA4btJFg6ySKYj3L8ORSYN-HAAx15GXI0SsNtfH2ke4KG2eVXImimR5fO4JaB8xSrTRdOxXa3iiBsabZM8KZNJkG6gGuST4Hm2cyeRaSEX46MmFefP-khy8UKcYQ9SoWefv8SoeKUdfasAILdDaxWgs7epXpn4f8jyk May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersTestMultiNic-1136853225 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 70ba771be4f9469085cb6ed8b1feef61 May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '20af90d1-1a30-431f-a1c2-1919b261cdf3'} May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:22.689021 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:22.693853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:22.696584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Returning 404 to user: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:22.697783 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-985ac680-2ae7-436d-8f94-7b002eb34c69 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "DELETE /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 404 len: 111 microversion: 2.1 time: 0.057742 May 19 08:23:22.699435 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 917/1897] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:22 2022] DELETE /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:22.704855 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:22.713468 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.721839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.722842 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.724088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.727426 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.739871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.764933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.768331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:22.778215 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41f5be9b-aba5-48ec-8033-b1ce5502728c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.512237 May 19 08:23:22.783033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 981/1898] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:22 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:22.814706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:22.817095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:22.831066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.833937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:22.835468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:22.836162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:23.490215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:23.509479 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6908ab8c-4fd1-41d1-b8b3-823e9bc2d3b3 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1507 microversion: 2.1 time: 0.808337 May 19 08:23:23.510339 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 918/1899] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:22 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1507 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:23.521007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:23.521579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] [instance: 20af90d1-1a30-431f-a1c2-1919b261cdf3] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:23.538099 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:23.538552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:23.539373 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:23.540002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:23.575425 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] HTTP exception thrown: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Request method failure captured: May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 HTTP/1.1 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3s7ltOKUR4pA4btJFg6ySKYj3L8ORSYN-HAAx15GXI0SsNtfH2ke4KG2eVXImimR5fO4JaB8xSrTRdOxXa3iiBsabZM8KZNJkG6gGuST4Hm2cyeRaSEX46MmFefP-khy8UKcYQ9SoWefv8SoeKUdfasAILdDaxWgs7epXpn4f8jyk May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9315d3e582f8468a92b56b0b4ee2120b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersTestMultiNic-1136853225 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 9315d3e582f8468a92b56b0b4ee2120b May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersTestMultiNic-1136853225 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 70ba771be4f9469085cb6ed8b1feef61 May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersTestMultiNic-1136853225-project May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '20af90d1-1a30-431f-a1c2-1919b261cdf3'} May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:23.580203 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:23.584975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] Returning 404 to user: Instance 20af90d1-1a30-431f-a1c2-1919b261cdf3 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:23.585620 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6ef15e33-5665-4e43-b4be-1b60ba6afc44 tempest-ServersTestMultiNic-1136853225 tempest-ServersTestMultiNic-1136853225-project] 10.222.0.78 "GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3" status: 404 len: 111 microversion: 2.1 time: 0.070025 May 19 08:23:23.586141 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 919/1900] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:23 2022] GET /compute/v2.1/servers/20af90d1-1a30-431f-a1c2-1919b261cdf3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:23.597485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:23.599530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:23.615165 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:23.617216 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:23.620248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:23.621851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:23.654135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16bddf05-f96f-4623-8b58-4f4b4f60d971 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1615 microversion: 2.1 time: 0.868100 May 19 08:23:23.657401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 982/1901] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:22 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1615 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:23.673490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:23.676115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:23.704079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:23.707441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:23.711980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:23.713753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.013496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:24.025623 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ebb17447-82c8-471a-b873-42f9ae94a709 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.437923 May 19 08:23:24.026745 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 920/1902] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:23 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:24.055298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:24.056522 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:24.094316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:24.094833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.098889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:24.100049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.556577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:24.577937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:24.584520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:24.590818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:24.607648 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca9836b2-c9f4-4a1e-b7f3-5997271103e5 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.946396 May 19 08:23:24.610643 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 983/1903] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:23 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:24.616696 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f7416a39-d9e3-4a52-ba16-9ca6f7d5c389 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1507 microversion: 2.1 time: 0.585762 May 19 08:23:24.618933 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 921/1904] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:24 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:24.633245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:24.643352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:24.646740 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:24.655757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'host': 'chh2-842464-2', 'deleted': False} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:24.666340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:24.671815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.676364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:24.678109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.683062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:24.683858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.688281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:24.689056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:24.999864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:23:25.016237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:25.125219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a59fac9-e08b-4857-891b-f4be2a8bfb20 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=chh2-842464-2&all_tenants=1" status: 200 len: 2305 microversion: 2.1 time: 0.511822 May 19 08:23:25.132207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 984/1905] 10.222.0.78 () {58 vars in 1189 bytes} [Thu May 19 08:23:24 2022] GET /compute/v2.1/servers?host=chh2-842464-2&all_tenants=1 => generated 2305 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:25.138149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:25.138750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:25.146125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.146684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.147647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.148174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.173865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:25.182843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:23:25.192205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:25.194846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:25.199379 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d8f0deb8-a145-4447-b472-3779ee8b6a4f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.577746 May 19 08:23:25.213115 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 922/1906] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:24 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:25.218614 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:25.219501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:25.226445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.226930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.227826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.228267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.320594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5c085a3-e6fe-43ff-b7cc-5950fd5b88bc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 204 len: 0 microversion: 2.1 time: 0.184369 May 19 08:23:25.330680 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 985/1907] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:25 2022] DELETE /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:25.340616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:25.345447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:23:25.360280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.361031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.370124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.370585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.391175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:25.413512 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bb524f6f-7058-4ffd-a2e4-e0546c3b249f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.197309 May 19 08:23:25.414315 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2054e82e-4c59-40c2-a5a0-27a9640e6142 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.077655 May 19 08:23:25.414856 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 923/1908] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:25 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:25.422357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 986/1909] 10.222.0.78 () {58 vars in 1195 bytes} [Thu May 19 08:23:25 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:23:25.432957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:25.438306 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:25.439884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:25.440493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:25.456919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.457711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.458888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.459497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.462724 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.471706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.475899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.476684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.614335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:23:25.615570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff02a7d7-802a-4607-9c20-c72b87f4752b tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 0 microversion: 2.1 time: 0.190585 May 19 08:23:25.621453 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 987/1910] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:23:25 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:23:25.628752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:25.634751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:25.655036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.655910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.658062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.660922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.821636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:23:25.825205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:23:25.826785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:23:25.827979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:23:25.829886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:23:25.875012 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.compute.api [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Instance is already in deleting state, ignoring this request May 19 08:23:25.876493 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bc2128d3-2f7a-48bf-88a0-14517cd1d596 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 204 len: 0 microversion: 2.1 time: 0.459689 May 19 08:23:25.888602 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 924/1911] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:25 2022] DELETE /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:23:25.925994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:25.929199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:25.957433 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.958534 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.960795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:25.967778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:25.978871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:26.001453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:26.001921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:26.002738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:26.003180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:26.125159 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0a00887-4ee4-4396-a81d-358437230684 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 1068 microversion: 2.1 time: 0.501857 May 19 08:23:26.136564 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 988/1912] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:23:25 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 1068 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 08:23:26.149749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:26.152916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:26.170683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:26.171186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:26.172041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:26.172582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:26.591479 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:23:26.592079 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 08:23:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 (ip 10.222.0.78) !!! May 19 08:23:26.747577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:26.885943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:26.914895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:UPDATE=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:26.935067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:26.948915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:26.951466 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-32d0842b-e0f2-4592-8beb-73cb34efab67 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.059758 May 19 08:23:26.969793 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 925/1913] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:25 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:26.978657 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:26.980357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:27.069491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:27.070374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:27.072106 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:27.072911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:27.687605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:27.695600 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36e878a7-0dcc-4bd8-bf57-2b915d9f53fc tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1513 microversion: 2.1 time: 1.555479 May 19 08:23:27.696426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 989/1914] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:26 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1513 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:27.715635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:27.727117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:27.759991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:27.760649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:27.761916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:27.762578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:28.112445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:28.123350 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ecb0550f-f888-40f8-9474-12d39e698f9e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1472 microversion: 2.1 time: 1.151872 May 19 08:23:28.123953 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 926/1915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:26 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1472 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:28.142747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:28.143363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:28.172719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:28.180904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:28.182556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:28.190055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:28.477213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:28.492645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:28.495721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:28.497426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-061e3f0e-f38a-47dc-b5b9-c247af55c73b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.786391 May 19 08:23:28.509706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 990/1916] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:27 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:28.515563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:28.516447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:28.522947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:28.525768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:28.526617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:28.527713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:28.528328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:28.555206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:28.566019 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ddea28f4-662e-4402-acb1-74a40787d445 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.430727 May 19 08:23:28.569978 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 927/1917] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:28 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:28.717874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:28.718349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:28.733361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:28.733889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:28.734696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:28.741191 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:29.248604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:29.264942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:29.268811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:29.274670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03dbdec2-9702-4634-ba7c-9897328f1d8f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.762767 May 19 08:23:29.280175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 991/1918] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:28 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:29.354725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-210e078c-0ec6-4055-834a-c97088ef35b0 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Action: 'create', calling method: .version_select at 0x7f3211a220d0>, body: {"keypair": {"name": "tempest-keypair-1365724906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyxb6qZ8RJqXkOeJf8tD3YbuAb7xUv6j6CE84Fjcmrn9Mj4WxoiOINWW+qpG8vgVp/+UUZdobByakC6AHuRMkIW1NGTqU7LajyMFHYgrUq8dNgYIskQX29spDrnoMBiwQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:29.380721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-210e078c-0ec6-4055-834a-c97088ef35b0 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Getting quotas for project aedf9656cdcb41dfb5bf02c3890fd923. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:23:29.399564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-210e078c-0ec6-4055-834a-c97088ef35b0 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Getting quotas for user dec914fb1a8747798025b5fe0ebb6ca2 and project aedf9656cdcb41dfb5bf02c3890fd923. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:23:29.460815 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-210e078c-0ec6-4055-834a-c97088ef35b0 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178466 May 19 08:23:29.462044 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 992/1919] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:23:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:29.473747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:29.475511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:29.494753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:29.496089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:29.498663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:29.499399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:29.772705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:29.786069 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8e8f6d39-24e2-4dc0-8bf2-284aa38e21cd tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1513 microversion: 2.1 time: 1.070291 May 19 08:23:29.786705 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 928/1920] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:28 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1513 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:23:29.800830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:29.801495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:29.819253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:29.819740 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:29.820531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:29.824147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:29.996688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:30.010057 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5319314d-6cab-4f14-aee9-d198ce604ea5 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1472 microversion: 2.1 time: 0.542818 May 19 08:23:30.022241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 993/1921] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:29 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1472 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:30.029401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:30.030287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:30.036743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:30.037541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:30.038684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:30.039334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:30.416847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:30.426913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbabc842-f524-4b53-b3fb-27beed41f6d6 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.402618 May 19 08:23:30.442394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 994/1922] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:30 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:30.448318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:30.455641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:30.466022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:30.470901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:30.475308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:30.476033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:30.846390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:30.871286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:30.874753 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:30.877550 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-21a9b842-c2f0-4eda-af60-e22b45ec7601 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.088620 May 19 08:23:30.880960 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 929/1923] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:29 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:30.900595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:30.904646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:30.918567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:30.920869 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:30.922567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:30.925198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:31.332294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:31.430148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7cc48a60f14daa825d66600fe1dd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff49ea2c1efc41f685b496815d13bc09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:31.445068 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ebdc27be-b99b-4607-90f9-b8e47852d462 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 200 len: 1302 microversion: 2.1 time: 0.558256 May 19 08:23:31.445068 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 930/1924] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:30 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 1302 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:31.466900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-43ec5edb-1629-4a12-8a56-7a297250d89b req-35bc54f3-c080-4bea-8b11-708192664f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84caa600-527f-4ffc-95dd-c1980eaef3d9", "name": "network-vif-deleted", "tag": "b08f4d66-1935-41eb-9bdc-45f96a5ab2f0"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:31.488415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-43ec5edb-1629-4a12-8a56-7a297250d89b req-35bc54f3-c080-4bea-8b11-708192664f6f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:31.488869 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-43ec5edb-1629-4a12-8a56-7a297250d89b req-35bc54f3-c080-4bea-8b11-708192664f6f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:31.518195 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-43ec5edb-1629-4a12-8a56-7a297250d89b req-35bc54f3-c080-4bea-8b11-708192664f6f service nova] Creating event network-vif-deleted:b08f4d66-1935-41eb-9bdc-45f96a5ab2f0 for instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 on chh1-842464-2 May 19 08:23:31.535158 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-43ec5edb-1629-4a12-8a56-7a297250d89b req-35bc54f3-c080-4bea-8b11-708192664f6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071978 May 19 08:23:31.536139 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 931/1925] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:31.547828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:31.554547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:31.569067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:31.569459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:31.570267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:31.570715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:31.754822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:31.812604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:31.836791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:31.841613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9da607e-61e7-4e59-8b1a-e56251adc9d8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.397529 May 19 08:23:31.847654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 995/1926] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:30 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:31.866618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:31.867650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:31.888246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:31.889105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:31.892572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:31.898686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.060214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:32.074319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5399084-9e39-4a0a-9428-5e1ab6caa0e7 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.224241 May 19 08:23:32.075521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 996/1927] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:31 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:32.086691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.092954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.112303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.113148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.114622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.115387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.184476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:32.452134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:32.463709 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8980c284-816c-4c61-94d9-d62f41f2ac4a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1472 microversion: 2.1 time: 0.924066 May 19 08:23:32.464358 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 932/1928] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:31 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1472 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:32.475017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.476602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 84caa600-527f-4ffc-95dd-c1980eaef3d9] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.493526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.494674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.498794 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.499687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.531861 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] HTTP exception thrown: Instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 could not be found. May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Request method failure captured: May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 HTTP/1.1 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3UDEkoO5JjEDLjlSWZ6zBom4dttJgmAr5PZ3wgVd8uP46tGsrso8yr32aM7C7-CKAyjogK_tjvC9jGTQrknO9fy2qI_oXOVccI1dV65bvw8gHrQiPs0sja2Vh5sWJxdyLBUXu6oyW0rXa5NHFRvtkr--q0lEpPh9UpPqELqQjK6sM May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5e7cc48a60f14daa825d66600fe1dd92 May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 could not be found. May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '84caa600-527f-4ffc-95dd-c1980eaef3d9'} May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 could not be found. May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 could not be found. May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.544227 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 could not be found. May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Returning 404 to user: Instance 84caa600-527f-4ffc-95dd-c1980eaef3d9 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:32.559210 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-566885f9-0db8-4dc1-beb5-470fbde2425d tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9" status: 404 len: 111 microversion: 2.1 time: 0.089336 May 19 08:23:32.565171 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 933/1929] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:32 2022] GET /compute/v2.1/servers/84caa600-527f-4ffc-95dd-c1980eaef3d9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:32.579778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.583882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.591322 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.591743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.592532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.592972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.618272 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] HTTP exception thrown: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Request method failure captured: May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce HTTP/1.1 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3UDEkoO5JjEDLjlSWZ6zBom4dttJgmAr5PZ3wgVd8uP46tGsrso8yr32aM7C7-CKAyjogK_tjvC9jGTQrknO9fy2qI_oXOVccI1dV65bvw8gHrQiPs0sja2Vh5sWJxdyLBUXu6oyW0rXa5NHFRvtkr--q0lEpPh9UpPqELqQjK6sM May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5e7cc48a60f14daa825d66600fe1dd92 May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '4242f4f6-3fd8-4333-b466-245f42dfc4ce'} May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:32.621367 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Returning 404 to user: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-db5c4d9f-1894-4b1a-9250-0d29215a36fa tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 404 len: 111 microversion: 2.1 time: 0.054665 May 19 08:23:32.626415 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 934/1930] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:32 2022] DELETE /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:32.635234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.636539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 4242f4f6-3fd8-4333-b466-245f42dfc4ce] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.646548 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.646678 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.647359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.647797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.670011 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] HTTP exception thrown: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Request method failure captured: May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce HTTP/1.1 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3UDEkoO5JjEDLjlSWZ6zBom4dttJgmAr5PZ3wgVd8uP46tGsrso8yr32aM7C7-CKAyjogK_tjvC9jGTQrknO9fy2qI_oXOVccI1dV65bvw8gHrQiPs0sja2Vh5sWJxdyLBUXu6oyW0rXa5NHFRvtkr--q0lEpPh9UpPqELqQjK6sM May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5e7cc48a60f14daa825d66600fe1dd92 May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '4242f4f6-3fd8-4333-b466-245f42dfc4ce'} May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.671489 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Returning 404 to user: Instance 4242f4f6-3fd8-4333-b466-245f42dfc4ce could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:32.676690 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-741c76f6-02ce-4a97-bce0-9a0cf152ac6f tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce" status: 404 len: 111 microversion: 2.1 time: 0.043095 May 19 08:23:32.691672 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 935/1931] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:32 2022] GET /compute/v2.1/servers/4242f4f6-3fd8-4333-b466-245f42dfc4ce => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:32.696553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.697057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.709762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.710455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.712128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.712570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.732395 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] HTTP exception thrown: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Request method failure captured: May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d HTTP/1.1 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3UDEkoO5JjEDLjlSWZ6zBom4dttJgmAr5PZ3wgVd8uP46tGsrso8yr32aM7C7-CKAyjogK_tjvC9jGTQrknO9fy2qI_oXOVccI1dV65bvw8gHrQiPs0sja2Vh5sWJxdyLBUXu6oyW0rXa5NHFRvtkr--q0lEpPh9UpPqELqQjK6sM May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5e7cc48a60f14daa825d66600fe1dd92 May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '2ec2d470-ea96-4789-b133-75e40f3ad85d'} May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:32.734065 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Returning 404 to user: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:32.738483 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7dd16406-d406-4247-8e4d-bac6f4b79b70 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 404 len: 111 microversion: 2.1 time: 0.042903 May 19 08:23:32.739419 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 936/1932] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:23:32 2022] DELETE /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:32.746232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.746864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] [instance: 2ec2d470-ea96-4789-b133-75e40f3ad85d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.758345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.758801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.759599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.760036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.841240 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] HTTP exception thrown: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Request method failure captured: May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d HTTP/1.1 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf3UDEkoO5JjEDLjlSWZ6zBom4dttJgmAr5PZ3wgVd8uP46tGsrso8yr32aM7C7-CKAyjogK_tjvC9jGTQrknO9fy2qI_oXOVccI1dV65bvw8gHrQiPs0sja2Vh5sWJxdyLBUXu6oyW0rXa5NHFRvtkr--q0lEpPh9UpPqELqQjK6sM May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff49ea2c1efc41f685b496815d13bc09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: ff49ea2c1efc41f685b496815d13bc09 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-589739051 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 5e7cc48a60f14daa825d66600fe1dd92 May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServerDiskConfigTestJSON-589739051-project May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '2ec2d470-ea96-4789-b133-75e40f3ad85d'} May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:32.846222 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:23:32.851163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] Returning 404 to user: Instance 2ec2d470-ea96-4789-b133-75e40f3ad85d could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:32.851781 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8057f1ac-44cf-4d8d-8fb2-a8427ad3a295 tempest-ServerDiskConfigTestJSON-589739051 tempest-ServerDiskConfigTestJSON-589739051-project] 10.222.0.78 "GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d" status: 404 len: 111 microversion: 2.1 time: 0.109855 May 19 08:23:32.851881 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 937/1933] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:32 2022] GET /compute/v2.1/servers/2ec2d470-ea96-4789-b133-75e40f3ad85d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:32.869692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:32.872677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:32.886194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.886672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:32.887475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:32.887919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:33.193769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.210815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.212314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.213634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13489b08-e079-48b1-a43a-7a74e88e350a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.135978 May 19 08:23:33.225030 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 997/1934] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:32 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:33.231166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:33.232203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:33.247005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:33.249849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:33.250921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:33.251582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:33.452571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.467737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-396508c3-d37f-4982-88b6-0e14c360e012 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.241071 May 19 08:23:33.473880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 998/1935] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:33 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:33.503961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:33.509634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:33.540523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:33.544574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:33.548126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:33.552170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:33.891318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.907690 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.919859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:33.921385 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8dc58deb-ae5e-4d41-a9bc-70f0882c0d25 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.060132 May 19 08:23:33.922489 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 938/1936] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:32 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:33.928256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-99ef2270-d56a-42aa-ba1c-9ccd992694f6 req-03776743-5ebc-4438-9681-2475983dc2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee67616-6551-4084-9ed3-cdaf5574749f", "name": "network-vif-unplugged", "status": "completed", "tag": "713a5191-8215-4c48-aede-a41292a8add6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:33.951557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-99ef2270-d56a-42aa-ba1c-9ccd992694f6 req-03776743-5ebc-4438-9681-2475983dc2e3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:33.952277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-99ef2270-d56a-42aa-ba1c-9ccd992694f6 req-03776743-5ebc-4438-9681-2475983dc2e3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:33.974162 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-99ef2270-d56a-42aa-ba1c-9ccd992694f6 req-03776743-5ebc-4438-9681-2475983dc2e3 service nova] Creating event network-vif-unplugged:713a5191-8215-4c48-aede-a41292a8add6 for instance 9ee67616-6551-4084-9ed3-cdaf5574749f on chh2-842464-2 May 19 08:23:33.991129 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-99ef2270-d56a-42aa-ba1c-9ccd992694f6 req-03776743-5ebc-4438-9681-2475983dc2e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067147 May 19 08:23:33.992132 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 939/1937] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:34.180449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:34.194077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-635a0a2f-1820-485f-88cc-080b2b8540ca tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1472 microversion: 2.1 time: 0.704581 May 19 08:23:34.206969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 999/1938] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:33 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1472 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:34.233639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:34.235078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:34.245569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:34.246018 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:34.246801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:34.247230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:34.490436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:34.491439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:34.508853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:34.509968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:34.511800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:34.512445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:34.842237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:34.858068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d48077f3-0a39-4df2-96fc-baf2f7311eaa tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.371519 May 19 08:23:34.867688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1000/1939] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:34 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:34.881277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "df10b827-2560-4e5a-bed3-7060ea9e09e7"}], "security_groups": [{"name": "tempest-securitygroup--1437305864"}], "key_name": "tempest-keypair-1365724906", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:34.939274 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:34.951525 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:34.958029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:34.962815 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-23f3ff0c-a75e-469a-9a81-154bd2566750 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.731206 May 19 08:23:34.966231 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 940/1940] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:34 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:34.982503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:34.983470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:35.020975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:35.021895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:35.023529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:35.025490 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:35.341904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] validate_networks() for [('df10b827-2560-4e5a-bed3-7060ea9e09e7', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:23:35.388732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:35.879260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:35.895042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:35.898420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:35.902897 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-52ea7714-a732-451e-8edd-039ef3938880 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.930527 May 19 08:23:35.904631 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 941/1941] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:34 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:35.929247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:35.930530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:35.943085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:35.944613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:35.946064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:35.946944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.412846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:36.427726 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-370fa525-235d-4895-a7ac-8c3d9089222f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1472 microversion: 2.1 time: 0.521403 May 19 08:23:36.439787 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 942/1942] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:35 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1472 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:36.446144 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:36.447199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:36.456041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.457773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.458937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.460643 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.587642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:36.603050 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-196179c7-60b6-46fc-a440-ea199b68b8f1 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.159193 May 19 08:23:36.604799 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 943/1943] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:36 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:36.630473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:36.633962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:36.647845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:23:36.649241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:23:36.650167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:23:36.651770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:23:36.652562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:23:36.669370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.671263 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.672645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.672784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.673097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.673431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.674497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.675268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.703135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Getting quotas for project aedf9656cdcb41dfb5bf02c3890fd923. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:23:36.722054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Getting quotas for user dec914fb1a8747798025b5fe0ebb6ca2 and project aedf9656cdcb41dfb5bf02c3890fd923. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:23:36.756174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:23:36.760645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:23:36.855800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77013475-7037-4061-86de-9421fc94ee4a tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.986599 May 19 08:23:36.856462 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1001/1944] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:23:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:23:36.871061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-50e0206f-77c1-4697-8edc-96237b627d57 req-abef5da4-50e2-48c3-aa23-5a1e1794b867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee67616-6551-4084-9ed3-cdaf5574749f", "tag": "713a5191-8215-4c48-aede-a41292a8add6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:36.894756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-50e0206f-77c1-4697-8edc-96237b627d57 req-abef5da4-50e2-48c3-aa23-5a1e1794b867 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.895343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-50e0206f-77c1-4697-8edc-96237b627d57 req-abef5da4-50e2-48c3-aa23-5a1e1794b867 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.933161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:36.933723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-50e0206f-77c1-4697-8edc-96237b627d57 req-abef5da4-50e2-48c3-aa23-5a1e1794b867 service nova] Creating event network-changed:713a5191-8215-4c48-aede-a41292a8add6 for instance 9ee67616-6551-4084-9ed3-cdaf5574749f on chh2-842464-2 May 19 08:23:36.941056 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-50e0206f-77c1-4697-8edc-96237b627d57 req-abef5da4-50e2-48c3-aa23-5a1e1794b867 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077061 May 19 08:23:36.942435 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1002/1945] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:36.950219 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:36.951168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9ce007c-fbc3-48c5-9b5c-56a1fba7c07f tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:36.952161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9ce007c-fbc3-48c5-9b5c-56a1fba7c07f tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:36.952311 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:36.953589 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d3bc9ba2-2dc0-4bdc-846a-1df5c3024881 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.343381 May 19 08:23:36.954680 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 944/1946] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:36 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:36.959503 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:36.960112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:36.967975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.968478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:36.969255 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:36.970072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:37.192918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9ce007c-fbc3-48c5-9b5c-56a1fba7c07f tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:37.209805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9ce007c-fbc3-48c5-9b5c-56a1fba7c07f tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1226 microversion: 2.1 time: 0.265539 May 19 08:23:37.211754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1003/1947] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:36 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1226 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:37.446981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:37.447758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:37.460921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:37.462441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:37.469922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:37.470388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:37.701090 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:37.715259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:37.719190 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:37.726154 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b489ae60-79e0-439e-9816-3bb8a2a5732d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.770380 May 19 08:23:37.727217 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 945/1948] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:36 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:37.814874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:37.829783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-192b3f2f-6f09-4951-a18a-d161ff8acedc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1472 microversion: 2.1 time: 0.387354 May 19 08:23:37.840943 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1004/1949] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:37 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:37.846478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:37.847555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:37.855194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:37.855901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:37.856979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:37.857706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:37.912499 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-870474929", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "663ac32d-43b9-46f3-8122-56edcdc139ce"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:37.935553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:37.954106 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf04dfc1-a136-48e8-8032-7d9a5a4bb71f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.111602 May 19 08:23:37.970145 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1005/1950] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:37 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:37.982045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:37.985519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:38.005485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:38.006252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:38.007349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:38.008013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:38.008744 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] validate_networks() for [('663ac32d-43b9-46f3-8122-56edcdc139ce', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:23:38.349708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:38.362381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:38.364460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:38.370055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88412227-fee3-4ffe-adeb-24c7bb8a53bb tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.398911 May 19 08:23:38.385857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1006/1951] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:37 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:38.392736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:38.393981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:38.400591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:38.404455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:38.407971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:38.409349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:38.776662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:38.789972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc7d2859-3289-4006-a066-a6c4ad37d530 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1286 microversion: 2.1 time: 0.400859 May 19 08:23:38.793811 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1007/1952] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:38 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1286 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:38.810987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:38.812035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:38.830409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:38.831797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:38.834602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:38.836219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.469440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:23:39.469949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:23:39.470464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:23:39.470966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:23:39.471938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:23:39.497526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.498017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.501430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.506754 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.507013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:39.521155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:39.534265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:39.535221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Getting quotas for project 8e30d4a5716e424487ddd33560f168d4. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:23:39.535631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15051a3d-1f6e-40eb-abc6-62e4eb18a3c6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.740109 May 19 08:23:39.536241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1008/1953] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:38 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:39.548601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Getting quotas for user eee964e8cef44879bd61c924e230565c and project 8e30d4a5716e424487ddd33560f168d4. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:23:39.556406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:39.557741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:39.568528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:23:39.571350 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:23:39.574211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.580720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.581707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.582250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.650920 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fd99c2df-3705-4f43-8e21-5f3521df7191 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921481 May 19 08:23:39.652327 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 946/1954] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:23:39.659163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:39.659982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:39.668179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.668921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.670313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.670946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.830206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:39.834039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:39.844674 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3de9747c-462f-4d3c-a5ca-51801b5b1256 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 200 len: 1183 microversion: 2.1 time: 0.190624 May 19 08:23:39.849890 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 947/1955] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:39 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 1183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:39.870398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:39.871078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:39.885875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.886326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:39.887117 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:39.887558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.018876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:41.041944 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1040b00b-7ac2-4754-9584-3f6ace4a6f7e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1478 microversion: 2.1 time: 1.504195 May 19 08:23:41.043182 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1009/1956] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:39 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1478 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:41.069558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:41.071940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:41.087400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.088467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.090200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.093913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.408636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:41.418502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c685201e-1a30-41af-b4dd-e22cc64225b3 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1220 microversion: 2.1 time: 0.359586 May 19 08:23:41.441450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1010/1957] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:41 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1220 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:41.461227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:41.466186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:41.483110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.483987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.485053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.485750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.673358 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:41.684435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:41.698706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:41.705886 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-74c775ad-b4ea-4eee-88cd-172e498bb9be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.852132 May 19 08:23:41.709233 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 948/1958] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:39 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:41.722066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:41.722682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:41.757077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.757911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.759187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.760187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.838621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:41.855517 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d6dc24a-08c9-4e0e-971e-b0f8acc60959 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1284 microversion: 2.1 time: 0.409923 May 19 08:23:41.868974 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1011/1959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:41 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1284 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:41.876218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:41.877366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 74cdd443-b415-48e2-aa1c-63d2c9995854] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:41.885667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.886597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.887645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:41.888387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:41.924112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] HTTP exception thrown: Instance 74cdd443-b415-48e2-aa1c-63d2c9995854 could not be found. May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Request method failure captured: May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 HTTP/1.1 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihfzO4x_i3wgiElttUCdAxEjMoIbzPSVzjzOW0LKbO3Z9OCGPg5ZZqWU-mdob3p17nf55hCebyOZyP2vpq_90b1YeZ0hhWNXk2LDHg-x-ulutkKyFVSin3eZkFrWghv06EzRHS9YE77Xw0N-t4mmesUjKjNdrkScxWD4hk3YrZ6_z0-U May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6704bb799559404288e26a24be6625c7 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-LiveMigrationTest-2054594347 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6704bb799559404288e26a24be6625c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6704bb799559404288e26a24be6625c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-LiveMigrationTest-2054594347 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6704bb799559404288e26a24be6625c7 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-LiveMigrationTest-2054594347 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-LiveMigrationTest-2054594347-project May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 57e320171eec44a8bdb1dcd9e0039226 May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-LiveMigrationTest-2054594347-project May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 74cdd443-b415-48e2-aa1c-63d2c9995854 could not be found. May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '74cdd443-b415-48e2-aa1c-63d2c9995854'} May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cdd443-b415-48e2-aa1c-63d2c9995854 could not be found. May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cdd443-b415-48e2-aa1c-63d2c9995854 could not be found. May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:23:41.929215 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cdd443-b415-48e2-aa1c-63d2c9995854 could not be found. May 19 08:23:41.934825 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:23:41.940654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Returning 404 to user: Instance 74cdd443-b415-48e2-aa1c-63d2c9995854 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:23:41.942135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4e9fd4c-c720-427c-a56a-846515b5ea61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854" status: 404 len: 111 microversion: 2.1 time: 0.071001 May 19 08:23:41.946609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1012/1960] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:41 2022] GET /compute/v2.1/servers/74cdd443-b415-48e2-aa1c-63d2c9995854 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:23:42.061771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:42.063310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:42.091845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:42.096224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:42.104505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:42.108318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:42.843667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:42.858793 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:42.865539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:42.874107 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9462414b-af7e-4225-99e5-8091cb9d1a4f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.163615 May 19 08:23:42.877236 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 949/1961] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:41 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:42.909071 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:42.910420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:42.939088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:42.943052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:42.946660 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:42.952533 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:43.259706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:43.272657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e943c535-7fc5-4dbf-8ece-731590189169 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1282 microversion: 2.1 time: 0.377439 May 19 08:23:43.276725 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 950/1962] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:42 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1282 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:43.305622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:43.307964 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:43.355298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:43.355747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:43.364948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:43.370139 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:43.372468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:43.387576 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69e56cfd-163b-4c1c-8b57-7e13ea2b16d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1478 microversion: 2.1 time: 1.327780 May 19 08:23:43.398954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1013/1963] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:42 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1478 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:43.412099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:43.412757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:43.446986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:43.447868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:43.453346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:43.453810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:45.144143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:45.168497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:45.173847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:45.180144 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-45fe8e98-6f4a-436e-a1c1-3825d74c7c45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.900819 May 19 08:23:45.193343 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 951/1964] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:43 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:45.228160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-13b538a8-0ec4-4705-9be4-fea2f4b26b2c req-8c745c53-3fef-46fd-a4d3-2ae696da1090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "name": "network-vif-unplugged", "status": "completed", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:45.251485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:45.261448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-13b538a8-0ec4-4705-9be4-fea2f4b26b2c req-8c745c53-3fef-46fd-a4d3-2ae696da1090 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:45.262707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-803f0bec-9e95-4a3a-8a85-42200989917b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 1.862377 May 19 08:23:45.263257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-13b538a8-0ec4-4705-9be4-fea2f4b26b2c req-8c745c53-3fef-46fd-a4d3-2ae696da1090 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:45.279101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1014/1965] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:43 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:45.288906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:45.289630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:45.334216 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-13b538a8-0ec4-4705-9be4-fea2f4b26b2c req-8c745c53-3fef-46fd-a4d3-2ae696da1090 service nova] Creating event network-vif-unplugged:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:23:45.338947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:45.339543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:45.340396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:45.340850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:45.354904 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-13b538a8-0ec4-4705-9be4-fea2f4b26b2c req-8c745c53-3fef-46fd-a4d3-2ae696da1090 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139644 May 19 08:23:45.366385 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 952/1966] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:45.435114 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:45.443308 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:45.465924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:45.471898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:45.473097 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:45.473701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:46.688837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:47.114608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:47.133647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:47.145294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:47.149290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78cc492f-460f-4e74-b812-2cefb1f9e9ce tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.868995 May 19 08:23:47.154975 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1015/1967] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:45 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:47.185868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:47.186843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:47.198478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:47.199212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:47.202234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:47.202865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:47.212000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:47.234831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:47.243305 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5a6e770b-0d26-4d2d-a720-461958848ec1 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1324 microversion: 2.1 time: 1.853315 May 19 08:23:47.249667 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 953/1968] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:45 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1324 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:47.263298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:47.268587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:47.290180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:47.301261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:47.305778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:47.316776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:48.603853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:48.615789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-631b34dc-6249-4836-bdcb-b5c1bd56cb9b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1478 microversion: 2.1 time: 1.459146 May 19 08:23:48.618011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1016/1969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:47 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1478 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:48.624136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:48.625091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:48.632180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:48.633034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:48.635664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:48.636537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:48.696806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:48.721209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:48.745050 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:48.748221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:48.749601 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c6f9750a-5c98-41fa-aaea-6bb7a981475f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.498591 May 19 08:23:48.753881 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 954/1970] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:47 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:48.766926 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-1d5ff6eb-a60a-406e-a33c-817a5c461bf1 req-97e8a58e-92c1-4509-9ac2-0c0e0fbb45b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "name": "network-vif-plugged", "status": "completed", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:48.794137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1d5ff6eb-a60a-406e-a33c-817a5c461bf1 req-97e8a58e-92c1-4509-9ac2-0c0e0fbb45b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:48.795795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1d5ff6eb-a60a-406e-a33c-817a5c461bf1 req-97e8a58e-92c1-4509-9ac2-0c0e0fbb45b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:48.848551 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-1d5ff6eb-a60a-406e-a33c-817a5c461bf1 req-97e8a58e-92c1-4509-9ac2-0c0e0fbb45b2 service nova] Creating event network-vif-plugged:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:23:48.855582 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-1d5ff6eb-a60a-406e-a33c-817a5c461bf1 req-97e8a58e-92c1-4509-9ac2-0c0e0fbb45b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097234 May 19 08:23:48.871660 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 955/1971] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:49.007862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c02cfc3b-1b68-464d-8b7e-fad00f6774d1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'create', calling method: .version_select at 0x7f32119805e0>, body: {"keypair": {"name": "tempest-keypair-1384998341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5YI5Y/tMXzPI8ZIxmFAA+lo8KpSo/9NOueWaiqkQ/w2IWF6ZNJh2B5Vg7+dxJaBXonmU73fbarCokfRVD8pxL31W/6v5So06pS+GM3avfW2178qY7y17dNeGXm0o2kwA=="}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:49.026855 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:49.044986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-c02cfc3b-1b68-464d-8b7e-fad00f6774d1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for project b607e36aa42545dfb715c629002236ed. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:23:49.053839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-c02cfc3b-1b68-464d-8b7e-fad00f6774d1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for user 59f3ba2c06c045d6afccb1639ed8d083 and project b607e36aa42545dfb715c629002236ed. Resources: {'key_pairs'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:23:49.129038 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c02cfc3b-1b68-464d-8b7e-fad00f6774d1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.255905 May 19 08:23:49.136069 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 956/1972] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:23:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:49.137421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:49.142177 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:49.149408 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.150986 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:49.151979 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.152817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:49.280106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:49.292077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fafa0e76-b389-48ef-a44a-7b8c6631c155 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.672222 May 19 08:23:49.293121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1017/1973] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:48 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:49.298089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:49.301209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:49.321332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.323818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:49.327198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.328386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:49.522356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:49.635289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:49.649946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-614da54b-1297-4a58-8083-432ebd98a75b tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1324 microversion: 2.1 time: 0.355392 May 19 08:23:49.650596 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1018/1974] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:49 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:49.667380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f409b1a7-bbc0-4b13-8f5e-0bbf32b226bd req-3560ea78-a9d5-475d-93a1-e3ae7c74e6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc9e1bc-4154-40e2-b315-12548c900826", "tag": "2a7264e7-2314-4256-9ec1-58d7f45b71d7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:49.678284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f409b1a7-bbc0-4b13-8f5e-0bbf32b226bd req-3560ea78-a9d5-475d-93a1-e3ae7c74e6bf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.679043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f409b1a7-bbc0-4b13-8f5e-0bbf32b226bd req-3560ea78-a9d5-475d-93a1-e3ae7c74e6bf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:49.702395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f409b1a7-bbc0-4b13-8f5e-0bbf32b226bd req-3560ea78-a9d5-475d-93a1-e3ae7c74e6bf service nova] Creating event network-changed:2a7264e7-2314-4256-9ec1-58d7f45b71d7 for instance 8bc9e1bc-4154-40e2-b315-12548c900826 on chh1-842464-2 May 19 08:23:49.718523 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f409b1a7-bbc0-4b13-8f5e-0bbf32b226bd req-3560ea78-a9d5-475d-93a1-e3ae7c74e6bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061623 May 19 08:23:49.724259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1019/1975] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:49.749797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:49.750933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:49.765989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.768477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:49.773760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:49.776199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:50.802958 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:50.822318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:50.824361 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:50.829547 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-713da5c6-92e7-4442-8604-703f7ed2cd74 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.697412 May 19 08:23:50.832989 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 957/1976] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:49 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:50.845386 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:50.846604 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:50.864477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:50.868039 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:50.869997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:50.872873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.022294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:51.032793 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee03146b-f6f4-4564-afa3-681cf21e6099 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1478 microversion: 2.1 time: 1.307034 May 19 08:23:51.043789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1020/1977] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:49 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1478 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:51.049989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:51.051138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:51.063082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.065854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.067009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.068988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.587801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:51.601992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:51.604604 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:51.606198 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9df78605-e23d-4357-8661-81b187879e56 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.771998 May 19 08:23:51.620391 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 958/1978] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:50 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:51.626930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:51.627825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:51.644316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:51.654497 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-842c8add-40a9-40b7-8896-e3adca1c1b6d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.608936 May 19 08:23:51.655874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.656508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.657537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.658292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.660162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1021/1979] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:51 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:51.784636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4cdf82c7-68bf-4af1-b960-53c3f9995245 req-6063bbdd-72e1-4794-a6e5-d59c6703b300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "467ccb00-beac-4760-8193-d0074776b2fa", "tag": "17a0d138-39eb-478d-8a08-dc22711d39d5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:51.817579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4cdf82c7-68bf-4af1-b960-53c3f9995245 req-6063bbdd-72e1-4794-a6e5-d59c6703b300 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.821298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4cdf82c7-68bf-4af1-b960-53c3f9995245 req-6063bbdd-72e1-4794-a6e5-d59c6703b300 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.835217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4cdf82c7-68bf-4af1-b960-53c3f9995245 req-6063bbdd-72e1-4794-a6e5-d59c6703b300 service nova] Creating event network-changed:17a0d138-39eb-478d-8a08-dc22711d39d5 for instance 467ccb00-beac-4760-8193-d0074776b2fa on chh1-842464-2 May 19 08:23:51.847642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4cdf82c7-68bf-4af1-b960-53c3f9995245 req-6063bbdd-72e1-4794-a6e5-d59c6703b300 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068395 May 19 08:23:51.849054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1022/1980] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:23:51.856271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:51.857170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:51.863988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.864811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:51.865986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:51.866598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:52.106149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:52.122821 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2251c90c-8254-42ce-a745-77a0d24a9066 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1324 microversion: 2.1 time: 0.500000 May 19 08:23:52.126479 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 959/1981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:51 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:52.135933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:52.143695 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:52.166405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:52.167308 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:52.170619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:52.171385 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:52.812922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:52.853751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:52.871744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:52.877274 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:52.895363 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4c2d0a6-eaeb-48f1-b16e-064f2bcf6e4e tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.040897 May 19 08:23:52.897275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1023/1982] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:51 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:52.914194 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-61bf1386-8e3d-4cfd-af28-bb291c965bfd tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1464 microversion: 2.1 time: 0.779359 May 19 08:23:52.923273 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 960/1983] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:52 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1464 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:52.926230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:52.928946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:52.943701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:52.945686 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:52.948464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:52.949029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:52.950494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:52.951166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:52.963811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:52.964310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:52.967764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:52.968689 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:53.399119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:53.411552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:53.414235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:53.416257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:53.417014 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a9bf425-c1d9-48ba-975b-34002f3163df tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.517284 May 19 08:23:53.418683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1024/1984] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:52 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:53.424905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:53.425900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:53.435188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:53.436065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:53.436927 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-07784f3f-8221-42a3-a716-4b288f5d5657 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.512290 May 19 08:23:53.437451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:53.438146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:53.441573 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 961/1985] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:52 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:53.446517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:53.447291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:53.469935 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:53.472548 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:53.473425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:53.473987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:53.997244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:54.006014 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1c3baad-3508-4ab8-bb93-21bd5d6f6792 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1464 microversion: 2.1 time: 0.585809 May 19 08:23:54.016967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:54.016967 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5fe3eb97-69be-4651-bf6d-e84083377d5e tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1324 microversion: 2.1 time: 0.573453 May 19 08:23:54.018763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1025/1986] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:53 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1464 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:54.023976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:54.024793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:54.028078 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 962/1987] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:53 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1324 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:54.032932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.033729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.034754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.035355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.049047 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:54.050976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:54.059764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.060579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.061779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.062396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.157020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:23:54.157289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:23:54.168773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:23:54.168773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:23:54.168773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:23:54.239102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:54.247516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.247516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.248866 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.249467 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.283408 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-55c84b1d-698a-4703-ab14-a8601ad173e1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 1068 microversion: 2.1 time: 0.253842 May 19 08:23:54.299622 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 963/1988] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:23:54 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 1068 bytes in 265 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 19 08:23:54.300921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-566212729", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6106690e-bca7-4255-9662-43648d2ed217"}], "security_groups": [{"name": "tempest-securitygroup--1338369020"}], "key_name": "tempest-keypair-1384998341", "user_data": "}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:54.550518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:54.569765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:54.573398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:54.575295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb935622-4597-41c2-823d-8928db1d0be3 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.554844 May 19 08:23:54.577712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1026/1989] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:54 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:54.586169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:54.587071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:54.597695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:54.601107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.602101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.604622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:54.605573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:54.630650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] validate_networks() for [('6106690e-bca7-4255-9662-43648d2ed217', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:23:55.373276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:55.381098 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84fb7f7a-94a7-47c0-8dde-d7f70529a456 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.802122 May 19 08:23:55.385998 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1027/1990] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:54 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:55.391939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:55.392567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:55.409769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:55.410228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:55.411035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:55.411488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:55.853995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:55.867270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:55.871109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:55.872580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d588df5-ff93-463c-a2c6-5217a6585fd9 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.484597 May 19 08:23:55.891117 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1028/1991] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:55 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:55.897630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:55.899738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:55.907901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:55.908661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:55.909804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:55.910482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.381078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:56.391990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b8802e2-63d2-4988-b089-8d72174f465d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.499367 May 19 08:23:56.404528 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1029/1992] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:55 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:56.406239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:23:56.406817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:23:56.407680 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:23:56.408155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:23:56.408671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:23:56.411026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:56.411918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:56.419520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.420247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.421211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.422397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.428380 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.431017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.432578 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.435537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.492919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:23:56.500450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for user 59f3ba2c06c045d6afccb1639ed8d083 and project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:23:56.520425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:23:56.524119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:23:56.603539 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-75e25400-b600-4321-8166-97d806e27141 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.307065 May 19 08:23:56.613284 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 964/1993] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:23:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 2313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:23:56.639581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:56.642960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:56.660520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.661096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.662930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.663484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.694827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:23:56.776294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:56.784983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9f08821-128c-43f6-995c-e06882299b17 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1324 microversion: 2.1 time: 0.379314 May 19 08:23:56.786208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1030/1994] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:56 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1324 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:56.792169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:56.793165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:56.802329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.803113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:56.804143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:56.804801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.207788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.212422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.225160 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ce4f5a4-c5ad-4c9c-9da7-8fdd9a39e8b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.437523 May 19 08:23:57.226130 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1031/1995] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:56 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:57.227249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.230073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.231648 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e98172bd-e672-45b4-902f-5e7b4fb992b4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.621515 May 19 08:23:57.232690 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 965/1996] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:56 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:57.233610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee70ac0a-987a-4049-8719-5069b5a194f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:57.234513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee70ac0a-987a-4049-8719-5069b5a194f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:57.238180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:57.239129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:57.257651 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.258141 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.259066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.259907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.328702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee70ac0a-987a-4049-8719-5069b5a194f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.342279 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee70ac0a-987a-4049-8719-5069b5a194f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1238 microversion: 2.1 time: 0.114808 May 19 08:23:57.352729 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1032/1997] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:57 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:57.411361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:57.412974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:57.426411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.429720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.433168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.433967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.527924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.549225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.551346 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.558044 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-450d4dfe-d529-4b15-8ca7-49c00efa2f2d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.323985 May 19 08:23:57.558879 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 966/1998] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:57 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:57.631539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-8543d56c-3040-4544-b31b-4f9290f902e6 req-25d0bebf-6e6f-4c23-85ed-d504c556fcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ccb00-beac-4760-8193-d0074776b2fa", "name": "network-vif-plugged", "status": "completed", "tag": "17a0d138-39eb-478d-8a08-dc22711d39d5"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:23:57.679706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8543d56c-3040-4544-b31b-4f9290f902e6 req-25d0bebf-6e6f-4c23-85ed-d504c556fcb8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.687002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8543d56c-3040-4544-b31b-4f9290f902e6 req-25d0bebf-6e6f-4c23-85ed-d504c556fcb8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.734027 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-8543d56c-3040-4544-b31b-4f9290f902e6 req-25d0bebf-6e6f-4c23-85ed-d504c556fcb8 service nova] Creating event network-vif-plugged:17a0d138-39eb-478d-8a08-dc22711d39d5 for instance 467ccb00-beac-4760-8193-d0074776b2fa on chh1-842464-2 May 19 08:23:57.740024 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-8543d56c-3040-4544-b31b-4f9290f902e6 req-25d0bebf-6e6f-4c23-85ed-d504c556fcb8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113287 May 19 08:23:57.741390 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 967/1999] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:23:57.804153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:57.805059 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:57.820625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.821403 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.823285 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:57.826858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:57.828984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:57.840953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b28ece3b-0153-496c-9335-9aa50838354d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.434938 May 19 08:23:57.843834 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1033/2000] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:57 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:58.062163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:58.079479 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-10b99711-e1a3-49c4-ba6d-81b6ce8ccb3f tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1324 microversion: 2.1 time: 0.276817 May 19 08:23:58.085364 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 968/2001] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:57 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:23:58.260517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:58.261585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:58.266267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:58.267433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:58.272371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.272828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.273654 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.274095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.276599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.277330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.278292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.278922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.670074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:58.686542 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:58.705692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:58.709939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:58.715874 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d8ab560d-1432-4105-adae-64be7473567f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.460827 May 19 08:23:58.717440 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 969/2002] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:58 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:58.722558 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61fb0b51-adfa-4084-b713-a40ac4aaa3ef tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.464055 May 19 08:23:58.733930 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1034/2003] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:58 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:58.739383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:58.740376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:58.748925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.750411 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.751696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.752368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.875248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:58.883666 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7026f821-2d1e-4985-95f7-308b52f8ee95 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1296 microversion: 2.1 time: 0.164198 May 19 08:23:58.894920 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 970/2004] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:58 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1296 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:58.902115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:58.902966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:58.909737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.910464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.911420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.912020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.924180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:58.924801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:58.932412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.932890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:58.933778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:58.934298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:59.342085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:59.350359 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b97a7995-7011-46ff-a498-a88636ffdc80 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.453965 May 19 08:23:59.354778 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 971/2005] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:58 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:23:59.365590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:59.367352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:59.380546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:59.386140 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:59.387423 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:59.388068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:59.894553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:59.911953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:59.913589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:23:59.914853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-586cb668-d6be-4f37-b461-ba7ffb87c1d7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 1.179836 May 19 08:23:59.922211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1035/2006] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:58 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:23:59.930436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:23:59.932526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:23:59.952911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:59.953399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:59.954188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:23:59.954686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:23:59.969334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:00.125924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:00.138797 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dbac3d08-40ff-4452-95fa-36dabca44af4 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1521 microversion: 2.1 time: 0.782592 May 19 08:24:00.142279 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 972/2007] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:23:59 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1521 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:00.170962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:00.171745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:00.191374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:00.191854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:00.192686 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:00.193144 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:00.844649 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:00.858161 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c67cc779-e859-4cdb-b9ea-b096f89a9168 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.714606 May 19 08:24:00.858896 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 973/2008] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:00 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:00.872017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-f437037e-9ee4-4575-aa7d-792e9b860c3c req-89f602dc-42d1-4825-a180-831fb53b7e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e1bc-4154-40e2-b315-12548c900826", "name": "network-vif-plugged", "status": "completed", "tag": "2a7264e7-2314-4256-9ec1-58d7f45b71d7"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:00.881010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-f437037e-9ee4-4575-aa7d-792e9b860c3c req-89f602dc-42d1-4825-a180-831fb53b7e7e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:00.881494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-f437037e-9ee4-4575-aa7d-792e9b860c3c req-89f602dc-42d1-4825-a180-831fb53b7e7e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:00.894273 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-f437037e-9ee4-4575-aa7d-792e9b860c3c req-89f602dc-42d1-4825-a180-831fb53b7e7e service nova] Creating event network-vif-plugged:2a7264e7-2314-4256-9ec1-58d7f45b71d7 for instance 8bc9e1bc-4154-40e2-b315-12548c900826 on chh1-842464-2 May 19 08:24:00.899986 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-f437037e-9ee4-4575-aa7d-792e9b860c3c req-89f602dc-42d1-4825-a180-831fb53b7e7e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039039 May 19 08:24:00.901429 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 974/2009] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:00.910419 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:00.911390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:00.928076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:00.929188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:00.930329 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:00.930976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:00.951074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:00.964557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:00.973968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:00.975528 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f62b36a-5464-44e0-9d64-af985b7a2224 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.051989 May 19 08:24:00.995491 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1036/2010] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:23:59 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:01.000803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:01.010986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:01.019030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:01.019678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:01.020689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:01.021366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:01.052449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] HTTP exception thrown: Instance is not a member of specified network May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Request method failure captured: May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa/ips/invalid HTTP/1.1 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6Jn1BqH_AVmgJinGQcxmlxMA8BgSVenZYi3G1hJs38ih86VgF5didTqGCkaywimIeJau5ztQWHRAMicy2-8MyvrGLjXi27ocf0gMBE7eqlwcVogA-QnRNnJvx7goZQr4X46nVTfobDwisocLczS0pOySCSCWdGUkNu_MRI66vgLvs May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8e30d4a5716e424487ddd33560f168d4 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8e30d4a5716e424487ddd33560f168d4 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerAddressesNegativeTestJSON-1500265466-project May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: eee964e8cef44879bd61c924e230565c May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1500265466-project May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance is not a member of specified network May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '467ccb00-beac-4760-8193-d0074776b2fa', 'id': 'invalid'} May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 19 08:24:01.060071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:01.066222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:01.067372 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e7e8399-2a38-4391-89c5-764652d7c10a tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.070561 May 19 08:24:01.073409 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1037/2011] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:24:00 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa/ips/invalid => generated 91 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:24:01.086483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:01.087406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:01.103080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:01.103719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:01.107658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:01.108362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.047660 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.061840 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e649ac55-8de6-49dc-8bbe-86d9ceb127af tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 1.158931 May 19 08:24:02.064431 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 975/2012] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:00 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:02.073044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:02.074369 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:02.086260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.086920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.088751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.089401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.133270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.142573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e117a4e3-9b2f-4f03-afbe-1e073987d4cc tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 1.067734 May 19 08:24:02.154054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1038/2013] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:01 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:02.159518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a1de9f6-2e6c-4282-98f0-697e65912818 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:02.160363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a1de9f6-2e6c-4282-98f0-697e65912818 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Failed to fetch instance by id 999 {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:24:02.162328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8a1de9f6-2e6c-4282-98f0-697e65912818 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] HTTP exception thrown: Instance 999 could not be found. May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a1de9f6-2e6c-4282-98f0-697e65912818 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Request method failure captured: May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6Jn1BqH_AVmgJinGQcxmlxMA8BgSVenZYi3G1hJs38ih86VgF5didTqGCkaywimIeJau5ztQWHRAMicy2-8MyvrGLjXi27ocf0gMBE7eqlwcVogA-QnRNnJvx7goZQr4X46nVTfobDwisocLczS0pOySCSCWdGUkNu_MRI66vgLvs May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8e30d4a5716e424487ddd33560f168d4 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8e30d4a5716e424487ddd33560f168d4 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerAddressesNegativeTestJSON-1500265466-project May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: eee964e8cef44879bd61c924e230565c May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1500265466-project May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 999 could not be found. May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '999'} May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 19 08:24:02.166473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:02.173397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a1de9f6-2e6c-4282-98f0-697e65912818 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:02.175048 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a1de9f6-2e6c-4282-98f0-697e65912818 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019641 May 19 08:24:02.180007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1039/2014] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:24:02 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:24:02.185930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:02.186915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:02.194768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.195639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.196697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.197823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.424923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.435819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.438142 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.440369 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9924467c-e4d8-4e45-84e5-ef2db7e36178 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1646 microversion: 2.25 time: 0.373774 May 19 08:24:02.452498 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 976/2015] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:02 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1646 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:02.476231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:02.479246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:02.495227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.496640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.497965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.498617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.649707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.664773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-655f4183-85a0-4405-8904-e704b58527b3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.483310 May 19 08:24:02.666376 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1040/2016] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:02 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:02.672458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:02.673290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:02.692157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.693074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.694171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.696124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.760806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:02.887831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.897783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d1a5cb9-aa00-4d34-a7c6-3049fb962931 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "DELETE /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 204 len: 0 microversion: 2.1 time: 0.229188 May 19 08:24:02.901955 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1041/2017] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:02 2022] DELETE /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:02.902136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.902136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:02.903178 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b681723e-029d-4988-a83c-8a25d9a80689 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.450341 May 19 08:24:02.914083 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 977/2018] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:02 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:02.914307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:02.914307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:02.926646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.927097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:02.929188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:02.929656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.081692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:03.083508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:03.100872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.101750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.103892 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.104571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.449780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:03.458091 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7b5dcd15-f482-4cd6-b33d-b00cae99972d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.381657 May 19 08:24:03.459979 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 978/2019] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:03 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:03.466458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:03.467628 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:03.475430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.476152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.477138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.477850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.481846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:03.524125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a681b305-e83a-49f8-bb00-ba8e6043d1c9 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1527 microversion: 2.1 time: 0.619419 May 19 08:24:03.525170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1042/2020] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:02 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1527 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:03.530968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:03.532878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:03.541112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.541923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.543507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.544252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.862972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:03.874280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:03.876526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:03.878369 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15b5cbae-fc6f-4126-9288-0179d4298787 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1636 microversion: 2.25 time: 0.351680 May 19 08:24:03.879460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1043/2021] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:03 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1636 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:03.885917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:03.886857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:03.893730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.894878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.896037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.896649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.908445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:03.939598 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a72bd443-b6aa-4c74-8489-89f4c32f281d tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1352 microversion: 2.1 time: 0.471939 May 19 08:24:03.940315 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 979/2022] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:03 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1352 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:03.951059 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cf4dad0b-739f-429f-8301-c519c3fb90ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '.version_select at 0x7f3217a05820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:03.956025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf4dad0b-739f-429f-8301-c519c3fb90ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:03.956504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cf4dad0b-739f-429f-8301-c519c3fb90ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:03.985276 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cf4dad0b-739f-429f-8301-c519c3fb90ad tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2783 microversion: 2.25 time: 0.043730 May 19 08:24:03.988263 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 980/2023] 10.222.0.78 () {60 vars in 1183 bytes} [Thu May 19 08:24:03 2022] GET /compute/v2.1/os-migrations => generated 2783 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:04.009113 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:04.009789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:04.025683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:04.026358 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:04.027494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:04.027924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:04.679309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:04.696729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6adfc34c-3395-4900-a0f8-b383b752bf7c tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.815982 May 19 08:24:04.697673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1044/2024] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:03 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:04.702507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:04.704913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:04.726704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:04.727480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:04.729154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:04.729792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.029496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:05.046155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:05.047814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:05.057283 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-20c2eee0-b852-4d46-9da7-c8e4580a255b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.059281 May 19 08:24:05.057986 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 981/2025] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:03 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:05.091543 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-134dbd13-621e-4575-b0be-55bd55f4ed2b req-39f1e9d4-2354-451f-8872-76cc2c693b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:05.156198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-134dbd13-621e-4575-b0be-55bd55f4ed2b req-39f1e9d4-2354-451f-8872-76cc2c693b33 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.158435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-134dbd13-621e-4575-b0be-55bd55f4ed2b req-39f1e9d4-2354-451f-8872-76cc2c693b33 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.190606 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-134dbd13-621e-4575-b0be-55bd55f4ed2b req-39f1e9d4-2354-451f-8872-76cc2c693b33 service nova] Creating event network-changed:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:24:05.203377 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-134dbd13-621e-4575-b0be-55bd55f4ed2b req-39f1e9d4-2354-451f-8872-76cc2c693b33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141789 May 19 08:24:05.204606 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 982/2026] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:05.217048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:05.218030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:05.221106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 9ee67616-6551-4084-9ed3-cdaf5574749f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:05.239497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.239954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.240739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.241172 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.255001 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a115398-66de-457e-a278-8090b2e1a9e3 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 2129 microversion: 2.25 time: 0.556047 May 19 08:24:05.255908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1045/2027] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:04 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 2129 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:05.264231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:05.265100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:05.282322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.283094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.284659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.285542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.817582 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:05.828305 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-44a21bc7-508f-4400-ab4f-b49e0ac85b6d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.616312 May 19 08:24:05.839662 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 983/2028] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:05 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:05.844747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:05.844938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee964e8cef44879bd61c924e230565c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e30d4a5716e424487ddd33560f168d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:05.848989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:05.868505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.870010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.871035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.871683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.871829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38324b07-b69f-4dd9-833e-3857349b6c40 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 200 len: 1527 microversion: 2.1 time: 0.614606 May 19 08:24:05.875691 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1046/2029] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:05 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 1527 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:05.898320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:05.908602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:05.933914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.935306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:05.936298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:05.937821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:06.460360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:06.511595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=16 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:06.532417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:06.539479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:06.551617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 9ee67616-6551-4084-9ed3-cdaf5574749f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:06.560087 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de98eb14-476e-4973-a345-01cfc1445c65 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1541 microversion: 2.1 time: 0.719025 May 19 08:24:06.572303 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 984/2030] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:05 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1541 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:06.579169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:06.580388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:06.590553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:06.591446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:06.592554 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:06.593250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:06.596575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76bf4aa8-70af-43a8-b95e-6c2c1d7c84f0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 2129 microversion: 2.25 time: 0.714394 May 19 08:24:06.597222 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1047/2031] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:05 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 2129 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:06.610685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:06.611671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:06.629757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:06.630711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:06.639063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:06.640457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:06.945595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:06.958181 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dee8a40f-cca2-42d8-b957-4b19ed3ee980 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.384106 May 19 08:24:06.958782 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 985/2032] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:06 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:06.978705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:06.980217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:06.993917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.001718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.002974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.003663 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.082770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:07.116200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:07.126504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:07.132274 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-014addde-e4d3-40aa-b8f1-1664aff24b7f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.531085 May 19 08:24:07.134892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1048/2033] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:06 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:07.160591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:07.163236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:07.176974 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-22d4d395-2273-4c46-8ac8-0d43ae2ab444 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213817 May 19 08:24:07.178535 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 986/2034] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:24:06 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:07.193384 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:07.195273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:07.204700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.205043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.207734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.208674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.209976 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.212861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.213828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.214716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.334150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:07.395593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lazy-loading 'services' on Instance uuid 9ee67616-6551-4084-9ed3-cdaf5574749f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:07.545040 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81bd4694-84d0-48a5-b286-9922831dc013 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments/7ac88954-3f84-433e-9e7d-596b76d3046b" status: 202 len: 0 microversion: 2.25 time: 0.397785 May 19 08:24:07.545770 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1049/2035] 10.222.0.78 () {60 vars in 1456 bytes} [Thu May 19 08:24:07 2022] DELETE /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments/7ac88954-3f84-433e-9e7d-596b76d3046b => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:07.565016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:07.566368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] [instance: 467ccb00-beac-4760-8193-d0074776b2fa] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:07.597603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.598477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.599664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.600326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.618068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:07.627762 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-65ed635d-ae42-4a9b-916f-f586baca6bf9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.447060 May 19 08:24:07.637902 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 987/2036] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:07 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:07.644696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-49fd2846-7f38-41c8-b511-26361d37496c req-290830ee-9639-4941-a605-dd94594a916b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "467ccb00-beac-4760-8193-d0074776b2fa", "name": "network-vif-deleted", "tag": "17a0d138-39eb-478d-8a08-dc22711d39d5"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:07.648727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] HTTP exception thrown: Instance 467ccb00-beac-4760-8193-d0074776b2fa could not be found. May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Request method failure captured: May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa HTTP/1.1 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6Jn1BqH_AVmgJinGQcxmlxMA8BgSVenZYi3G1hJs38ih86VgF5didTqGCkaywimIeJau5ztQWHRAMicy2-8MyvrGLjXi27ocf0gMBE7eqlwcVogA-QnRNnJvx7goZQr4X46nVTfobDwisocLczS0pOySCSCWdGUkNu_MRI66vgLvs May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8e30d4a5716e424487ddd33560f168d4 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e30d4a5716e424487ddd33560f168d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8e30d4a5716e424487ddd33560f168d4 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1500265466 May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerAddressesNegativeTestJSON-1500265466-project May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: eee964e8cef44879bd61c924e230565c May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1500265466-project May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 467ccb00-beac-4760-8193-d0074776b2fa could not be found. May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '467ccb00-beac-4760-8193-d0074776b2fa'} May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 467ccb00-beac-4760-8193-d0074776b2fa could not be found. May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 467ccb00-beac-4760-8193-d0074776b2fa could not be found. May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:07.651302 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 467ccb00-beac-4760-8193-d0074776b2fa could not be found. May 19 08:24:07.656171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:07.659054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] Returning 404 to user: Instance 467ccb00-beac-4760-8193-d0074776b2fa could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:07.660203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d003ba2-8d11-4148-af15-37788105d271 tempest-ServerAddressesNegativeTestJSON-1500265466 tempest-ServerAddressesNegativeTestJSON-1500265466-project] 10.222.0.78 "GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa" status: 404 len: 111 microversion: 2.1 time: 0.110830 May 19 08:24:07.661337 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1050/2037] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:07 2022] GET /compute/v2.1/servers/467ccb00-beac-4760-8193-d0074776b2fa => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:07.667159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:07.669230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:07.676351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.677296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.678431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.679098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.684987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-49fd2846-7f38-41c8-b511-26361d37496c req-290830ee-9639-4941-a605-dd94594a916b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.684987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-49fd2846-7f38-41c8-b511-26361d37496c req-290830ee-9639-4941-a605-dd94594a916b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.711615 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-49fd2846-7f38-41c8-b511-26361d37496c req-290830ee-9639-4941-a605-dd94594a916b service nova] Creating event network-vif-deleted:17a0d138-39eb-478d-8a08-dc22711d39d5 for instance 467ccb00-beac-4760-8193-d0074776b2fa on chh1-842464-2 May 19 08:24:07.711832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:07.715876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8adb3648-8d52-4cdd-a0a8-46f6da91be63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053108 May 19 08:24:07.720636 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1051/2038] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:07 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:07.726036 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-49fd2846-7f38-41c8-b511-26361d37496c req-290830ee-9639-4941-a605-dd94594a916b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086388 May 19 08:24:07.727276 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 988/2039] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:07.981633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:07.982667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:07.997887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:07.998750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:07.999948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.000634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.153673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:08.154534 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:08.166019 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.166849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.178033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.179877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.772624 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:08.787696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:08.806324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34eb2bdf-2639-4896-8439-7f2e4256cd13 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.831219 May 19 08:24:08.818405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1052/2040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:07 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:08.822148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:08.833156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:08.837930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:08.839568 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e28333aa-471d-403b-aeff-7b87f3711559 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.691233 May 19 08:24:08.840398 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 989/2041] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:08 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:24:08.841255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:08.847899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:08.860568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:08.863026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.866671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.867802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.869155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.876305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.880937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.882198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:08.892797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:08.960963 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d525d7ec-f5f2-4914-8484-2cf8983419ea tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118336 May 19 08:24:08.961596 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 990/2042] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:08 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:09.085585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-44c5d3a6-724e-4f90-bf21-1480669dbf57 req-2b9d3a85-f707-4227-b673-7b4cecdc6733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc9e1bc-4154-40e2-b315-12548c900826", "tag": "2a7264e7-2314-4256-9ec1-58d7f45b71d7"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:09.103693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-44c5d3a6-724e-4f90-bf21-1480669dbf57 req-2b9d3a85-f707-4227-b673-7b4cecdc6733 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:09.105614 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-44c5d3a6-724e-4f90-bf21-1480669dbf57 req-2b9d3a85-f707-4227-b673-7b4cecdc6733 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:09.148080 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-44c5d3a6-724e-4f90-bf21-1480669dbf57 req-2b9d3a85-f707-4227-b673-7b4cecdc6733 service nova] Creating event network-changed:2a7264e7-2314-4256-9ec1-58d7f45b71d7 for instance 8bc9e1bc-4154-40e2-b315-12548c900826 on chh1-842464-2 May 19 08:24:09.159143 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-44c5d3a6-724e-4f90-bf21-1480669dbf57 req-2b9d3a85-f707-4227-b673-7b4cecdc6733 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083637 May 19 08:24:09.160169 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 991/2043] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:24:09.619848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:09.629843 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-866265d4-0acb-43c5-8d61-4f2112b240c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.809899 May 19 08:24:09.634561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1053/2044] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:08 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:09.847091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:09.847921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:09.859805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:09.865647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:09.879150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:09.886557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:09.886754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:09.887868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:09.889686 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:09.890603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:09.891477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:09.891973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:10.752975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:10.762922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:10.775703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:10.777211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:10.785657 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-90e481a0-d3cd-454f-9ba0-8be15b198936 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.926908 May 19 08:24:10.786474 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 992/2045] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:09 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:10.792009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e1d6c22-a973-4f23-8e91-622fa8caaea1 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.937997 May 19 08:24:10.792605 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1054/2046] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:09 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:24:10.802596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:10.803854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:10.813736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:10.815655 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:10.828872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:10.841479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:10.843831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:10.846916 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:10.848407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:10.851319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:10.854875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:10.874495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:10.875189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:10.940057 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-105d209a-89b5-44d6-81ad-4cb3764dee48 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152454 May 19 08:24:10.941082 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 993/2047] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:10 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:11.231434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:11.241233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24b9ecbb-c999-41c0-bf15-15fb145a42fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.445953 May 19 08:24:11.252863 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1055/2048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:10 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:11.806773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:11.807838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:11.811328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:11.812191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:11.818904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:11.822081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:11.824630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:11.825136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:11.825801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:11.825966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:11.826615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:11.827061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:12.143863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:12.153939 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-150af1a7-2e3b-4f68-ad89-58e4c73829d3 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.353992 May 19 08:24:12.154972 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 994/2049] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:11 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:12.161600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:12.162725 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:12.171487 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:12.172086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:12.173482 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:12.174052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:12.227190 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d2becfec-6d72-4a8a-be66-ad38529d9b63 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071040 May 19 08:24:12.228643 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 995/2050] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:12 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:12.253725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:12.259687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:12.260438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:12.264848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:12.267450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:12.269009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-760a529c-3af7-41d3-885f-bf20a2f1b122 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.461771 May 19 08:24:12.275121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:12.276213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:12.277771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:12.278397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:12.280493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1056/2051] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:11 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:24:12.464586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:12.486562 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-851cfdd7-1ade-4a96-89c5-8e5734d8169d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.231646 May 19 08:24:12.488813 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 996/2052] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:12 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:12.701236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c9f5730d-072e-4959-af27-b68481e16c3a req-85a93405-de48-4482-b82e-cdf4f4a6fff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-plugged", "status": "completed", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:12.715393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c9f5730d-072e-4959-af27-b68481e16c3a req-85a93405-de48-4482-b82e-cdf4f4a6fff0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:12.719803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c9f5730d-072e-4959-af27-b68481e16c3a req-85a93405-de48-4482-b82e-cdf4f4a6fff0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:12.756186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c9f5730d-072e-4959-af27-b68481e16c3a req-85a93405-de48-4482-b82e-cdf4f4a6fff0 service nova] Creating event network-vif-plugged:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:24:12.764425 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c9f5730d-072e-4959-af27-b68481e16c3a req-85a93405-de48-4482-b82e-cdf4f4a6fff0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069641 May 19 08:24:12.765070 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1057/2053] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:24:13.171994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:13.173410 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:13.182246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.183828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.184891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.185657 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.244701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:13.246273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:13.257805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.259817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.261258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.261997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.305999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7da75ac5-d52a-46c0-a539-046bc8337fee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.068632 May 19 08:24:13.307596 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1058/2054] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:13 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:13.314933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:13.316073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:13.326980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.327817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.329458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.330178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.571098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:13.584973 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b169122f-53a8-4b73-9298-d07723373542 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.417078 May 19 08:24:13.585742 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 997/2055] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:13 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:13.598853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:13.599903 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:13.614457 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.616633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.621955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:13.622949 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:13.672824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:13.685787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:13.691207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:13.692748 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e58b9d14-811c-49d5-8eb8-b89433f917cd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.383794 May 19 08:24:13.706288 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1059/2056] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:13 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:13.861233 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:13.872295 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-beff9e7a-9aa5-4def-84e3-4ae2e2200eee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1364 microversion: 2.1 time: 0.282538 May 19 08:24:13.872900 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 998/2057] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:13 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:14.317809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:14.318698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:14.331517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.333479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.334612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.336034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.601989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:14.604475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:14.610234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.610981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.611952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.612569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.654743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3a7a625-06dd-454f-ae6f-b93dfd58d12c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.340962 May 19 08:24:14.655995 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1060/2058] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:14 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:14.713543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:14.714488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:14.724795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.725494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.726485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.727101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.829208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:14.843581 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fceebb34-b94e-46dd-8e24-0f0662d3e4ee tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.245324 May 19 08:24:14.868916 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 999/2059] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:14 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:14.890395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:14.891025 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:14.907732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.908196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:14.909688 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:14.910137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:15.051918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:15.066404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:15.069073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:15.087280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d882f022-c8b5-4fef-92d0-c64e1b52050b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.378299 May 19 08:24:15.094805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1061/2060] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:14 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:24:15.187790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:15.196946 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4268732b-64eb-4b00-b841-103b046135f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1550 microversion: 2.1 time: 0.310321 May 19 08:24:15.215924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:15.216441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:15.220749 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1000/2061] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:14 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1550 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:15.223672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:15.224348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:15.225368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:15.225988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:15.370538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c6e014a-1f20-4e3d-b98b-7ef4e3411827 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158732 May 19 08:24:15.371831 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1062/2062] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:24:15 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:15.667994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:15.669663 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:15.681912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:15.686959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:15.688289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:15.688908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:15.755070 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-77964dbc-50dd-4421-9483-c64bac4954c3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092406 May 19 08:24:15.756369 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1001/2063] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:15 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:15.874370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:15.875228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:15.887847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:15.902214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:15.903224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:15.903778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:16.111991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:16.112914 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:16.128952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:16.129774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:16.130800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:16.131436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:16.554412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:16.570763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a68453af-fa17-4590-b37f-00a986a39bb8 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.700135 May 19 08:24:16.575004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1063/2064] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:15 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:16.769078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:16.770445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:16.779763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:16.784642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:16.785634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:16.786368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:16.799412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:16.821220 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:16.826023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:16.829611 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2496b1d2-934b-46e9-9287-684ae307466f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.721461 May 19 08:24:16.832108 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1002/2065] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:16 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:16.876364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bd59802-2ccb-417f-b6f7-6cdacae2806c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.111409 May 19 08:24:16.879451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1064/2066] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:16 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:17.516847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:17.517571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:17.544406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-131585f1-df26-456b-8020-748f98d8552d req-d182ce3f-1b7a-4e76-8066-31a8841c2c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:17.560363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:17.560829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:17.561653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:17.572442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-131585f1-df26-456b-8020-748f98d8552d req-d182ce3f-1b7a-4e76-8066-31a8841c2c95 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:17.573012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-131585f1-df26-456b-8020-748f98d8552d req-d182ce3f-1b7a-4e76-8066-31a8841c2c95 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:17.577895 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:17.584695 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:17.610287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-131585f1-df26-456b-8020-748f98d8552d req-d182ce3f-1b7a-4e76-8066-31a8841c2c95 service nova] Creating event network-changed:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:24:17.624071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-131585f1-df26-456b-8020-748f98d8552d req-d182ce3f-1b7a-4e76-8066-31a8841c2c95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090265 May 19 08:24:17.625271 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1065/2067] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:17.637598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:17.644044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:17.655745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:17.679538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:17.681507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:17.684658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:17.956914 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:17.975490 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c67291f7-8fb9-49b1-8174-3e1f694fc778 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1550 microversion: 2.1 time: 0.462375 May 19 08:24:17.980611 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1003/2068] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:17 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1550 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:17.996161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:17.998370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:18.015064 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:18.015518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:18.016309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:18.022471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:18.267894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:18.282960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bd8e8d4-ad37-468f-8a84-a1bf0a18742f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.653597 May 19 08:24:18.284333 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1066/2069] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:17 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:18.304807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:18.307190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:18.316865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:18.321852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:18.323500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:18.324736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:18.375771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbbbc39f-cd50-423c-83dc-830840d6e7e2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090093 May 19 08:24:18.381232 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1067/2070] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:18 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:18.386909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:18.387536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:18.402782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:18.403111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:18.403915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:18.404461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:18.457871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:18.475032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:18.479844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:18.481544 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9ccbfe79-260f-4175-8860-0a2f0c560d1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.499444 May 19 08:24:18.482383 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1004/2071] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:17 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:18.655556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1521585141", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:18.692303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:18.704193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79c79f51-62cb-4e60-9dd0-e431177bb055 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1550 microversion: 2.1 time: 0.321714 May 19 08:24:18.708801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1068/2072] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:18 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1550 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:18.734333 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] validate_networks() for [('df976f3f-de22-4a84-9855-b6cebddc479b', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:24:19.271029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:24:19.271672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:24:19.272086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:24:19.272765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:24:19.273814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:24:19.301799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.302607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.303800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.304450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.306738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:19.307358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:19.320658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.322195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.323211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.325340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.334975 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Getting quotas for project 7b66ea12d6964ec68ba46b8305b68cef. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:24:19.344065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Getting quotas for user c7922e2a372443b1b1330dd16ba60b4e and project 7b66ea12d6964ec68ba46b8305b68cef. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:24:19.368927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:24:19.371581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:24:19.464780 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0ce58435-b492-4036-8f0a-7629900e6eb1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.969131 May 19 08:24:19.471899 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1005/2073] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:24:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:24:19.478312 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:19.479310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:19.487154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.487612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.488390 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.488826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.523377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:19.526240 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-56446964-6529-4f96-a336-bde16ea9d5a2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052859 May 19 08:24:19.530811 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1006/2074] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:19 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:19.533380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdcfd310-36ff-4055-8d67-6723b912d21b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.230697 May 19 08:24:19.543953 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1069/2075] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:19 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:19.544326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1f60e9f0-de61-4c7b-b830-ca09971343f5 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:19.544326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1f60e9f0-de61-4c7b-b830-ca09971343f5 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:19.550235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:19.550961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:19.558919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.559663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.560692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.561273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.577758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:19.639945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1f60e9f0-de61-4c7b-b830-ca09971343f5 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:19.648474 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1f60e9f0-de61-4c7b-b830-ca09971343f5 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1214 microversion: 2.1 time: 0.116368 May 19 08:24:19.658354 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1007/2076] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:19 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:19.730670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:19.731202 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:19.741294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.741858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.742813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:19.743638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:19.877972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:19.896535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:19.898703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:19.904044 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49d98c12-a9fe-4741-8f20-a8726852e997 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.364908 May 19 08:24:19.906790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1070/2077] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:19 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:20.087477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:20.100443 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-62bf9ba6-0574-4e61-b7ac-6de30c9e2a7a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.377633 May 19 08:24:20.108518 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1008/2078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:19 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:20.126790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:20.127548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:20.135702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.136278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.137452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.137976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.382555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:20.397938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-228522db-7367-450e-8b51-6d6f986fb2d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.275393 May 19 08:24:20.400382 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1071/2079] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:20 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:20.419001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1053232555"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:20.421396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:20.428326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.429049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.430086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.431477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.538576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:20.539684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:20.548778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.549268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.550131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.550584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.584510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-109c6397-b3de-4ca6-95a1-9bb9fdee11ad tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050240 May 19 08:24:20.585410 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1072/2080] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:20 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:24:20.590974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:20.591885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:20.599720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.600721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.602586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.603722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.784591 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-904832ea-f430-41ee-bb24-8b5e4a510283 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.370710 May 19 08:24:20.786120 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1009/2081] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:24:20 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 19 08:24:20.793483 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:20.795264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:20.804973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.806554 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.807918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.808622 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.811168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:20.827663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a318bfaf-61ee-417f-b65c-e011ac6ff09e tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1473 microversion: 2.1 time: 0.240627 May 19 08:24:20.828783 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1073/2082] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:20 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1473 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:20.887465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:20.896813 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-45ea98b3-9287-4070-b411-1ff967a6c222 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1266 microversion: 2.1 time: 0.108794 May 19 08:24:20.897988 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1010/2083] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:20 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:20.924762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:20.925419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:20.937795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:20.939775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.942333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:20.943386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:20.944256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:21.416099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:21.442471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:21.450966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:21.458248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9dbfec5-6d72-4dd3-8a34-cf84aa4bb431 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.537765 May 19 08:24:21.459814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1074/2084] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:20 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:21.601450 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:21.604655 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:21.621421 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:21.622790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:21.624892 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:21.625574 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:21.697017 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f5cfa5d1-0233-4263-8608-8d9a442dd935 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102727 May 19 08:24:21.697691 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1011/2085] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:21 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:21.845053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:21.845834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:21.855155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:21.856318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:21.861855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:21.862521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:21.919982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:21.920907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:21.928094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:21.928584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:21.929476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:21.930151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:22.030796 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:22.059563 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1c92949f-ff68-4d07-9077-0d419f6137f1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1272 microversion: 2.1 time: 0.145211 May 19 08:24:22.069540 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1012/2086] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:21 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:22.137235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:22.170236 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af1dc2cc-cc93-46e5-8dab-851132c5b42a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.329359 May 19 08:24:22.171061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1075/2087] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:21 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:22.476353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:22.476998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:22.484954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:22.485783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:22.486583 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:22.489159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:22.710967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:22.712425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:22.719244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:22.719699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:22.720523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:22.720967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:22.762658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0615d04a-d913-4a9a-a7fb-f5ae386b8d98 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.055846 May 19 08:24:22.763938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1076/2088] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:22 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:23.065943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:23.077287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:23.078044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:23.080313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:23.081860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:23.083291 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a28d404-8679-4428-bd55-6227c6c2e3ca tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.610948 May 19 08:24:23.083850 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1013/2089] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:22 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:23.095706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.097136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.098127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.098732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.189703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:23.191496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:23.198696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.199913 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.201277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.202158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.453771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:23.465256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc358e08-f5f9-4106-b478-ecdb946fd630 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 0.391743 May 19 08:24:23.466676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1077/2090] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:23 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:23.503593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:23.526714 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-46bfcf6a-c030-49a0-8a0c-ede67912ddc1 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.342220 May 19 08:24:23.529666 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1014/2091] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:23 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:23.672375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ed6e7a14-d6ac-4e9e-994b-9b9d1f058f09 req-99f090f5-b263-4b41-b029-f191ceb2d91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13633aa-6210-4efa-9610-ec0ae1b75c99", "tag": "9ec0d21d-bf64-49f3-b518-13e28672352b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:23.686073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ed6e7a14-d6ac-4e9e-994b-9b9d1f058f09 req-99f090f5-b263-4b41-b029-f191ceb2d91c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.689066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ed6e7a14-d6ac-4e9e-994b-9b9d1f058f09 req-99f090f5-b263-4b41-b029-f191ceb2d91c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.707400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ed6e7a14-d6ac-4e9e-994b-9b9d1f058f09 req-99f090f5-b263-4b41-b029-f191ceb2d91c service nova] Creating event network-changed:9ec0d21d-bf64-49f3-b518-13e28672352b for instance d13633aa-6210-4efa-9610-ec0ae1b75c99 on chh1-842464-2 May 19 08:24:23.715129 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ed6e7a14-d6ac-4e9e-994b-9b9d1f058f09 req-99f090f5-b263-4b41-b029-f191ceb2d91c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051133 May 19 08:24:23.716367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1078/2092] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:23.775586 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:23.776593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:23.784270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.784719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.785747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:23.786369 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:23.828093 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fea6ee22-1ada-41a7-b5c5-3c3fe9682754 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.057710 May 19 08:24:23.828709 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1015/2093] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:23 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:24.104319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:24.105035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:24.113164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.113774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.114770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.115210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.319237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:24.328909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:24.330454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:24.331612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e442acbf-86eb-4049-aed5-e6dc50934eb6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.232616 May 19 08:24:24.332206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1079/2094] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:24 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:24.483713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:24.484327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:24.491188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.491644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.492436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.492876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.544222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:24.544920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:24.552280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.552805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.553866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.554760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.723500 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:24.736424 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-773b98ad-12bd-4cd3-b442-fee8f8112122 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 0.256612 May 19 08:24:24.749402 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1016/2095] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:24 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:24.756930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:24.765714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-273f4278-b918-4fa7-bc3a-5655416a6179 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.225270 May 19 08:24:24.769404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1080/2096] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:24 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:24.780650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-fa02bc9c-d209-4aa6-a091-25ab0e489133 req-ea0bebf8-5ca1-4a12-a807-534ca9ef78cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "name": "network-vif-unplugged", "status": "completed", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:24.789531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-fa02bc9c-d209-4aa6-a091-25ab0e489133 req-ea0bebf8-5ca1-4a12-a807-534ca9ef78cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.790129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-fa02bc9c-d209-4aa6-a091-25ab0e489133 req-ea0bebf8-5ca1-4a12-a807-534ca9ef78cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.804245 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-fa02bc9c-d209-4aa6-a091-25ab0e489133 req-ea0bebf8-5ca1-4a12-a807-534ca9ef78cc service nova] Creating event network-vif-unplugged:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:24:24.809329 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-fa02bc9c-d209-4aa6-a091-25ab0e489133 req-ea0bebf8-5ca1-4a12-a807-534ca9ef78cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032523 May 19 08:24:24.810567 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1017/2097] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:24.840508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:24.841839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:24.848162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.848734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.850363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:24.850949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:24.885939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85dce373-e89a-4934-a2f5-dddcc7f67ae2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.050154 May 19 08:24:24.886714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1081/2098] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:24 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:24:25.353327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:25.354235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:25.373775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:25.374442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:25.375925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:25.381196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:25.754682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:25.755306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:25.771345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:25.772024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:25.772969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:25.773574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:25.777352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:25.787747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:25.797722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:25.799189 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b34f4e9e-da3d-48b5-94c4-3d656a22c403 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.451817 May 19 08:24:25.820175 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1018/2099] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:25 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:25.826251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:25.827079 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:25.834853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:25.835763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:25.837217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:25.837825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.144276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:26.152743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f7ed752-1f71-4cc1-90e3-a9f9b827be61 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 0.402616 May 19 08:24:26.153576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1082/2100] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:25 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:26.173746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:26.174681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:26.189063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:26.189932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.191707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:26.192302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.230964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e9b648c-b376-4c47-942d-1749714db578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061405 May 19 08:24:26.235537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:26.243873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1083/2101] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:26 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:24:26.248694 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6817231b-30b8-4abf-b36a-85aa107f4dbe tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.426509 May 19 08:24:26.251386 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1019/2102] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:25 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:26.820030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:26.822229 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:26.836830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:26.837609 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.838830 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:26.840696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.893601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:26.894927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:26.910940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:26.918005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.920711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:26.923970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:26.992785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:27.163638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9424670-ef68-4f3d-bad9-c32e2c528b72 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 204 len: 0 microversion: 2.1 time: 0.269145 May 19 08:24:27.166751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1084/2103] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:26 2022] DELETE /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:27.178984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:27.181109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:27.189722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.190593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.192199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.192994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.202675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:27.205641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:27.216796 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:27.218716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:27.220191 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c502b7b1-9d6e-438b-9e40-f5cbc85d3866 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.403968 May 19 08:24:27.221439 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1020/2104] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:26 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:27.227788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:27.228638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:27.238355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.238991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.239922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.240486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.714081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:27.724355 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6b6744dc-954c-4276-aba3-4610ba51f6ce tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1500 microversion: 2.1 time: 0.501157 May 19 08:24:27.725094 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1021/2105] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:27 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1500 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:27.739439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:27.743916 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:27.764040 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.765360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.766155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.766596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.858871 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-81029c81-ecf2-46a5-9dc1-5ef71ddb6ce0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.132615 May 19 08:24:27.859832 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1022/2106] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:24:27 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:27.888461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:27.889073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:27.921201 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.922020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:27.924145 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:27.926138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:28.189171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:28.193779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:28.211248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8e2b49e-40b8-4cdc-a1e6-6726fca671c8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 1.040585 May 19 08:24:28.228483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1085/2107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:27 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:28.228483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5f9957fc-6ef6-4fa0-8576-cf2199a47b8d req-7c8003ff-b26c-4a5f-8056-08fade344fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-plugged", "status": "completed", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:28.246333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5f9957fc-6ef6-4fa0-8576-cf2199a47b8d req-7c8003ff-b26c-4a5f-8056-08fade344fb1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:28.246785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5f9957fc-6ef6-4fa0-8576-cf2199a47b8d req-7c8003ff-b26c-4a5f-8056-08fade344fb1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:28.276005 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5f9957fc-6ef6-4fa0-8576-cf2199a47b8d req-7c8003ff-b26c-4a5f-8056-08fade344fb1 service nova] Creating event network-vif-plugged:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:24:28.286714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5f9957fc-6ef6-4fa0-8576-cf2199a47b8d req-7c8003ff-b26c-4a5f-8056-08fade344fb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065448 May 19 08:24:28.287340 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1086/2108] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:28.302871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:28.303587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:28.317299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:28.321915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:28.324206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:28.326695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:28.780137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:28.800051 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-675bfe3d-c327-4d51-9c2c-12d4ecc5016b tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.937064 May 19 08:24:28.801005 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1023/2109] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:27 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:28.807154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:28.809809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:28.826771 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:28.827233 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:28.828030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:28.828585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:29.072710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:29.083217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:29.108106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:29.110003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f916c2be-3da4-49d6-b3d0-d3f352e5410f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.819744 May 19 08:24:29.110214 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1087/2110] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:28 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:29.235894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:29.239753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:29.250110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:29.251728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:29.254229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:29.255371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:29.293955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:29.307744 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-27d9f309-bd37-4329-ab68-dd4ae0508e5a tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1500 microversion: 2.1 time: 0.504315 May 19 08:24:29.309645 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1024/2111] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:28 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1500 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:29.554326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:29.580917 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86abe5c2-9b5e-4e2a-915c-aeab1dd00f2c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 0.348615 May 19 08:24:29.594333 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1088/2112] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:29 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:29.818292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:29.819148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:29.832039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-258473d0-837c-48f1-91bd-55c7645e5f68 req-a45d7501-2ffe-46b7-86f6-20fac400a8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62299986-c4dc-49cf-9f63-fccde1b436ed", "name": "network-vif-deleted", "tag": "a6ce6c6f-2f39-4049-bf13-b32836bd3d67"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:29.848439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:29.850371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=8 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:29.858923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:29.860285 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:29.863175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:29.863878 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:29.873077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-258473d0-837c-48f1-91bd-55c7645e5f68 req-a45d7501-2ffe-46b7-86f6-20fac400a8e5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:29.873556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-258473d0-837c-48f1-91bd-55c7645e5f68 req-a45d7501-2ffe-46b7-86f6-20fac400a8e5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:29.934125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-258473d0-837c-48f1-91bd-55c7645e5f68 req-a45d7501-2ffe-46b7-86f6-20fac400a8e5 service nova] Creating event network-vif-deleted:a6ce6c6f-2f39-4049-bf13-b32836bd3d67 for instance 62299986-c4dc-49cf-9f63-fccde1b436ed on chh1-842464-2 May 19 08:24:29.952040 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-258473d0-837c-48f1-91bd-55c7645e5f68 req-a45d7501-2ffe-46b7-86f6-20fac400a8e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123842 May 19 08:24:29.957166 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1089/2113] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:30.168842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:30.173896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:30.208841 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:30.222864 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-43f13aca-6d7e-494f-b227-964a09aeff49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.409141 May 19 08:24:30.228743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.230995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.231964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.235187 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1025/2114] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:29 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:30.236944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.325997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:30.329048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:30.337826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.338442 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.339322 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.339756 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.431671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.432464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.433060 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lazy-loading 'fault' on Instance uuid 62299986-c4dc-49cf-9f63-fccde1b436ed {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:30.677642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:30.693257 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-905d9f24-455a-41c2-950a-60eeddcf1e61 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 200 len: 1301 microversion: 2.1 time: 0.370110 May 19 08:24:30.696419 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1026/2115] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:30 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 1301 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:30.702359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-feb76825-9d57-4231-a98d-fd5e0308d792 req-659885a4-9eec-492a-83dc-61701474f698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "name": "network-vif-plugged", "status": "completed", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}, {"server_uuid": "d13633aa-6210-4efa-9610-ec0ae1b75c99", "name": "network-vif-plugged", "status": "completed", "tag": "9ec0d21d-bf64-49f3-b518-13e28672352b"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:30.731438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-feb76825-9d57-4231-a98d-fd5e0308d792 req-659885a4-9eec-492a-83dc-61701474f698 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.732849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-feb76825-9d57-4231-a98d-fd5e0308d792 req-659885a4-9eec-492a-83dc-61701474f698 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.770326 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-feb76825-9d57-4231-a98d-fd5e0308d792 req-659885a4-9eec-492a-83dc-61701474f698 service nova] Creating event network-vif-plugged:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:24:30.771071 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-feb76825-9d57-4231-a98d-fd5e0308d792 req-659885a4-9eec-492a-83dc-61701474f698 service nova] Creating event network-vif-plugged:9ec0d21d-bf64-49f3-b518-13e28672352b for instance d13633aa-6210-4efa-9610-ec0ae1b75c99 on chh1-842464-2 May 19 08:24:30.798289 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-feb76825-9d57-4231-a98d-fd5e0308d792 req-659885a4-9eec-492a-83dc-61701474f698 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097438 May 19 08:24:30.800360 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1027/2116] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:30.814781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:30.818425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:30.850140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:30.862485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.866488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:30.868637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:30.869119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.872807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:30.874254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:30.886742 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93ab6d4d-a43b-49b3-8790-52b2c26c9cc9 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.761761 May 19 08:24:30.902416 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1090/2117] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:30 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:31.243506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:31.245377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:31.273135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.274106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.275218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.275869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.374368 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:31.381993 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1fd45a08-92a8-4c03-bae5-93e04542eee6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 0.579655 May 19 08:24:31.395130 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1028/2118] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:30 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:31.584403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:31.600727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6283bb2-a664-43d4-a413-b6c78264f4ac tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.363403 May 19 08:24:31.602351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1091/2119] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:31 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:31.733722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:31.734836 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: 62299986-c4dc-49cf-9f63-fccde1b436ed] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:31.756473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.761732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.765078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.768678 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.815859 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] HTTP exception thrown: Instance 62299986-c4dc-49cf-9f63-fccde1b436ed could not be found. May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Request method failure captured: May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed HTTP/1.1 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzO4x_i3wgiElttUCdAxEjMoIbzPSVzjzOW0LKbO3Z9OCGPg5ZZqWU-mdob3p17nf55hCebyOZyP2vpq_90b1YeZ0hhWNXk2LDHg-x-ulutkKyFVSin3eZkFrWghv06EzRHS9YE77Xw0N-t4mmesUjKjNdrkScxWD4hk3YrZ6_z0-U May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6704bb799559404288e26a24be6625c7 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-LiveMigrationTest-2054594347 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6704bb799559404288e26a24be6625c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6704bb799559404288e26a24be6625c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-LiveMigrationTest-2054594347 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6704bb799559404288e26a24be6625c7 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-LiveMigrationTest-2054594347 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-LiveMigrationTest-2054594347-project May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 57e320171eec44a8bdb1dcd9e0039226 May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-LiveMigrationTest-2054594347-project May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 62299986-c4dc-49cf-9f63-fccde1b436ed could not be found. May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '62299986-c4dc-49cf-9f63-fccde1b436ed'} May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62299986-c4dc-49cf-9f63-fccde1b436ed could not be found. May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62299986-c4dc-49cf-9f63-fccde1b436ed could not be found. May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:31.835340 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62299986-c4dc-49cf-9f63-fccde1b436ed could not be found. May 19 08:24:31.839960 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:31.842303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Returning 404 to user: Instance 62299986-c4dc-49cf-9f63-fccde1b436ed could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:31.843363 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7550e4c9-333d-44b7-b329-7eb3d1054650 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed" status: 404 len: 111 microversion: 2.1 time: 0.129253 May 19 08:24:31.864187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:31.864973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:31.871795 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1029/2120] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:31 2022] GET /compute/v2.1/servers/62299986-c4dc-49cf-9f63-fccde1b436ed => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:31.873906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.875839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.876875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.890062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.910930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:31.911557 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:31.925108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.927537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.928528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:31.929130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:31.943095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:32.132322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad29bf99-e5e3-4150-a895-28173298b8ee tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 204 len: 0 microversion: 2.1 time: 0.274682 May 19 08:24:32.133835 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1092/2121] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:31 2022] DELETE /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:24:32.143588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:32.146590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:32.162148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:32.163045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:32.166010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:32.169241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:32.340432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:32.358056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:32.361192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:32.362985 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7defd51b-88b7-42b9-9f70-7c72714d2090 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 0.456248 May 19 08:24:32.384911 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1030/2122] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:31 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:24:32.401765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:32.402398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:32.413941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:32.415533 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:32.416715 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:32.417553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:32.759918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:32.774810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d04d6e25-f464-4ebc-bcac-1219681d2c91 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1486 microversion: 2.1 time: 0.637045 May 19 08:24:32.786768 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1093/2123] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:32 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1486 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:32.793860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:32.795348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:32.804482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:32.807620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:32.808669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:32.809384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:32.846208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:32.858519 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7bfa7187-be01-45c4-9acd-318755c2fc18 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1314 microversion: 2.1 time: 0.462348 May 19 08:24:32.859653 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1031/2124] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:32 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:33.228462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:33.237940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c179bcb8-4865-4bf7-9ea2-49d25b080ba0 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1479 microversion: 2.1 time: 0.449653 May 19 08:24:33.249681 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1094/2125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:32 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1479 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:33.396326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:33.397029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:33.415581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:33.428096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:33.429014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:33.429501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:33.792146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:33.793448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:33.801442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:33.807500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:33.814227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:33.815959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:34.549341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:34.573334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:34.579074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:34.584411 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b6439b00-76a6-44ae-b2ad-31d5eb365dda tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1891 microversion: 2.32 time: 1.189421 May 19 08:24:34.587937 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1032/2126] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:33 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1891 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:34.592290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:34.605076 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:34.606970 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:34.616043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7494fe8b-be76-4b5b-a7a9-91509ca0a7e9 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1486 microversion: 2.1 time: 0.825132 May 19 08:24:34.619832 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1095/2127] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:33 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1486 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:34.628477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:34.631295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:34.634230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:34.634908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:34.635092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:34.635716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:34.667223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:34.671213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:34.674351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:34.676465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.061430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:35.077663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-082dcbac-b2f1-4abd-b6b0-c4531ce5eb87 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1464 microversion: 2.1 time: 0.456561 May 19 08:24:35.091120 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1096/2128] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:34 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1464 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:35.117460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:35.120599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:35.142386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.144531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.146173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.148223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.167192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:35.176433 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-91c5a67d-13ba-4ea0-8f11-e6c4f238a6b2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1500 microversion: 2.1 time: 0.586842 May 19 08:24:35.179582 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1033/2129] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:34 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1500 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:35.197132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:35.198684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:35.212271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:35.224531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.225664 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.230474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.230942 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.300161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lazy-loading 'flavor' on Instance uuid d13633aa-6210-4efa-9610-ec0ae1b75c99 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:35.354735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83be2cf7-ebdb-4f2f-808d-3a98987e358d tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 0 microversion: 2.1 time: 0.246623 May 19 08:24:35.358266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1097/2130] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:24:35 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:24:35.370317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:35.372426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:35.396830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.397568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.398546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.399954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.543765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.544217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.544678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lazy-loading 'fault' on Instance uuid 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:35.629796 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0613005b-b9ea-4fad-a925-78320625aa88 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "POST /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99/action" status: 200 len: 32 microversion: 2.1 time: 0.436013 May 19 08:24:35.633939 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1034/2131] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:24:35 2022] POST /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 08:24:35.659928 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-5a6e19cb-cd1d-4db0-9e48-eac0eb316609 req-8f1e063c-d7ab-4b44-877a-50fc95d0344e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93eae31-e24a-436c-bc97-3baa1493eb1c", "name": "network-vif-deleted", "tag": "c1a5faf3-ec9b-44d9-be6b-4d996e247878"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:35.693741 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-5a6e19cb-cd1d-4db0-9e48-eac0eb316609 req-8f1e063c-d7ab-4b44-877a-50fc95d0344e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.695869 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-5a6e19cb-cd1d-4db0-9e48-eac0eb316609 req-8f1e063c-d7ab-4b44-877a-50fc95d0344e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.741484 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-5a6e19cb-cd1d-4db0-9e48-eac0eb316609 req-8f1e063c-d7ab-4b44-877a-50fc95d0344e service nova] Creating event network-vif-deleted:c1a5faf3-ec9b-44d9-be6b-4d996e247878 for instance d93eae31-e24a-436c-bc97-3baa1493eb1c on chh2-842464-2 May 19 08:24:35.752279 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-5a6e19cb-cd1d-4db0-9e48-eac0eb316609 req-8f1e063c-d7ab-4b44-877a-50fc95d0344e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115695 May 19 08:24:35.755735 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1035/2132] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:35.768016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:35.770729 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:35.802266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.803505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:35.805937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:35.808043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.049986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b2758a0-1352-4ab7-9004-882d88f0d977 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1598 microversion: 2.1 time: 0.685122 May 19 08:24:36.053085 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1098/2133] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:35 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1598 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:36.060095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:36.060725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:36.082813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.083501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.084108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.084568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.161339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.161793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.162250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lazy-loading 'fault' on Instance uuid d93eae31-e24a-436c-bc97-3baa1493eb1c {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:36.371468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:36.401038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3138af5-d1ba-4cfe-aff5-63ce490589df tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 200 len: 1301 microversion: 2.1 time: 0.340697 May 19 08:24:36.401038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1099/2134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:36 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 1301 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:36.421936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:36.424206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:36.439892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.441663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.444239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.444710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.457183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:36.538659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:36.555155 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:36.556973 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:36.558231 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-480553ae-e0be-40ce-89ac-deac4639c1f0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.801030 May 19 08:24:36.581689 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1036/2135] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:35 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:36.587675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:36.588927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:36.607815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.618157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.619250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.619832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.623000 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:36.784705 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5cd95109-ec97-4fc0-a012-b2702479f127 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action" status: 202 len: 0 microversion: 2.1 time: 0.201518 May 19 08:24:36.786630 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1037/2136] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:24:36 2022] POST /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:24:36.795814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:36.796818 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:36.811836 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.814839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:36.819277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:36.820044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.078893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:37.088584 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d4c17c1-1789-4eed-b709-98ae13cbe778 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.679709 May 19 08:24:37.099347 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1100/2137] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:36 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:37.193895 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9b548661-f7b3-4591-907d-5ab34d247af8 tempest-ServersAdminTestJSON-312297142 tempest-ServersAdminTestJSON-312297142-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1615 microversion: 2.1 time: 0.399431 May 19 08:24:37.207664 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1038/2138] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:36 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1615 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:37.221057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:37.221627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:37.234283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.234742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.238669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.239125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.302278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:37.414048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:37.415675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: d93eae31-e24a-436c-bc97-3baa1493eb1c] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:37.428520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.432879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.434121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.435546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.487179 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] HTTP exception thrown: Instance d93eae31-e24a-436c-bc97-3baa1493eb1c could not be found. May 19 08:24:37.497286 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb55b0a0-3c2a-4937-8917-d0d440e39020 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 204 len: 0 microversion: 2.1 time: 0.281029 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Request method failure captured: May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c HTTP/1.1 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzO4x_i3wgiElttUCdAxEjMoIbzPSVzjzOW0LKbO3Z9OCGPg5ZZqWU-mdob3p17nf55hCebyOZyP2vpq_90b1YeZ0hhWNXk2LDHg-x-ulutkKyFVSin3eZkFrWghv06EzRHS9YE77Xw0N-t4mmesUjKjNdrkScxWD4hk3YrZ6_z0-U May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6704bb799559404288e26a24be6625c7 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-LiveMigrationTest-2054594347 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6704bb799559404288e26a24be6625c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6704bb799559404288e26a24be6625c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-LiveMigrationTest-2054594347 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6704bb799559404288e26a24be6625c7 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-LiveMigrationTest-2054594347 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-LiveMigrationTest-2054594347-project May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 57e320171eec44a8bdb1dcd9e0039226 May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-LiveMigrationTest-2054594347-project May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance d93eae31-e24a-436c-bc97-3baa1493eb1c could not be found. May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'd93eae31-e24a-436c-bc97-3baa1493eb1c'} May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93eae31-e24a-436c-bc97-3baa1493eb1c could not be found. May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93eae31-e24a-436c-bc97-3baa1493eb1c could not be found. May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:37.498510 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93eae31-e24a-436c-bc97-3baa1493eb1c could not be found. May 19 08:24:37.501874 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:37.506630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Returning 404 to user: Instance d93eae31-e24a-436c-bc97-3baa1493eb1c could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:37.508947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1101/2139] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:37 2022] DELETE /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:37.510529 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d9d92b85-7d95-4e21-ba2e-5f16eeb6cd73 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c" status: 404 len: 111 microversion: 2.1 time: 0.099121 May 19 08:24:37.518000 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1039/2140] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:37 2022] GET /compute/v2.1/servers/d93eae31-e24a-436c-bc97-3baa1493eb1c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:37.530413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:37.533118 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:37.534160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:37.537194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:37.562228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.567265 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.568374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.572154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.573096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.576693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.577415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.580186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.641841 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:37.833753 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a587e02a-9a55-4d74-9ead-1d22158c284e tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 204 len: 0 microversion: 2.1 time: 0.313781 May 19 08:24:37.834491 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1040/2141] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:37 2022] DELETE /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:37.844146 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:37.845919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:37.862929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.864882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.868074 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.868696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.900305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:37.915030 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00a21356-b0c3-4a06-ba1b-2152bf3ca794 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1468 microversion: 2.1 time: 0.400409 May 19 08:24:37.916233 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1102/2142] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:37 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:37.921865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:37.922739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:37.938958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.940393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:37.946430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:37.947214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.259524 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:38.281240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:38.283055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:38.284284 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-853bec7c-6172-4c95-9644-ab47ac516df8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.444603 May 19 08:24:38.295719 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1041/2143] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:37 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:38.295719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:38.295719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:38.307947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:38.308401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.309195 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:38.309659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.509071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:38.520193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1f30635-5bb5-4233-955b-985c1e1a3dbc tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1500 microversion: 2.1 time: 0.602618 May 19 08:24:38.530570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1103/2144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:37 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1500 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:38.662498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:38.675913 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a23bfb4e-eaad-4b5b-ac8f-c4411187a4e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.389975 May 19 08:24:38.676806 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1042/2145] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:38 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:38.727493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:38.728008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:38.735190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:38.735996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.739093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:38.744482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.813118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:38.934459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:38.936022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:38.953629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:38.966141 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.969095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:38.971116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:38.994992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6098b3f-e009-434b-8478-e0629d05abac tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 204 len: 0 microversion: 2.1 time: 0.267952 May 19 08:24:38.996228 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1104/2146] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:38 2022] DELETE /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:39.006243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:39.009231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:39.016268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.016868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.019602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.020163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.510584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:39.515244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:39.521868 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ff6635c4-6b20-4466-9caa-9ca0b64d8e9f tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1468 microversion: 2.1 time: 0.593117 May 19 08:24:39.527979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de677dd4-6a39-4d00-a440-05ba9bc52888 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1666 microversion: 2.1 time: 0.527196 May 19 08:24:39.533492 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1043/2147] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:38 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1468 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:39.539798 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1105/2148] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:38 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1666 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:39.541353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:39.542061 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:39.548727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f859bdbf-b39c-422f-937c-e6b7fcde913f req-75c57910-9e72-40a3-b01c-43ff9c6146ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd25d84e-f3ec-4845-a751-609e31473949", "name": "network-vif-deleted", "tag": "4d3cebd2-0571-4120-b6e1-f2e22fcf9194"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:39.550000 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.550814 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.551919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.552436 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.570037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f859bdbf-b39c-422f-937c-e6b7fcde913f req-75c57910-9e72-40a3-b01c-43ff9c6146ad service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.570568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f859bdbf-b39c-422f-937c-e6b7fcde913f req-75c57910-9e72-40a3-b01c-43ff9c6146ad service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.595263 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f859bdbf-b39c-422f-937c-e6b7fcde913f req-75c57910-9e72-40a3-b01c-43ff9c6146ad service nova] Creating event network-vif-deleted:4d3cebd2-0571-4120-b6e1-f2e22fcf9194 for instance fd25d84e-f3ec-4845-a751-609e31473949 on chh1-842464-2 May 19 08:24:39.610987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f859bdbf-b39c-422f-937c-e6b7fcde913f req-75c57910-9e72-40a3-b01c-43ff9c6146ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069947 May 19 08:24:39.613548 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1106/2149] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:39.621129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:39.621870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:39.642002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.642454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.644468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.644912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.877336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:39.885117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c0de1e8-885f-4702-bcd4-d708409aab7f tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1458 microversion: 2.1 time: 0.270325 May 19 08:24:39.896764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1107/2150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:39 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1458 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:39.902359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:39.904362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:39.914664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.916836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:39.918095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:39.918777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.178847 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:40.192043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:40.206063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:40.207530 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2787bc9c-4950-4145-8523-84dcd84eea06 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.671904 May 19 08:24:40.208440 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1044/2151] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:39 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:40.325848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:40.342825 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78f01339-b6a2-4c9b-98d7-218a58863eea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.444310 May 19 08:24:40.373344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1108/2152] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:39 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:40.542693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:40.542789 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:40.548459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:40.549162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:40.559498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.559958 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.560858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.561510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.565912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.568112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.572642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.575703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.698908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.699668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.700133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lazy-loading 'fault' on Instance uuid 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:40.931868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:40.944509 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-19d3bcbd-444d-4f04-a00e-7c9b74c57161 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 200 len: 1303 microversion: 2.1 time: 0.408200 May 19 08:24:40.947161 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1045/2153] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:40 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 1303 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:40.957006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:40.957906 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:40.971278 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.978247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:40.979856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:40.980540 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:41.086369 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:41.089781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:41.093287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lazy-loading 'fault' on Instance uuid fd25d84e-f3ec-4845-a751-609e31473949 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:41.225344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:41.244273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d76a6bb3-2fbd-4ff2-b125-1abe38a7533b tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1666 microversion: 2.1 time: 0.701420 May 19 08:24:41.248480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1109/2154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:40 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1666 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:41.259367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:41.262213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:41.271196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:41.285226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:41.285997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:41.293796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:41.294376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:41.331737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57e320171eec44a8bdb1dcd9e0039226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6704bb799559404288e26a24be6625c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:41.339929 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-af1c7908-478b-4240-8754-70fd0abfa8f2 tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 200 len: 1301 microversion: 2.1 time: 0.391328 May 19 08:24:41.346059 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1046/2155] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:40 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 1301 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:41.372918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:41.373921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:41.387592 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:41.389999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:41.398631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:41.399654 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.476430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:42.506641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:42.522942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:42.544063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:42.555187 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cb9eabdd-8e0b-485e-b8ac-327ce9a7228a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 1.186119 May 19 08:24:42.556592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-45f9170c-ac1d-4a9b-8cc1-07cc4139811a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 1.299964 May 19 08:24:42.579579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1110/2156] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:41 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:42.594700 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1047/2157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:41 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:42.606119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d125f551-3f83-4312-8625-abfe7a10929a req-32583cb7-cc70-4505-95eb-1b6c63220d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa9990a-e0ce-4fdb-be55-e69b2bd99b37", "name": "network-vif-deleted", "tag": "b33161a8-4035-4c00-a655-d973dd0c030d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:42.607783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:42.608676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:42.628388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d125f551-3f83-4312-8625-abfe7a10929a req-32583cb7-cc70-4505-95eb-1b6c63220d03 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.629270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d125f551-3f83-4312-8625-abfe7a10929a req-32583cb7-cc70-4505-95eb-1b6c63220d03 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.639353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.640466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.648168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d125f551-3f83-4312-8625-abfe7a10929a req-32583cb7-cc70-4505-95eb-1b6c63220d03 service nova] Creating event network-vif-deleted:b33161a8-4035-4c00-a655-d973dd0c030d for instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 on chh2-842464-2 May 19 08:24:42.651109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.653601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.657018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d125f551-3f83-4312-8625-abfe7a10929a req-32583cb7-cc70-4505-95eb-1b6c63220d03 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072287 May 19 08:24:42.658230 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1111/2158] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:42.667403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:42.668556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:42.677788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.678610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.679580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.680835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.748633 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] HTTP exception thrown: Instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 could not be found. May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Request method failure captured: May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 HTTP/1.1 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf45gTOrH5ISTggZDRXtgJVDRNhSRMKY3i_DzXDOiajKxCSAupO_2f9DgYb5hFpkdxWWq740twWsSxc0BUn1vyZPkGv6Qxl0dPh9fQApX69E-PaW7oDUOUMPRSFY9e4dE93-ZQtbJ-kr_dQlFVDmVFpDeEpMYqo7a3ml0-zz5CcxNKw May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6c738a16a46d484f93107c39e225138d May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c738a16a46d484f93107c39e225138d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c738a16a46d484f93107c39e225138d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c738a16a46d484f93107c39e225138d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c738a16a46d484f93107c39e225138d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6c738a16a46d484f93107c39e225138d May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-ServersAdminTestJSON-2103068810-project May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: cff7f11ade014fad83d3020b54a700f0 May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-ServersAdminTestJSON-2103068810-project May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 could not be found. May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '2aa9990a-e0ce-4fdb-be55-e69b2bd99b37'} May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 could not be found. May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 could not be found. May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:42.758880 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 could not be found. May 19 08:24:42.762524 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.771093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Returning 404 to user: Instance 2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:42.774413 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf78bd9e-50ad-43c6-baa2-d656268166d6 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37" status: 404 len: 111 microversion: 2.1 time: 0.177799 May 19 08:24:42.781819 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1048/2159] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:42 2022] GET /compute/v2.1/servers/2aa9990a-e0ce-4fdb-be55-e69b2bd99b37 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:42.805881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:42.818759 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] [instance: fd25d84e-f3ec-4845-a751-609e31473949] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:42.837553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.839111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.840936 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.842367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.891084 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] HTTP exception thrown: Instance fd25d84e-f3ec-4845-a751-609e31473949 could not be found. May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Request method failure captured: May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 HTTP/1.1 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihfzO4x_i3wgiElttUCdAxEjMoIbzPSVzjzOW0LKbO3Z9OCGPg5ZZqWU-mdob3p17nf55hCebyOZyP2vpq_90b1YeZ0hhWNXk2LDHg-x-ulutkKyFVSin3eZkFrWghv06EzRHS9YE77Xw0N-t4mmesUjKjNdrkScxWD4hk3YrZ6_z0-U May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 6704bb799559404288e26a24be6625c7 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-LiveMigrationTest-2054594347 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6704bb799559404288e26a24be6625c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6704bb799559404288e26a24be6625c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6704bb799559404288e26a24be6625c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-LiveMigrationTest-2054594347 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 6704bb799559404288e26a24be6625c7 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-LiveMigrationTest-2054594347 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-LiveMigrationTest-2054594347-project May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 57e320171eec44a8bdb1dcd9e0039226 May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-LiveMigrationTest-2054594347-project May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance fd25d84e-f3ec-4845-a751-609e31473949 could not be found. May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'fd25d84e-f3ec-4845-a751-609e31473949'} May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd25d84e-f3ec-4845-a751-609e31473949 could not be found. May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd25d84e-f3ec-4845-a751-609e31473949 could not be found. May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:42.895645 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd25d84e-f3ec-4845-a751-609e31473949 could not be found. May 19 08:24:42.899595 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:24:42.903347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] Returning 404 to user: Instance fd25d84e-f3ec-4845-a751-609e31473949 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:42.906087 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d05f1fb7-9a44-45ad-a329-3d357d500ece tempest-LiveMigrationTest-2054594347 tempest-LiveMigrationTest-2054594347-project] 10.222.0.78 "GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949" status: 404 len: 111 microversion: 2.1 time: 0.122223 May 19 08:24:42.907484 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1049/2160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:42 2022] GET /compute/v2.1/servers/fd25d84e-f3ec-4845-a751-609e31473949 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:42.918231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:42.927088 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:42.957570 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.966176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:42.969545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:42.969545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:43.077609 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:43.228238 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:43.406909 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3d129fcf-d084-4e84-9dfc-5d60f2c1c126 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "DELETE /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 204 len: 0 microversion: 2.1 time: 0.493012 May 19 08:24:43.408536 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1050/2161] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:42 2022] DELETE /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:43.434924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:43.436214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:43.454477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:43.455501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:43.458134 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:43.459424 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:43.465964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:43.479350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e87de54d-dce8-49e4-9f93-dd490f3b8d76 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1598 microversion: 2.1 time: 0.818847 May 19 08:24:43.481284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1112/2162] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:42 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1598 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:43.597987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:43.599042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:43.622693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:43.623436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:43.624430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:43.625015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:44.814464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:44.825825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:44.838895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:44.840084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:44.841078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0edffb1-cd27-4552-a741-f896879c2225 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 1.247640 May 19 08:24:44.842442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1113/2163] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:43 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:44.857771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:44.858638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:44.869800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:44.870489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:44.872092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:44.872214 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ce2a9161-4616-4e2e-9cda-d77952bafdfb tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1469 microversion: 2.1 time: 1.450485 May 19 08:24:44.872785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:44.876414 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1051/2164] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:43 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1469 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:44.903392 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:44.907356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:44.927470 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:44.928175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:44.930936 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:44.933230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:45.214514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec914fb1a8747798025b5fe0ebb6ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedf9656cdcb41dfb5bf02c3890fd923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:45.239530 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bbc1af2b-9873-409c-bb2d-ac5958063ee8 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 200 len: 1598 microversion: 2.1 time: 0.361934 May 19 08:24:45.240134 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1052/2165] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:44 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 1598 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:45.860240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:45.861825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:45.875841 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:45.879736 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:45.881082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:45.881874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:45.901577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:45.908642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:45.920555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-964ae8e4-b7c7-4669-b950-f57924f2ebe1 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 1.076583 May 19 08:24:45.955829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1114/2166] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:44 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:45.961813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:45.974529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:46.025278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:46.041945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:46.048981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:46.053991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:47.443253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:47.465402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9616c771-5f24-47dd-b277-04824bb572fc tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1469 microversion: 2.1 time: 1.517605 May 19 08:24:47.478871 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1115/2167] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:45 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1469 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:47.485644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9d1b8111-36ad-48f7-a0a6-8b2c5c795fa7 req-4c82bdc6-3907-48c0-a369-1e7ce61d8e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e1bc-4154-40e2-b315-12548c900826", "name": "network-vif-deleted", "tag": "2a7264e7-2314-4256-9ec1-58d7f45b71d7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:47.515801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9d1b8111-36ad-48f7-a0a6-8b2c5c795fa7 req-4c82bdc6-3907-48c0-a369-1e7ce61d8e9b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:47.516250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9d1b8111-36ad-48f7-a0a6-8b2c5c795fa7 req-4c82bdc6-3907-48c0-a369-1e7ce61d8e9b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:47.547935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9d1b8111-36ad-48f7-a0a6-8b2c5c795fa7 req-4c82bdc6-3907-48c0-a369-1e7ce61d8e9b service nova] Creating event network-vif-deleted:2a7264e7-2314-4256-9ec1-58d7f45b71d7 for instance 8bc9e1bc-4154-40e2-b315-12548c900826 on chh1-842464-2 May 19 08:24:47.558139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9d1b8111-36ad-48f7-a0a6-8b2c5c795fa7 req-4c82bdc6-3907-48c0-a369-1e7ce61d8e9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076821 May 19 08:24:47.559117 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1116/2168] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:47.585297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:47.597943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] [instance: 8bc9e1bc-4154-40e2-b315-12548c900826] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:47.607802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:47.625087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:47.626173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:47.626973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:47.627412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:47.644851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:47.653575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:47.656369 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1c2c531b-2a7b-4569-836a-653113577fc4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 1.800031 May 19 08:24:47.659334 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1053/2169] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:45 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:47.690282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:47.691185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:47.707990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:47.708716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:47.714584 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:47.715508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:47.719349 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] HTTP exception thrown: Instance 8bc9e1bc-4154-40e2-b315-12548c900826 could not be found. May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Request method failure captured: May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 HTTP/1.1 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6Ad_6Tpb77Qr9_zfq52sr9tQB11ztZi--v8QbAQDEtylguINPoJoD6EFVA0wg30hyqvsWhJqidmDNdLkGGj1h_g0XPdS-MINq4ybiy2wCeDDWWx5CVYy6qX9KWu5HCmBwi504uYoNXAkrf5_OhbJ59aqFDDldAZ5QP5_UTEMKRk5Q May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: aedf9656cdcb41dfb5bf02c3890fd923 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestFqdnHostnames-1339342326 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aedf9656cdcb41dfb5bf02c3890fd923"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aedf9656cdcb41dfb5bf02c3890fd923"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aedf9656cdcb41dfb5bf02c3890fd923"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aedf9656cdcb41dfb5bf02c3890fd923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestFqdnHostnames-1339342326 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: aedf9656cdcb41dfb5bf02c3890fd923 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1339342326 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestFqdnHostnames-1339342326-project May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: dec914fb1a8747798025b5fe0ebb6ca2 May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestFqdnHostnames-1339342326-project May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8bc9e1bc-4154-40e2-b315-12548c900826 could not be found. May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8bc9e1bc-4154-40e2-b315-12548c900826'} May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc9e1bc-4154-40e2-b315-12548c900826 could not be found. May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc9e1bc-4154-40e2-b315-12548c900826 could not be found. May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:47.723815 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc9e1bc-4154-40e2-b315-12548c900826 could not be found. May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:47.728482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Returning 404 to user: Instance 8bc9e1bc-4154-40e2-b315-12548c900826 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:47.731514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08695ec4-fa33-4e57-924f-b9ae6307a8ef tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826" status: 404 len: 111 microversion: 2.1 time: 0.166907 May 19 08:24:47.735022 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1117/2170] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:47 2022] GET /compute/v2.1/servers/8bc9e1bc-4154-40e2-b315-12548c900826 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:47.749769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92f5defb-4ce0-4f24-89c7-da3cb93c6694 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] Calling method '.version_select at 0x7f3211ef6310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:47.797478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92f5defb-4ce0-4f24-89c7-da3cb93c6694 tempest-ServersTestFqdnHostnames-1339342326 tempest-ServersTestFqdnHostnames-1339342326-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365724906" status: 202 len: 0 microversion: 2.1 time: 0.057316 May 19 08:24:47.798451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1118/2171] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365724906 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:24:48.457614 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:48.466102 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f97a51c6-919e-44ea-b97b-bb162717a3af tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.805507 May 19 08:24:48.466682 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1054/2172] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:47 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:48.487932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:48.488630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:48.507907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:48.512462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:48.516064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:48.516556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:48.679714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:48.681548 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:48.698231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:48.703897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:48.705031 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:48.708301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:48.994703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:49.007361 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aeefc545-13f1-4760-a8dd-4e6df7778840 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1469 microversion: 2.1 time: 0.525670 May 19 08:24:49.017255 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1119/2173] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:48 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1469 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:49.372537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:49.400629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:49.405053 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:49.407665 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-915e2d62-4bde-4e54-8c3d-4a6965ece711 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.732445 May 19 08:24:49.433231 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1055/2174] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:48 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:24:49.484260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:49.484887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:49.492877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:49.493453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:49.494132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:49.494573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:49.625295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-6c8f3bc1-3424-462d-9b13-7e350e1ecfe9 req-7723f373-64d6-4419-bcb7-b9c29ef809d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb4daca-bf3f-4a95-a693-fd3444e52ab2", "name": "network-vif-deleted", "tag": "7b487261-76e6-4c5d-b3b7-baa36518fdb6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:49.639394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6c8f3bc1-3424-462d-9b13-7e350e1ecfe9 req-7723f373-64d6-4419-bcb7-b9c29ef809d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:49.654940 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-6c8f3bc1-3424-462d-9b13-7e350e1ecfe9 req-7723f373-64d6-4419-bcb7-b9c29ef809d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:49.740102 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-6c8f3bc1-3424-462d-9b13-7e350e1ecfe9 req-7723f373-64d6-4419-bcb7-b9c29ef809d5 service nova] Creating event network-vif-deleted:7b487261-76e6-4c5d-b3b7-baa36518fdb6 for instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 on chh2-842464-2 May 19 08:24:49.749147 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-6c8f3bc1-3424-462d-9b13-7e350e1ecfe9 req-7723f373-64d6-4419-bcb7-b9c29ef809d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150462 May 19 08:24:49.750237 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1056/2175] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:24:49.904636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:49.913583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aefc5b40-063c-4867-a419-e1dc32a7a39d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.433227 May 19 08:24:49.914996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1120/2176] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:49 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:49.967594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:49.970007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:49.996261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:49.998745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.001416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.004057 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.029820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:50.031916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:50.073722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.074223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.076749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.077791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.238406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.238885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.240493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lazy-loading 'fault' on Instance uuid acb4daca-bf3f-4a95-a693-fd3444e52ab2 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:24:50.385574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:50.405816 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf6292fb-09b7-4791-85a2-36869d8dc650 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 200 len: 1304 microversion: 2.1 time: 0.385576 May 19 08:24:50.406753 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1121/2177] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:50 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 1304 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:50.434264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:50.435218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:50.442543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.443490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.444403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.445660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.487448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:50.504705 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7ad25d88-181e-470e-90a3-4ad42ceb51ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.543791 May 19 08:24:50.513822 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1057/2178] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:49 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:50.929937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:50.932283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:50.932970 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:50.943160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:50.944235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.944701 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.947509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:50.953946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:50.953946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:50.956840 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a18c9d68-e2da-40a5-bfe1-f446b538e2bc tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.531240 May 19 08:24:50.957809 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1122/2179] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:50 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:51.173597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:51.188372 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b6ba17b3-dba3-4be6-89fb-be3df0a1bfef tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.260394 May 19 08:24:51.189191 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1058/2180] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:50 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:51.423038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:51.423443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: acb4daca-bf3f-4a95-a693-fd3444e52ab2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:51.441034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.442994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.444486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.444892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.482734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] HTTP exception thrown: Instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 could not be found. May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Request method failure captured: May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 HTTP/1.1 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf45gTOrH5ISTggZDRXtgJVDRNhSRMKY3i_DzXDOiajKxCSAupO_2f9DgYb5hFpkdxWWq740twWsSxc0BUn1vyZPkGv6Qxl0dPh9fQApX69E-PaW7oDUOUMPRSFY9e4dE93-ZQtbJ-kr_dQlFVDmVFpDeEpMYqo7a3ml0-zz5CcxNKw May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6c738a16a46d484f93107c39e225138d May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c738a16a46d484f93107c39e225138d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c738a16a46d484f93107c39e225138d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c738a16a46d484f93107c39e225138d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c738a16a46d484f93107c39e225138d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6c738a16a46d484f93107c39e225138d May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminTestJSON-2103068810-project May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cff7f11ade014fad83d3020b54a700f0 May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminTestJSON-2103068810-project May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 could not be found. May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'acb4daca-bf3f-4a95-a693-fd3444e52ab2'} May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 could not be found. May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 could not be found. May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:51.484298 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 could not be found. May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Returning 404 to user: Instance acb4daca-bf3f-4a95-a693-fd3444e52ab2 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3933943-f8f1-456d-9f88-23e4f108ee49 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2" status: 404 len: 111 microversion: 2.1 time: 0.067115 May 19 08:24:51.487646 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1123/2181] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:51 2022] GET /compute/v2.1/servers/acb4daca-bf3f-4a95-a693-fd3444e52ab2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:51.494374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:51.495263 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:51.501769 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.502352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.503262 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.503828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.540464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:51.541721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:51.555488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.563251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.572868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:24:51.578034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.579858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.822371 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0b29cca1-7ab0-4955-aff4-89a61ee7d58a tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 204 len: 0 microversion: 2.1 time: 0.331565 May 19 08:24:51.826195 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1059/2182] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:24:51 2022] DELETE /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:24:51.842764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:51.843479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:51.863141 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.863601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.864404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:51.864854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:51.936159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:51.954243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-386aab99-311a-4b89-b40b-da65213c2cdc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.417439 May 19 08:24:51.956958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1124/2183] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:51 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:51.975215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-304677406"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:51.976466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:52.012100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:52.012614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:52.015125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:52.015627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:52.450363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:52.463471 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e6752975-ef86-48f3-bb75-f1b665a206c4 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1470 microversion: 2.1 time: 0.635099 May 19 08:24:52.467798 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1060/2184] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:51 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1470 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:52.484846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:52.485513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:52.509212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:52.515491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:52.522669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:52.523171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:52.563195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1637d06-9bc5-4b6f-ad35-d1cad1e43590 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.591579 May 19 08:24:52.567871 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1125/2185] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:24:51 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) May 19 08:24:52.578488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:52.579197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:52.594807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:52.602680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:52.603781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:52.604377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:53.147564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:53.166602 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51fd82ae-1702-4f00-ba46-092a0807649b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.601661 May 19 08:24:53.172828 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1126/2186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:52 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:53.341432 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:53.361021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:53.364832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:53.369979 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a8f54f7c-6873-489b-8308-80415d0c158a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.900267 May 19 08:24:53.370885 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1061/2187] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:52 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:53.530965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:53.536762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:53.565681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:53.566165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:53.566966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:53.567407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:54.069431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:54.079060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9471d646-8b9e-414f-a1c1-2e9ee198ce05 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1470 microversion: 2.1 time: 0.587816 May 19 08:24:54.094665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1127/2188] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:53 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1470 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:54.189704 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:54.190444 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:54.205108 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:54.205811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:54.212121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:54.213069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:54.399331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:54.399850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:54.414396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:54.415220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:54.416360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:54.417067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:55.068377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:55.080069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:55.081616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:55.082818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dad98fbf-6801-4a4e-bde9-cbf56546215a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.696223 May 19 08:24:55.094385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1128/2189] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:54 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:55.110785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:55.111651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:55.122218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:55.124961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:55.126312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:55.129898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:55.250461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cff7f11ade014fad83d3020b54a700f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c738a16a46d484f93107c39e225138d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:55.266075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88c02f96-045c-48fe-8599-50068a9254c2 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 200 len: 1428 microversion: 2.1 time: 0.159087 May 19 08:24:55.266986 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1129/2190] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:55 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:55.342362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-767aa9c8-c298-4024-9555-48d52273d8f1 req-b05f65cf-eb6d-4b06-8eb9-d3f98c87dd47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1", "name": "network-vif-deleted", "tag": "dd13febf-dcad-48fb-98c3-63b39cf9e3d8"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:55.357809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-767aa9c8-c298-4024-9555-48d52273d8f1 req-b05f65cf-eb6d-4b06-8eb9-d3f98c87dd47 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:55.369344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-767aa9c8-c298-4024-9555-48d52273d8f1 req-b05f65cf-eb6d-4b06-8eb9-d3f98c87dd47 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:55.373725 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:55.408052 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-48fdad33-e1e6-43c2-ad45-e52be9b8bf6c tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 1.222416 May 19 08:24:55.410457 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1062/2191] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:54 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:55.422756 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-767aa9c8-c298-4024-9555-48d52273d8f1 req-b05f65cf-eb6d-4b06-8eb9-d3f98c87dd47 service nova] Creating event network-vif-deleted:dd13febf-dcad-48fb-98c3-63b39cf9e3d8 for instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 on chh2-842464-2 May 19 08:24:55.432007 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-767aa9c8-c298-4024-9555-48d52273d8f1 req-b05f65cf-eb6d-4b06-8eb9-d3f98c87dd47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097305 May 19 08:24:55.438292 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1130/2192] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 08:24:56.126336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:56.127152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:56.141952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:56.142411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:56.143213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:56.143650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:56.387153 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1018064740", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:56.478766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:24:56.807230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:56.822137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:56.823637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:56.825081 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4f98e1a-22ce-4c46-ab7d-f19382ae39ab tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.703635 May 19 08:24:56.825683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1131/2193] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:56 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:56.837353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:56.837990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] [instance: 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:56.858487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:56.858487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:56.859224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:56.859668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:56.891166 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] HTTP exception thrown: Instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 could not be found. May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Request method failure captured: May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 HTTP/1.1 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf45gTOrH5ISTggZDRXtgJVDRNhSRMKY3i_DzXDOiajKxCSAupO_2f9DgYb5hFpkdxWWq740twWsSxc0BUn1vyZPkGv6Qxl0dPh9fQApX69E-PaW7oDUOUMPRSFY9e4dE93-ZQtbJ-kr_dQlFVDmVFpDeEpMYqo7a3ml0-zz5CcxNKw May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6c738a16a46d484f93107c39e225138d May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c738a16a46d484f93107c39e225138d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c738a16a46d484f93107c39e225138d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c738a16a46d484f93107c39e225138d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c738a16a46d484f93107c39e225138d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6c738a16a46d484f93107c39e225138d May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminTestJSON-2103068810 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminTestJSON-2103068810-project May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cff7f11ade014fad83d3020b54a700f0 May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminTestJSON-2103068810-project May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 could not be found. May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1'} May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 could not be found. May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 could not be found. May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:24:56.892899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 could not be found. May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] Returning 404 to user: Instance 4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b229d1ac-90e0-41ef-babf-7d0d08e7b334 tempest-ServersAdminTestJSON-2103068810 tempest-ServersAdminTestJSON-2103068810-project] 10.222.0.78 "GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1" status: 404 len: 111 microversion: 2.1 time: 0.067767 May 19 08:24:56.896236 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1132/2194] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:56 2022] GET /compute/v2.1/servers/4afe78ed-e6da-4bd8-aa1f-03dbe19d49b1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:24:56.912928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:56.913581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:56.937661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:56.938180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:56.939086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:56.939582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:57.011454 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:24:57.011955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:24:57.012546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:24:57.013006 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:24:57.013449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:24:57.041010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:57.042316 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:57.043517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:57.044159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:57.092605 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Getting quotas for project 416bd02add2542bba2e724ee9e42578b. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:24:57.108221 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Getting quotas for user e0ab94e75e8246b5bbec881f6cdd4f6e and project 416bd02add2542bba2e724ee9e42578b. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:24:57.143922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:24:57.150330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:24:57.277892 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-93858f2e-7384-4ec6-9fc0-898d4d75f811 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171607 May 19 08:24:57.285873 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1063/2195] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:24:57.297079 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-30d7d667-0384-4dea-b604-98efc44e15f7 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:57.298023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-30d7d667-0384-4dea-b604-98efc44e15f7 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:57.343472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:57.352957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-899695b7-de0a-408f-abcc-82a318c73e01 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.456907 May 19 08:24:57.358538 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1133/2196] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:56 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:57.611721 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-30d7d667-0384-4dea-b604-98efc44e15f7 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:57.634735 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-30d7d667-0384-4dea-b604-98efc44e15f7 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1223 microversion: 2.1 time: 0.342055 May 19 08:24:57.660829 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1064/2197] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:57 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1223 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:24:57.850312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:57.852593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:57.879231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:57.879993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:57.886476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:57.890058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:57.909586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:57.917295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-8a8f5986-7532-4540-a94d-7360a2111a7a req-2ac0fc70-1c3d-4d58-9aad-3a4a97540399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "1ade10ca-5a76-44a1-b65c-a3621244ef74"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:24:57.937652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:24:57.966119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8a8f5986-7532-4540-a94d-7360a2111a7a req-2ac0fc70-1c3d-4d58-9aad-3a4a97540399 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:57.973638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-8a8f5986-7532-4540-a94d-7360a2111a7a req-2ac0fc70-1c3d-4d58-9aad-3a4a97540399 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:58.031088 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-8a8f5986-7532-4540-a94d-7360a2111a7a req-2ac0fc70-1c3d-4d58-9aad-3a4a97540399 service nova] Creating event network-vif-plugged:1ade10ca-5a76-44a1-b65c-a3621244ef74 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:24:58.062132 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-8a8f5986-7532-4540-a94d-7360a2111a7a req-2ac0fc70-1c3d-4d58-9aad-3a4a97540399 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144302 May 19 08:24:58.064935 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1065/2198] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:24:58.377158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:58.377902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:58.396297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:58.396612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:58.400417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:58.400867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:59.216028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:59.238571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:59.249204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:59.258319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43b9dfd4-91fe-424f-9b00-a5c228fb2837 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 1.416087 May 19 08:24:59.265892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1134/2199] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:24:57 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:24:59.277226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:24:59.292704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:24:59.314630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:59.319572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:59.322894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:24:59.326188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:24:59.426815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:59.441988 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2b51762e-e328-4a64-bbab-da4c61b0da02 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 1.064567 May 19 08:24:59.445580 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1066/2200] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:58 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:24:59.531570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:24:59.541995 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-792cd645-6826-4f73-9b76-0836923196a8 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1275 microversion: 2.1 time: 0.274650 May 19 08:24:59.542589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1135/2201] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:24:59 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:00.283112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:00.284056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:00.296179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.296945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:00.298011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.298659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:00.392132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d3603806-abfe-47dc-9106-6cfcc0dbdbc1 req-fee60b59-02af-47ee-aec0-838a30c81030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "e8fc8d94-8d22-41a4-9fca-3e3794bcefc1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:00.412601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d3603806-abfe-47dc-9106-6cfcc0dbdbc1 req-fee60b59-02af-47ee-aec0-838a30c81030 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.416517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d3603806-abfe-47dc-9106-6cfcc0dbdbc1 req-fee60b59-02af-47ee-aec0-838a30c81030 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:00.451243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d3603806-abfe-47dc-9106-6cfcc0dbdbc1 req-fee60b59-02af-47ee-aec0-838a30c81030 service nova] Creating event network-vif-plugged:e8fc8d94-8d22-41a4-9fca-3e3794bcefc1 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:00.465886 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d3603806-abfe-47dc-9106-6cfcc0dbdbc1 req-fee60b59-02af-47ee-aec0-838a30c81030 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078294 May 19 08:25:00.467353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1136/2202] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:25:00.484097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:00.490486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:00.507982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.509816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:00.515081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.515818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:00.770940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:00.787003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ca9c2ad-7a09-48ed-b5d6-539c89b7eb2a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.317175 May 19 08:25:00.798723 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1137/2203] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:00 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:00.819438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:00.821075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:00.857104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.863348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:00.867578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:00.872434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:01.088285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:01.096807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2aafa35e-aef8-414c-bad0-85edda5da32c tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1281 microversion: 2.1 time: 0.296472 May 19 08:25:01.108637 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1138/2204] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:00 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:01.113912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:01.127958 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:01.137352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:01.142498 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2692a1df-2977-4ae0-9458-c3bd106bb002 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.866244 May 19 08:25:01.157341 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1067/2205] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:00 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:01.805560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:01.806174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:01.824965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:01.832896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:01.838531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:01.838981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:02.114366 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:02.115251 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:02.136909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:02.140309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:02.143562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:02.145405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:02.233294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:02.573947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:02.582803 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3bcc66d0-0e9f-4f5d-9351-1ff6b23dbac6 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1281 microversion: 2.1 time: 0.472291 May 19 08:25:02.583399 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1068/2206] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:02 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1281 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:25:02.610762 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:02.611422 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:02.644223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:02.644683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:02.645542 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:02.657127 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:03.089268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:03.112777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:03.119702 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:03.124521 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b1b60a4c-254a-4130-8499-5510331daa1a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.539874 May 19 08:25:03.128162 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1069/2207] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:02 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:03.144726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-b001f891-bf8a-41d9-ab25-03a28fdb4baa req-b21383e0-e7bb-4b86-bff4-8c0a031a715e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "80c46ebd-c10d-4225-b559-8c49f3a69aee"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:03.145829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:03.154466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ca541b1-71bc-47c4-8cbc-2646c1457950 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 1.353992 May 19 08:25:03.155052 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1139/2208] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:01 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:03.162760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b001f891-bf8a-41d9-ab25-03a28fdb4baa req-b21383e0-e7bb-4b86-bff4-8c0a031a715e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:03.163556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b001f891-bf8a-41d9-ab25-03a28fdb4baa req-b21383e0-e7bb-4b86-bff4-8c0a031a715e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:03.202748 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-b001f891-bf8a-41d9-ab25-03a28fdb4baa req-b21383e0-e7bb-4b86-bff4-8c0a031a715e service nova] Creating event network-vif-plugged:80c46ebd-c10d-4225-b559-8c49f3a69aee for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:03.215694 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-b001f891-bf8a-41d9-ab25-03a28fdb4baa req-b21383e0-e7bb-4b86-bff4-8c0a031a715e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084800 May 19 08:25:03.218798 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1070/2209] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:03.600328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:03.600891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:03.610786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:03.611244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:03.612034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:03.612473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:04.147664 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:04.149642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:04.187999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:04.193676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:04.198297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:04.201738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:04.484283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:04.497431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8c7d8f7-2f6f-4470-bf92-c3b091ddb77f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1323 microversion: 2.1 time: 0.901137 May 19 08:25:04.506930 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1140/2210] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:03 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1323 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:04.527426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:04.528455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:04.566633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:04.568702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:04.575817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:04.577183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:05.437286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:05.449119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:05.455425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:05.467060 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4883686c-d6b9-4a63-9c88-110db7c9d166 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 1.326013 May 19 08:25:05.482340 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1071/2211] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:04 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:05.487956 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab"}, {"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-plugged", "status": "completed", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "b1328560-4eff-4a93-823e-a34547baed16"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:05.498965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:05.499725 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:05.517129 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] Creating event network-vif-plugged:b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:05.518068 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] Creating event network-vif-plugged:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:25:05.518779 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] Creating event network-vif-plugged:b1328560-4eff-4a93-823e-a34547baed16 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:05.526342 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-cbe1f83e-7bcf-4c7c-a21e-46152f79166e req-950615ab-45d3-4cd4-9393-c88ad4ad18d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042275 May 19 08:25:05.527797 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1072/2212] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:05.794808 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-479809188", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:05.906982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:25:05.925129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:05.938262 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-406a8a62-e617-44d6-8983-78d9b39b2c38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 1.426023 May 19 08:25:05.954135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1141/2213] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:04 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:05.959541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:05.960535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:05.968044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:05.968867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:05.969900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:05.970556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:06.976573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:06.996453 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36dd3b48-68b1-4388-8f34-1d46ca8c57dc tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1323 microversion: 2.1 time: 1.040717 May 19 08:25:07.000741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1142/2214] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:05 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1323 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:07.061266 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:07.115261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-768607995", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:07.128512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:07.130052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:07.130968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:07.131593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:07.132440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:07.178121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:07.182035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:07.183414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:07.184224 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:07.214733 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Getting quotas for project fffd387929ad41e1baae24bc7f67966c. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:07.227422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:25:07.232648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Getting quotas for user 3bd0897e5f8d4eafb9a723dffb403ab5 and project fffd387929ad41e1baae24bc7f67966c. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:07.265553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:07.267961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:07.385445 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-95df0f10-572c-4e29-8058-b220c3321d86 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.855400 May 19 08:25:07.389639 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1073/2215] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:25:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:25:07.424056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:07.424693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:07.448531 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:07.448905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:07.453564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:07.454022 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:08.275933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:08.295348 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:08.296912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:08.307949 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2081f09b-4caf-44c0-8e7e-09aff0c6bb1b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 0.898414 May 19 08:25:08.309145 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1074/2216] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:07 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:08.314007 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:08.315008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:08.332631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:08.333408 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:08.334367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:08.334944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:08.634758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:08.643087 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a939d326-7158-4dae-ba59-b2c7b9886eaa tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.332651 May 19 08:25:08.653965 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1075/2217] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:08 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:08.659174 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:08.660136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:08.670928 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:08.686960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:08.688203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:08.688844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:08.909099 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:08.927558 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cb0e5557-8974-4271-bad0-6740e875341b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1265 microversion: 2.1 time: 0.272190 May 19 08:25:08.945405 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1076/2218] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:08 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:08.973675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-9d417325-85ba-458e-904f-3968f91a9883 req-9ea005fb-a81e-4a86-a591-839308a1c33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a6511a-72d2-4039-ad3d-82d76892b6b0", "tag": "cfd06d78-9d75-4cf0-9d15-e1ee162bcdc7"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:08.995866 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9d417325-85ba-458e-904f-3968f91a9883 req-9ea005fb-a81e-4a86-a591-839308a1c33d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:08.996437 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-9d417325-85ba-458e-904f-3968f91a9883 req-9ea005fb-a81e-4a86-a591-839308a1c33d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.026789 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-9d417325-85ba-458e-904f-3968f91a9883 req-9ea005fb-a81e-4a86-a591-839308a1c33d service nova] Creating event network-changed:cfd06d78-9d75-4cf0-9d15-e1ee162bcdc7 for instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 on chh1-842464-2 May 19 08:25:09.039062 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-9d417325-85ba-458e-904f-3968f91a9883 req-9ea005fb-a81e-4a86-a591-839308a1c33d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091864 May 19 08:25:09.044781 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1077/2219] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:09.054496 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-b522eeff-a6fb-4c27-a599-13793d73f222 req-8400c093-bad8-4e8d-bba0-e77a71248894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "5d2075ad-5696-49b2-8373-97e00abd0329"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-plugged", "status": "completed", "tag": "16d3d764-2d91-4ed4-9a5f-8f83a9f4f980"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:09.103241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b522eeff-a6fb-4c27-a599-13793d73f222 req-8400c093-bad8-4e8d-bba0-e77a71248894 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.113923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-b522eeff-a6fb-4c27-a599-13793d73f222 req-8400c093-bad8-4e8d-bba0-e77a71248894 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.157994 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-b522eeff-a6fb-4c27-a599-13793d73f222 req-8400c093-bad8-4e8d-bba0-e77a71248894 service nova] Creating event network-vif-plugged:5d2075ad-5696-49b2-8373-97e00abd0329 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:09.166114 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-b522eeff-a6fb-4c27-a599-13793d73f222 req-8400c093-bad8-4e8d-bba0-e77a71248894 service nova] Creating event network-vif-plugged:16d3d764-2d91-4ed4-9a5f-8f83a9f4f980 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:09.172222 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-b522eeff-a6fb-4c27-a599-13793d73f222 req-8400c093-bad8-4e8d-bba0-e77a71248894 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125540 May 19 08:25:09.173671 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1078/2220] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:09.183430 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:09.184461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:09.203952 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.204596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.206621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.207225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.571884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:09.573176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:09.573931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:09.575698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:09.576305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:09.601657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.604082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.606621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.607230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.647320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:09.666330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:09.684067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:09.691683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:09.809762 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfd98f13-d53a-4957-8729-d69b3ef15b96 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.804175 May 19 08:25:09.811911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1143/2221] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:25:09.830562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:09.837648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:09.878200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.880071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.881402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:09.887243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:09.948429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:09.968071 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4ad956e5-3092-470b-85b6-f38c89f5352e tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1323 microversion: 2.1 time: 0.792975 May 19 08:25:09.970062 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1079/2222] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:09 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1323 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:09.984364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:09.988784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:10.024680 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:10.025634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:10.026867 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:10.027983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:10.899709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:10.914204 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-797016a6-21f9-4b76-9977-f348da388826 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1506 microversion: 2.1 time: 0.940089 May 19 08:25:10.915478 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1080/2223] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:09 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1506 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:10.928227 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:10.929955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:10.944129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:10.945848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:10.950235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:10.951303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:11.512000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:11.548201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:11.551491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:11.552718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8dbaad9-8b88-4465-8d43-d94c83c71692 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1879 microversion: 2.32 time: 1.737886 May 19 08:25:11.558031 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1144/2224] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:09 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1879 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:11.564622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:11.570804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:11.572918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:11.579241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:11.580709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:11.581798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:11.582244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:11.870382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:11.901846 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-517cb97d-6fe6-493d-be0c-31668fa35e0a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1218 microversion: 2.1 time: 0.974191 May 19 08:25:11.912121 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1081/2225] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:10 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1218 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:11.954441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:11.955096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:12.012758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:12.017897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:12.022833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:12.028566 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:14.045434 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:14.067772 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-029267ff-73d5-4fbe-977f-0cf6495992f4 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1323 microversion: 2.1 time: 2.145996 May 19 08:25:14.072440 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1082/2226] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:11 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1323 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:14.094722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:14.098829 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:14.128129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:14.129520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:14.135003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:14.135785 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:14.212652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:14.223229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69eca0a5-6672-4d8f-8be1-62a38db3010e tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 2.663835 May 19 08:25:14.223822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1145/2227] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:11 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 2665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:14.243698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:14.244193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:14.269614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:14.275695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:14.276578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:14.277021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:15.527117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:15.544008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:15.555584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:15.563410 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de035199-d0f7-42db-aa65-8e860b2b2789 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2830 microversion: 2.32 time: 1.338534 May 19 08:25:15.571890 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1146/2228] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:14 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2830 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:15.591295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:15.592593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:15.614775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:15.615668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:15.618408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:15.621918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:15.680845 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:15.709279 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-644613fb-626b-4d0b-b947-680a39bda94d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1486 microversion: 2.1 time: 1.631821 May 19 08:25:15.711862 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1083/2229] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:14 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1486 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:15.744327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-0858a64a-cb34-4242-826f-21f8d6c7d23f req-8f4b84d6-c100-4d9f-9d70-19b7f94cf0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a6511a-72d2-4039-ad3d-82d76892b6b0", "name": "network-vif-plugged", "status": "completed", "tag": "cfd06d78-9d75-4cf0-9d15-e1ee162bcdc7"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:15.779317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0858a64a-cb34-4242-826f-21f8d6c7d23f req-8f4b84d6-c100-4d9f-9d70-19b7f94cf0ea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:15.782460 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-0858a64a-cb34-4242-826f-21f8d6c7d23f req-8f4b84d6-c100-4d9f-9d70-19b7f94cf0ea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:15.835568 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-0858a64a-cb34-4242-826f-21f8d6c7d23f req-8f4b84d6-c100-4d9f-9d70-19b7f94cf0ea service nova] Creating event network-vif-plugged:cfd06d78-9d75-4cf0-9d15-e1ee162bcdc7 for instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 on chh1-842464-2 May 19 08:25:15.862977 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-0858a64a-cb34-4242-826f-21f8d6c7d23f req-8f4b84d6-c100-4d9f-9d70-19b7f94cf0ea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138117 May 19 08:25:15.863601 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1084/2230] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:15.888650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:15.889951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:15.914909 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:15.930455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:15.932720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:15.935520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:16.033792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:16.054375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08c19977-4938-41fd-b37c-9116c1cf9d1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1272 microversion: 2.1 time: 0.471350 May 19 08:25:16.067461 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1147/2231] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:15 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1272 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:16.073755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:16.074950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:16.087595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:16.088164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:16.097367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:16.097597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:16.553229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:16.568087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f1e7702-3f67-4e38-9f2d-2c3cc0a7d804 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 0.498986 May 19 08:25:16.577605 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1148/2232] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:16 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:16.577605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:16.577605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:16.585950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:16.595967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:16.597038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:16.597475 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6d2dc3d0-07df-4e86-acd6-3b7b2a616208 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1323 microversion: 2.1 time: 0.730582 May 19 08:25:16.598172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:16.599235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:16.621630 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1085/2233] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:15 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1323 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:16.635181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1579969502", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:16.730371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] validate_networks() for [('df976f3f-de22-4a84-9855-b6cebddc479b', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:25:17.123135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbbfc40a-86f5-492c-b9e1-d1ed01661e5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.552926 May 19 08:25:17.123914 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1149/2234] 10.222.0.78 () {60 vars in 1315 bytes} [Thu May 19 08:25:16 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e/os-interface => generated 1830 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:17.129562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:17.130616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:17.170143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:17.175211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:17.176171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:17.181183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:17.204885 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:17.256714 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=14 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:17.461814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:17.488998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb04b661-04f2-4889-bccc-40ad11a1a52d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1272 microversion: 2.1 time: 0.361356 May 19 08:25:17.502683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1150/2235] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:17 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1272 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:17.521077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3baa3158-7664-43fe-92d3-293f5e6f0e46 req-3d55812d-99fb-413e-bfa2-ad27f25cdfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a231d457-6981-4c74-8722-8d3917904e71", "tag": "338c34ec-a985-4270-84fe-958125d181dd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:17.566789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3baa3158-7664-43fe-92d3-293f5e6f0e46 req-3d55812d-99fb-413e-bfa2-ad27f25cdfe4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3baa3158-7664-43fe-92d3-293f5e6f0e46 req-3d55812d-99fb-413e-bfa2-ad27f25cdfe4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3baa3158-7664-43fe-92d3-293f5e6f0e46 req-3d55812d-99fb-413e-bfa2-ad27f25cdfe4 service nova] Creating event network-changed:338c34ec-a985-4270-84fe-958125d181dd for instance a231d457-6981-4c74-8722-8d3917904e71 on chh2-842464-2 May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3baa3158-7664-43fe-92d3-293f5e6f0e46 req-3d55812d-99fb-413e-bfa2-ad27f25cdfe4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091179 May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1151/2236] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:17.637971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:18.472338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:18.487481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56af4a4f-7328-46bb-8b41-dfd7d9cc4a3b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 0.889347 May 19 08:25:18.490833 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1152/2237] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:17 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:18.520559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:18.524926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:18.543682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:18.544632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:18.545645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:18.549600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:18.567097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:19.272132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:19.273739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:19.275439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:19.276036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:19.276606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:19.289910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:19.290645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:19.291831 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:19.293021 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:19.318356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Getting quotas for project 7b66ea12d6964ec68ba46b8305b68cef. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:19.326856 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Getting quotas for user c7922e2a372443b1b1330dd16ba60b4e and project 7b66ea12d6964ec68ba46b8305b68cef. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:19.348168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:19.351133 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:19.376170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:19.388076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b51c152-3e74-46f1-b44f-975e736fd56f tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1472 microversion: 2.1 time: 0.872361 May 19 08:25:19.389626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1153/2238] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:18 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1472 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:19.403849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:19.404787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:19.412489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:19.413396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:19.423902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:19.424585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:19.451780 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a25ce0c-5917-44ab-95db-0ba95202b272 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.828719 May 19 08:25:19.463412 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1086/2239] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:25:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:25:19.471016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1130933030", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b"}], "block_device_mapping_v2": [{"uuid": "74d37aa1-9420-4ac1-a6bc-c3f22b7b501c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:19.598168 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] validate_networks() for [('b8b1ccff-9b69-4373-a7d2-c9fd7f6fe92b', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:25:19.626108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:19.677193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:20.126589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:20.141281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9d442d9-d321-4e0f-a675-99a3b4f92cf1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.749670 May 19 08:25:20.146575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1154/2240] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:19 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:20.159885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d84d6d0e-ed45-4eb5-9b84-38f9c76c63d1 req-0d9c0179-2023-4278-a1f2-91dd559a4cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "tag": "e8fc8d94-8d22-41a4-9fca-3e3794bcefc1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:20.183670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d84d6d0e-ed45-4eb5-9b84-38f9c76c63d1 req-0d9c0179-2023-4278-a1f2-91dd559a4cea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.184124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d84d6d0e-ed45-4eb5-9b84-38f9c76c63d1 req-0d9c0179-2023-4278-a1f2-91dd559a4cea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:20.217660 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d84d6d0e-ed45-4eb5-9b84-38f9c76c63d1 req-0d9c0179-2023-4278-a1f2-91dd559a4cea service nova] Creating event network-changed:e8fc8d94-8d22-41a4-9fca-3e3794bcefc1 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:25:20.235362 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d84d6d0e-ed45-4eb5-9b84-38f9c76c63d1 req-0d9c0179-2023-4278-a1f2-91dd559a4cea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085255 May 19 08:25:20.239109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1155/2241] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:20.253719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:20.255010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:20.285544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.286391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:20.287353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.287998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:20.346298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Request method failure captured: May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0/diagnostics HTTP/1.1 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7W-Rx5zBcZAIlgh4T-8Ot-TD0jlMb26G73TanrElhDVvfoKdvJHrJtobSkHta6Zzjxtl05cSukGlqniqWCu2WdJ4WMMX7uttkTEgb8pf3WuChqK94nYlXfDeHJ0f7XO7VRGljqIhr27qCF7lAQp3lUXDx6-HoBr8X_k_ZVQY84hTM May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 416bd02add2542bba2e724ee9e42578b May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-896210031 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/416bd02add2542bba2e724ee9e42578b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/416bd02add2542bba2e724ee9e42578b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_416bd02add2542bba2e724ee9e42578b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/416bd02add2542bba2e724ee9e42578b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-896210031 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 416bd02add2542bba2e724ee9e42578b May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-896210031 May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerDiagnosticsNegativeTest-896210031-project May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e0ab94e75e8246b5bbec881f6cdd4f6e May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-896210031-project May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '26a6511a-72d2-4039-ad3d-82d76892b6b0'} May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:20.359143 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:20.363346 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:20.363346 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:20.363346 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:25:20.363346 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:25:20.363346 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 19 08:25:20.363346 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:20.364669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:25:20.365720 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d65dbf63-7f84-49cb-aae6-4d5d6c4d4b70 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.125014 May 19 08:25:20.366780 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1156/2242] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:25:20 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0/diagnostics => generated 117 bytes in 127 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:25:20.375481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:20.377681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:20.394137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.399581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:20.402309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.402923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:20.707052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:20.716267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f789e805-6ea4-41f9-878b-e2636394f2bf tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1218 microversion: 2.1 time: 0.348254 May 19 08:25:20.716858 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1157/2243] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:20 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1218 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:20.733469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:20.734101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:20.752200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.752665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:20.753494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:20.753946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.223755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:21.233231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c15c2f82-9d7f-4f42-b924-2374455ffa9d tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 0.515267 May 19 08:25:21.236514 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1158/2244] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:20 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:21.252676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:21.265257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:21.273861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:21.274364 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:21.274865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:21.275465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:21.277521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:21.297573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.298030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.298881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.299253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.303080 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.304370 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.305511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.306140 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.353081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:21.366052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Getting quotas for user 024724b24b274d7db1c43874767de143 and project a9217796f39e4b02b0c09a4aaf552190. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:21.424164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:25:21.497360 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:21.501062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74d37aa1-9420-4ac1-a6bc-c3f22b7b501c',volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:21.697729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0330ba23-c2c5-4708-be97-49ede0971004 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "DELETE /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 204 len: 0 microversion: 2.1 time: 0.456551 May 19 08:25:21.700059 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1159/2245] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:25:21 2022] DELETE /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:25:21.723007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:21.727984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:21.740689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.742865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.746662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.748260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:21.929883 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d04c93b5-078e-48cc-97fe-0c25f0ce9958 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.465049 May 19 08:25:21.937333 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1087/2246] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:25:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2473 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:25:21.964910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-20e7219d-30ea-4020-98d8-bbd6345b6235 req-3d1b44e7-a564-491b-b749-9dd7f3f4e259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7978275d-cb9b-440e-9a41-14a9abc98448", "tag": "969d881b-2c8e-4205-aa52-a43784044d2d"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:21.985871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-20e7219d-30ea-4020-98d8-bbd6345b6235 req-3d1b44e7-a564-491b-b749-9dd7f3f4e259 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:21.988815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-20e7219d-30ea-4020-98d8-bbd6345b6235 req-3d1b44e7-a564-491b-b749-9dd7f3f4e259 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:22.062508 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-20e7219d-30ea-4020-98d8-bbd6345b6235 req-3d1b44e7-a564-491b-b749-9dd7f3f4e259 service nova] Creating event network-changed:969d881b-2c8e-4205-aa52-a43784044d2d for instance 7978275d-cb9b-440e-9a41-14a9abc98448 on chh1-842464-2 May 19 08:25:22.086819 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-20e7219d-30ea-4020-98d8-bbd6345b6235 req-3d1b44e7-a564-491b-b749-9dd7f3f4e259 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144839 May 19 08:25:22.087430 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1088/2247] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:22.106047 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:22.113648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:22.138440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:22.142232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:22.148612 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:22.152363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:22.541517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:22.555785 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf0d7398-f857-4c18-bea6-f8fa2708a5bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.838493 May 19 08:25:22.556454 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1160/2248] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:21 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:22.561012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:22.561691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:22.622749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:22.623350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:22.624197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:22.635242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:22.933828 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:22.947680 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e7a08df5-d31a-4e7f-9671-3e9acd0174f3 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1478 microversion: 2.1 time: 0.856632 May 19 08:25:22.953846 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1089/2249] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:22 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1478 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:22.966256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:22.973002 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:22.990666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:22.993347 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:22.994319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:22.998062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:23.114893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:23.146334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36a2f571-f5db-4a6f-abfb-3db0b9b123dd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1272 microversion: 2.1 time: 0.580203 May 19 08:25:23.166851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1161/2250] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:22 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1272 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:23.221763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:23.225281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:23.247612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:23.249339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:23.251638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:23.252621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:23.306676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:23.311472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:23.318968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:23.324719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:23.334312 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-31515afc-35c1-4fe5-a5f5-197e63426273 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1185 microversion: 2.25 time: 0.378901 May 19 08:25:23.337131 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1090/2251] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:22 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1185 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:23.580338 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:23.582087 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:23.597020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:23.602125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:23.603325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:23.607308 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:24.341903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:24.360709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b62afa6-7514-4d7c-b881-6e1c96f0895b tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 1.192391 May 19 08:25:24.375788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1162/2252] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:23 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:24.393504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:24.395396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:24.396488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:24.405866 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-45393b9c-fa9f-488c-a335-d620ae462641 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.834988 May 19 08:25:24.410539 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1091/2253] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:23 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:24.428272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:24.428272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:24.428272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:24.428272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:24.433743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:24.437625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:24.458240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:24.458989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:24.462187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:24.462908 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.335319 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:25.349650 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1f282d87-6b6d-4dae-8648-0b0df51e8b8a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.924601 May 19 08:25:25.367439 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1092/2254] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:24 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:25.387464 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:25.388860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:25.409611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.410120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.411268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.411844 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.598883 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:25.609595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:25.621379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:25.622814 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6d5e5982-5f6a-4be4-9e13-06313c4af357 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1251 microversion: 2.25 time: 0.254657 May 19 08:25:25.627375 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1093/2255] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:25 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1251 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:25.633906 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a28b8626-f709-453a-89b7-06ce78454467 req-53caab1c-4b59-48d3-ab3a-2055b913843f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231d457-6981-4c74-8722-8d3917904e71", "name": "network-vif-plugged", "status": "completed", "tag": "338c34ec-a985-4270-84fe-958125d181dd"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:25.653489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:25.669668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a28b8626-f709-453a-89b7-06ce78454467 req-53caab1c-4b59-48d3-ab3a-2055b913843f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.672179 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a28b8626-f709-453a-89b7-06ce78454467 req-53caab1c-4b59-48d3-ab3a-2055b913843f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.745767 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a28b8626-f709-453a-89b7-06ce78454467 req-53caab1c-4b59-48d3-ab3a-2055b913843f service nova] Creating event network-vif-plugged:338c34ec-a985-4270-84fe-958125d181dd for instance a231d457-6981-4c74-8722-8d3917904e71 on chh2-842464-2 May 19 08:25:25.765784 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a28b8626-f709-453a-89b7-06ce78454467 req-53caab1c-4b59-48d3-ab3a-2055b913843f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136832 May 19 08:25:25.772080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ab94e75e8246b5bbec881f6cdd4f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '416bd02add2542bba2e724ee9e42578b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:25.781461 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1094/2256] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:25.786419 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1036e12-2e0c-4a71-bb32-5bf7f59b2552 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 200 len: 1478 microversion: 2.1 time: 1.407678 May 19 08:25:25.797121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1163/2257] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:24 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 1478 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:25.800341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:25.817875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:25.818640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:25.836263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:25.852481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.852958 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.857759 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.858213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.864463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.864980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:25.865912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:25.866382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:26.698340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:26.704255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:26.711989 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f60ebb61-edba-459f-a3be-bc1e66efb9d0 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 0.927365 May 19 08:25:26.718031 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1095/2258] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:25 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:26.723561 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-c95b5428-0779-4983-b661-ba8336d81c25 req-8edc3a9c-95b5-4d2c-b599-ea64b625b363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a6511a-72d2-4039-ad3d-82d76892b6b0", "name": "network-vif-deleted", "tag": "cfd06d78-9d75-4cf0-9d15-e1ee162bcdc7"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:26.731441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13a5eb98-9fbd-4c9f-9250-0d0b0634e87a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.933071 May 19 08:25:26.747751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1164/2259] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:25 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:26.750974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c95b5428-0779-4983-b661-ba8336d81c25 req-8edc3a9c-95b5-4d2c-b599-ea64b625b363 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:26.751713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-c95b5428-0779-4983-b661-ba8336d81c25 req-8edc3a9c-95b5-4d2c-b599-ea64b625b363 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:26.765979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1258fc7c-793d-4182-ae98-008dbe9c785a req-4204f5e1-a420-44fb-a431-40d4511a313a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365b103e-7914-4f7c-a05e-38a781ec2b84", "tag": "86171350-e229-401c-a171-6ec18297f34c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:26.778604 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-c95b5428-0779-4983-b661-ba8336d81c25 req-8edc3a9c-95b5-4d2c-b599-ea64b625b363 service nova] Creating event network-vif-deleted:cfd06d78-9d75-4cf0-9d15-e1ee162bcdc7 for instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 on chh1-842464-2 May 19 08:25:26.793333 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-c95b5428-0779-4983-b661-ba8336d81c25 req-8edc3a9c-95b5-4d2c-b599-ea64b625b363 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073638 May 19 08:25:26.795466 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1096/2260] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:26.801619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1258fc7c-793d-4182-ae98-008dbe9c785a req-4204f5e1-a420-44fb-a431-40d4511a313a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:26.802164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1258fc7c-793d-4182-ae98-008dbe9c785a req-4204f5e1-a420-44fb-a431-40d4511a313a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:26.808904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:26.809872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:26.823422 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:26.826371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:26.828449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:26.829480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:26.847108 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1258fc7c-793d-4182-ae98-008dbe9c785a req-4204f5e1-a420-44fb-a431-40d4511a313a service nova] Creating event network-changed:86171350-e229-401c-a171-6ec18297f34c for instance 365b103e-7914-4f7c-a05e-38a781ec2b84 on chh2-842464-2 May 19 08:25:26.870706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1258fc7c-793d-4182-ae98-008dbe9c785a req-4204f5e1-a420-44fb-a431-40d4511a313a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121552 May 19 08:25:26.878237 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1165/2261] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:26.891244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:26.900881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:26.923113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:26.923943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:26.924898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:26.925516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:27.361459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:27.371950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:27.374034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:27.375829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03e7afdf-4eb9-4f43-ae80-9389a3a5f3c2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.496359 May 19 08:25:27.387542 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1166/2262] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:26 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:27.392761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:27.393718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] [instance: 26a6511a-72d2-4039-ad3d-82d76892b6b0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:27.402192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:27.403021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:27.404159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:27.404904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:27.424748 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] HTTP exception thrown: Instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 could not be found. May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Request method failure captured: May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 HTTP/1.1 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7W-Rx5zBcZAIlgh4T-8Ot-TD0jlMb26G73TanrElhDVvfoKdvJHrJtobSkHta6Zzjxtl05cSukGlqniqWCu2WdJ4WMMX7uttkTEgb8pf3WuChqK94nYlXfDeHJ0f7XO7VRGljqIhr27qCF7lAQp3lUXDx6-HoBr8X_k_ZVQY84hTM May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 416bd02add2542bba2e724ee9e42578b May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-896210031 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/416bd02add2542bba2e724ee9e42578b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/416bd02add2542bba2e724ee9e42578b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_416bd02add2542bba2e724ee9e42578b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/416bd02add2542bba2e724ee9e42578b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-896210031 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 416bd02add2542bba2e724ee9e42578b May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-896210031 May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerDiagnosticsNegativeTest-896210031-project May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e0ab94e75e8246b5bbec881f6cdd4f6e May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-896210031-project May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 could not be found. May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '26a6511a-72d2-4039-ad3d-82d76892b6b0'} May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 could not be found. May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 could not be found. May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:27.431786 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 could not be found. May 19 08:25:27.435239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:27.440938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] Returning 404 to user: Instance 26a6511a-72d2-4039-ad3d-82d76892b6b0 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:25:27.442078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c8966c6-00b5-43f4-8d98-8a04ce36f6b5 tempest-ServerDiagnosticsNegativeTest-896210031 tempest-ServerDiagnosticsNegativeTest-896210031-project] 10.222.0.78 "GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0" status: 404 len: 111 microversion: 2.1 time: 0.053297 May 19 08:25:27.442844 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1167/2263] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:27 2022] GET /compute/v2.1/servers/26a6511a-72d2-4039-ad3d-82d76892b6b0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:25:27.505399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:27.520844 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f2ac56f0-cd6c-4abf-9581-a231ae4807c0 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.723883 May 19 08:25:27.523162 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1097/2264] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:26 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:27.600434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:27.601609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:27.612031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:27.612913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:27.614077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:27.614739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:27.734653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:27.736051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:27.750902 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:27.751591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:27.752629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:27.753396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.032150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.044099 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.058891 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8db11cba-5aa2-4e8e-92dc-8a5d67960984 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1313 microversion: 2.1 time: 0.328019 May 19 08:25:28.060524 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1098/2265] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:27 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:25:28.065807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:28.066185 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf55fa9e-66db-4496-93c6-73b648329e8d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.472107 May 19 08:25:28.066823 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1168/2266] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:27 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:25:28.067125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:28.077242 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:28.078331 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.079803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:28.080393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.394948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:28.395499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:28.408843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:28.409347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.414721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:28.415192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.549238 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.566887 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-92cbf1ab-32f8-4d1f-ba43-f82ae07db92f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.505023 May 19 08:25:28.567484 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1099/2267] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:28 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:28.572472 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:28.573078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:28.591461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:28.591905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.592681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:28.593112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:28.851636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.861029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.863024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.864774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5377d54-6749-448f-8c38-dc2a83ed3a76 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.474166 May 19 08:25:28.867169 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1169/2268] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:28 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:25:28.901293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:28.927790 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bc7acddd-c828-4b09-ab4d-0d7bcf429199 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.359206 May 19 08:25:28.930199 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1100/2269] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:28 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:29.079612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:29.080294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:29.088357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:29.088984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:29.096486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.097542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:29.098411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.100215 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.104453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:29.104850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:29.105716 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.106162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:29.158186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:29.447733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:29.452850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:29.457126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bb81b56-83d2-4e5b-ab7c-3610b676c081 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1462 microversion: 2.1 time: 0.382200 May 19 08:25:29.458542 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1170/2270] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:29 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1462 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:29.468482 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e7638d39-d33e-4f95-b6f0-1ee60dcddf93 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.383808 May 19 08:25:29.471272 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1101/2271] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:29 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:29.472190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cee4537e-f65f-4158-aba8-9487f68d1351 req-2e7d7941-f6e5-42d1-ac60-f6637338fd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b79bad-0fe9-46cb-9eca-4ccbe3e70234", "tag": "456143eb-7f9b-4b6f-a56e-75a2953883c6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:29.490070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cee4537e-f65f-4158-aba8-9487f68d1351 req-2e7d7941-f6e5-42d1-ac60-f6637338fd98 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.490922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cee4537e-f65f-4158-aba8-9487f68d1351 req-2e7d7941-f6e5-42d1-ac60-f6637338fd98 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:29.508937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cee4537e-f65f-4158-aba8-9487f68d1351 req-2e7d7941-f6e5-42d1-ac60-f6637338fd98 service nova] Creating event network-changed:456143eb-7f9b-4b6f-a56e-75a2953883c6 for instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 on chh1-842464-2 May 19 08:25:29.514780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cee4537e-f65f-4158-aba8-9487f68d1351 req-2e7d7941-f6e5-42d1-ac60-f6637338fd98 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054785 May 19 08:25:29.516167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1171/2272] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:29.521948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-630102765"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:29.524354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:29.532807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.534095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:29.535191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:29.535893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.038678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b44d1ca-4a54-4c77-94f7-cd8e514ca045 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.520300 May 19 08:25:30.040104 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1172/2273] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:25:29 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 19 08:25:30.050532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:30.051509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:30.061795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.062541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.073160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.074012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.286041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a8de7697-ac5e-46e8-96b7-b6309c719acd tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Calling method '.version_select at 0x7f32117ef280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:30.300734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8de7697-ac5e-46e8-96b7-b6309c719acd tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.301585 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8de7697-ac5e-46e8-96b7-b6309c719acd tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.341367 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8de7697-ac5e-46e8-96b7-b6309c719acd tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.343857 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a8de7697-ac5e-46e8-96b7-b6309c719acd tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.374331 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a8de7697-ac5e-46e8-96b7-b6309c719acd tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/fffd387929ad41e1baae24bc7f67966c?start=2022-05-18T08%3A25%3A29.469911&end=2022-05-20T08%3A25%3A29.469911" status: 200 len: 694 microversion: 2.1 time: 0.899640 May 19 08:25:30.377533 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1102/2274] 10.222.0.78 () {58 vars in 1411 bytes} [Thu May 19 08:25:29 2022] GET /compute/v2.1/os-simple-tenant-usage/fffd387929ad41e1baae24bc7f67966c?start=2022-05-18T08%3A25%3A29.469911&end=2022-05-20T08%3A25%3A29.469911 => generated 694 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:30.384376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:30.385243 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:30.394809 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.395769 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.396720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.397495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.677234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:30.700051 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5def800b-4d95-45d1-99d8-ca4d5a0933cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.656397 May 19 08:25:30.700859 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1173/2275] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:30 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:30.717704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:30.719437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:30.740609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.745154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.746615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.747513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.854640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:30.864681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:30.868593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:30.869790 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4ff2f212-b843-4f23-b6cb-8e26e8e251ee tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.491032 May 19 08:25:30.887757 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1103/2276] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:30 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:30.903193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:30.903193 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:30.915269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.915805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:30.916677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:30.917194 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.057851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:31.071077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5227b05f-d484-4fa9-b4c5-4a0d82b77aca tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.367449 May 19 08:25:31.073243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1174/2277] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:30 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:31.083859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7023ee87-88d9-417c-8a02-a3e353b62e49 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '.version_select at 0x7f3212182550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:31.102456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7023ee87-88d9-417c-8a02-a3e353b62e49 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.108822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7023ee87-88d9-417c-8a02-a3e353b62e49 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.147920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7023ee87-88d9-417c-8a02-a3e353b62e49 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.159704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7023ee87-88d9-417c-8a02-a3e353b62e49 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.203902 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7023ee87-88d9-417c-8a02-a3e353b62e49 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/fffd387929ad41e1baae24bc7f67966c?start=2022-05-18T08%3A25%3A29.469911&end=2022-05-20T08%3A25%3A29.469911" status: 200 len: 694 microversion: 2.1 time: 0.125120 May 19 08:25:31.211699 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1175/2278] 10.222.0.78 () {58 vars in 1411 bytes} [Thu May 19 08:25:31 2022] GET /compute/v2.1/os-simple-tenant-usage/fffd387929ad41e1baae24bc7f67966c?start=2022-05-18T08%3A25%3A29.469911&end=2022-05-20T08%3A25%3A29.469911 => generated 694 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:31.223569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-39986722-d2ac-4444-b9af-9fda0481c9ae req-a3b1490c-9ca4-4fb2-8a27-ddd878b7be13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7978275d-cb9b-440e-9a41-14a9abc98448", "name": "network-vif-plugged", "status": "completed", "tag": "969d881b-2c8e-4205-aa52-a43784044d2d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:31.254425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-39986722-d2ac-4444-b9af-9fda0481c9ae req-a3b1490c-9ca4-4fb2-8a27-ddd878b7be13 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.262006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-39986722-d2ac-4444-b9af-9fda0481c9ae req-a3b1490c-9ca4-4fb2-8a27-ddd878b7be13 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.292921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-39986722-d2ac-4444-b9af-9fda0481c9ae req-a3b1490c-9ca4-4fb2-8a27-ddd878b7be13 service nova] Creating event network-vif-plugged:969d881b-2c8e-4205-aa52-a43784044d2d for instance 7978275d-cb9b-440e-9a41-14a9abc98448 on chh1-842464-2 May 19 08:25:31.309724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-39986722-d2ac-4444-b9af-9fda0481c9ae req-a3b1490c-9ca4-4fb2-8a27-ddd878b7be13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088973 May 19 08:25:31.310723 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1176/2279] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:31.317032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0fa80d9-3cac-49fb-b943-ec1009729553 tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Calling method '.version_select at 0x7f3211f02280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:31.345721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0fa80d9-3cac-49fb-b943-ec1009729553 tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.346177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0fa80d9-3cac-49fb-b943-ec1009729553 tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.393535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0fa80d9-3cac-49fb-b943-ec1009729553 tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.394010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0fa80d9-3cac-49fb-b943-ec1009729553 tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.394289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=12 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:31.515525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0fa80d9-3cac-49fb-b943-ec1009729553 tempest-TenantUsagesTestJSON-1262816873 tempest-TenantUsagesTestJSON-1262816873-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T08%3A25%3A29.469911&end=2022-05-20T08%3A25%3A29.469911&detailed=1" status: 200 len: 27131 microversion: 2.1 time: 0.203295 May 19 08:25:31.516357 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:31.516999 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1177/2280] 10.222.0.78 () {58 vars in 1334 bytes} [Thu May 19 08:25:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-18T08%3A25%3A29.469911&end=2022-05-20T08%3A25%3A29.469911&detailed=1 => generated 27131 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:25:31.526272 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d5813b2f-725f-4b26-b831-5beb2b01b95f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.637040 May 19 08:25:31.537139 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1104/2281] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:30 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:31.562925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:31.563798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:31.577902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.578666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.583719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.584628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.651599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:25:31.727813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:31.728459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:31.753118 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.755392 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.756237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.764404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.870454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db335c22-b99c-4605-8a60-f812037b1d70 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 204 len: 0 microversion: 2.1 time: 0.310861 May 19 08:25:31.874261 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1178/2282] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:25:31 2022] DELETE /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:25:31.891522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:31.892430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:31.909646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.910377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:31.911414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:31.912951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.160008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.172936 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-db9313e8-6eb6-46ee-8585-caac8eca32a7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1314 microversion: 2.1 time: 0.458852 May 19 08:25:32.175042 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1105/2283] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:31 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:25:32.189924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:32.190757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:32.200875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.206093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:32.207189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.208610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:32.209250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.216964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ba955ad-d6c5-4989-9b8d-32cdea29250a tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1468 microversion: 2.1 time: 0.333847 May 19 08:25:32.217944 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1179/2284] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:31 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:32.230651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:32.232428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:32.256684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:32.257709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.259393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:32.259965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.452712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.466507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.469681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.479246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-450084ea-cc5f-486b-9bab-7714e0c85677 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.257294 May 19 08:25:32.493346 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1180/2285] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:32 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:32.493568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.493568 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a56662c2-00fd-4fe4-90dc-536d6538b932 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.305773 May 19 08:25:32.493568 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1106/2286] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:32 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:32.546300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:32.547021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:32.555501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:32.557439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.558447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:32.559028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:32.745121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:32.754708 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2802592-3d21-4fa0-84c2-0dfee3c3f5c0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1686 microversion: 2.1 time: 0.213928 May 19 08:25:32.755285 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1181/2287] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:32 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1686 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:33.207271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:33.207936 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:33.223929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.224352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.226773 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.227230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.234735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:33.235353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:33.257214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.257671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.258654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.259071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.621962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:33.633273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de190999-0e82-4524-a39b-2ca38168a3f1 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1468 microversion: 2.1 time: 0.402246 May 19 08:25:33.633902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1182/2288] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:33 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:33.666071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d6464ad3-26c5-48ab-90d4-86d5f0053296 req-932890ef-2885-4444-a9f8-956d362c2f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-unplugged", "status": "completed", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:33.685007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d6464ad3-26c5-48ab-90d4-86d5f0053296 req-932890ef-2885-4444-a9f8-956d362c2f93 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.686528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d6464ad3-26c5-48ab-90d4-86d5f0053296 req-932890ef-2885-4444-a9f8-956d362c2f93 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.712478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d6464ad3-26c5-48ab-90d4-86d5f0053296 req-932890ef-2885-4444-a9f8-956d362c2f93 service nova] Creating event network-vif-unplugged:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:25:33.725028 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:33.735046 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e01eee55-224d-442f-8dc9-f86abcf2b422 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1498 microversion: 2.1 time: 0.545828 May 19 08:25:33.737042 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d6464ad3-26c5-48ab-90d4-86d5f0053296 req-932890ef-2885-4444-a9f8-956d362c2f93 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091906 May 19 08:25:33.738149 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1107/2289] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:33 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1498 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:33.740298 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1183/2290] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:33.754963 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:33.758593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:33.768776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:33.770080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:33.784861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.787568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.788779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.790971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.791749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.795142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:33.796278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:33.796927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.245252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:34.259578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:34.267313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:34.268600 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0cda4077-1f57-4132-82d8-11328b41327c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.525790 May 19 08:25:34.269296 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1184/2291] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:33 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:34.288462 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:34.306912 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a58b3fe5-c87e-4e2c-a560-bac62d629c63 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.567328 May 19 08:25:34.308450 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1108/2292] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:33 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:34.318349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:34.324941 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:34.326036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:34.332682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.333792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:34.335297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.339835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.340843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.352204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.355052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.356318 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.358439 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.401217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:25:34.405070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:34.505513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:34.599410 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3fe65bc2-e650-45fc-add9-2faf284e071c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 204 len: 0 microversion: 2.1 time: 0.305534 May 19 08:25:34.603763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1185/2293] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:25:34 2022] DELETE /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:25:34.654455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:34.668596 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bf508e2a-2ac6-41af-9224-939f1e696065 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1686 microversion: 2.1 time: 0.347584 May 19 08:25:34.670216 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1109/2294] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:34 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1686 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:34.685236 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-70dce3ce-4422-412f-9e32-bdee72236ae6 req-15f91d5d-09c9-4697-bfea-ea77a40ca3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a231d457-6981-4c74-8722-8d3917904e71", "name": "network-vif-deleted", "tag": "338c34ec-a985-4270-84fe-958125d181dd"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:34.697081 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-70dce3ce-4422-412f-9e32-bdee72236ae6 req-15f91d5d-09c9-4697-bfea-ea77a40ca3b6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.697850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-70dce3ce-4422-412f-9e32-bdee72236ae6 req-15f91d5d-09c9-4697-bfea-ea77a40ca3b6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.711248 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-70dce3ce-4422-412f-9e32-bdee72236ae6 req-15f91d5d-09c9-4697-bfea-ea77a40ca3b6 service nova] Creating event network-vif-deleted:338c34ec-a985-4270-84fe-958125d181dd for instance a231d457-6981-4c74-8722-8d3917904e71 on chh2-842464-2 May 19 08:25:34.718210 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-70dce3ce-4422-412f-9e32-bdee72236ae6 req-15f91d5d-09c9-4697-bfea-ea77a40ca3b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046376 May 19 08:25:34.718968 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1110/2295] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:34.726608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:34.728799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:34.737111 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.737734 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.738725 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.739355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.791311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-90241930", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": "none"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:34.797155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:34.851644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:34.852406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:34.853184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:34.853785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:34.854357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:34.867030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.867692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.868798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.869459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.891824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Getting quotas for project 2808e28b254a4d768473ef06df34a0eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:34.898663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Getting quotas for user 65d7e0861c454ab291b01b0e5f267059 and project 2808e28b254a4d768473ef06df34a0eb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:34.914550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:34.929536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:34.944995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:34.956926 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fb83bc0d-00d8-45d5-92e8-a05a2428219c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1504 microversion: 2.1 time: 0.236416 May 19 08:25:34.970000 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1111/2296] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:34 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:34.982640 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:34.984770 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:34.991415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.991848 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:34.992826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:34.993256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.004749 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0910f394-b6d9-4aaa-9477-3d13d7049b70 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.399635 May 19 08:25:35.005678 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1186/2297] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:25:35.017728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0abaf5f6-e468-4c16-bf09-60dbf2160af3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:35.019170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0abaf5f6-e468-4c16-bf09-60dbf2160af3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:35.114147 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.114932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.115513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lazy-loading 'fault' on Instance uuid a231d457-6981-4c74-8722-8d3917904e71 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:25:35.175347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0abaf5f6-e468-4c16-bf09-60dbf2160af3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.203733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0abaf5f6-e468-4c16-bf09-60dbf2160af3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.211953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0abaf5f6-e468-4c16-bf09-60dbf2160af3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.238474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0abaf5f6-e468-4c16-bf09-60dbf2160af3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "PUT /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1357 microversion: 2.75 time: 0.224371 May 19 08:25:35.241417 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1187/2298] 10.222.0.78 () {62 vars in 1296 bytes} [Thu May 19 08:25:35 2022] PUT /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:35.258228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55df5e09-a685-408e-b63f-c048501d44f0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:35.260758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55df5e09-a685-408e-b63f-c048501d44f0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:35.268784 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bd0897e5f8d4eafb9a723dffb403ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffd387929ad41e1baae24bc7f67966c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.301404 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b5497a8a-fe3a-43a6-8304-1256af85c6b5 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 200 len: 1303 microversion: 2.1 time: 0.329996 May 19 08:25:35.313387 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1112/2299] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:34 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 1303 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:35.318310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:35.319788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:35.327580 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.328536 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.329882 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.330953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.356869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55df5e09-a685-408e-b63f-c048501d44f0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.365524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55df5e09-a685-408e-b63f-c048501d44f0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.367319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55df5e09-a685-408e-b63f-c048501d44f0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.374626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55df5e09-a685-408e-b63f-c048501d44f0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1357 microversion: 2.75 time: 0.120898 May 19 08:25:35.397397 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1188/2300] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:35 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1357 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:35.404641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:35.405264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:35.418652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.420196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.422209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.423287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.634490 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.647703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.650709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.652697 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bad65c11-edac-4320-bf61-917e6eb94ad3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.338061 May 19 08:25:35.653808 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1113/2301] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:35 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:35.709645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:35.711143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:35.734639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.735777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.737646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.738872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.746001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:35.760504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-861f659c-6804-495c-8c61-b4c3671a372d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.371504 May 19 08:25:35.766207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1189/2302] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:35 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:35.797727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-29df3c04-d0ab-4b30-9136-88e9263e7158 req-9bdebb70-9e3e-4cea-806c-ccfca789e1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365b103e-7914-4f7c-a05e-38a781ec2b84", "name": "network-vif-plugged", "status": "completed", "tag": "86171350-e229-401c-a171-6ec18297f34c"}, {"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-plugged", "status": "completed", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:35.814521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29df3c04-d0ab-4b30-9136-88e9263e7158 req-9bdebb70-9e3e-4cea-806c-ccfca789e1a3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.815007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29df3c04-d0ab-4b30-9136-88e9263e7158 req-9bdebb70-9e3e-4cea-806c-ccfca789e1a3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.843992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-29df3c04-d0ab-4b30-9136-88e9263e7158 req-9bdebb70-9e3e-4cea-806c-ccfca789e1a3 service nova] Creating event network-vif-plugged:86171350-e229-401c-a171-6ec18297f34c for instance 365b103e-7914-4f7c-a05e-38a781ec2b84 on chh2-842464-2 May 19 08:25:35.844466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-29df3c04-d0ab-4b30-9136-88e9263e7158 req-9bdebb70-9e3e-4cea-806c-ccfca789e1a3 service nova] Creating event network-vif-plugged:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:25:35.872951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-29df3c04-d0ab-4b30-9136-88e9263e7158 req-9bdebb70-9e3e-4cea-806c-ccfca789e1a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081169 May 19 08:25:35.874009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1190/2303] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:35.980005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:35.981107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:35.989771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.990599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:35.991983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:35.992500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.003558 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:36.028472 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-64926e92-e2f1-4494-89ba-0c7a21b36241 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.336788 May 19 08:25:36.029364 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1114/2304] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:35 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:36.250136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:36.260022 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d066e38-4d03-48e0-9662-89d6a124c787 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1504 microversion: 2.1 time: 0.287325 May 19 08:25:36.261626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1191/2305] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:35 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:36.326203 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:36.328219 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] [instance: a231d457-6981-4c74-8722-8d3917904e71] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:36.346516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.349700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.350819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.351957 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.384888 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] HTTP exception thrown: Instance a231d457-6981-4c74-8722-8d3917904e71 could not be found. May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Request method failure captured: May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 HTTP/1.1 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf7f2ZEGXcdZBeXs3Jg2hgRs7iXpilB6LVD2enzuMN7vRD4qU5VVdryxfkTXOfkSOY-cCCScuMgbrLsh93f67aMPfKP7a0473aM5QM3bcz1cZY1Rk74u1bAByvXso7x93v54SY1MUw2af4iLbc7aNSlQUvWjak1zc_Yuosu46coNKmg May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: fffd387929ad41e1baae24bc7f67966c May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-TenantUsagesTestJSON-985160627 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fffd387929ad41e1baae24bc7f67966c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fffd387929ad41e1baae24bc7f67966c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fffd387929ad41e1baae24bc7f67966c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fffd387929ad41e1baae24bc7f67966c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-TenantUsagesTestJSON-985160627 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: fffd387929ad41e1baae24bc7f67966c May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-TenantUsagesTestJSON-985160627 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-TenantUsagesTestJSON-985160627-project May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 3bd0897e5f8d4eafb9a723dffb403ab5 May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-TenantUsagesTestJSON-985160627-project May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance a231d457-6981-4c74-8722-8d3917904e71 could not be found. May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': 'a231d457-6981-4c74-8722-8d3917904e71'} May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a231d457-6981-4c74-8722-8d3917904e71 could not be found. May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a231d457-6981-4c74-8722-8d3917904e71 could not be found. May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:36.389613 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a231d457-6981-4c74-8722-8d3917904e71 could not be found. May 19 08:25:36.393853 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:25:36.395378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] Returning 404 to user: Instance a231d457-6981-4c74-8722-8d3917904e71 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:25:36.397995 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ea653b2a-3096-448d-9ddf-78b1aae34274 tempest-TenantUsagesTestJSON-985160627 tempest-TenantUsagesTestJSON-985160627-project] 10.222.0.78 "GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71" status: 404 len: 111 microversion: 2.1 time: 0.079483 May 19 08:25:36.399191 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1115/2306] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:36 2022] GET /compute/v2.1/servers/a231d457-6981-4c74-8722-8d3917904e71 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:25:36.411443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:36.412112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:36.435277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.435738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.437164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.437640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.683518 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:36.684154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:36.704289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.705532 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.707684 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.713977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.825912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:36.839482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:36.841111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:36.859750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5d95cdf-2537-4c45-b255-97be505ea2ff tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1353 microversion: 2.75 time: 0.451763 May 19 08:25:36.860356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1192/2307] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:36 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1353 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:36.867874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:36.874067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:36.890261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.893705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:36.895098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:36.895745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:37.135502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:37.160521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:37.163950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:37.167750 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c847b02a-cf44-48b3-98b8-bf1553168e0d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.491167 May 19 08:25:37.180099 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1116/2308] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:36 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:37.187660 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:37.188603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:37.204611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:37.205425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:37.206353 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:37.206971 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:37.455058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:37.466657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a6666b5-d151-4c9f-91d0-d2536d76490e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1314 microversion: 2.1 time: 0.605045 May 19 08:25:37.479488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1193/2309] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:36 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:37.490643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:37.493036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:37.506282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:37.510649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:37.523689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:37.524677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:37.755746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:37.780610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8176e68b-628f-401e-9189-92d42bbdae6c tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 200 len: 1462 microversion: 2.1 time: 0.299501 May 19 08:25:37.781224 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1194/2310] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:37 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 1462 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:37.966158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:37.977407 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-56a417b8-3212-4f73-b3fd-3507cc421cd2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.795767 May 19 08:25:37.997017 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1117/2311] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:37 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:38.002023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:38.002618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:38.051950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.054614 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.056836 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.058551 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.184843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3770eb57-9e76-4bca-b4f5-bd695303ef8c req-196a30e4-7eb8-4515-a24c-d1137664b395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7978275d-cb9b-440e-9a41-14a9abc98448", "name": "network-vif-deleted", "tag": "969d881b-2c8e-4205-aa52-a43784044d2d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:38.205244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3770eb57-9e76-4bca-b4f5-bd695303ef8c req-196a30e4-7eb8-4515-a24c-d1137664b395 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.205729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3770eb57-9e76-4bca-b4f5-bd695303ef8c req-196a30e4-7eb8-4515-a24c-d1137664b395 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.248967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3770eb57-9e76-4bca-b4f5-bd695303ef8c req-196a30e4-7eb8-4515-a24c-d1137664b395 service nova] Creating event network-vif-deleted:969d881b-2c8e-4205-aa52-a43784044d2d for instance 7978275d-cb9b-440e-9a41-14a9abc98448 on chh1-842464-2 May 19 08:25:38.262145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3770eb57-9e76-4bca-b4f5-bd695303ef8c req-196a30e4-7eb8-4515-a24c-d1137664b395 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.466117 May 19 08:25:38.264702 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1195/2312] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:38.284305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.296026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:38.299935 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.301661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.302328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:38.315920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.316434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.317368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.319450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.323913 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-de73b4ae-a616-4e01-8177-35ced6ecc5db tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1415 microversion: 2.75 time: 0.325638 May 19 08:25:38.326680 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1118/2313] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:37 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1415 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:38.490379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:38.491897 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:38.512192 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.515123 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.516407 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.518335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.655066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.681363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.683432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.684683 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d87796bc-63e4-4568-b65b-031138c03663 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.418624 May 19 08:25:38.685270 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1196/2314] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:38 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:38.799643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:38.800646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:38.813858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.816222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.817160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.819201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.872709 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:38.877008 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 HTTP/1.1 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7978275d-cb9b-440e-9a41-14a9abc98448'} May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:25:38.880649 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:25:38.885045 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-255e500e-a954-46b1-b90f-d6141bf513ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 404 len: 111 microversion: 2.1 time: 0.087701 May 19 08:25:38.885577 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e9697506-a774-493e-9437-a5621c68ded9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1500 microversion: 2.1 time: 0.398081 May 19 08:25:38.885663 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1197/2315] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:38 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:25:38.885734 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1119/2316] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:38 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1500 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:38.910838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:38.911643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:38.931403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.931865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.932690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:38.933136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:38.999227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lazy-loading 'flavor' on Instance uuid 365b103e-7914-4f7c-a05e-38a781ec2b84 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:25:39.002305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:39.002921 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:39.015795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:39.019616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:39.022098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:39.024511 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:39.325538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f79fbf5-773b-4d1f-89ba-4fe6ea1758e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "POST /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84/action" status: 200 len: 32 microversion: 2.1 time: 0.416652 May 19 08:25:39.328706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1198/2317] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:25:38 2022] POST /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84/action => generated 32 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:25:39.346356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-28308772", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:39.495425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:25:40.203710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:40.230398 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a429276f-05d6-4881-9a2a-64d9216dfc1d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 1.231259 May 19 08:25:40.232561 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1120/2318] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:38 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:40.240199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:40.242960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:40.258537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:40.260098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:40.261500 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:40.262508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:40.348597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:41.313063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:41.328404 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a89460a7-1024-426d-83e1-456609b46c93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 1.093829 May 19 08:25:41.333462 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1121/2319] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:40 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:41.342756 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:41.345615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:41.362175 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:41.362933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:41.391863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:41.393739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:41.619575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:41.633641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:41.653218 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:41.681105 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9eda8711-fa0c-4461-918c-aee5c301e85f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1436 microversion: 2.75 time: 0.346060 May 19 08:25:41.687927 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1122/2320] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:41 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1436 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:41.701901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:41.712264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:41.735618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:41.736154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:41.737932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:41.738381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.156083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:42.157240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:42.157917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:42.158707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:42.159834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:42.192102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.193117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.196327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.199116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.282494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:42.302206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:42.337470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:42.383161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:42.396330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:42.399451 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8dd1ba52-b3f2-4f5e-91ba-6216e0896c9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1293 microversion: 2.25 time: 0.710417 May 19 08:25:42.419095 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1123/2321] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:41 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1293 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:42.429125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:42.437463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:42.437947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:42.439352 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:42.453164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.455679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.458277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.458912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.565928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91aa2567-3b90-4935-9e35-e7ae1471f2b4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.233590 May 19 08:25:42.569916 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1199/2322] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:25:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:25:42.583635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:42.594876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:42.608124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.608924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.610021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.611012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.776018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:42.777768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:42.780704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:42.781789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:42.783285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:42.924226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:42.929225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:42.938870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.941498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:42.945238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:42.957339 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ea2b6738-d500-49dd-90d1-7deb6e0f5908 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.536785 May 19 08:25:42.963226 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1124/2323] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:42 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:42.969495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:43.278595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-704155452", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:43.292265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:43.310126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:43.328244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:43.370990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17d5ce07-5fb2-4cfb-a4a7-534f0f99b8d3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "POST /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43/action" status: 202 len: 1493 microversion: 2.75 time: 0.793720 May 19 08:25:43.384930 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1200/2324] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:25:42 2022] POST /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43/action => generated 1493 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 08:25:43.395109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:43.395772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:43.418051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:43.418592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:43.419570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:43.420021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:43.444627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] validate_networks() for None {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:25:44.276053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:44.285551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-394ba5ec-4643-4db0-90ad-a11f39230578 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.912611 May 19 08:25:44.290425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1201/2325] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:43 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:44.296408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:44.300906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:44.326957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.328317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.329508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.330244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.548392 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:25:44.548923 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:25:44.549204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:25:44.549795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:25:44.550212 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:25:44.562214 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.562943 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.563890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.564478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.571144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:44.580342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b331e5f3-a327-42bb-ab89-2f0c454da6d9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1265 microversion: 2.1 time: 0.288343 May 19 08:25:44.590734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1202/2326] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:44 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:44.597699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:44.600292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:44.604286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Getting quotas for project 506115ac4a6f4e12bd31e9db0d15b3d8. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:25:44.616059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.617959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Getting quotas for user 4444c61e2c03455992d6bcf1835a8709 and project 506115ac4a6f4e12bd31e9db0d15b3d8. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:25:44.619476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.620324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.620772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.654537 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:25:44.657281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:25:44.660572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:44.729763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:44.736533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:44.738320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:44.744834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c3f5581-a3b0-441b-809b-bcd4f4b3a11f tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.158259 May 19 08:25:44.746169 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1203/2327] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:44 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:44.751949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:44.753231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:44.793835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.795157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.802462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.803475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.825517 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ade25c61-b649-4c2f-b2ef-a1de348003cc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858170 May 19 08:25:44.826482 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1125/2328] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:25:44.849148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:44.857378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:44.871369 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.872139 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:44.873219 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:44.886303 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:45.323204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:45.371826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:45.374573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:45.376546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b16f5ed1-218e-4cc2-aeb2-970c37510154 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.629046 May 19 08:25:45.379175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1204/2329] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:44 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:45.385565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2fe3a753-c8da-44c7-927f-6a4b49febe2f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:45.386715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2fe3a753-c8da-44c7-927f-6a4b49febe2f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:45.543492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:45.552264 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-21eeba7e-597b-489b-90b7-155b067b57d9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.719548 May 19 08:25:45.563418 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1126/2330] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:44 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:45.586010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:45.586851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:45.605817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:45.606269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:45.607065 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:45.610939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:45.778353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2fe3a753-c8da-44c7-927f-6a4b49febe2f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:45.787875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2fe3a753-c8da-44c7-927f-6a4b49febe2f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1216 microversion: 2.1 time: 0.407164 May 19 08:25:45.788585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1205/2331] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:45 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1216 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:45.809713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:45.811913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:45.841717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:45.845043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:45.846126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:45.846877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:46.000453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:46.017379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6277e01-9e1d-4694-8174-423ec8299278 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1271 microversion: 2.1 time: 0.225782 May 19 08:25:46.018612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1206/2332] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:45 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:46.024705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:46.028476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:46.048462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:46.051767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:46.052906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:46.055839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:46.190875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:46.194925 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:46.205219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:46.212285 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f5d20cc2-fa47-4ee0-bdd1-06af8bf436f8 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.646004 May 19 08:25:46.212880 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1127/2333] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:45 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:46.233467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:46.234979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:46.241702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ba6a072-8836-438a-a4e2-5f3601ac7efe tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.221803 May 19 08:25:46.243594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1207/2334] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:46 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:46.398959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:46.399854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:46.413731 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:46.414181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:46.414955 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:46.415385 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:46.570329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:46.570957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:46.580776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:46.581462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:46.582191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:46.585376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.212286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.228860 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.233488 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.235839 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b5367f27-880d-480f-873f-f07da22a5de0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.842550 May 19 08:25:47.246544 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1128/2335] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:46 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:47.251876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.263841 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:47.264600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:47.264855 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1532805d-181f-4bbe-9938-02bc58ffa3c4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.698996 May 19 08:25:47.274813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1208/2336] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:46 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:25:47.278358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:47.279133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:47.289661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:47.290868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.291497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.292669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.294413 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.295201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.295732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.298051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.298570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.526077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.540258 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-264d111d-16b6-473b-ab9c-228ecf2c51ce tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1274 microversion: 2.1 time: 0.301636 May 19 08:25:47.551001 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1129/2337] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:47 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:47.556971 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:47.572447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:47.583124 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.583958 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.585602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.586277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.775227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.786825 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3276fce-5d3e-427a-97cc-27e620d63caa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1313 microversion: 2.1 time: 0.519762 May 19 08:25:47.792601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1209/2338] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:47 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:47.808049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:47.814215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:47.828087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.830426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.831400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:47.838358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:47.957293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.969861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.973189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.977923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:47.987537 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5bf4a1aa-047b-4745-ae90-2ccc8c5840e4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.434411 May 19 08:25:47.994686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e50c24f-4436-4256-9d87-e79f448076f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.200579 May 19 08:25:47.995587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1210/2339] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:47 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:47.999664 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1130/2340] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:47 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:48.161156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-456d8834-a239-4a6f-be54-8e0bf34c7d24 req-b2a5d6ae-0c95-46f1-9b3f-b6bb0b6121b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2d627a-8b5c-49b5-9a3b-5c255187b78d", "tag": "f6a0400f-13d4-4432-9f38-e012b268019a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:48.190250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-456d8834-a239-4a6f-be54-8e0bf34c7d24 req-b2a5d6ae-0c95-46f1-9b3f-b6bb0b6121b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.191513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-456d8834-a239-4a6f-be54-8e0bf34c7d24 req-b2a5d6ae-0c95-46f1-9b3f-b6bb0b6121b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:48.234506 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-456d8834-a239-4a6f-be54-8e0bf34c7d24 req-b2a5d6ae-0c95-46f1-9b3f-b6bb0b6121b2 service nova] Creating event network-changed:f6a0400f-13d4-4432-9f38-e012b268019a for instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d on chh1-842464-2 May 19 08:25:48.248718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-456d8834-a239-4a6f-be54-8e0bf34c7d24 req-b2a5d6ae-0c95-46f1-9b3f-b6bb0b6121b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099888 May 19 08:25:48.253609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1211/2341] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:48.254901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:48.258595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:48.269283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.269951 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:48.270901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.271783 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:48.284483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:48.285130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:48.301412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.301872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:48.314402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.315053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:48.605876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:48.625591 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:48.627891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:48.630076 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7d02a19d-9cf7-466d-bae6-6b411f6aee5a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.379634 May 19 08:25:48.632001 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1131/2342] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:48 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:48.637085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:48.638700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:48.649587 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.650385 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:48.651746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:48.652394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.099324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.110543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df15a851-9b4c-48d5-aabf-0dcc3a056c27 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.830531 May 19 08:25:49.121500 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1212/2343] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:48 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:49.127489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:49.128581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:49.136855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.137852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.139075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.139967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.367792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.377537 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7f34deb7-ca30-4b98-acfd-a26ff528bb6f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.744190 May 19 08:25:49.388436 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1132/2344] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:48 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:49.394652 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:49.396058 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:49.408170 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.409014 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.409962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.410632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.421388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.430032 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0dfc5d31-8d3b-4c5b-8d91-9b446ff64683 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1313 microversion: 2.1 time: 0.307025 May 19 08:25:49.439243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1213/2345] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:49 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:49.447356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:49.447992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:49.463059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.463517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.464278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.464714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.601390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.612521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.620101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.640383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-555c874c-812b-4853-af0a-8bf155ff536a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.201912 May 19 08:25:49.640383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1214/2346] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:49 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:49.658289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:49.658938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.666461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:49.673978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.674571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.676682 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9bea03dd-dec8-4f76-b77a-2ca54847f08d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.286737 May 19 08:25:49.678349 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1133/2347] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:49 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:49.678982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:49.679472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:49.894409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.905809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.908256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:49.910085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-864a11be-6fb7-4e75-a444-f8e082107372 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.264589 May 19 08:25:49.911462 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1215/2348] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:49 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:50.139855 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:50.141474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:50.143694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:50.153273 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.154238 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.155890 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.157157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.399260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:50.400247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:50.415181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.418880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.420025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.422360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.464705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:50.479155 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d864fd9a-eda1-4e7b-aeb1-42072ade1d5b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.350490 May 19 08:25:50.481270 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1134/2349] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:50 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:50.495979 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:50.497069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:50.507094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.507911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.509109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.509922 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.831570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:50.848342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f58333c-4fb2-4538-8ebe-6bbc28affa32 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.456347 May 19 08:25:50.848958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1216/2350] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:50 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:50.857218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:50.866046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:50.885200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.886029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.887023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:50.887615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:50.956981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:50.973738 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a2b67db9-f392-446d-8dc9-ee0fd8729de7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1313 microversion: 2.1 time: 0.490562 May 19 08:25:50.976400 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1135/2351] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:50 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:50.981510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:50.988600 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:51.003964 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.010295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.012435 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.018180 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.085818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.095217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.106384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.132259 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-776ed32a-8428-40f2-b147-de19075000a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.281427 May 19 08:25:51.133355 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1217/2352] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:50 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:51.145220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:51.145897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:51.165112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.165596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.166396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.166841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.522466 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.534243 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d4a6f763-fc3b-4269-b859-d9d5bad4c72f tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.555607 May 19 08:25:51.534243 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1136/2353] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:50 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:51.563550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:51.564256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:51.585570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.596348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.603171 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.604946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.604946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.604946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.612043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:51.625827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-42b687f7-e647-44a5-b351-17833e691486 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.491219 May 19 08:25:51.627764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1218/2354] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:51 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:51.866429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:51.867033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:51.887455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.887916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:51.888711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:51.889148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.100188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:52.117008 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-aad6f805-f53d-4065-86e0-a17ada80e92d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.559392 May 19 08:25:52.119406 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1137/2355] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:51 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:52.141653 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:52.145295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:52.174181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.174811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.179929 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.182333 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.252325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:52.480583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:52.490020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98aa1d52-cd8b-4900-b63d-2385cdd0b4c0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.627511 May 19 08:25:52.495193 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1219/2356] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:51 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:25:52.508751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:52.511386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:52.539799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.542079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.546509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.546673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.609803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:52.619356 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4e536bc7-d51d-4b4c-9172-c7efb9ed11cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1313 microversion: 2.1 time: 0.498248 May 19 08:25:52.626417 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1138/2357] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:52 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:52.640868 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:52.645137 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:52.662494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.666031 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.667209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.667869 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.767507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:52.783939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:52.791438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:52.804621 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf879805-c254-4d25-b525-80622f4c27c2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.304792 May 19 08:25:52.805897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1220/2358] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:52 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:52.817719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:52.818633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:52.837668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.838160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:52.839291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:52.839739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:53.390154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:53.405209 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bbff2ed3-0f86-4461-ba5e-b61fede7928b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.777115 May 19 08:25:53.405857 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1139/2359] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:52 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:53.422073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-4c2ed0f7-a3e6-4992-8253-85a2963eeebd req-6ca0ae2e-64cd-49ff-a971-30f9f55b38fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:53.460115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4c2ed0f7-a3e6-4992-8253-85a2963eeebd req-6ca0ae2e-64cd-49ff-a971-30f9f55b38fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:53.460676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4c2ed0f7-a3e6-4992-8253-85a2963eeebd req-6ca0ae2e-64cd-49ff-a971-30f9f55b38fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:53.514087 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-4c2ed0f7-a3e6-4992-8253-85a2963eeebd req-6ca0ae2e-64cd-49ff-a971-30f9f55b38fa service nova] Creating event network-changed:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:25:53.533559 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-4c2ed0f7-a3e6-4992-8253-85a2963eeebd req-6ca0ae2e-64cd-49ff-a971-30f9f55b38fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115040 May 19 08:25:53.537054 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1140/2360] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:53.545165 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:53.548728 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:53.557484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:53.557992 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:53.558858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:53.559301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:53.830336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:53.837980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:53.848721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:53.860407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:53.866400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6681a968-61ee-4775-9071-b1da9ab4453b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 1.055520 May 19 08:25:53.881937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1221/2361] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:52 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:53.900430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:53.907056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:53.927026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:53.932407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:53.942466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:53.943283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.035416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.052685 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-18499626-72da-49c7-9458-5092247e9ce8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.513416 May 19 08:25:54.063857 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1141/2362] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:53 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:54.077710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:54.078334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:54.097445 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.097918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.098823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.099363 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.335799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.356075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98db2f84-b147-4c8e-878a-8dc8e812ef47 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.465996 May 19 08:25:54.356827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1222/2363] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:53 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:54.366111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:54.373513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:54.392473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.393937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.397636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.398122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.463027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.490208 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e7e52681-9010-48f4-be73-75d1b19d5b0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1313 microversion: 2.1 time: 0.419738 May 19 08:25:54.495262 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1142/2364] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:54 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:54.500995 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:54.502843 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:54.510493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.511317 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.512661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.525328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.545229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.559058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.563766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.578673 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86d310cb-3da2-4c32-8a1a-315cbb254bf2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.216282 May 19 08:25:54.579971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1223/2365] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:54 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:54.582670 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:54.638093 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=6 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:54.779520 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:54.802188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-12700eb7-aeb9-4aa9-adc8-ca345328f100 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.305387 May 19 08:25:54.814209 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1143/2366] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:54 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:54.901105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:54.907877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:54.937154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.950250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:54.951287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:54.951847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.076487 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:55.078335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:55.096341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.098029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.104048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.105005 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.211552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:55.221883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:55.237873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:55.239575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a639003a-b57b-4c2b-9567-f30f215d7578 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.343333 May 19 08:25:55.241668 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1224/2367] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:54 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:55.266789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5e3c9159-f168-4513-8039-1c25e42b64ee req-c482ce13-9ed8-4686-8b93-4dbbc7ebeb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2d627a-8b5c-49b5-9a3b-5c255187b78d", "name": "network-vif-plugged", "status": "completed", "tag": "f6a0400f-13d4-4432-9f38-e012b268019a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:55.282772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5e3c9159-f168-4513-8039-1c25e42b64ee req-c482ce13-9ed8-4686-8b93-4dbbc7ebeb0e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.288459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5e3c9159-f168-4513-8039-1c25e42b64ee req-c482ce13-9ed8-4686-8b93-4dbbc7ebeb0e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.319830 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5e3c9159-f168-4513-8039-1c25e42b64ee req-c482ce13-9ed8-4686-8b93-4dbbc7ebeb0e service nova] Creating event network-vif-plugged:f6a0400f-13d4-4432-9f38-e012b268019a for instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d on chh1-842464-2 May 19 08:25:55.331510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5e3c9159-f168-4513-8039-1c25e42b64ee req-c482ce13-9ed8-4686-8b93-4dbbc7ebeb0e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068673 May 19 08:25:55.335727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1225/2368] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:25:55.374295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:55.375835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:55.392865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.393512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.394435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.395051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.783550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=18 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:55.871944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:55.883556 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c0223d6b-de50-4f73-877f-e9325d289ea2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.814411 May 19 08:25:55.885135 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1144/2369] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:55 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:55.905846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:55.906750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:55.923805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.926763 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:55.928961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:55.935944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:56.158259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:56.180105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed27378d-afee-42f2-9413-a002a7eff0ab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.808365 May 19 08:25:56.212508 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1226/2370] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:55 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:56.237529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:56.238532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:56.260943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:56.268492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:56.273770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:56.275365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:56.361042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:25:56.429114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:56.444005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:56.446006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:56.463516 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d957bc15-f97b-4e94-b655-b7d76d3f6959 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.249310 May 19 08:25:56.474719 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1227/2371] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:56 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:56.478404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:56.479033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:56.495792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:56.496244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:56.497042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:56.497521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:56.840541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:56.853762 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c5b34576-e117-4d1f-9f6c-71373008540a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1313 microversion: 2.1 time: 0.966899 May 19 08:25:56.857768 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1145/2372] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:55 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1313 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:56.871033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:56.871664 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:56.904667 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:56.909414 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:56.912826 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:56.913410 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:57.796919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:57.806321 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-043bc371-d0e3-42a6-94aa-d60b8e1b01c3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 1.340847 May 19 08:25:57.807145 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1228/2373] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:56 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:57.819288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:57.823791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:57.838525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:57.839097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:57.839972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:57.845766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:57.923291 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:57.939989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:57.942326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:57.945892 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-33113984-d0bc-4af1-b9a4-c90b70a2aad6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 1.086896 May 19 08:25:57.948869 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1146/2374] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:56 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:57.970569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:57.971187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:57.985873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:57.986327 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:57.987547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:57.987984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.352731 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:58.364812 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a1e5a31a-e482-4f98-b5df-ebcb6b9afd49 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.413518 May 19 08:25:58.371472 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1147/2375] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:57 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:58.376876 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-1a78833a-254e-4802-b302-022d6b617b6c req-6aec4754-098e-49cf-9340-750aa0ec7410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b79bad-0fe9-46cb-9eca-4ccbe3e70234", "name": "network-vif-plugged", "status": "completed", "tag": "456143eb-7f9b-4b6f-a56e-75a2953883c6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:25:58.406323 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1a78833a-254e-4802-b302-022d6b617b6c req-6aec4754-098e-49cf-9340-750aa0ec7410 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.406778 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-1a78833a-254e-4802-b302-022d6b617b6c req-6aec4754-098e-49cf-9340-750aa0ec7410 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.417365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:58.432587 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f0a4b41-3512-412d-b596-7a4e02f4d752 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.621323 May 19 08:25:58.433215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1229/2376] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:57 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:58.456539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:58.457169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:58.469569 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-1a78833a-254e-4802-b302-022d6b617b6c req-6aec4754-098e-49cf-9340-750aa0ec7410 service nova] Creating event network-vif-plugged:456143eb-7f9b-4b6f-a56e-75a2953883c6 for instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 on chh1-842464-2 May 19 08:25:58.488528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.489009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.491303 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-1a78833a-254e-4802-b302-022d6b617b6c req-6aec4754-098e-49cf-9340-750aa0ec7410 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118445 May 19 08:25:58.491917 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1148/2377] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:25:58.494008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.494643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.507849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:58.508565 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:58.568599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.569271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.570172 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.570627 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.754925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:58.771916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:58.781183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:58.803243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0863c24-1392-4cda-bd97-6957e9abff24 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.357095 May 19 08:25:58.821173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1230/2378] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:58 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:25:58.835640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:58.836274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:58.845982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.846994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:58.848356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:58.849368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:59.474953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:59.483931 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1b4e8a9f-634d-4938-b93a-2a3fc99c1432 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1497 microversion: 2.1 time: 0.990786 May 19 08:25:59.484530 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1149/2379] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:58 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1497 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:59.507641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:59.508333 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:59.528990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:59.529490 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:59.530301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:59.530746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:59.629936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:25:59.639379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6c6899d-038f-466b-8341-fc1792826521 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.816963 May 19 08:25:59.639983 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1231/2380] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:58 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:25:59.656440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:25:59.657106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:25:59.689094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:59.689799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:25:59.702108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:25:59.702691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.031859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.047493 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.050246 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.056172 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-54c606e0-8bc3-450d-8b61-dfb4fd9d2190 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1281 microversion: 2.25 time: 0.556081 May 19 08:26:00.059364 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1150/2381] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:25:59 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1281 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:00.074861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:00.076209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:00.106139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.119495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8ae3edc-a2b9-4a41-a83c-3028382ebcf0 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.474839 May 19 08:26:00.124736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1232/2382] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:25:59 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:00.131389 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.136555 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.137833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.139621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:00.140658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:00.144419 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.161151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.164111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.165912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.167531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.348662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.358978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.368848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.399140 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90e3bd0c-70f7-488f-8422-8a24685cd642 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.273018 May 19 08:26:00.414711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1233/2383] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:00 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:00.580849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.592701 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-94426064-3184-4c63-8c80-9cad205b0458 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.530500 May 19 08:26:00.612527 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1151/2384] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:00 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:00.658099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:00.659068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:00.670743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.671525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.674202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.674819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.767394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-4fa37f59-63af-48e9-a3a5-3a496f689235 req-a86c0073-8852-4fe5-8810-7d93904ad40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "name": "network-vif-plugged", "status": "completed", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:00.782861 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4fa37f59-63af-48e9-a3a5-3a496f689235 req-a86c0073-8852-4fe5-8810-7d93904ad40d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:00.783313 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-4fa37f59-63af-48e9-a3a5-3a496f689235 req-a86c0073-8852-4fe5-8810-7d93904ad40d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:00.833094 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-4fa37f59-63af-48e9-a3a5-3a496f689235 req-a86c0073-8852-4fe5-8810-7d93904ad40d service nova] Creating event network-vif-plugged:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:26:00.844134 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-4fa37f59-63af-48e9-a3a5-3a496f689235 req-a86c0073-8852-4fe5-8810-7d93904ad40d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082749 May 19 08:26:00.847006 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1152/2385] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:00.971903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:00.984846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e945fdf2-1eea-4819-a742-026e857d9093 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.331961 May 19 08:26:00.988440 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1234/2386] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:00 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:01.079023 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:01.080443 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:01.100249 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.100790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.105732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.107782 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.145346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:01.146062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:01.160338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.162408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.169293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.170128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.410858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.420700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.424163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.425706 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1ab58cdf-8e12-4576-af58-964d35cbf299 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1477 microversion: 2.25 time: 0.352780 May 19 08:26:01.426799 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1153/2387] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:01 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:01.432452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:01.433481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:01.433764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.444917 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73fe3517-aae6-4f0b-a273-25560065b967 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1316 microversion: 2.1 time: 0.308262 May 19 08:26:01.446841 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.447512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.448547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.449275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.455176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1235/2388] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:01 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:01.551676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.560961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.562515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.568410 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-74e394d3-6632-4da1-bef8-45e7ea3309bc tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.139624 May 19 08:26:01.569534 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1154/2389] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:01 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:01.620344 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:01.621128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:01.628051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.628800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.629797 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.630425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.631303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:01.632341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:01.640866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.641344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.642648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.643227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.856017 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:01.864805 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e229f6d8-55d3-4f56-a5cb-27eebfbac500 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1681 microversion: 2.1 time: 0.248188 May 19 08:26:01.866381 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1155/2390] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:01 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:01.868468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:01.887078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a366773e-4f9b-417b-ba25-c3da808bb72c tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1970 microversion: 2.25 time: 0.429917 May 19 08:26:01.888309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1236/2391] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:01 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1970 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:01.905984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:01.906960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:01.914750 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.915677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:01.916683 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:01.917533 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.006202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:02.007052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:02.018700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.019236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.020011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.027626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.084567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:02.103873 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3a78b3ce-049f-445a-a059-ab9e845126a8 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1970 microversion: 2.25 time: 0.202179 May 19 08:26:02.121537 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1156/2392] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:01 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1970 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:02.128999 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ff8ac040-763f-45a0-a4aa-98f895ca175e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:02.131773 chdv-842464-2 devstack@n-api.service[119073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:26:02.131773 chdv-842464-2 devstack@n-api.service[119073]: warnings.warn(msg) May 19 08:26:02.133349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff8ac040-763f-45a0-a4aa-98f895ca175e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.134032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff8ac040-763f-45a0-a4aa-98f895ca175e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.135043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff8ac040-763f-45a0-a4aa-98f895ca175e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.135673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ff8ac040-763f-45a0-a4aa-98f895ca175e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.205851 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ff8ac040-763f-45a0-a4aa-98f895ca175e tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.080534 May 19 08:26:02.210713 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1157/2393] 10.222.0.78 () {60 vars in 1216 bytes} [Thu May 19 08:26:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:26:02.228758 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "chh2-842464-2", "block_migration": "auto"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:02.230742 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:02.252285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:02.263007 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac2473c4-db84-47b5-b998-c6e40ae2d2b7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.260865 May 19 08:26:02.263665 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.264272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1237/2394] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:02 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:02.270886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.274562 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.276305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.467095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:02.469192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:02.488082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.497336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.499862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.501377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.662599 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'flavor' on Instance uuid 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:02.678724 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Going to try to live migrate instance to chh2-842464-2 {{(pid=119073) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:26:02.760972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:02.769158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:02.772838 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85a708bf-c272-424d-85cd-8056659f4e48 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1466 microversion: 2.1 time: 0.313869 May 19 08:26:02.777695 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1238/2395] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:02 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1466 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:02.784473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:02.785538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:02.796772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.797589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.798623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.799267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.918890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:02.932613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:02.934174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:02.941511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-388215fe-1c7d-4a06-806b-7fee6a5f69f1 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.162217 May 19 08:26:02.954963 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1239/2396] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:02 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:02.966217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1585432308", "metadata": {"image_type": "test"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:02.967597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:02.979040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.980043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:02.982354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:02.983228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:03.027203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Getting quotas for project 506115ac4a6f4e12bd31e9db0d15b3d8. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:26:03.032913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Getting quotas for user 4444c61e2c03455992d6bcf1835a8709 and project 506115ac4a6f4e12bd31e9db0d15b3d8. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:26:03.330498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1019b216-0058-460f-9541-b0342988dc99 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "POST /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.374439 May 19 08:26:03.331408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1240/2397] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:26:02 2022] POST /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:26:03.343726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:03.344461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:03.351567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:03.352026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:03.352809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:03.353245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:03.567323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:03.589568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31cbf8aa-4a67-4aba-b2f1-db57a7118bdd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.256176 May 19 08:26:03.602443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1241/2398] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:03 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:03.607668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:03.608301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:03.615565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:03.616005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:03.616792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:03.617282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:03.901944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:03.913518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f828bfdd-88b2-4fd5-a459-e3c03a603039 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.309583 May 19 08:26:03.914738 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1242/2399] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:03 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:03.927254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9fe99dd9-e432-4b0f-9ce0-c4b9bb2c5bfe tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211b2c430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:03.983681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9fe99dd9-e432-4b0f-9ce0-c4b9bb2c5bfe tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.067518 May 19 08:26:03.984284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1243/2400] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:03 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:03.989007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "397f0866-9cb7-40cd-8719-9ebeef0152eb"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:03.990695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:03.998153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:03.998856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:03.999844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.000509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.281180 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-84dd499c-9485-4486-8cd5-0d0416ba4c64 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234/action" status: 202 len: 0 microversion: 2.25 time: 2.062539 May 19 08:26:04.285213 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1158/2401] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:26:02 2022] POST /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234/action => generated 0 bytes in 2068 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 08:26:04.291042 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:04.292080 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:04.303054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.303938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.304988 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.305660 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.387917 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f68f9a5-eca5-4c91-9cef-1b6c1880b84a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402391 May 19 08:26:04.388917 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1244/2402] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:26:03 2022] POST /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:04.397721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:04.398299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:04.436690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.437382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.442454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.443631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.525972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:04.542495 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8e8f7e50-9323-4340-8736-1062d2e95719 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.253320 May 19 08:26:04.543350 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1159/2403] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:04 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:04.556270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:04.557668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:04.577083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.577634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.578459 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.578901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.922264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:04.934998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:04.936834 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:04.953930 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d36e8395-5972-4df3-8471-7c3b907532a3 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.408208 May 19 08:26:04.955030 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1160/2404] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:04 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:04.959919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:04.960530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:04.976256 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.978149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:04.980062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:04.982906 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:05.014596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:05.098676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.125820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.127341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.138165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27ea14b7-754c-4010-9846-40979512440d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2948 microversion: 2.32 time: 0.738631 May 19 08:26:05.149113 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1245/2405] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:04 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2948 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:05.172416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:05.173779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:05.194423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:05.194928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:05.202380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:05.205445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:05.427205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.454729 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.465792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.475514 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bfeee893-38a0-4f33-bdbf-974e3d685b13 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.518482 May 19 08:26:05.479270 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1161/2406] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:04 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:05.484625 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ea47fd93-e0e8-41a8-9224-1cd439e5d3e6 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32117f8c10>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:05.582533 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ea47fd93-e0e8-41a8-9224-1cd439e5d3e6 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.101620 May 19 08:26:05.583129 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1162/2407] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:05 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:05.588052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:05.588474 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:05.642396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:05.645275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:05.646560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:05.649682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:05.675776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:05.690016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7827927f-06f3-4ab0-8d6e-a389bae1808a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.538782 May 19 08:26:05.692369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1246/2408] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:05 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:05.930655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-28c38656-119e-4717-b1c0-0b43e33a9963 req-6a885b01-4f83-460d-b755-215c0594ca83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-unplugged", "status": "completed", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:05.943942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:05.949802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-28c38656-119e-4717-b1c0-0b43e33a9963 req-6a885b01-4f83-460d-b755-215c0594ca83 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:05.950294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-28c38656-119e-4717-b1c0-0b43e33a9963 req-6a885b01-4f83-460d-b755-215c0594ca83 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:05.964302 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-28c38656-119e-4717-b1c0-0b43e33a9963 req-6a885b01-4f83-460d-b755-215c0594ca83 service nova] Creating event network-vif-unplugged:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:26:05.991650 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-28c38656-119e-4717-b1c0-0b43e33a9963 req-6a885b01-4f83-460d-b755-215c0594ca83 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.244513 May 19 08:26:05.993209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1247/2409] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:26:06.000978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:06.001885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:06.029294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.030663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.031687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.032278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.147306 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cd94e718-d5e4-489f-9795-6fac89f20d1d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.561988 May 19 08:26:06.156167 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1163/2410] 10.222.0.78 () {60 vars in 1315 bytes} [Thu May 19 08:26:05 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e/os-interface => generated 1830 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:06.201752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:06.217157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:06.222439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:06.234095 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c9057ef-47a0-48ad-afbb-70548759a889 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.237867 May 19 08:26:06.240732 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1248/2411] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:05 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:06.284408 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:06.287710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:06.295984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.296695 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.297694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.298281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.472777 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:06.483689 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-49a0a155-1357-4ca0-a3fd-a6f548ea3ef5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.203792 May 19 08:26:06.484286 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1164/2412] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:06 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:06.504765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:06.508624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:06.509243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:06.510127 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:06.540164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.540910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.541479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.541944 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.549084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.550302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:06.555224 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:06.558143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.147614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.165502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73a99846-89c6-4e30-a819-44f94481d153 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.665647 May 19 08:26:07.181088 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1249/2413] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:06 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:07.205391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-baea7c27-b80d-405a-8a4d-e3c6aa63685b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32123970d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:07.228325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.259241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.261055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.265914 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8f4d15e3-ddf4-4671-8bc7-13a59bffc314 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.764173 May 19 08:26:07.268309 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1165/2414] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:06 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:07.288279 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:07.290046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:07.300086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-baea7c27-b80d-405a-8a4d-e3c6aa63685b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.116403 May 19 08:26:07.306422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1250/2415] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:07 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:07.312167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.312859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.314795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.315261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.317016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:07.317675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:07.335404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.335846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.337051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.337698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.613751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.625430 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b15360f-98ef-4f89-9c04-032a1e972ee1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.317826 May 19 08:26:07.628070 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1251/2416] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:07 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:07.645459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:07.646784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:07.658273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.659149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.660643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.663543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.703460 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.728189 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4734fc6b-49cc-4787-9d20-6b42fee1ef9b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.457920 May 19 08:26:07.729421 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1166/2417] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:07 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:07.742982 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:07.749003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:07.760811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.768723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.769862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.770452 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.804544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.818300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.820522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:07.840237 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa8fd91c-c20f-40d8-b551-05280df4fc18 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.210934 May 19 08:26:07.841510 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1252/2418] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:07 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:07.936121 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-514269f9-796f-4fd9-87e7-6bd8f85df716 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.203456 May 19 08:26:07.945757 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1167/2419] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:26:07 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:26:07.948537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:07.949174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:07.959736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.960411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:07.961252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:07.968939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:08.293742 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:08.294679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:08.310996 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:08.311471 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:08.312359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:08.312807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:08.725909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:08.735156 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f571fee0-c15e-4d34-b03e-d3e59c94a2a8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1670 microversion: 2.1 time: 0.793288 May 19 08:26:08.741345 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1253/2420] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:07 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1670 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:08.754690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8117fad1-4554-4074-8699-58edf6fceb00 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211e1eb80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:08.844163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:08.861395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:08.863455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:08.871244 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-accbd896-69c5-4df0-bc52-35c9439734be tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.580497 May 19 08:26:08.877225 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1168/2421] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:08 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:08.895189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8117fad1-4554-4074-8699-58edf6fceb00 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.152413 May 19 08:26:08.902250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1254/2422] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:08 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:08.908736 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:08.911546 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:08.916756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:08.917399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:08.928306 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:08.928901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:08.934372 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:08.934880 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:08.939120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:08.939586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:08.941148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:08.941628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:09.188628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:09.205858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:09.218752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:09.227085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:09.248303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adcf2b0d-e425-440d-ba02-0caf49ace0a0 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.341149 May 19 08:26:09.248910 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1255/2423] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:08 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:09.270173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bcd52275-51f5-4474-82a8-7e9357014a98 req-ad796d00-1880-44c4-b792-bbdcaf21e1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "name": "network-vif-plugged", "status": "completed", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:09.307475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bcd52275-51f5-4474-82a8-7e9357014a98 req-ad796d00-1880-44c4-b792-bbdcaf21e1f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:09.312337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bcd52275-51f5-4474-82a8-7e9357014a98 req-ad796d00-1880-44c4-b792-bbdcaf21e1f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:09.373110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bcd52275-51f5-4474-82a8-7e9357014a98 req-ad796d00-1880-44c4-b792-bbdcaf21e1f3 service nova] Creating event network-vif-plugged:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:26:09.393607 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bcd52275-51f5-4474-82a8-7e9357014a98 req-ad796d00-1880-44c4-b792-bbdcaf21e1f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136908 May 19 08:26:09.404749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1256/2424] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:09.566105 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:09.588305 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9ba7ccac-08f1-489f-8250-b9fae45a8ab6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.709418 May 19 08:26:09.589502 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1169/2425] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:08 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:09.764466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:09.765101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:09.781445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:09.781445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:09.781445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:09.781445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:09.898393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:09.899095 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:09.910402 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:09.910857 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:09.911813 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:09.912129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:10.292401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.293017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.302206 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9570bae4-0499-4b2c-bec5-97e07bde5612 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1670 microversion: 2.1 time: 0.543031 May 19 08:26:10.303193 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1257/2426] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:09 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1670 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:10.315708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.318458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5d13296-ae6f-48ea-9d12-e333edb0e5e5 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3212104670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:10.320270 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.321583 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-28330930-f3a0-4227-bf85-356905b9ee6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.428605 May 19 08:26:10.340522 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1170/2427] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:09 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:10.351016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:10.352269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:10.360444 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:10.361429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:10.362553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:10.363182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:10.385249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5d13296-ae6f-48ea-9d12-e333edb0e5e5 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.080857 May 19 08:26:10.386282 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1258/2428] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:10 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:10.483550 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.493710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.495446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.520580 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7a6f772f-35a1-4121-8092-21878e5b23b4 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.178037 May 19 08:26:10.524058 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1171/2429] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:10 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:10.607592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:10.608398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:10.618611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:10.619142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:10.619995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:10.620438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:10.928757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:10.938528 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19bbf98c-09a9-4896-bee5-16f92b427921 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.335455 May 19 08:26:10.939125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1259/2430] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:10 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:11.325535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:11.326226 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:11.334917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.334917 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.342750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:11.343379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:11.345836 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.346292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.356506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.356965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.357784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.358402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.612648 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.630162 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-57202228-b0e4-438e-8481-234ff3fd00df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.308710 May 19 08:26:11.631170 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1172/2431] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:11 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:11.636332 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a8aa9f2a-e0e3-48c6-877e-a05f147d1c71 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32118f8f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:11.693943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.706491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.708269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.709605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8539dd7e-66c2-40f7-aba8-35a0b36d8be4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.373187 May 19 08:26:11.710246 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1260/2432] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:11 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:11.712449 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a8aa9f2a-e0e3-48c6-877e-a05f147d1c71 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.080225 May 19 08:26:11.713188 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1173/2433] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:11 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:11.723914 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:11.725360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:11.725990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:11.726765 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:11.732867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.733347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.734137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.734577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.740802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.760954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.761926 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.762487 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.847139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.859350 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-25f973ef-65e7-4756-a130-487c9f3e431a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 200 len: 322 microversion: 2.1 time: 0.144160 May 19 08:26:11.860048 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1174/2434] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:26:11 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:11.860454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.862559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:11.876859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:11.877637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:11.885545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef9c6c33-aacf-4d3b-9368-713261ac665d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.163906 May 19 08:26:11.886143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1261/2435] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:11 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:11.902388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.902845 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.903635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.904080 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.960416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:11.961081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:11.974586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.975238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:11.976042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:11.976486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.148820 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:12.181790 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:12.192456 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9c4ea20d-af63-4554-9e30-2d93534dfc7b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.320747 May 19 08:26:12.196570 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1175/2436] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:11 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:12.217217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:12.217874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:12.235188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.235646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.236449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.236889 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.283776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:12.296547 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a47eaf5-b6e3-4b6c-ac4e-083d34f83814 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.340572 May 19 08:26:12.298381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1262/2437] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:11 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:12.463205 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:12.472358 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-860b89b7-28a2-48e6-bf3d-29bf04c398db tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.258934 May 19 08:26:12.473396 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1176/2438] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:12 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:12.498358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:12.499237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:12.513544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.516793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.517858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.518285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.729342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-575471d2-0347-48c3-b293-3b607efa90b5 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211804d30>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:12.733817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:12.759179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d420564-3a72-4667-a938-c2a88f1debcf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.262237 May 19 08:26:12.763302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1263/2439] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:12 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:12.769442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:12.770592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:12.784613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.788646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.789609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.790063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.804287 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-575471d2-0347-48c3-b293-3b607efa90b5 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.080330 May 19 08:26:12.805647 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1177/2440] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:12 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:12.815764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:12.816581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:12.826004 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.826602 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:12.827501 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:12.828056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:13.039791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.059204 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3fb23199-afeb-4ff4-8798-dcd4d8971e32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.243119 May 19 08:26:13.061420 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1178/2441] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:12 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:13.074870 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:13.075510 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:13.089478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.096136 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:13.098066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:13.100298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:13.102517 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:13.103352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.105234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.106807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c9200a4-d21a-455d-b2be-d88aecd03266 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.342250 May 19 08:26:13.108074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1264/2442] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:12 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:13.206648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2131127764", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "6106690e-bca7-4255-9662-43648d2ed217"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:13.253441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.266034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.269700 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.283805 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-44387f97-1e78-475f-a2ea-2c47d66c2d5d tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.220585 May 19 08:26:13.284886 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1179/2443] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:13 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:13.300089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] validate_networks() for [('6106690e-bca7-4255-9662-43648d2ed217', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:26:13.333102 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:13.334232 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:13.348268 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:13.350827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:13.351905 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:13.354401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:13.823164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:13.827775 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:13.849766 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-739d0999-cbbb-4d68-8e3f-47caf80bbddc tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.526274 May 19 08:26:13.859903 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1180/2444] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:13 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:13.873615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a756feae-fd29-4843-9a90-3eef2d7f3898 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211888700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:13.958915 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a756feae-fd29-4843-9a90-3eef2d7f3898 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.099344 May 19 08:26:13.959795 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1181/2445] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:13 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:14.129747 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:14.131031 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:14.134158 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:14.153639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.154693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.155953 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.161545 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.173453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:26:14.174854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:26:14.175570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:26:14.176135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:26:14.176894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:26:14.191100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.192072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.193203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.194024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.219471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:26:14.226601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for user 59f3ba2c06c045d6afccb1639ed8d083 and project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:26:14.274074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:26:14.281558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:26:14.377777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-365a4fcc-8b45-4a86-a06d-bed1ab4e3688 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174669 May 19 08:26:14.385017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1265/2446] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:26:14.392595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:14.393410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:14.400481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.402229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.402756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.403547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.403989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.416029 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.418853 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.420388 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-14b4470a-55b1-47c7-aa32-e6253da92395 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.294637 May 19 08:26:14.422503 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1182/2447] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:14 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:14.428239 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-14532167-477f-49e6-9eef-92b26d6d0212 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:14.429409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-14532167-477f-49e6-9eef-92b26d6d0212 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:14.562959 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-14532167-477f-49e6-9eef-92b26d6d0212 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.575352 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-14532167-477f-49e6-9eef-92b26d6d0212 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1215 microversion: 2.1 time: 0.151560 May 19 08:26:14.577613 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1183/2448] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:14 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:14.590862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.613798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.622889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:14.629414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4fefe0c-0b7d-4a4f-b02a-c5181bfea5a6 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1445 microversion: 2.75 time: 0.243099 May 19 08:26:14.629953 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1266/2449] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:14 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1445 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:14.869937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:14.870641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:14.877987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.877987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.879250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:14.879250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:14.972873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f8d8adb-20e6-4dbd-9ed2-b6c4178483b7 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211cf0d30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:15.052108 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f8d8adb-20e6-4dbd-9ed2-b6c4178483b7 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.082986 May 19 08:26:15.052958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1267/2450] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:14 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:15.118815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.128831 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-29a83f18-731a-4e33-baf0-4f4f69a07586 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.262870 May 19 08:26:15.138983 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1184/2451] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:14 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:15.439899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:15.440656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:15.460203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:15.461055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:15.462109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:15.462717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:15.596803 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:15.597732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:15.607240 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:15.614038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:15.616067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:15.616766 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:15.702048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.720051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.721635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.722823 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd7283fd-5115-4baf-8425-8e7e9f77c9b2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.287735 May 19 08:26:15.724425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1268/2452] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:15 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:15.731484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:15.736957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:15.747587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:15.748030 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.748186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:15.752950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:15.753492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:15.758151 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9b07dab2-20f4-499c-966f-82be5475b51f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1211 microversion: 2.1 time: 0.165563 May 19 08:26:15.759435 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1185/2453] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:15 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1211 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:15.892193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.902506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.904374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:15.912003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f13fea1-92ef-4981-803d-86d59f10406a tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1451 microversion: 2.75 time: 0.185716 May 19 08:26:15.924815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1269/2454] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:15 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1451 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:16.066056 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ca38aa12-6fe9-4529-a509-e7524ea66bd9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211894f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:16.139239 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ca38aa12-6fe9-4529-a509-e7524ea66bd9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.077518 May 19 08:26:16.139835 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1186/2455] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:16 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:16.149657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:16.151381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:16.160787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.161674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.162724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.163361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.359965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:16.371570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a085277-14f8-4cef-903a-eb4e2d5f5ff4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.226687 May 19 08:26:16.373099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1270/2456] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:16 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:16.746386 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:16.748431 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:16.760326 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.761067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.762209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.762804 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.777476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:16.778312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:16.795793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.795793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.795793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.795793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.899758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:16.909102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db6ab7d9-7b59-4d74-bebb-aee0b5afdee9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1267 microversion: 2.1 time: 0.135268 May 19 08:26:16.912593 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1271/2457] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:16 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:16.942160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:16.943459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:16.950839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.951304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:16.952094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:16.952538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.019396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.031507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.036854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.038696 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-57b8c89d-dc6a-46dd-a204-894b0631801e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.296143 May 19 08:26:17.042183 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1187/2458] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:16 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:17.092359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.108567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.110135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.127954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9f45009-0f49-4e63-9f5a-95906f76e451 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1451 microversion: 2.75 time: 0.198596 May 19 08:26:17.128604 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1272/2459] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:16 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1451 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:17.153529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2a19df66-ac2f-4985-8bac-fdc6674cb7db tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32117f8280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:17.232888 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2a19df66-ac2f-4985-8bac-fdc6674cb7db tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.083925 May 19 08:26:17.233770 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1188/2460] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:17 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:17.391219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:17.393266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:17.403084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.404205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.405639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.406394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.721557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:17.729700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cca061c-564f-4150-8aa7-10de924c2c0b tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1486 microversion: 2.1 time: 0.342648 May 19 08:26:17.742787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1273/2461] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:17 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1486 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:17.749477 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:17.749969 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:17.772541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.772994 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.773812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.779811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.889593 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a79ce357-c0cf-42e7-bf64-8174d27aa5e7 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "POST /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84/action" status: 202 len: 0 microversion: 2.1 time: 0.145467 May 19 08:26:17.893342 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1189/2462] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:26:17 2022] POST /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:26:17.900261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:17.901087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:17.909275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.909749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.910558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.911002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.930801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:17.931879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:17.940752 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.941703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:17.943382 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:17.948016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:18.127801 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.157180 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5e8b57ee-4c0d-4569-ae8c-8a634535360c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1285 microversion: 2.1 time: 0.231430 May 19 08:26:18.167208 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1190/2463] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:17 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:18.167551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.167672 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:18.168950 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:18.184409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:18.185507 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:18.186044 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef2ea3ee-6f2e-49de-b6db-1c9770e8380a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1494 microversion: 2.1 time: 0.291259 May 19 08:26:18.186606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:18.187343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:18.193451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1274/2464] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:17 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1494 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:18.213471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:18.214252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:18.228563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:18.229151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:18.230081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:18.234156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:18.359748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.362731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:18.376612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.378547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.387111 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2769cec0-b725-4eda-bb3e-798414131e99 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1451 microversion: 2.75 time: 0.191100 May 19 08:26:18.388259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1275/2465] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:18 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1451 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:18.393219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5adae063-6fc1-48a0-8b2f-03af2755331e tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3212025700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:18.472258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5adae063-6fc1-48a0-8b2f-03af2755331e tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.082623 May 19 08:26:18.473720 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1276/2466] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:18 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:18.495409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.510082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.511526 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:18.515215 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-72b8f735-d091-4dc0-9586-5272c67646dd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.353440 May 19 08:26:18.529716 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1191/2467] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:18 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:19.176287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:19.177483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:19.194635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.197923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.199778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.200469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.204937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:19.205872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:19.220787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.221645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.224564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.228301 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.700209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:19.709419 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:19.716465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39aa030f-4618-4329-ac7c-06da20e582ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.545314 May 19 08:26:19.717792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1277/2468] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:19 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:19.718835 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e792017e-145a-4692-8606-cf269a56dcf6 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1494 microversion: 2.1 time: 0.518567 May 19 08:26:19.719428 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1192/2469] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:19 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1494 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:19.734911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:19.735814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:19.743967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.744768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.745853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.746224 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1ba68ed1-9f40-4657-97e8-942c328be183 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211804d30>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:19.746753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.847595 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1ba68ed1-9f40-4657-97e8-942c328be183 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.114875 May 19 08:26:19.848184 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1193/2470] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:19 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:19.858222 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:19.858858 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:19.866371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:19.866601 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.867159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.867948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:19.868522 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:19.879374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:19.881548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:19.900621 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-100409c2-9e65-4bc4-9b8c-ea44e8bc7b00 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1436 microversion: 2.75 time: 0.181494 May 19 08:26:19.901938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1278/2471] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:19 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1436 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:20.084345 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:20.097530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:20.100121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:20.101668 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6afa5463-073a-4520-bb39-f8038ab923b3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.252510 May 19 08:26:20.113810 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1194/2472] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:19 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:20.187513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:20.189075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:20.211693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.212160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.212958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.213431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.245618 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-febe69d9-b836-4847-8d3d-77032ed71b68 req-aa6ef1e5-3656-4b10-9da9-0a5f3e35268b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c9cc78-f8e7-4279-848f-d656e6e20c5f", "tag": "b7074007-c11b-4547-827a-d95d357fbf8a"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:20.258697 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-febe69d9-b836-4847-8d3d-77032ed71b68 req-aa6ef1e5-3656-4b10-9da9-0a5f3e35268b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.259383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-febe69d9-b836-4847-8d3d-77032ed71b68 req-aa6ef1e5-3656-4b10-9da9-0a5f3e35268b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.273416 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-febe69d9-b836-4847-8d3d-77032ed71b68 req-aa6ef1e5-3656-4b10-9da9-0a5f3e35268b service nova] Creating event network-changed:b7074007-c11b-4547-827a-d95d357fbf8a for instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f on chh2-842464-2 May 19 08:26:20.284226 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-febe69d9-b836-4847-8d3d-77032ed71b68 req-aa6ef1e5-3656-4b10-9da9-0a5f3e35268b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127758 May 19 08:26:20.285461 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1195/2473] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:20.365662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:26:20.366483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:26:20.367977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:26:20.368679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:26:20.369392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:26:20.479105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:20.486104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.487050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.488073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.489748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.654657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:20.683409 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba642d22-939f-49c5-b9ca-a4bc4f59ee1c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43/action" status: 202 len: 1938 microversion: 2.75 time: 0.766981 May 19 08:26:20.684586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1279/2474] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:26:19 2022] POST /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43/action => generated 1938 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 19 08:26:20.704855 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:20.705607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:20.718161 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.718881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.719930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.720522 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.736196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:20.737221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:20.744423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.745111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.746115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.746865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.923779 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:20.951459 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8096d189-3076-4875-a4fd-6650deafda4b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.250754 May 19 08:26:20.963948 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1196/2475] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:20 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:20.975564 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:20.976712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:20.982964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:20.983681 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.984426 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.985694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:20.987010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:20.991572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06c68135-30b1-4b74-84cd-9050945b5220 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.259263 May 19 08:26:21.001486 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1280/2476] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:20 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:21.006924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6cc16e0-4dd3-4ee2-a39f-5ba7fa11b363 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3212157ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:21.066988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6cc16e0-4dd3-4ee2-a39f-5ba7fa11b363 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.064323 May 19 08:26:21.070360 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1281/2477] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:21 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:21.121137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:21.121789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:21.132144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:21.132658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:21.135004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:21.135446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:21.212823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:21.251307 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c4cfec77-7e6a-4445-b74e-c6087dd64ea4 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1494 microversion: 2.1 time: 0.285901 May 19 08:26:21.254763 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1197/2478] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:20 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1494 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:21.376657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:21.390421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:21.392919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:21.394157 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a89ad702-d45a-435e-8f83-c3ead64439f3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.278063 May 19 08:26:21.394915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1282/2479] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:21 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:21.971035 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:21.971877 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:21.982849 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:21.983948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:21.985662 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:21.986395 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.009365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:22.010004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:22.023116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.025535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.027288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.027748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.101324 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:22.148184 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d3d11077-faad-4e1d-b528-eafb220cabf6 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.180531 May 19 08:26:22.148834 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1198/2480] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:21 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:22.162224 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5833f3fc-8c7a-471b-93d0-6c45326f4a82 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32118d9f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:22.232537 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5833f3fc-8c7a-471b-93d0-6c45326f4a82 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.081016 May 19 08:26:22.233601 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1199/2481] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:22 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:22.272978 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:22.274904 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:22.284020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:22.287293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.292077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.292800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.294701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ee93f4b-7da7-42ab-843d-74603d2a9f0c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.289919 May 19 08:26:22.297132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.304088 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1283/2482] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:22 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:22.416215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:22.417215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:22.419260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:22.445625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.446878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.448091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.448355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.670310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:22.695616 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e04d23b0-44aa-4a35-8d21-0ed0554a518d tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1500 microversion: 2.1 time: 0.427220 May 19 08:26:22.729008 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1200/2483] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:22 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1500 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:22.741149 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:22.742100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:22.764967 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.765475 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.766289 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:22.766726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:22.821051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:26:22.847478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:22.855068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:22.856214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:22.857460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-470a04fe-879d-4141-b45c-c52920fd81b1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.446367 May 19 08:26:22.858367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1284/2484] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:22 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:22.868401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:22.980976 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f6a9ad2b-82e5-4d06-b498-ab93191bcf38 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "DELETE /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 204 len: 0 microversion: 2.1 time: 0.249796 May 19 08:26:22.981853 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1201/2485] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:26:22 2022] DELETE /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:26:22.991158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:22.992154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:22.999798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.000549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.001705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.002423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.170269 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:23.170977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:23.180169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.180519 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.181349 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.186887 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.207120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:23.222018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af8db7b7-6b44-40b4-afbe-34e3e7cf259a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.235853 May 19 08:26:23.233137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1285/2486] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:22 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:23.246685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50497653-902a-46e3-b5ff-693a776708fe tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211d1b430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:23.314918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50497653-902a-46e3-b5ff-693a776708fe tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.072060 May 19 08:26:23.315513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1286/2487] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:23 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:23.335213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:23.338653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:23.358659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.358659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.358659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.358659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.377245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:23.401358 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3a4ad6d2-1a7b-4d68-8197-a09c33f04800 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.235112 May 19 08:26:23.402321 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1202/2488] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:23 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:23.542107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:23.554625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0dcf29ba-847e-463f-9ec5-2c7956524c56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.237492 May 19 08:26:23.556054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1287/2489] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:23 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:23.877675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:23.878567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:23.886764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.887228 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:23.888894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:23.889393 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.065920 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:24.076726 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:24.080211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:24.081851 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b3add900-b3f8-4ef6-b910-fb120f24d169 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.208616 May 19 08:26:24.082958 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1203/2490] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:23 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:24.241092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:24.241752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:24.244904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:24.252055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:24.252429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.253418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:24.253869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.259993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:24.328850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-98809295-e720-43ed-91d8-17eb26ab461a tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32118e1940>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:24.391073 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-98809295-e720-43ed-91d8-17eb26ab461a tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1424 microversion: 2.1 time: 0.066498 May 19 08:26:24.392081 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1204/2491] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:24 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:24.421636 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:24.422660 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:24.431167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:24.432077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:24.432732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.433722 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:24.434343 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.443894 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a305086-d9ae-4137-98c6-e075a6c5911e tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.206555 May 19 08:26:24.445347 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1288/2492] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:24 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:24.531401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:24.554202 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-955d390f-cbec-402c-ab21-9915cafee775 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.137712 May 19 08:26:24.555411 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1205/2493] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:24 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:24.572898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:24.573553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:24.580194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:24.580572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.581366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:24.581802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:24.735093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:24.743763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a817cb48-d333-40bb-ab5b-e77e7df548b5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.174887 May 19 08:26:24.744416 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1289/2494] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:24 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:25.100706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.101371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:25.103300 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:25.108960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.109425 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.110990 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.111438 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.257634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:25.266096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:25.267611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:25.268771 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-353fca19-1fc6-4d03-a13d-fb625621d06c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.172659 May 19 08:26:25.269354 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1206/2495] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:25.404379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56a4e1b6-316e-4a1a-b1e7-f4e4c540f884 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211ebc940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.453963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56a4e1b6-316e-4a1a-b1e7-f4e4c540f884 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1433 microversion: 2.1 time: 0.053502 May 19 08:26:25.454635 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1290/2496] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1433 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:25.467710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5a84aed8-b9ef-4aba-8245-81a1be3364d9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32118e1f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.468225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.468432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:25.475503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.476077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.477149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.477734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.524551 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5a84aed8-b9ef-4aba-8245-81a1be3364d9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 200 len: 1433 microversion: 2.1 time: 0.060777 May 19 08:26:25.525280 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1207/2497] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 1433 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:25.538945 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.539573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:25.547032 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.547486 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.548272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.548713 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.691576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:25.701084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1452649-923d-4729-9f98-9a66151ac3d3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.237138 May 19 08:26:25.701957 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1291/2498] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:25.707800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.708886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:25.717590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.718147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.718801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.719238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.737743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:25.747808 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2de1e6f7-2409-4770-950c-ef3e69d3dcd8 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1466 microversion: 2.1 time: 0.213924 May 19 08:26:25.753402 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1208/2499] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1466 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:25.767635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.768657 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:25.775094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.776096 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.777118 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:25.777620 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:25.803619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:25.829476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf51b6f3-76ed-4c49-898d-bdf64adc409f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.126255 May 19 08:26:25.843275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1292/2500] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:25.843275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfcf0d00-65b3-406a-88c7-6846fce5f148 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211b04e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.894677 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfcf0d00-65b3-406a-88c7-6846fce5f148 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff" status: 200 len: 784 microversion: 2.1 time: 0.061743 May 19 08:26:25.896189 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1293/2501] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/images/666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff => generated 784 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:25.907770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08a210d2-d06e-439c-962c-46057265b2e6 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.917376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08a210d2-d06e-439c-962c-46057265b2e6 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013326 May 19 08:26:25.918305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1294/2502] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:26:25.932799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5887fc0-6049-4128-80bf-b88a0dc98b61 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211ebc940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:25.942410 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:25.952705 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9cd0bca0-ae3d-4d4d-b6d8-251d5dc1a374 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.196309 May 19 08:26:25.953568 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1209/2503] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:25 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:26.287506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:26.288098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:26.295417 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.296223 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.296566 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.297185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.489922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5887fc0-6049-4128-80bf-b88a0dc98b61 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "DELETE /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 204 len: 0 microversion: 2.1 time: 0.562179 May 19 08:26:26.490507 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1295/2504] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:25 2022] DELETE /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:26:26.498735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a787c33f-8944-4665-844d-0712b6796573 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211e885e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:26.523412 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:26.524661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a787c33f-8944-4665-844d-0712b6796573 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] HTTP exception thrown: Image not found. May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a787c33f-8944-4665-844d-0712b6796573 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Request method failure captured: May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 HTTP/1.1 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf8FQS7mVlEMqN8KK-7Ek_TetWs9n86JGoXtJYkxNrIvUI5sZF6fcmZnJJeq2vGAGmZX6PvvmCdT9qJFgdMifbWl1DV7Agfa8CYhb9PTAUAn_SGqegPIqHc8uj41Wyf_-Gy2pKxajjkIDcQYLb2wwYXULgOvuUXU-Ab2swh5DVx1sRs May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 506115ac4a6f4e12bd31e9db0d15b3d8 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 506115ac4a6f4e12bd31e9db0d15b3d8 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerTestJSON-1179739545-project May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 4444c61e2c03455992d6bcf1835a8709 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerTestJSON-1179739545-project May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'bb5979f8-a851-4023-b1ea-6759c979eb89'} May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bb5979f8-a851-4023-b1ea-6759c979eb89 May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:26:26.527313 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb5979f8-a851-4023-b1ea-6759c979eb89 could not be found. May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a787c33f-8944-4665-844d-0712b6796573 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:26:26.531807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a787c33f-8944-4665-844d-0712b6796573 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 404 len: 62 microversion: 2.1 time: 0.034039 May 19 08:26:26.535483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1296/2505] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:26 2022] GET /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:26:26.541437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-977816600"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:26.542579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:26.544642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:26.546792 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:26.548564 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-df61f248-304d-4a15-9b3f-dc1138dc0d9a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.265103 May 19 08:26:26.557513 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1210/2506] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:26 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:26.557699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.557699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.557699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.557699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.571432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:26.720036 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:26.720675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:26.727932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.728379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.729150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.729611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.886876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7de0a2db-d4b6-4a26-b7f7-de0094426f1b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "POST /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.350149 May 19 08:26:26.888240 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1297/2507] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:26:26 2022] POST /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:26:26.895043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:26.896005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:26.904375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.904828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.906209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:26.907267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:26.919539 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:26.945739 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-33eed116-0ef0-4021-bdfb-7977cd2484ea tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.229379 May 19 08:26:26.946409 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1211/2508] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:26 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:26.962729 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cea43052-ccad-4284-8406-7e9c96c71eab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f321173ca60>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:27.017032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:27.022628 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cea43052-ccad-4284-8406-7e9c96c71eab tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.074695 May 19 08:26:27.023230 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1212/2509] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:26 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:27.028958 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:27.030281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:27.038753 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:27.039213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:27.040247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:27.040749 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:27.048326 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4402ecdb-d086-45a8-9143-76cf129f78ba tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.158563 May 19 08:26:27.049596 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1298/2510] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:26 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:27.214708 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:27.224416 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-89a9443c-2274-423a-892e-68d471389821 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.199150 May 19 08:26:27.225280 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1213/2511] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:27 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:27.569798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:27.570989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:27.578936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:27.579735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:27.580907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:27.581606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:27.964757 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:27.965927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:27.980117 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:27.980575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:27.982893 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:27.985123 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.149863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:28.176088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:28.178431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:28.179749 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b459d502-5393-4b97-b021-db86dc0b0cd2 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.614779 May 19 08:26:28.192040 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1299/2512] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:27 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:28.200292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18f3a03c-3a73-4f80-9acb-d2bb4def5a75 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f321217edc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:28.258391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18f3a03c-3a73-4f80-9acb-d2bb4def5a75 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.062419 May 19 08:26:28.259248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1300/2513] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:28 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:28.270157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:28.271335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:28.277620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:28.278072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.278846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:28.279279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.282718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:28.293760 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-85c176de-60ac-400c-be41-babbb1d717b3 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1506 microversion: 2.1 time: 0.332926 May 19 08:26:28.302205 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1214/2514] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:27 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:28.313674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:28.314732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:28.329409 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:28.329811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.330965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:28.331533 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.434107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:28.484379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d59c7938-06a3-422f-9d87-c8ff0b023f08 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.218065 May 19 08:26:28.485131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1301/2515] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:28 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:28.690817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4631e75d-cac9-4432-ab9d-097b83ba8214 req-64feece5-bdbb-4e90-ae13-a15b1ba8f57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365b103e-7914-4f7c-a05e-38a781ec2b84", "name": "network-vif-deleted", "tag": "86171350-e229-401c-a171-6ec18297f34c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:28.705069 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:28.715692 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d746d304-0f6f-4268-baec-9060ad05859e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.410123 May 19 08:26:28.726882 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1215/2516] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:28 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:28.727694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4631e75d-cac9-4432-ab9d-097b83ba8214 req-64feece5-bdbb-4e90-ae13-a15b1ba8f57b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:28.731787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4631e75d-cac9-4432-ab9d-097b83ba8214 req-64feece5-bdbb-4e90-ae13-a15b1ba8f57b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.761238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4631e75d-cac9-4432-ab9d-097b83ba8214 req-64feece5-bdbb-4e90-ae13-a15b1ba8f57b service nova] Creating event network-vif-deleted:86171350-e229-401c-a171-6ec18297f34c for instance 365b103e-7914-4f7c-a05e-38a781ec2b84 on chh2-842464-2 May 19 08:26:28.767622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4631e75d-cac9-4432-ab9d-097b83ba8214 req-64feece5-bdbb-4e90-ae13-a15b1ba8f57b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082725 May 19 08:26:28.768976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1302/2517] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:28.869041 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-30d44332-9ef4-4541-8798-1e8c6e9c81a5 req-30d1d488-7d39-4f1e-b491-3cb980cb23a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "name": "network-vif-unplugged", "status": "completed", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:28.910554 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-30d44332-9ef4-4541-8798-1e8c6e9c81a5 req-30d1d488-7d39-4f1e-b491-3cb980cb23a4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:28.910993 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-30d44332-9ef4-4541-8798-1e8c6e9c81a5 req-30d1d488-7d39-4f1e-b491-3cb980cb23a4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:28.925848 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-30d44332-9ef4-4541-8798-1e8c6e9c81a5 req-30d1d488-7d39-4f1e-b491-3cb980cb23a4 service nova] Creating event network-vif-unplugged:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:26:28.932938 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-30d44332-9ef4-4541-8798-1e8c6e9c81a5 req-30d1d488-7d39-4f1e-b491-3cb980cb23a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073351 May 19 08:26:28.934325 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1216/2518] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:29.203312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:29.204643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:29.213252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.214288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.215711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.216714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.278107 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-452ee67d-13f1-4fd5-98e9-55378d305b09 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32118d90d0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:29.359586 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-452ee67d-13f1-4fd5-98e9-55378d305b09 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.083084 May 19 08:26:29.359586 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1217/2519] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:29 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:29.368415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:29.372704 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:29.389954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.393623 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.394572 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.395120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.435833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:29.447280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:29.449107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:29.450475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fa3756a-bda8-4595-a2f5-9c09ea6fc66e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.255496 May 19 08:26:29.451546 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1303/2520] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:29 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:29.482252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.482930 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.483553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lazy-loading 'fault' on Instance uuid 365b103e-7914-4f7c-a05e-38a781ec2b84 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:29.507934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:29.508715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:29.522840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.523418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.524260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.524749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.575461 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:29.586336 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ebbc9996-b1f7-43dc-a632-b67d0f154f74 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 200 len: 1304 microversion: 2.1 time: 0.232539 May 19 08:26:29.586936 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1218/2521] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:29 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:29.647753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:29.676521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-541587c1-ea53-4100-8afb-7d6d5b99bbb2 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.172524 May 19 08:26:29.678917 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1304/2522] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:29 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:29.735937 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:29.736575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:29.745939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.747115 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.748190 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:29.749712 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:29.959739 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:29.970144 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2f68b52b-5da8-4913-94e7-df97cdb2dc58 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.240381 May 19 08:26:29.970740 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1219/2523] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:29 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:30.367456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93e7d213-6555-492e-8b4e-bcef27b3b971 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f321217e9d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:30.434321 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93e7d213-6555-492e-8b4e-bcef27b3b971 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.071369 May 19 08:26:30.437954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1305/2524] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:30 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:30.469613 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:30.470356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:30.478101 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.478573 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.479325 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.479761 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.604248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:30.605164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: 365b103e-7914-4f7c-a05e-38a781ec2b84] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:30.614815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.615546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.616508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.617094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.631775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] HTTP exception thrown: Instance 365b103e-7914-4f7c-a05e-38a781ec2b84 could not be found. May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Request method failure captured: May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 HTTP/1.1 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6xzqP0VpbHYKuYS3Szwv31fWj28qzTM9MQqBJpWqEnPCi48AAsEyf0j-WCk7HKen6FsVYE1c9qDXaYhV8Tp5neiDrZS-Qjq9G2fj6RPUn5t3xFXErDjdxN69rNaRnGKTSJJIplVQ_CDwrmw4W_yuPsHVlP_D7JowPiUYZ2JcZqnlY May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7b66ea12d6964ec68ba46b8305b68cef May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueTestJSON-991923412 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueTestJSON-991923412 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7b66ea12d6964ec68ba46b8305b68cef May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueTestJSON-991923412 May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueTestJSON-991923412-project May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7922e2a372443b1b1330dd16ba60b4e May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueTestJSON-991923412-project May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 365b103e-7914-4f7c-a05e-38a781ec2b84 could not be found. May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '365b103e-7914-4f7c-a05e-38a781ec2b84'} May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 365b103e-7914-4f7c-a05e-38a781ec2b84 could not be found. May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 365b103e-7914-4f7c-a05e-38a781ec2b84 could not be found. May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:30.633787 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 365b103e-7914-4f7c-a05e-38a781ec2b84 could not be found. May 19 08:26:30.637856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:30.639018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Returning 404 to user: Instance 365b103e-7914-4f7c-a05e-38a781ec2b84 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:26:30.640036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfc3fe86-80e2-435c-b7a3-cc71b1e7f6a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84" status: 404 len: 111 microversion: 2.1 time: 0.039958 May 19 08:26:30.643858 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1306/2525] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:30 2022] GET /compute/v2.1/servers/365b103e-7914-4f7c-a05e-38a781ec2b84 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:26:30.649529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:30.650254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:30.657004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.657737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.658831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.659651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.694864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:26:30.773485 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:30.784862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:30.788375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:30.789682 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-94c5e089-cf46-4b40-8db1-da2fedae6628 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.324014 May 19 08:26:30.805977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df138453-3699-4d46-abf2-99388ac06042 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 204 len: 0 microversion: 2.1 time: 0.160214 May 19 08:26:30.815582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1307/2526] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:26:30 2022] DELETE /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:26:30.822612 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1220/2527] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:30 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:30.824124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:30.825159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:30.841934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.842200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.843035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.843629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.846527 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:30.847151 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:30.877575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.881939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.883011 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:30.883610 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:30.888793 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:31.025158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:31.044125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2807792-5c69-4f01-bb64-7d43204f366c tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.230390 May 19 08:26:31.045101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1308/2528] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:30 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:31.050594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:31.051400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:31.058086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:31.058743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:31.059665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:31.060081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:31.264647 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:31.275587 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1d11c9cb-4aba-4c0c-b739-9b685c0dc4e2 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1492 microversion: 2.1 time: 0.449928 May 19 08:26:31.276326 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1221/2529] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:30 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1492 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:31.360145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:31.372010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20fb1391-d647-401d-8041-c21e9e87c63c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.325236 May 19 08:26:31.382158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1309/2530] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:31 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:31.452381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-614b8b3e-42b6-4548-8bb9-8fdd74ac2d77 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32119801f0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:31.525012 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-614b8b3e-42b6-4548-8bb9-8fdd74ac2d77 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.077254 May 19 08:26:31.526936 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1222/2531] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:31 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:31.819372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-749b1f6d-6e04-4b6a-a16a-56d9c0157ee3 req-d5eec7d5-07e6-4d09-b2b7-e1f18b5ba514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c9cc78-f8e7-4279-848f-d656e6e20c5f", "name": "network-vif-plugged", "status": "completed", "tag": "b7074007-c11b-4547-827a-d95d357fbf8a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:31.831431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-749b1f6d-6e04-4b6a-a16a-56d9c0157ee3 req-d5eec7d5-07e6-4d09-b2b7-e1f18b5ba514 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:31.832173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-749b1f6d-6e04-4b6a-a16a-56d9c0157ee3 req-d5eec7d5-07e6-4d09-b2b7-e1f18b5ba514 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:31.848567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-749b1f6d-6e04-4b6a-a16a-56d9c0157ee3 req-d5eec7d5-07e6-4d09-b2b7-e1f18b5ba514 service nova] Creating event network-vif-plugged:b7074007-c11b-4547-827a-d95d357fbf8a for instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f on chh2-842464-2 May 19 08:26:31.860694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-749b1f6d-6e04-4b6a-a16a-56d9c0157ee3 req-d5eec7d5-07e6-4d09-b2b7-e1f18b5ba514 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046380 May 19 08:26:31.861744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1310/2532] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:31.886822 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:31.887823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:31.894816 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:31.895946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:31.897199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:31.897862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.071850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:32.073256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:32.082190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:32.084580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.086149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:32.086840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.092873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:32.105619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:32.107642 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:32.109005 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7fed94a8-7778-4af0-a2da-afe0baba6272 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.226387 May 19 08:26:32.122216 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1223/2533] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:31 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:32.209484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:32.238004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61a09aa1-facf-4cf7-ab8f-3566e263252a tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.174653 May 19 08:26:32.238504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1311/2534] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:32 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:32.296160 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:32.296898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:32.304465 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:32.304931 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.305776 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:32.306588 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.399938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:32.401855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:32.408682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:32.409146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.410093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:32.411629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:32.466211 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:32.476521 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-59794a8a-3a6a-4d67-89f2-dd532b28da7a tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1492 microversion: 2.1 time: 0.184399 May 19 08:26:32.477810 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1224/2535] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:32 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1492 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:32.542480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4dbe73cb-44a6-4836-8fee-09aac8164f73 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32118e1040>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:32.600518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:32.615457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2aa85873-667d-4fa6-8af8-6c6320624d9e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1315 microversion: 2.1 time: 0.219934 May 19 08:26:32.616107 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1312/2536] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:32 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:32.627137 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4dbe73cb-44a6-4836-8fee-09aac8164f73 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.090464 May 19 08:26:32.627948 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1225/2537] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:32 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:33.143243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:33.144511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:33.159671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.160152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.161297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.161880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.181162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:33.258947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:33.259846 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:33.278204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.278710 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.279569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.280198 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.318376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:33.329535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:33.331711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:33.334111 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81265469-cd2a-4941-bb38-212869b41440 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.197729 May 19 08:26:33.334963 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1313/2538] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:33 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:33.371092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:33.390874 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-735fd5c4-3528-4fca-990f-4d9310fcfd34 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.135816 May 19 08:26:33.391367 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1226/2539] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:33 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:33.495903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:33.496718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:33.504108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.505456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.506789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.507236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.633646 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:33.634355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:33.641446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.641839 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.642628 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.643068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.679212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:33.689041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56932b7e-6e59-4927-99a1-56a0fa6872a9 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1492 microversion: 2.1 time: 0.197971 May 19 08:26:33.689691 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1314/2540] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:33 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1492 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:33.696411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55252551-46d5-43ed-8c06-6bf484bd08cd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211e98b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:33.751495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55252551-46d5-43ed-8c06-6bf484bd08cd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.060751 May 19 08:26:33.752087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1315/2541] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:33 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:33.795659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:33.804126 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2a77a72f-32f4-46bb-9023-008e37a505ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1501 microversion: 2.1 time: 0.175988 May 19 08:26:33.804700 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1227/2542] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:33 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:33.820203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31b80aee-caa1-42bb-8277-cf1c0cf175b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:33.826620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31b80aee-caa1-42bb-8277-cf1c0cf175b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.827077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31b80aee-caa1-42bb-8277-cf1c0cf175b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.882204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-45439c61-42e5-4fae-a292-b27943921931 req-ac6d610c-1699-4ca4-a5d8-eb1b2b33eef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "name": "network-vif-plugged", "status": "completed", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:33.890436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31b80aee-caa1-42bb-8277-cf1c0cf175b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:26:33.890864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-45439c61-42e5-4fae-a292-b27943921931 req-ac6d610c-1699-4ca4-a5d8-eb1b2b33eef2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.891780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-45439c61-42e5-4fae-a292-b27943921931 req-ac6d610c-1699-4ca4-a5d8-eb1b2b33eef2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.903886 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-45439c61-42e5-4fae-a292-b27943921931 req-ac6d610c-1699-4ca4-a5d8-eb1b2b33eef2 service nova] Creating event network-vif-plugged:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:26:33.908887 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-45439c61-42e5-4fae-a292-b27943921931 req-ac6d610c-1699-4ca4-a5d8-eb1b2b33eef2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030721 May 19 08:26:33.909523 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1228/2543] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:26:33.935776 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31b80aee-caa1-42bb-8277-cf1c0cf175b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.119275 May 19 08:26:33.936425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1316/2544] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:26:33 2022] POST /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:26:33.946072 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:33.946863 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:33.954617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.955094 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:33.956121 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:33.956799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.188298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:34.197723 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9440fc6f-b23a-48ca-bbdc-0d4ddffea8bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.256654 May 19 08:26:34.208635 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1229/2545] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:33 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:34.355464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:34.356478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:34.375416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:34.376574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.377852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:34.378606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.415489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:34.416084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:34.429356 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:34.430204 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.433267 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:34.433907 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.605617 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:34.627114 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-09c5eb0d-5b24-4ff9-8fd8-8aab9cc2c305 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.221043 May 19 08:26:34.628370 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1230/2546] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:34 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:34.698014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:34.710567 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:34.711280 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:34.715696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:34.718753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:34.720909 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf79054d-6648-4e82-acc0-d2b582e8da57 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.372105 May 19 08:26:34.722239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1317/2547] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:34 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:34.726791 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:34.734590 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:34.735529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.737965 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:34.738639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:34.764583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-462ae97e-81a6-4bac-941f-169d9e05c0dc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217b7d3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:34.875179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-462ae97e-81a6-4bac-941f-169d9e05c0dc tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.114279 May 19 08:26:34.876909 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1318/2548] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:34 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:34.987582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:34.988193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:34.991405 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:34.999250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.002165 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-526574d9-bd2f-41a9-9803-db4871924123 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1450 microversion: 2.1 time: 0.298069 May 19 08:26:35.003780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.006202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.006469 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1231/2549] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:34 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1450 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:35.009818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.074974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-d1451413-d671-416b-aa7e-c0b87d42c407 req-9f85cf9b-08f8-4a25-939b-6003220d9176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13633aa-6210-4efa-9610-ec0ae1b75c99", "name": "network-vif-deleted", "tag": "9ec0d21d-bf64-49f3-b518-13e28672352b"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:35.080442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:26:35.099297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d1451413-d671-416b-aa7e-c0b87d42c407 req-9f85cf9b-08f8-4a25-939b-6003220d9176 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.099998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-d1451413-d671-416b-aa7e-c0b87d42c407 req-9f85cf9b-08f8-4a25-939b-6003220d9176 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.116109 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-d1451413-d671-416b-aa7e-c0b87d42c407 req-9f85cf9b-08f8-4a25-939b-6003220d9176 service nova] Creating event network-vif-deleted:9ec0d21d-bf64-49f3-b518-13e28672352b for instance d13633aa-6210-4efa-9610-ec0ae1b75c99 on chh1-842464-2 May 19 08:26:35.125654 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-d1451413-d671-416b-aa7e-c0b87d42c407 req-9f85cf9b-08f8-4a25-939b-6003220d9176 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056672 May 19 08:26:35.127085 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1232/2550] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:35.218947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:35.220120 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:35.252188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.254541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.260150 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.261891 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.269412 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85c64780-d4ab-41cb-9128-963b9037d74b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 204 len: 0 microversion: 2.1 time: 0.285853 May 19 08:26:35.270099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1319/2551] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:26:34 2022] DELETE /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:26:35.283541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:35.284259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:35.300691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.301139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.301992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.302593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.529063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:35.542707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e93ac4b4-1f50-4a93-8217-e9fb10af0849 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1549 microversion: 2.1 time: 0.266614 May 19 08:26:35.543378 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1320/2552] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:35 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:35.638034 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:35.650390 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-9a35a504-900e-441f-ae79-148d9469f8e8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.435547 May 19 08:26:35.661489 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1233/2553] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:35 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:35.661772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:35.661772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:35.666279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.667066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.668446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.669265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.745296 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:35.745851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:35.754218 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.755671 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.756673 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:35.757276 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:35.823977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:35.862963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67cc9bf6-1e7b-40f8-a3dc-899395037023 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.216279 May 19 08:26:35.864608 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1321/2554] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:35 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:35.891374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30498a31-6a58-439d-b1c2-9e5c8bbd2a53 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211d55040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:35.959369 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30498a31-6a58-439d-b1c2-9e5c8bbd2a53 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.073616 May 19 08:26:35.969925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1322/2555] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:35 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:36.023770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:36.024830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:36.032930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.033772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.034755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.035492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.052335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:36.066817 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:36.070404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:36.072088 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f2dbbdaa-b876-4920-b895-5ffab8b2be9e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.330847 May 19 08:26:36.073208 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1234/2556] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:35 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:36.091871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.092858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.093955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lazy-loading 'fault' on Instance uuid d13633aa-6210-4efa-9610-ec0ae1b75c99 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:36.145899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:36.155955 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8948a8e4-835d-4883-bd95-442c86d5db93 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1304 microversion: 2.1 time: 0.136940 May 19 08:26:36.157176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1323/2557] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:36 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:36.561745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:36.563505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:36.574864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.575669 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.576598 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.577184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.675474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:36.676688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:36.705647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.706650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.707826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.709015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.780455 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:36.799866 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-09fa2a29-e7b7-47c9-abc8-a554aadc7bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1549 microversion: 2.1 time: 0.243024 May 19 08:26:36.800478 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1235/2558] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:36 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1549 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:36.887083 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:36.888359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:36.900918 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.903479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:36.905900 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:36.906449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.010235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:37.012449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:37.020312 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f074f77-e208-41ab-8b09-b1b74b3d6ebe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.352825 May 19 08:26:37.022567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1324/2559] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:36 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:37.035095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37908744-c0f1-45ae-a99e-b5152a9260a9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217b7d4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:37.041673 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e29e5023-4fa5-4829-bb44-cb71a6b49b73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.160010 May 19 08:26:37.042500 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1236/2560] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:36 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:37.091378 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:37.092049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:37.103785 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-37908744-c0f1-45ae-a99e-b5152a9260a9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.079867 May 19 08:26:37.105111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1325/2561] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:37 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:37.105506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.105962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.106799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.107429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.174727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:37.175695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:37.189452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.190213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.191242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.191896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.265660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.278320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.279079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lazy-loading 'fault' on Instance uuid d13633aa-6210-4efa-9610-ec0ae1b75c99 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:37.330033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:37.373098 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:37.378024 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:37.391080 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b5852047-3684-47d2-8a53-7e1f4059e16e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.293649 May 19 08:26:37.391749 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1237/2562] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:37 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:37.403431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7922e2a372443b1b1330dd16ba60b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b66ea12d6964ec68ba46b8305b68cef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:37.414817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0be4d1da-3195-433f-9de5-208d2e8708bd tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 200 len: 1304 microversion: 2.1 time: 0.244293 May 19 08:26:37.415518 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1326/2563] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:37 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 1304 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:37.819101 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:37.819832 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:37.841816 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.842631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:37.843743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:37.844415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.042176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:38.043714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:38.059043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.060274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.061578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.062617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.276873 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:38.286628 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-66c98734-6dea-4ee5-b528-7e664ff93615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1549 microversion: 2.1 time: 0.472191 May 19 08:26:38.297504 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1238/2564] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:37 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1549 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:38.303285 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:38.304135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:38.311277 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.311961 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.313085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.313746 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.459748 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:38.460203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:38.476619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:38.477791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfb2281c-35db-4d16-bbbe-5c08fe310e79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.441267 May 19 08:26:38.482779 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1327/2565] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:38 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:38.489572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb5ffd47-49d0-4659-b495-a7360de97146 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217b7d160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:38.499569 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e5fb52eb-0f3c-4c5c-999d-c7f224998e9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.200561 May 19 08:26:38.506187 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1239/2566] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:38 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:38.516948 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:38.518980 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:38.539159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.539159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.539159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.539159 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.561145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb5ffd47-49d0-4659-b495-a7360de97146 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.076327 May 19 08:26:38.566617 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1328/2567] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:38 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:38.575493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:38.578035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] [instance: d13633aa-6210-4efa-9610-ec0ae1b75c99] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:38.592277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.592857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.593732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:38.595260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:38.613275 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] HTTP exception thrown: Instance d13633aa-6210-4efa-9610-ec0ae1b75c99 could not be found. May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Request method failure captured: May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 HTTP/1.1 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6xzqP0VpbHYKuYS3Szwv31fWj28qzTM9MQqBJpWqEnPCi48AAsEyf0j-WCk7HKen6FsVYE1c9qDXaYhV8Tp5neiDrZS-Qjq9G2fj6RPUn5t3xFXErDjdxN69rNaRnGKTSJJIplVQ_CDwrmw4W_yuPsHVlP_D7JowPiUYZ2JcZqnlY May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7b66ea12d6964ec68ba46b8305b68cef May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueTestJSON-991923412 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7b66ea12d6964ec68ba46b8305b68cef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueTestJSON-991923412 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7b66ea12d6964ec68ba46b8305b68cef May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueTestJSON-991923412 May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueTestJSON-991923412-project May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7922e2a372443b1b1330dd16ba60b4e May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueTestJSON-991923412-project May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d13633aa-6210-4efa-9610-ec0ae1b75c99 could not be found. May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd13633aa-6210-4efa-9610-ec0ae1b75c99'} May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13633aa-6210-4efa-9610-ec0ae1b75c99 could not be found. May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13633aa-6210-4efa-9610-ec0ae1b75c99 could not be found. May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:38.616118 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13633aa-6210-4efa-9610-ec0ae1b75c99 could not be found. May 19 08:26:38.621126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:38.623124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] Returning 404 to user: Instance d13633aa-6210-4efa-9610-ec0ae1b75c99 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:26:38.624317 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2367280-8fec-452a-9cfa-df985800fe30 tempest-ServerRescueTestJSON-991923412 tempest-ServerRescueTestJSON-991923412-project] 10.222.0.78 "GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99" status: 404 len: 111 microversion: 2.1 time: 0.056165 May 19 08:26:38.625054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1329/2568] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:38 2022] GET /compute/v2.1/servers/d13633aa-6210-4efa-9610-ec0ae1b75c99 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:26:39.291984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:39.308412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:39.309015 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:39.309193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:39.316874 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:39.323203 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-26fedba8-eadf-4783-80ec-a9f58982c5d3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.813925 May 19 08:26:39.324445 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1240/2569] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:38 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:39.335426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:39.335878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:39.336734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:39.337204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:39.501774 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:39.502469 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:39.518016 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:39.520085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:39.523038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:39.524932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:39.611442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:39.629066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6170465-2d57-4f88-9df9-82c252eac332 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1507 microversion: 2.1 time: 0.328219 May 19 08:26:39.633575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1330/2570] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:39 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:39.642153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:39.645565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:39.662395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:39.668309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:39.671074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:39.673534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:39.675355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:39.914879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:39.964592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:39.983450 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-047798fd-3c79-421e-86c2-ad5b64e0e721 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.348701 May 19 08:26:39.986900 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1331/2571] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:39 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:39.998699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fdedf7a3-0fea-4340-98e0-d7e7358b5877 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211e1eee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:40.080649 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fdedf7a3-0fea-4340-98e0-d7e7358b5877 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.090447 May 19 08:26:40.081662 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1332/2572] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:39 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:40.092333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-52f87657-fe27-4e4c-8b90-1957e9139749 req-8b44cca1-dfad-4b7a-b06a-8f447ead98a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b79bad-0fe9-46cb-9eca-4ccbe3e70234", "name": "network-vif-unplugged", "status": "completed", "tag": "456143eb-7f9b-4b6f-a56e-75a2953883c6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:40.112962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-52f87657-fe27-4e4c-8b90-1957e9139749 req-8b44cca1-dfad-4b7a-b06a-8f447ead98a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:40.113437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-52f87657-fe27-4e4c-8b90-1957e9139749 req-8b44cca1-dfad-4b7a-b06a-8f447ead98a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:40.139292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:40.148117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-52f87657-fe27-4e4c-8b90-1957e9139749 req-8b44cca1-dfad-4b7a-b06a-8f447ead98a1 service nova] Creating event network-vif-unplugged:456143eb-7f9b-4b6f-a56e-75a2953883c6 for instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 on chh1-842464-2 May 19 08:26:40.150251 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-446b6078-3249-401f-a653-13613d63c9bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.653085 May 19 08:26:40.159709 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1241/2573] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:39 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:40.159927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-52f87657-fe27-4e4c-8b90-1957e9139749 req-8b44cca1-dfad-4b7a-b06a-8f447ead98a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067071 May 19 08:26:40.159927 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1333/2574] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:40.342862 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:40.343535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:40.354379 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:40.354836 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:40.355645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:40.356089 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:40.657441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:40.659126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:40.688478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:40.690301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:40.692908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:40.693679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:40.824738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:40.839946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:40.846152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:40.853016 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-86f5d456-6c38-43b8-8f8a-4bf9a07415cc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.508948 May 19 08:26:40.853731 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1242/2575] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:40 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:40.881564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:40.896601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1527e84-deb9-42b0-95cd-27d580d080ef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.244132 May 19 08:26:40.897830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1334/2576] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:40 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:41.008594 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:41.009244 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:41.021458 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.026374 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.028441 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.029427 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.095669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f5788f1-3392-4e94-90be-daedf530b507 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217ae9ca0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:41.171547 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f5788f1-3392-4e94-90be-daedf530b507 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.080582 May 19 08:26:41.172134 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1335/2577] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:41 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:41.193740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:41.194719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:41.214426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.214937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.215751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.216186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.247165 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:41.318295 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-60280ff8-f57e-4106-ba33-f199457fba9b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.308045 May 19 08:26:41.334224 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1243/2578] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:41 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:41.675371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:41.686080 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3f394e0-6d43-4ee4-9a8e-e810d9f3abd3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.512910 May 19 08:26:41.705969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1336/2579] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:41 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:41.876896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:41.876896 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:41.890538 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.891001 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.891800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.892234 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.916485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:41.917125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:41.936907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.939010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:41.943392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:41.945908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:42.228240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:42.270692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b452dc5c-a4e0-4b1e-baf2-b50026b25477 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.349834 May 19 08:26:42.274887 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1337/2580] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:41 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:42.289980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f824534c-d963-4255-a91c-01d0044dfc43 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211e88e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:42.385616 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f824534c-d963-4255-a91c-01d0044dfc43 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.108231 May 19 08:26:42.411637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:42.434131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1338/2581] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:42 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:42.442241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-140da368-2081-450f-ae95-19986c850ace req-7583cc96-fc32-46d2-b5b7-609d0f845014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2d627a-8b5c-49b5-9a3b-5c255187b78d", "name": "network-vif-deleted", "tag": "f6a0400f-13d4-4432-9f38-e012b268019a"}, {"name": "network-changed", "server_uuid": "75b79bad-0fe9-46cb-9eca-4ccbe3e70234", "tag": "456143eb-7f9b-4b6f-a56e-75a2953883c6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:42.456675 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:42.457255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-140da368-2081-450f-ae95-19986c850ace req-7583cc96-fc32-46d2-b5b7-609d0f845014 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:42.459013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-140da368-2081-450f-ae95-19986c850ace req-7583cc96-fc32-46d2-b5b7-609d0f845014 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:42.460926 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:42.468152 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a9a1acdf-7df3-43f8-80d4-7f6539335605 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.597703 May 19 08:26:42.474385 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1244/2582] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:41 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:42.479253 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:42.479884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:42.493513 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-140da368-2081-450f-ae95-19986c850ace req-7583cc96-fc32-46d2-b5b7-609d0f845014 service nova] Creating event network-vif-deleted:f6a0400f-13d4-4432-9f38-e012b268019a for instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d on chh1-842464-2 May 19 08:26:42.494426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-140da368-2081-450f-ae95-19986c850ace req-7583cc96-fc32-46d2-b5b7-609d0f845014 service nova] Creating event network-changed:456143eb-7f9b-4b6f-a56e-75a2953883c6 for instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 on chh1-842464-2 May 19 08:26:42.497369 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:42.497881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:42.501189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:42.503989 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:42.515068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-140da368-2081-450f-ae95-19986c850ace req-7583cc96-fc32-46d2-b5b7-609d0f845014 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077947 May 19 08:26:42.517289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1339/2583] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:42.716279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:42.717867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:42.724397 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:42.734248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:42.738011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:42.739204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:42.739866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:42.791583 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-18386363-f6ee-4661-b472-b9325e0f3d1b tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.315947 May 19 08:26:42.792203 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1245/2584] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:42 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:43.202580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:43.215821 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6087ca12-d1ab-4a20-98f0-e2c6c23ab6b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.505020 May 19 08:26:43.219398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1340/2585] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:42 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:43.288398 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:43.290254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:43.304272 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:43.305048 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:43.306128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:43.306764 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:43.416672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-686e2a24-5844-45ad-ab50-788c989f6670 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217ae9670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:43.522259 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-686e2a24-5844-45ad-ab50-788c989f6670 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.116080 May 19 08:26:43.523308 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1341/2586] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:43 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:43.537877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:43.538504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:43.563322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:43.571695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:43.572715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:43.573176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:43.818478 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:43.829188 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-68a07fe5-62c0-4055-85fb-5cb06c7b45bb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.545060 May 19 08:26:43.834348 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1246/2587] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:43 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:43.850003 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:43.851044 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:43.858556 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:43.866199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:43.867063 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:43.867508 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:43.986329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:44.002109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:44.012983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:44.022374 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8507616-604b-4725-b326-4d8578c04cc3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.497894 May 19 08:26:44.023297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1342/2588] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:43 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:44.122825 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:44.163347 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ce46f430-fd4a-4225-9f94-9c08d73588e5 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.327466 May 19 08:26:44.164287 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1247/2589] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:43 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:44.237203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:44.238359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:44.256652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:44.257741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:44.259038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:44.261228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:44.535677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4c0e448f-3a64-4741-98f1-d4601741ac69 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f32179f1160>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:44.617075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:44.631145 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4c0e448f-3a64-4741-98f1-d4601741ac69 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.099435 May 19 08:26:44.632035 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1248/2590] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:44 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:44.639495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-baf9bcef-f5ca-4dcf-9d59-01b5cd7a9b5e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.407340 May 19 08:26:44.642896 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1343/2591] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:44 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:44.851693 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:44.852208 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:44.869833 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:44.870311 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:44.871143 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:44.871596 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:45.041098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:45.041928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:45.063399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:45.065334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:45.071920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:45.076512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:45.159322 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:45.200399 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f0dc52c6-afc4-41be-8d5a-a3edff2cc029 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.352433 May 19 08:26:45.202830 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1249/2592] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:44 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:45.219176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:45.220156 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:45.237892 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:45.240235 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:45.244875 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:45.245658 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:45.684957 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.objects.instance [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:45.788716 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b9efd0a7-c6f7-496e-975e-4cef6aa67b86 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.583461 May 19 08:26:45.790041 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1250/2593] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:45 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:45.806659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d58506c6-f7f5-4fae-b2ac-50dbc870ed60 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211980f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:45.891142 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d58506c6-f7f5-4fae-b2ac-50dbc870ed60 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.099885 May 19 08:26:45.893710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:45.898347 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1251/2594] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:45 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:45.905099 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:45.911339 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:45.912673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:45.923932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:45.928103 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:45.928282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b20b0ddd-3902-4fbb-838c-0b7ec0799225 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.891124 May 19 08:26:45.933284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1344/2595] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:45 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:45.933881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:45.935187 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:45.941514 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:46.218610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:46.219932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:46.235387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:46.236186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:46.237177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:46.237841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:46.414762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:46.431713 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82acd9ea-f8d3-4f27-b0b4-c1e5365e8ccd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.216695 May 19 08:26:46.438677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1345/2596] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:46 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:46.582297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:46.600676 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b4775d09-8047-4bd9-90ce-fa066d19fb1f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.698591 May 19 08:26:46.601649 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1252/2597] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:45 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:46.826631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:46.827538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:46.845046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:46.850668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:46.851985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:46.853045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:46.905444 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-08c9784c-d875-4863-8c96-d800bc014487 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217a02dc0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:46.986639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:47.014463 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-08c9784c-d875-4863-8c96-d800bc014487 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.112790 May 19 08:26:47.018393 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1253/2598] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:46 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:47.029194 chdv-842464-2 devstack@n-api.service[119073]: Traceback (most recent call last): May 19 08:26:47.029194 chdv-842464-2 devstack@n-api.service[119073]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 19 08:26:47.029194 chdv-842464-2 devstack@n-api.service[119073]: timer() May 19 08:26:47.029588 chdv-842464-2 devstack@n-api.service[119073]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 19 08:26:47.029588 chdv-842464-2 devstack@n-api.service[119073]: cb(*args, **kw) May 19 08:26:47.029588 chdv-842464-2 devstack@n-api.service[119073]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire May 19 08:26:47.029588 chdv-842464-2 devstack@n-api.service[119073]: waiter.switch() May 19 08:26:47.029588 chdv-842464-2 devstack@n-api.service[119073]: greenlet.error: cannot switch to a different thread May 19 08:26:47.034912 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:47.035676 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:47.036474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-053bffc0-c5e4-4a14-a0e8-c8d50234ff73 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.211387 May 19 08:26:47.037586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1346/2599] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:46 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:47.077577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:47.078283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:47.079033 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:47.081480 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:47.404264 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:47.413281 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:47.415079 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:47.416414 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c9da4115-c973-42f3-85c1-aa32179cdd07 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.396914 May 19 08:26:47.417419 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1254/2600] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:47 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:47.456819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:47.457956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:47.487474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:47.488335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:47.490042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:47.490422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:47.621085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:47.624085 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:47.641334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:47.654040 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1caa271-9532-49bb-9806-71b3ad3b7c95 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.201648 May 19 08:26:47.657070 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1347/2601] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:47 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:47.670132 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:47.672879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:47.674687 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:47.675698 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.031012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a665fa29-af02-4154-89a9-e4414fbf355c tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211e88310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:48.107149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a665fa29-af02-4154-89a9-e4414fbf355c tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.079061 May 19 08:26:48.115272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1348/2602] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:48 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:48.118387 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:48.128208 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ecd2271f-7010-4280-83c7-d013a8bafe2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.514478 May 19 08:26:48.128820 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1255/2603] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:47 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:48.141614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:48.142425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:48.166104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:48.166895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.167899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:48.168530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.283267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:48.351657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8503ab64-6628-4ae4-811a-8690eab44f77 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.234873 May 19 08:26:48.355670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1349/2604] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:48 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:48.447560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:48.448492 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:48.457128 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:48.458071 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.459577 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:48.461008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.677063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:48.679256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:48.694487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:48.695533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.697702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:48.698491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:48.759447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:48.778184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:48.781446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:48.789026 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-20c62c63-f006-43cc-a978-09d026617dae tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.346924 May 19 08:26:48.806972 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1256/2605] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:48 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:48.844245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:48.860284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54d5e4bb-7262-470d-b80b-59eaa8e7c135 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.188704 May 19 08:26:48.862505 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1350/2606] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:48 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:49.121504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bf35b4d-37c0-4b33-aad9-525a8bd273e2 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217af6dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:49.136987 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b695ee67-d80b-4a52-946c-2f749d96e3d2 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Action: 'create', calling method: .version_select at 0x7f3217aceaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1685932475", "metadata": {"Type": "work"}}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:49.198310 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bf35b4d-37c0-4b33-aad9-525a8bd273e2 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.080901 May 19 08:26:49.206222 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1351/2607] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:49 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:49.213653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:49.214998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:49.224942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:49.225550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:49.227221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:49.227770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:49.424670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:49.434839 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-456617ad-89e8-4fa4-bc5e-d536301d159b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.226143 May 19 08:26:49.436913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1352/2608] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:49 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:49.441930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:49.442632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:49.450235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:49.450797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:49.451709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:49.452235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:49.580514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:49.604563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-416de93b-c5c5-4ea4-89e5-c275962e8436 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.166630 May 19 08:26:49.618268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1353/2609] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:49 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:49.811592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:49.812225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:49.829692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:49.830144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:49.830935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:49.831378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.090773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:50.098496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:50.109701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:50.111604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:50.113187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82a25aca-579c-4fc3-9723-fe834b00d897 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.305569 May 19 08:26:50.124737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1354/2610] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:49 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:50.124737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:50.124737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:50.137898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:50.138348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.139204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:50.139637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.286290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:50.297713 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8936794-9ac8-4cf6-b7fe-1401f81da4e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.181662 May 19 08:26:50.307211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1355/2611] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:50 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:50.312032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-521d6066-6a72-40c5-9fb2-034ce86fd50e tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217b4b700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:50.380303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-521d6066-6a72-40c5-9fb2-034ce86fd50e tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.071940 May 19 08:26:50.381400 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1356/2612] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:50 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:50.453622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:50.454661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:50.464620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:50.466404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.467200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:50.468643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.728626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:50.742314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3fe6467d-0ef6-4b34-9df9-90958a68602a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.292924 May 19 08:26:50.755386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1357/2613] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:50 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:50.760572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:50.761180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:50.771273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:50.771859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.772704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:50.773188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:50.937149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:50.990679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abbbcb7b-5558-4256-8d0b-f942a758be6d tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.234010 May 19 08:26:50.991285 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1358/2614] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:50 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:51.138445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:51.139081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:51.147957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:51.148428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:51.149221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:51.149708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:51.471439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:51.488651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:51.490246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:51.495743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5cb697a-7829-4f1e-b5b0-36816ab3444f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.361584 May 19 08:26:51.506621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1359/2615] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:51 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:51.510862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:51.511562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:51.527707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:51.528171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:51.528972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:51.529436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:51.657430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:51.672378 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c32db29f-3a66-4341-8255-4aa5e4c431df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.173800 May 19 08:26:51.673164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1360/2616] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:51 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:51.696646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e64629e-e03d-4ddc-9f70-361cf7136ccd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217b4b700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:51.774552 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e64629e-e03d-4ddc-9f70-361cf7136ccd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.087066 May 19 08:26:51.776809 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1361/2617] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:51 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:51.806537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:51.809520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:51.823548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:51.825632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:51.826968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:51.827674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.188876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:52.199103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffd0a54e-85c4-4f12-941e-d449a69f372b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.420013 May 19 08:26:52.200169 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1362/2618] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:51 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:52.204805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:52.205666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:52.214324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:52.214775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.216383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:52.216915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.321631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:52.343386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7407fc94-2d2f-44d4-9fa6-6775f08a402f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.141962 May 19 08:26:52.344248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1363/2619] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:52 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:52.520593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:52.521576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:52.530519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:52.531132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.531969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:52.532414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.762298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:52.776874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:52.779909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:52.786386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8de2e78c-c5fc-4fb7-8e8f-0876647b9b6e tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.269250 May 19 08:26:52.804775 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1364/2620] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:52 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:52.812529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:52.812529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:52.818549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:52.819006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.819791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:52.820218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:52.929573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:52.953594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2038b9f7-2e5c-4e25-a23c-011099fe09b1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.147048 May 19 08:26:52.955601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1365/2621] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:52 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:52.960678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8227b038-3408-42e3-9638-cf3214e6488c tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3211b04ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:53.018231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8227b038-3408-42e3-9638-cf3214e6488c tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1428 microversion: 2.1 time: 0.061073 May 19 08:26:53.018731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1366/2622] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:52 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:53.233919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:53.234697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:53.242557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:53.243002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:53.243808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:53.244372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:53.492126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:53.504630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43663612-f686-4d59-a8e7-7a3eed777fe8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.274881 May 19 08:26:53.509827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1367/2623] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:53 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:53.524234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:53.524865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:53.533688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:53.534139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:53.534898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:53.536832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:53.639860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:53.675562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c89013a-4333-4b01-882c-07ad942e16a8 tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1925 microversion: 2.75 time: 0.155965 May 19 08:26:53.682261 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1368/2624] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:53 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1925 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:53.809445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:53.811879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:53.819905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:53.820481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:53.821502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:53.827358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:53.998976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:54.009045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:54.010655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:54.011811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9c4ccda-ea52-4fc6-ae73-8044ed71f9f6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.206867 May 19 08:26:54.012375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1369/2625] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:53 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:26:54.016998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:54.017636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:54.026353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.026353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.026729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.027188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.100395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:54.109555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-837fdd19-bfdc-45c0-8bff-eb2fc3c9a750 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.095907 May 19 08:26:54.110814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1370/2626] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:54 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:54.117106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56bcd057-4010-490b-926a-8d270e38b13b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217af13a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:54.173152 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56bcd057-4010-490b-926a-8d270e38b13b tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1437 microversion: 2.1 time: 0.060987 May 19 08:26:54.174021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1371/2627] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:54 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1437 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:54.185849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-491239b8-b509-40b1-88a4-f4a20ef23bc6 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217ab25e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:54.234761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-491239b8-b509-40b1-88a4-f4a20ef23bc6 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 200 len: 1437 microversion: 2.1 time: 0.052877 May 19 08:26:54.236329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1372/2628] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:26:54 2022] GET /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 1437 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:54.248642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:54.249402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:54.258117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.258593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.259373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.259828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.449442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:54.459278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8e4edf1-3dac-4753-b7f6-225500c19564 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1479 microversion: 2.1 time: 0.214720 May 19 08:26:54.460531 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1373/2629] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:54 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1479 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:26:54.522964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:54.523973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:54.530918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.531670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.532786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.533449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.700287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:54.710504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-326a2ca5-9181-4359-87f8-d9c1ca3667e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.192110 May 19 08:26:54.711534 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1374/2630] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:54 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:54.721615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:54.722246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:54.734922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.735382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.736147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:54.736777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:54.753842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:54.827932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:54.848221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0a42a02-75bd-4849-8709-8c022263cb8f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1931 microversion: 2.75 time: 0.135569 May 19 08:26:54.849012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1375/2631] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:54 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1931 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:55.031356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:55.031568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:55.038258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:55.039228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:55.039501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:55.039917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:55.285288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:55.296432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:55.299566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:55.299830 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98ce1cf8-c243-49e4-8121-22138f35b9b4 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.272842 May 19 08:26:55.301968 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1376/2632] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:55 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:55.314066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:55.314853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:55.322968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:55.323659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:55.324940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:55.325686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:55.403145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:55.412142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b87e474-5525-4e0e-a6cc-b852261aa2cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 200 len: 1344 microversion: 2.1 time: 0.110928 May 19 08:26:55.422152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1377/2633] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:55 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 1344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:55.477810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:55.479851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:55.487908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:55.488529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:55.490023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:55.490474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:55.672423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:55.681931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-876bd91f-be0f-413e-8e82-b6d47afe1907 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1466 microversion: 2.1 time: 0.209375 May 19 08:26:55.685570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1378/2634] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:55 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1466 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:55.709579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e765f88-e14b-42b9-82e5-67577c3be978 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217b7d0d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:56.705678 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b695ee67-d80b-4a52-946c-2f749d96e3d2 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 7.776521 May 19 08:26:56.706687 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1257/2635] 10.222.0.78 () {60 vars in 1155 bytes} [Thu May 19 08:26:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 7779 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 08:26:56.711981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:56.713290 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:56.733283 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:56.733843 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:56.734723 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:56.745983 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:56.899064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e765f88-e14b-42b9-82e5-67577c3be978 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "DELETE /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c" status: 204 len: 0 microversion: 2.1 time: 1.194975 May 19 08:26:56.903875 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1379/2636] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:55 2022] DELETE /compute/v2.1/images/e121a576-b346-4371-a78f-bedd1c43ef7c => generated 0 bytes in 1199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:26:56.912449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:56.913088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:56.924732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:56.925241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:56.926391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:56.926844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.044938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] Lazy-loading 'services' on Instance uuid d12bc49a-9db5-43ae-84f6-fe3fb9312e43 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:26:57.062456 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.072060 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b0971711-14a2-4b93-a8c3-1da8b029f3e2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.363735 May 19 08:26:57.083414 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1258/2637] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:56 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:57.089865 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.090720 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.092534 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a95839cc-b691-4704-a713-50c2496b6f2f tempest-ServersAdmin275Test-518299148 tempest-ServersAdmin275Test-518299148-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1916 microversion: 2.75 time: 0.187175 May 19 08:26:57.093954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1380/2638] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:56 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1916 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:57.099005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.100325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.107979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.108877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.110260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.110862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.125416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.126237 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.127275 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.127939 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.134900 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d HTTP/1.1 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4c2d627a-8b5c-49b5-9a3b-5c255187b78d'} May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.136599 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:26:57.140350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3686c15-0bfa-4eae-b448-0035fd80f182 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 404 len: 111 microversion: 2.1 time: 0.044576 May 19 08:26:57.145492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1381/2639] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:57 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:26:57.150332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abf11540-281a-46ae-a48f-093c15a6e372 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3211e1e1f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.164793 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:57.346501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abf11540-281a-46ae-a48f-093c15a6e372 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 353 microversion: 2.1 time: 0.199558 May 19 08:26:57.347381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1382/2640] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:26:57 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:57.354887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89e66623-62dc-4175-aee7-320e07efcfe9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '.version_select at 0x7f3217ab3310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.393991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-89e66623-62dc-4175-aee7-320e07efcfe9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] HTTP exception thrown: Image not found. May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89e66623-62dc-4175-aee7-320e07efcfe9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Request method failure captured: May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 HTTP/1.1 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf8FQS7mVlEMqN8KK-7Ek_TetWs9n86JGoXtJYkxNrIvUI5sZF6fcmZnJJeq2vGAGmZX6PvvmCdT9qJFgdMifbWl1DV7Agfa8CYhb9PTAUAn_SGqegPIqHc8uj41Wyf_-Gy2pKxajjkIDcQYLb2wwYXULgOvuUXU-Ab2swh5DVx1sRs May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 506115ac4a6f4e12bd31e9db0d15b3d8 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 506115ac4a6f4e12bd31e9db0d15b3d8 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerTestJSON-1179739545-project May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 4444c61e2c03455992d6bcf1835a8709 May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerTestJSON-1179739545-project May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'bb5979f8-a851-4023-b1ea-6759c979eb89'} May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bb5979f8-a851-4023-b1ea-6759c979eb89 to delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bb5979f8-a851-4023-b1ea-6759c979eb89 could not be found. May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.397497 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:26:57.401225 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.404397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89e66623-62dc-4175-aee7-320e07efcfe9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:26:57.405511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89e66623-62dc-4175-aee7-320e07efcfe9 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "DELETE /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89" status: 404 len: 62 microversion: 2.1 time: 0.056362 May 19 08:26:57.406547 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1383/2641] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:57 2022] DELETE /compute/v2.1/images/bb5979f8-a851-4023-b1ea-6759c979eb89 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:26:57.429615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.432552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.433480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.440582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.440760 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.442408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.442927 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.443725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.444179 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-65f8b248-689b-49b3-bc1b-2523b9eb61b0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.359367 May 19 08:26:57.444622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.445187 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1259/2642] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:57 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:57.451479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.451972 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.459568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.460082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.460879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.461342 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.495154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Going to try to terminate instance {{(pid=119073) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:26:57.506157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:26:57.621257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:26:57.635548 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24340205-be87-4ab4-96d2-c24463d0099e tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 204 len: 0 microversion: 2.75 time: 0.226901 May 19 08:26:57.636656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1384/2643] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:26:57 2022] DELETE /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:26:57.649427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.650889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.655117 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0c1c6bc7-65a4-4dcc-990f-0d92e4bc43fd tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 204 len: 0 microversion: 2.1 time: 0.207414 May 19 08:26:57.662490 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1260/2644] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:26:57 2022] DELETE /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:26:57.664603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.665182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.666448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.667164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.677299 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.680727 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.696265 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.696981 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.698113 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d/os-volume_attachments HTTP/1.1 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '4c2d627a-8b5c-49b5-9a3b-5c255187b78d'} May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:26:57.700422 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d515e03a-1ad4-4a69-be3d-818fe6ef0923 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063183 May 19 08:26:57.704179 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1385/2645] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:26:57 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:26:57.705827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.707043 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.733708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:57.741683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:57.762428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.762883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.763670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:57.764109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:57.881012 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.890309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.897396 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:57.908267 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-321a9fc9-77b6-41c6-a144-07d20cfed236 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1442 microversion: 2.75 time: 0.243459 May 19 08:26:57.910994 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1261/2646] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:57 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1442 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:57.990077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-3699761", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:58.088092 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:26:58.187131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:58.197417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ae630f6-ab0e-4663-b807-fba91feeff4f tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1472 microversion: 2.1 time: 0.493895 May 19 08:26:58.202354 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1386/2647] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:57 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:58.221118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:58.222310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:58.232616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:58.234620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:58.236910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:58.238313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:58.940532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:58.951408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bfa9f0de-e077-4082-878d-af9d1776ba34 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.743164 May 19 08:26:58.952458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1387/2648] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:58 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:58.975360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1eb761b-0776-4806-abf4-ce6f5145ecb5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217af6e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:59.059546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1eb761b-0776-4806-abf4-ce6f5145ecb5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 354 microversion: 2.1 time: 0.090824 May 19 08:26:59.067510 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1388/2649] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:26:58 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:59.067510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:59.067814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:59.079836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.080299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.081863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.082552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.125529 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:26:59.126553 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:26:59.127515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:26:59.128129 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:26:59.129659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:26:59.145181 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.145512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.146751 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.147196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.170077 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:26:59.175691 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:26:59.190026 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:26:59.193850 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:26:59.261453 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0e16d116-4ac3-438c-8520-9301a700bb89 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276252 May 19 08:26:59.262597 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1262/2650] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:26:59.267638 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a87b9ce9-5119-4d55-919e-4da748e692dc req-fa674786-8a09-428a-ba98-bd707bdc90da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "name": "network-vif-unplugged", "status": "completed", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:26:59.288184 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a87b9ce9-5119-4d55-919e-4da748e692dc req-fa674786-8a09-428a-ba98-bd707bdc90da service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.288977 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a87b9ce9-5119-4d55-919e-4da748e692dc req-fa674786-8a09-428a-ba98-bd707bdc90da service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.312528 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a87b9ce9-5119-4d55-919e-4da748e692dc req-fa674786-8a09-428a-ba98-bd707bdc90da service nova] Creating event network-vif-unplugged:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:26:59.324134 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a87b9ce9-5119-4d55-919e-4da748e692dc req-fa674786-8a09-428a-ba98-bd707bdc90da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059985 May 19 08:26:59.325015 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1263/2651] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:59.330217 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:59.330940 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:59.363196 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.363541 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.364334 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.365635 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.375953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.395389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.397134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.399225 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73ebbf5c-c118-4dc3-8ba7-2cbb80c60d6c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.337183 May 19 08:26:59.399368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1389/2652] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:59 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:59.413662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6776b8f-8d9d-40aa-a50b-3087d17476b6 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217ad2c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:59.505956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6776b8f-8d9d-40aa-a50b-3087d17476b6 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 354 microversion: 2.1 time: 0.105448 May 19 08:26:59.506787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1390/2653] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:26:59 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:26:59.511599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:59.513259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:59.521452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.521984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.522712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:26:59.523092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:26:59.653288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.691661 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.695010 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65d7e0861c454ab291b01b0e5f267059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2808e28b254a4d768473ef06df34a0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.743439 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fd0f26f5-901e-40ee-99a3-bea0eba33df2 tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 200 len: 1442 microversion: 2.75 time: 0.416733 May 19 08:26:59.744706 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1264/2654] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:26:59 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 1442 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:26:59.774852 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5a4d3ecc-5445-4aac-aa20-d0a8830208dd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:26:59.775473 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5a4d3ecc-5445-4aac-aa20-d0a8830208dd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:26:59.903903 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5a4d3ecc-5445-4aac-aa20-d0a8830208dd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:26:59.920634 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5a4d3ecc-5445-4aac-aa20-d0a8830208dd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1212 microversion: 2.1 time: 0.147903 May 19 08:26:59.922076 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1265/2655] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:59 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1212 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:26:59.930073 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a8458872-49bf-49cb-ad0a-0991a5ec1670 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f32118cd280>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:00.033773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4444c61e2c03455992d6bcf1835a8709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506115ac4a6f4e12bd31e9db0d15b3d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:00.045415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8cf1bf62-20bb-44c1-9ac5-3a0575203bb3 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 200 len: 1472 microversion: 2.1 time: 0.536836 May 19 08:27:00.074048 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1391/2656] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:26:59 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 1472 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:00.089058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:00.089911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:00.098410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:00.099179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:00.100225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:00.100858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:00.132890 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a8458872-49bf-49cb-ad0a-0991a5ec1670 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 202 len: 0 microversion: 2.1 time: 0.209427 May 19 08:27:00.133650 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1266/2657] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:26:59 2022] DELETE /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:00.142483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:27:00.143329 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:00.145401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:00.169191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:00.170354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:00.173633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:00.185062 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:00.185566 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:00.186420 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:00.195165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'flavor' on Instance uuid 5c40c329-0112-47e2-839e-b9f9b7bd973f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:00.203305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:00.213112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'system_metadata' on Instance uuid 5c40c329-0112-47e2-839e-b9f9b7bd973f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:00.352401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'metadata' on Instance uuid 5c40c329-0112-47e2-839e-b9f9b7bd973f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:00.913928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:00.914646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:00.944967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:00.952894 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:00.965922 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f4eab951-ffaa-487a-803b-b0086c769f45 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.831035 May 19 08:27:00.969039 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1267/2658] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:00 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:00.978608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-723046e8-c642-4409-acf7-6cd0949790ee tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217c42f70>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:01.088327 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-723046e8-c642-4409-acf7-6cd0949790ee tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 353 microversion: 2.1 time: 0.115040 May 19 08:27:01.089127 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1268/2659] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:27:00 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:01.094819 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:01.095718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:01.124358 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.128394 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.136082 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.138963 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.209339 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbc8091a-2a0c-4313-aa8c-84fc6a51e1b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 204 len: 0 microversion: 2.1 time: 1.133339 May 19 08:27:01.210548 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1392/2660] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:27:00 2022] DELETE /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:27:01.218955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1be5608f-84d2-4a7e-b24f-586addc340a0 req-ea77eeb7-0fa7-4af9-bd65-669d61fb2e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c2f5ea4-abe4-488c-8942-71cdaeae9fb1", "name": "network-vif-deleted", "tag": "69860e33-f954-4881-9151-0e01a92450c4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:01.242165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1be5608f-84d2-4a7e-b24f-586addc340a0 req-ea77eeb7-0fa7-4af9-bd65-669d61fb2e35 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.245120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1be5608f-84d2-4a7e-b24f-586addc340a0 req-ea77eeb7-0fa7-4af9-bd65-669d61fb2e35 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.268431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1be5608f-84d2-4a7e-b24f-586addc340a0 req-ea77eeb7-0fa7-4af9-bd65-669d61fb2e35 service nova] Creating event network-vif-deleted:69860e33-f954-4881-9151-0e01a92450c4 for instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 on chh1-842464-2 May 19 08:27:01.292792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1be5608f-84d2-4a7e-b24f-586addc340a0 req-ea77eeb7-0fa7-4af9-bd65-669d61fb2e35 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078260 May 19 08:27:01.294948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1393/2661] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:01.311398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:01.312230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] [instance: d12bc49a-9db5-43ae-84f6-fe3fb9312e43] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:01.353238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.358003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.359129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.359593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.398378 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] HTTP exception thrown: Instance d12bc49a-9db5-43ae-84f6-fe3fb9312e43 could not be found. May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Request method failure captured: May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 HTTP/1.1 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf78GzFxDJWfx9EimIlihaibmZikgG3Hp3aLL8xb0Ic5zPm4hxnYxs_EHSW_-9ekbRuclcnYw3U-7iuG9CxYlLDCvD9R3jyw-pw-u8nQOT_JXynvpqc2-lHkcSl5uRePntB_6PUo_hySdWgOutJnE40cf8klN_nbRLzciZJTJvRVtzQ May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.75 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2808e28b254a4d768473ef06df34a0eb May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdmin275Test-1590034141 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2808e28b254a4d768473ef06df34a0eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2808e28b254a4d768473ef06df34a0eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2808e28b254a4d768473ef06df34a0eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2808e28b254a4d768473ef06df34a0eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdmin275Test-1590034141 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2808e28b254a4d768473ef06df34a0eb May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdmin275Test-1590034141 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdmin275Test-1590034141-project May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 65d7e0861c454ab291b01b0e5f267059 May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdmin275Test-1590034141-project May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d12bc49a-9db5-43ae-84f6-fe3fb9312e43 could not be found. May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd12bc49a-9db5-43ae-84f6-fe3fb9312e43'} May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d12bc49a-9db5-43ae-84f6-fe3fb9312e43 could not be found. May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d12bc49a-9db5-43ae-84f6-fe3fb9312e43 could not be found. May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:01.402115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d12bc49a-9db5-43ae-84f6-fe3fb9312e43 could not be found. May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.405780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] Returning 404 to user: Instance d12bc49a-9db5-43ae-84f6-fe3fb9312e43 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:01.406251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba7dd17c-bfc1-4d2d-b65f-fb2e8504a3ee tempest-ServersAdmin275Test-1590034141 tempest-ServersAdmin275Test-1590034141-project] 10.222.0.78 "GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43" status: 404 len: 111 microversion: 2.75 time: 0.109442 May 19 08:27:01.412448 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1394/2662] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:01 2022] GET /compute/v2.1/servers/d12bc49a-9db5-43ae-84f6-fe3fb9312e43 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:27:01.418831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:01.419477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] [instance: 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:01.446583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.447483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.448654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.449256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.478495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] HTTP exception thrown: Instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 could not be found. May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Request method failure captured: May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 HTTP/1.1 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf8FQS7mVlEMqN8KK-7Ek_TetWs9n86JGoXtJYkxNrIvUI5sZF6fcmZnJJeq2vGAGmZX6PvvmCdT9qJFgdMifbWl1DV7Agfa8CYhb9PTAUAn_SGqegPIqHc8uj41Wyf_-Gy2pKxajjkIDcQYLb2wwYXULgOvuUXU-Ab2swh5DVx1sRs May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 506115ac4a6f4e12bd31e9db0d15b3d8 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/506115ac4a6f4e12bd31e9db0d15b3d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 506115ac4a6f4e12bd31e9db0d15b3d8 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1179739545 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesOneServerTestJSON-1179739545-project May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 4444c61e2c03455992d6bcf1835a8709 May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesOneServerTestJSON-1179739545-project May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 could not be found. May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8c2f5ea4-abe4-488c-8942-71cdaeae9fb1'} May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 could not be found. May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 could not be found. May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:01.481291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 could not be found. May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] Returning 404 to user: Instance 8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:01.484918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca0d9eda-2c2a-490e-a261-89898209d365 tempest-ImagesOneServerTestJSON-1179739545 tempest-ImagesOneServerTestJSON-1179739545-project] 10.222.0.78 "GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1" status: 404 len: 111 microversion: 2.1 time: 0.069547 May 19 08:27:01.491712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1395/2663] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:01 2022] GET /compute/v2.1/servers/8c2f5ea4-abe4-488c-8942-71cdaeae9fb1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:27:01.501088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:01.501753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:01.509456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.509916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.510725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:01.511163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:01.548504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:01.565931 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:01.573188 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:01.578692 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-02b87b1c-7238-4fd6-b146-976ab44f9ba3 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.488321 May 19 08:27:01.597190 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1269/2664] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:01 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:01.633716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:01.651676 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ba68a4d-a156-406f-9534-53959036c41b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1270 microversion: 2.1 time: 0.157235 May 19 08:27:01.662018 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1396/2665] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:01 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:01.987631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:01.989705 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:02.003276 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:02.005633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:02.006884 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:02.016984 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:02.101162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25311b87-de9a-46dc-a318-2014cf8d658f tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217b2dc10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:02.210737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25311b87-de9a-46dc-a318-2014cf8d658f tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 353 microversion: 2.1 time: 0.114428 May 19 08:27:02.216117 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1397/2666] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:27:02 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:02.467401 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:02.477920 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b3e24a33-0d66-46b0-a66d-3e0487042746 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.495518 May 19 08:27:02.488557 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1270/2667] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:01 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:02.599701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:02.600629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:02.609138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:02.609656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:02.610444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:02.610891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:02.671615 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:02.672282 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:02.682645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:02.686864 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:02.687824 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:02.688189 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:03.132654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:03.145602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:03.152335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:03.154604 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e2248ba-4d12-4ae3-8d9d-febe9bcde02b tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.559783 May 19 08:27:03.160342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1398/2668] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:02 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:03.164637 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:03.175820 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-8cf0b53b-3b57-4f36-a746-a9b1e5d78c07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 0.510177 May 19 08:27:03.186352 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1271/2669] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:02 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:03.227794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37f4f660-3eb5-417e-b185-07249a2b43a3 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217b04160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:03.386867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-37f4f660-3eb5-417e-b185-07249a2b43a3 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 353 microversion: 2.1 time: 0.166772 May 19 08:27:03.387966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1399/2670] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:27:03 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:03.496250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:03.496878 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:03.508650 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:03.509481 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:03.510738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:03.515206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:03.925649 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:03.942052 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b1f01f26-60b6-49c0-b542-c14e727b06c5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.448281 May 19 08:27:03.956476 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1272/2671] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:03 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:04.179733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:04.181354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:04.193330 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:04.195528 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:04.216002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.225292 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.225937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:04.227703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:04.229045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.230415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.231097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:04.234633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:04.658626 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:04.672704 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-d9830127-da20-4b63-a275-c4adcc450bfe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 0.484473 May 19 08:27:04.673940 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1273/2672] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:04 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:04.688427 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-777aeca5-2608-4c7d-a74a-d8cc4ea6cbe9 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f32121a2b80>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:04.725792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:04.743589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:04.749019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:04.752846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d4bafa5-399a-4031-a1de-6bff27910dd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1487 microversion: 2.25 time: 0.581114 May 19 08:27:04.765346 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1400/2673] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:04 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1487 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:04.776134 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-777aeca5-2608-4c7d-a74a-d8cc4ea6cbe9 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 353 microversion: 2.1 time: 0.100689 May 19 08:27:04.776847 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1274/2674] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:27:04 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:04.849568 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-7af79413-aee4-48dd-b7c1-996c5235b68e req-645840e8-c82d-4496-8589-aa64b24eb955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c40c329-0112-47e2-839e-b9f9b7bd973f", "tag": "5ba4f84b-65ec-4577-ad64-9a4d930d28af"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:04.877966 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-7af79413-aee4-48dd-b7c1-996c5235b68e req-645840e8-c82d-4496-8589-aa64b24eb955 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.878668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-7af79413-aee4-48dd-b7c1-996c5235b68e req-645840e8-c82d-4496-8589-aa64b24eb955 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:04.913847 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-7af79413-aee4-48dd-b7c1-996c5235b68e req-645840e8-c82d-4496-8589-aa64b24eb955 service nova] Creating event network-changed:5ba4f84b-65ec-4577-ad64-9a4d930d28af for instance 5c40c329-0112-47e2-839e-b9f9b7bd973f on chh1-842464-2 May 19 08:27:04.925442 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-7af79413-aee4-48dd-b7c1-996c5235b68e req-645840e8-c82d-4496-8589-aa64b24eb955 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080745 May 19 08:27:04.927518 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1275/2675] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:04.963008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:04.964037 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:04.978552 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.980595 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:04.983799 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:04.984631 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:05.071667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3735c3b8-6295-49b1-b676-ac5f10a636a1 tempest-ListImageFiltersNegativeTestJSON-1752211595 tempest-ListImageFiltersNegativeTestJSON-1752211595-project] Calling method '.version_select at 0x7f3217b2d700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:05.116116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3735c3b8-6295-49b1-b676-ac5f10a636a1 tempest-ListImageFiltersNegativeTestJSON-1752211595 tempest-ListImageFiltersNegativeTestJSON-1752211595-project] HTTP exception thrown: Image not found. May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3735c3b8-6295-49b1-b676-ac5f10a636a1 tempest-ListImageFiltersNegativeTestJSON-1752211595 tempest-ListImageFiltersNegativeTestJSON-1752211595-project] Request method failure captured: May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/images/15d9b248-35d0-474e-8d47-8b04df0829c7 HTTP/1.1 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9YpDva-E5fZGbP7BIHLt_iXT4_ULrT8ysiF5ttFgmaAXaJUcekqh-KycWoXpOmHHQZOabaxyPKwZ97cPtvGC726oy-xl9J4ZO6ACD9XAHqqEpFSG2L-t4ydHn7ESnBQj93RYNR_QEOz38_gVawbkpFMbCgSTlAKlyAL17sENnzjvY May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5518fd5f61e54ecc8d35ef60b975e6cd May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1752211595 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5518fd5f61e54ecc8d35ef60b975e6cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5518fd5f61e54ecc8d35ef60b975e6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5518fd5f61e54ecc8d35ef60b975e6cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5518fd5f61e54ecc8d35ef60b975e6cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1752211595 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5518fd5f61e54ecc8d35ef60b975e6cd May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1752211595 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListImageFiltersNegativeTestJSON-1752211595-project May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1e572de3caff4145af47785454e9a335 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1752211595-project May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '15d9b248-35d0-474e-8d47-8b04df0829c7'} May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 15d9b248-35d0-474e-8d47-8b04df0829c7 May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:27:05.122647 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 15d9b248-35d0-474e-8d47-8b04df0829c7 could not be found. May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3735c3b8-6295-49b1-b676-ac5f10a636a1 tempest-ListImageFiltersNegativeTestJSON-1752211595 tempest-ListImageFiltersNegativeTestJSON-1752211595-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:05.127473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3735c3b8-6295-49b1-b676-ac5f10a636a1 tempest-ListImageFiltersNegativeTestJSON-1752211595 tempest-ListImageFiltersNegativeTestJSON-1752211595-project] 10.222.0.78 "GET /compute/v2.1/images/15d9b248-35d0-474e-8d47-8b04df0829c7" status: 404 len: 62 microversion: 2.1 time: 0.359190 May 19 08:27:05.133286 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1401/2676] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:27:04 2022] GET /compute/v2.1/images/15d9b248-35d0-474e-8d47-8b04df0829c7 => generated 62 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:27:05.394879 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:05.406005 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-863bac54-962c-43e4-8ddb-937a22e8cf37 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1511 microversion: 2.1 time: 0.448590 May 19 08:27:05.420399 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1276/2677] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:04 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:05.692358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:05.694211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:05.710251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:05.711022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:05.722252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:05.722797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:05.774447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:05.776823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:05.791505 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:05.792388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:05.794261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:05.795840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.067782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:06.085450 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcdfd152-b2ed-4836-8b94-46de076a9cbd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 0.397676 May 19 08:27:06.096918 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1402/2678] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:05 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:06.110275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3da487a-1d78-4eef-b143-92eed2cf1f3b tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217af6430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:06.193287 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:06.204130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:06.211962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:06.215491 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-cb661fa1-f8db-4637-935c-c3da7697e9a5 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1477 microversion: 2.25 time: 0.447093 May 19 08:27:06.218645 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1277/2679] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:05 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1477 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:06.236467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3da487a-1d78-4eef-b143-92eed2cf1f3b tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 200 len: 353 microversion: 2.1 time: 0.129966 May 19 08:27:06.237161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1403/2680] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:27:06 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:06.239321 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-985931a1-97f2-4c36-99cc-f1344ce82ebb tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '.version_select at 0x7f32118cd700>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:06.242247 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-985931a1-97f2-4c36-99cc-f1344ce82ebb tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.245448 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-985931a1-97f2-4c36-99cc-f1344ce82ebb tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.268582 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-985931a1-97f2-4c36-99cc-f1344ce82ebb tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.037820 May 19 08:27:06.272786 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1278/2681] 10.222.0.78 () {60 vars in 1183 bytes} [Thu May 19 08:27:06 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:06.285988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:06.286727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:06.305928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.307037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.309913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.312516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.429008 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:06.429666 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:06.437522 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.438259 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.439263 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.439845 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.709931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] Lazy-loading 'services' on Instance uuid 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:06.743071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5aa0cef-1e24-49f1-82bc-15555d9401c0 tempest-LiveAutoBlockMigrationV225Test-1145431567 tempest-LiveAutoBlockMigrationV225Test-1145431567-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1970 microversion: 2.25 time: 0.461814 May 19 08:27:06.743676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1404/2682] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:06 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1970 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:06.781658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:06.782170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:06.791491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.792242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.793559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:06.803794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:06.871321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:27:06.967788 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:06.980345 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-59a660a5-f28a-44b1-8167-896901d21300 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1488 microversion: 2.1 time: 0.555188 May 19 08:27:06.981548 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1279/2683] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:06 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1488 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:06.998429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:07.010506 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:07.027169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.027964 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.029298 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.031091 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.123766 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5283f038-065b-4986-bf60-350617e78064 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "DELETE /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 204 len: 0 microversion: 2.25 time: 0.346296 May 19 08:27:07.124692 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1405/2684] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:27:06 2022] DELETE /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:27:07.145537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:07.149276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:07.164812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.166188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.167176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.167890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.371046 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-fc9522d5-ee4b-4395-8a07-c610a187e34a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 200 len: 132 microversion: 2.1 time: 0.376814 May 19 08:27:07.376231 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1280/2685] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:06 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 132 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:07.383391 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:07.384416 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:07.399084 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.402381 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.405135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.405872 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.419911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:07.501763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:07.514865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d4e2aed-5dca-4956-b6a5-a0899ddfdafe tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 0.384808 May 19 08:27:07.521595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1406/2686] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:07 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:07.534508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b69904c-7e9f-4788-952c-e111396730f5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Calling method '.version_select at 0x7f3217b7d160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:07.600404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1b69904c-7e9f-4788-952c-e111396730f5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] HTTP exception thrown: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b69904c-7e9f-4788-952c-e111396730f5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Request method failure captured: May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 HTTP/1.1 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9IDTB0Sf23cOBCwNLCVJ8NJMmZkoV14W1A5Z-OzBl1LbPGUiY8fGXPV2ZMIUrGhbuoX-stEvXHX-bSG_y5wNuMA6_2at4sz9Ysy7jYBX5eOtVKqlFIrKKerkZL1a4cywZDG55sKAshTrkm75IxIL_BR2kbhrmIZoCPEv0AHryYMt4 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 95a945570938449ab910884288b502d9 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesGetTestJSON-1047596667 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/95a945570938449ab910884288b502d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95a945570938449ab910884288b502d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_95a945570938449ab910884288b502d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/95a945570938449ab910884288b502d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesGetTestJSON-1047596667 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 95a945570938449ab910884288b502d9 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesGetTestJSON-1047596667 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesGetTestJSON-1047596667-project May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 70154035d6c2465ba09715c5b502b7f1 May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesGetTestJSON-1047596667-project May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: exception: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd1e93f33-09a7-44b6-93be-2b479b9d94d6'} May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. (HTTP 404) (Request-ID: req-b96a4f90-050c-40d6-ba78-2e5e3bdf73ab) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:27:07.602492 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b69904c-7e9f-4788-952c-e111396730f5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] Returning 404 to user: Volume d1e93f33-09a7-44b6-93be-2b479b9d94d6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b69904c-7e9f-4788-952c-e111396730f5 tempest-VolumesGetTestJSON-1047596667 tempest-VolumesGetTestJSON-1047596667-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6" status: 404 len: 109 microversion: 2.1 time: 0.081101 May 19 08:27:07.607310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1407/2687] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:27:07 2022] GET /compute/v2.1/os-volumes/d1e93f33-09a7-44b6-93be-2b479b9d94d6 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:27:07.615583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:07.615583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:07.628463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.629563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.638647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:07.639349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:07.773148 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:07.784163 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:07.796449 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:07.802012 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b3bc6da6-42e6-499d-bf17-d6975f0a9335 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1483 microversion: 2.25 time: 0.421376 May 19 08:27:07.803552 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1281/2688] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:07 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1483 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:07.965501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:08.001978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ea4b77d-4353-477e-b41f-d122702d00aa tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.391719 May 19 08:27:08.013654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1408/2689] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:07 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:08.024985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:08.026213 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:08.033718 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:08.035851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:08.040020 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:08.043206 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:08.405164 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:08.416298 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-77bfdbe7-5a16-4b23-a847-3d49f8931e29 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.396331 May 19 08:27:08.421462 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1282/2690] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:08 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:08.437610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:08.439276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:08.453068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:08.454410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:08.456085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:08.458203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:08.540119 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:08.540743 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:08.547593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:08.561738 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:08.563611 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:08.564340 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:09.157046 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:09.332645 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:09.346327 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-2e6840ee-fcf6-42f6-b67a-80604eb18f07 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 0.809909 May 19 08:27:09.359551 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1283/2691] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:08 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:09.368618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:09.378447 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3532fca6-845d-4ef9-8ccf-e9b9c5b8d33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.945317 May 19 08:27:09.393055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:09.397091 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1409/2692] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:08 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:09.399656 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:09.420732 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:09.421182 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:09.428446 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:09.428962 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:09.730771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1667808970", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:09.809972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:27:09.895644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:09.915926 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=8 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:09.919960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:09.921280 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:09.923413 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-58d2550c-7a43-4110-be46-93677eac7240 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1483 microversion: 2.25 time: 0.562766 May 19 08:27:09.924024 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1284/2693] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:09 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1483 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:09.964257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:09.966055 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:09.977914 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:09.978639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:09.979719 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:09.984376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:10.444199 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:10.459608 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-b6e23a8c-a6c5-4b1b-ae30-e9ab31203ccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.527508 May 19 08:27:10.480587 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1285/2694] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:09 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:10.500619 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-87803193-e7c1-4a6b-ab26-7d5ddc7e51c8 req-07077ccd-6e14-4174-9389-b7821572618d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b79bad-0fe9-46cb-9eca-4ccbe3e70234", "name": "network-vif-deleted", "tag": "456143eb-7f9b-4b6f-a56e-75a2953883c6"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:10.523086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:27:10.523825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:27:10.525289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:27:10.525898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:27:10.530527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:27:10.551209 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-87803193-e7c1-4a6b-ab26-7d5ddc7e51c8 req-07077ccd-6e14-4174-9389-b7821572618d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:10.552383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-87803193-e7c1-4a6b-ab26-7d5ddc7e51c8 req-07077ccd-6e14-4174-9389-b7821572618d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:10.600882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:10.602234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:10.612273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:10.614162 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-87803193-e7c1-4a6b-ab26-7d5ddc7e51c8 req-07077ccd-6e14-4174-9389-b7821572618d service nova] Creating event network-vif-deleted:456143eb-7f9b-4b6f-a56e-75a2953883c6 for instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 on chh2-842464-2 May 19 08:27:10.615855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:10.642096 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-87803193-e7c1-4a6b-ab26-7d5ddc7e51c8 req-07077ccd-6e14-4174-9389-b7821572618d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159786 May 19 08:27:10.645559 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1286/2695] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:10.664854 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:10.667051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:10.697252 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:10.698027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:10.702498 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:10.704309 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:10.714191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:10.737404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:10.774545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:27:10.778010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:27:10.843580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-993c471c-59cf-4822-829f-e397595c581f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444989 May 19 08:27:10.845476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1410/2696] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:27:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:27:11.527393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0158e3c0-f5a1-4053-86bb-556a4d931c47 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3217b2d820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-744824406", "description": "tempest-description-468978544"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:11.723768 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:11.723768 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7e340d51-7363-4a5a-8316-4493f95821cc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 1.076916 May 19 08:27:11.731345 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1287/2697] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:10 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:11.746494 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-102787115", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "6106690e-bca7-4255-9662-43648d2ed217"}]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:11.828569 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.neutron [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] validate_networks() for [('6106690e-bca7-4255-9662-43648d2ed217', None, None, None, None, None)] {{(pid=119073) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:27:12.035367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0158e3c0-f5a1-4053-86bb-556a4d931c47 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.187600 May 19 08:27:12.036646 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1411/2698] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:10 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:12.042795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:12.043922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:12.051525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.052329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.053470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.054306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.173950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:12.184628 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9825a790-ab7b-4908-870e-cf11fcb99fb4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1213 microversion: 2.1 time: 0.146138 May 19 08:27:12.185602 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1412/2699] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:12 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:12.190613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:12.191496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:12.198120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.198968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.200207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.201102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.321694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:12.333778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:12.335614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:12.337253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7eb3e7e7-bb47-4d6a-ba44-9fae81f6fc88 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.150455 May 19 08:27:12.346247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1413/2700] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:12 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:12.346247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d5c029d7-3351-4a3f-b6df-4d67fb798921 req-8abf80a3-0a6a-4499-94ea-ada67231311d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c40c329-0112-47e2-839e-b9f9b7bd973f", "name": "network-vif-plugged", "status": "completed", "tag": "5ba4f84b-65ec-4577-ad64-9a4d930d28af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:12.353247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d5c029d7-3351-4a3f-b6df-4d67fb798921 req-8abf80a3-0a6a-4499-94ea-ada67231311d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.353993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d5c029d7-3351-4a3f-b6df-4d67fb798921 req-8abf80a3-0a6a-4499-94ea-ada67231311d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.374188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d5c029d7-3351-4a3f-b6df-4d67fb798921 req-8abf80a3-0a6a-4499-94ea-ada67231311d service nova] Creating event network-vif-plugged:5ba4f84b-65ec-4577-ad64-9a4d930d28af for instance 5c40c329-0112-47e2-839e-b9f9b7bd973f on chh1-842464-2 May 19 08:27:12.382374 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d5c029d7-3351-4a3f-b6df-4d67fb798921 req-8abf80a3-0a6a-4499-94ea-ada67231311d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041744 May 19 08:27:12.384141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1414/2701] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:12.392760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39a321a9-2a66-4563-890c-b6caed0ef809 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3211ebc5e0>, body: {"security_group_rule": {"parent_group_id": "d371c237-8589-4197-8735-892b1e43eb80", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:12.688355 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:27:12.689924 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image limits 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:27:12.692404 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:27:12.695049 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image pref 0:0:0 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:27:12.696260 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.virt.hardware [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:27:12.715513 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.716429 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.717985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.718974 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.761919 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:12.774502 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for user 59f3ba2c06c045d6afccb1639ed8d083 and project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:12.794815 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Going to run 1 instances... {{(pid=119073) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:27:12.802623 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:27:12.876122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39a321a9-2a66-4563-890c-b6caed0ef809 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.490261 May 19 08:27:12.886453 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1415/2702] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:27:12 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:12.893622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:12.894613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:12.915046 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6474ff2d-87cf-4a88-9a3f-890ad3a1c5a3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182481 May 19 08:27:12.916089 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1288/2703] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:27:12.928964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.935597 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f624ec88-24cf-462e-a086-641a1d2f95fa tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f32117f8820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-736865268", "description": "tempest-description-799728855"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:12.951086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.954907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:12.955733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:12.963585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:13.416126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:13.428017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0cdf0bf-de0f-4802-8210-2f9f5369fdfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1312 microversion: 2.1 time: 0.539610 May 19 08:27:13.438879 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1416/2704] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:12 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1312 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:13.448365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c31c47a-a331-4f00-8991-5cccd09d1e56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:13.449568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c31c47a-a331-4f00-8991-5cccd09d1e56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:13.545719 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f624ec88-24cf-462e-a086-641a1d2f95fa tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.626628 May 19 08:27:13.552772 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1289/2705] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:12 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:13.559328 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:13.559957 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:13.587241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:13.588112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:13.589100 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:13.589840 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:13.625547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c31c47a-a331-4f00-8991-5cccd09d1e56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:13.653493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c31c47a-a331-4f00-8991-5cccd09d1e56 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1214 microversion: 2.1 time: 0.209864 May 19 08:27:13.654330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1417/2706] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:13 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:13.671831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:13.672779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:13.697356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:13.699021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:13.701415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:13.703151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:13.720341 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:13.749483 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e68259ec-7ae6-4c98-853a-b43bf48c61a8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1275 microversion: 2.1 time: 0.192963 May 19 08:27:13.762318 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1290/2707] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:13 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:13.777078 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-db4c2392-c153-4415-8d8b-ea68a937fa61 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3211975790>, body: {"security_group_rule": {"parent_group_id": "b9e60798-b8df-4380-a793-5cffbc548d30", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:13.844643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:13.854313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:13.856615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:13.857874 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff310091-fcd1-4dd7-9bfa-5d83dcb2f8a8 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.191707 May 19 08:27:13.862076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1418/2708] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:13 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:14.358192 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-db4c2392-c153-4415-8d8b-ea68a937fa61 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.590515 May 19 08:27:14.359207 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1291/2709] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:27:13 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:14.373740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5525eb0d-2171-4328-9d33-b0a2785d24d9 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3217b4b940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1067342097", "description": "tempest-description-1885975483"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:14.445679 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:14.446293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:14.467373 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:14.467827 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:14.468659 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:14.469271 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.173190 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:15.184486 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f1792e75-4a14-448f-ba26-e322e2d1325e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1495 microversion: 2.1 time: 0.743126 May 19 08:27:15.185583 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1292/2710] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:14 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1495 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:15.191603 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:15.192910 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:15.200563 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:15.201250 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.203294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:15.203294 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.329551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5525eb0d-2171-4328-9d33-b0a2785d24d9 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.961830 May 19 08:27:15.330938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1419/2711] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:14 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:15.336696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:15.337677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:15.355415 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:15.364417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:15.365903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.366980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:15.367705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.380178 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5d403394-2960-486b-a95e-972b80c513ce tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1272 microversion: 2.1 time: 0.186492 May 19 08:27:15.381914 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1293/2712] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:15 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:15.396692 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:15.398476 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:15.412823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:15.413696 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.415495 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:15.416154 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:15.612694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:15.624207 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:15.627086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:15.629542 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a29cfc36-f130-486a-97f5-366b3ae7bcab tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.245357 May 19 08:27:15.630356 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1294/2713] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:15 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:15.649038 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-ca4fc3ad-b6f2-4f05-9c83-48e55ef97e01 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3217a62a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1030345663", "description": "tempest-description-221813954"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:15.736414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:15.746409 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0481b8a1-f930-47cd-adad-4a9be45ee335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1317 microversion: 2.1 time: 0.413387 May 19 08:27:15.747638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1420/2714] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:15 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:16.202127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:16.202751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:16.210052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:16.210507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:16.211463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:16.212051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:16.217224 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-ca4fc3ad-b6f2-4f05-9c83-48e55ef97e01 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.573648 May 19 08:27:16.217887 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1295/2715] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:16.230169 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5e094c07-db42-48e6-be21-651c9e0e5760 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3217add670>, body: {"security_group_rule": {"parent_group_id": "b8fb5e61-615b-46c5-b1b1-f9d1fa310e88", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "eef45c0d-7871-4dba-8be1-8a1aa0774bdb"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:16.653590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:16.671481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccf36016-094c-4091-9a52-924fa2751748 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1495 microversion: 2.1 time: 0.467257 May 19 08:27:16.679193 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1421/2716] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:16 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1495 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:16.692192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:16.696040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:16.710091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:16.713070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:16.716276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:16.719197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.008471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:17.042495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b903d05c-710d-4572-9e22-e43ad02ba69b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1272 microversion: 2.1 time: 0.357708 May 19 08:27:17.045688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1422/2717] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:16 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:17.057706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:17.058509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:17.094408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.095243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.096357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.099122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.711201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:17.723878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:17.726665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:17.728361 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2fca052-dc95-4da8-98ae-a0ca4afdf764 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.681465 May 19 08:27:17.737194 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5e094c07-db42-48e6-be21-651c9e0e5760 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.511677 May 19 08:27:17.738923 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1296/2718] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:27:16 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:27:17.740498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1423/2719] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:17 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:17.745630 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:17.746869 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:17.759882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b10c0bec-7887-480d-bec6-07996de2791d req-bc779d6c-50c8-4927-b0f6-44e931e8af05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c40c329-0112-47e2-839e-b9f9b7bd973f", "name": "network-vif-deleted", "tag": "5ba4f84b-65ec-4577-ad64-9a4d930d28af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:17.766608 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.767540 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.771521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b10c0bec-7887-480d-bec6-07996de2791d req-bc779d6c-50c8-4927-b0f6-44e931e8af05 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.771674 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.772231 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.773245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b10c0bec-7887-480d-bec6-07996de2791d req-bc779d6c-50c8-4927-b0f6-44e931e8af05 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.791463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b10c0bec-7887-480d-bec6-07996de2791d req-bc779d6c-50c8-4927-b0f6-44e931e8af05 service nova] Creating event network-vif-deleted:5ba4f84b-65ec-4577-ad64-9a4d930d28af for instance 5c40c329-0112-47e2-839e-b9f9b7bd973f on chh1-842464-2 May 19 08:27:17.801939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b10c0bec-7887-480d-bec6-07996de2791d req-bc779d6c-50c8-4927-b0f6-44e931e8af05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055614 May 19 08:27:17.802858 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1424/2720] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:17.820278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:17.822610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:17.830912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.831702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.840384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.841082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.896544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:17.899345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:17.900093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:17.900964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'fault' on Instance uuid 5c40c329-0112-47e2-839e-b9f9b7bd973f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:18.022087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:18.037283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77aaa4ce-5f11-49e7-bd7d-cf97b32dfbd4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 200 len: 1302 microversion: 2.1 time: 0.230810 May 19 08:27:18.038493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1425/2721] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:17 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 1302 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:18.051676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88a41ab4-f25c-48ee-ab07-dd13f1ad25cf tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3211df7040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-834655050", "description": "tempest-description-1289741731"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:18.179898 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:18.188716 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-f66dcd2e-9b10-43ec-b948-cfadeb48858e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1317 microversion: 2.1 time: 0.447200 May 19 08:27:18.202095 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1297/2722] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:17 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:18.208802 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:18.209677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:18.219607 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:18.220086 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:18.221399 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:18.223371 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:18.341954 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:18.356787 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-3552bf55-c3fd-495b-bb96-eb0e854fb658 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1272 microversion: 2.1 time: 0.152471 May 19 08:27:18.366956 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1298/2723] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:18 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:18.367176 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-a244f8e7-72a0-4dd2-a189-f928359922b4 req-17d51f93-d5ac-499e-98d4-185d2715c9be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f53a05d-5149-4732-91fa-d68946239a66", "tag": "68e7277c-370c-44b3-9886-936bd40298a8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:18.380960 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a244f8e7-72a0-4dd2-a189-f928359922b4 req-17d51f93-d5ac-499e-98d4-185d2715c9be service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:18.381530 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-a244f8e7-72a0-4dd2-a189-f928359922b4 req-17d51f93-d5ac-499e-98d4-185d2715c9be service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:18.407338 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-a244f8e7-72a0-4dd2-a189-f928359922b4 req-17d51f93-d5ac-499e-98d4-185d2715c9be service nova] Creating event network-changed:68e7277c-370c-44b3-9886-936bd40298a8 for instance 1f53a05d-5149-4732-91fa-d68946239a66 on chh2-842464-2 May 19 08:27:18.415508 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-a244f8e7-72a0-4dd2-a189-f928359922b4 req-17d51f93-d5ac-499e-98d4-185d2715c9be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053520 May 19 08:27:18.416226 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1299/2724] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:18.740800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88a41ab4-f25c-48ee-ab07-dd13f1ad25cf tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.699579 May 19 08:27:18.741801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1426/2725] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:18.753067 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:18.756305 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:18.761617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4f337aa-ebec-4d6e-9d6e-04d1de552d17 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3217ae9670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2083920882", "description": "tempest-description-479648979"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:18.788362 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:18.789112 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:18.803795 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:18.804428 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:18.966575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:18.977152 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:18.980497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:18.983150 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bceeeb00-1ec7-467a-9111-0d99b79aff5c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.238565 May 19 08:27:18.984516 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1300/2726] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:18 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:19.055257 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:19.055881 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:19.067135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:19.067593 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:19.068375 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:19.068816 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:19.086099 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f HTTP/1.1 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '5c40c329-0112-47e2-839e-b9f9b7bd973f'} May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:19.088070 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:27:19.092712 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:19.094560 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:19.095670 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-180d0207-49a6-457e-a22c-5c37c99678c1 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 404 len: 111 microversion: 2.1 time: 0.045191 May 19 08:27:19.096711 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1301/2727] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:19 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:27:19.210286 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:19.211512 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:19.220310 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:19.223997 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:19.226440 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:19.230851 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:19.443845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4f337aa-ebec-4d6e-9d6e-04d1de552d17 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.691421 May 19 08:27:19.448463 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1427/2728] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:19.453345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-639527491", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:19.513485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:27:19.818616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:19.839136 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7ba15534-3321-4383-9b18-4a7d516be335 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1317 microversion: 2.1 time: 0.634012 May 19 08:27:19.840091 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1302/2729] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:19 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:19.847068 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:19.848489 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:19.863052 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:19.864677 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:19.866515 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:19.867279 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:20.343807 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:20.362257 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-5e5011c6-18a0-49f4-a896-8161e9ddd535 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.518565 May 19 08:27:20.363786 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1303/2730] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:19 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:20.369053 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-bc219227-b735-4660-bfba-ebcb3492dbf5 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3217a62b80>, body: {"security_group_rule": {"parent_group_id": "672ec95d-28b3-407f-9155-cac907593385", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "37dab1b1-7544-46e1-be2c-917e560175f4"}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:20.656871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:20.839295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:27:20.839873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:27:20.840478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:27:20.841002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:27:20.841562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:27:20.859480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:20.860097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:20.861579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:20.879366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:20.934308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:20.951780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:20.988832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:27:20.996528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:27:21.122715 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0d710f3-6cbd-448f-a65e-90556acf41f8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.671980 May 19 08:27:21.123618 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1428/2731] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:27:21.155826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:21.160853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:21.178693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:21.179164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:21.179975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:21.180421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:21.340096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:21.356858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:21.360516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:21.362393 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9ae3fc8-c8b9-4e27-ae2e-c6fe1247d07f tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.235488 May 19 08:27:21.364442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1429/2732] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:21 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:21.384568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:21.385237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:21.403562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:21.408290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:21.409119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:21.409607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:21.709345 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-bc219227-b735-4660-bfba-ebcb3492dbf5 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.344085 May 19 08:27:21.709966 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1304/2733] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:27:20 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:21.714985 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-bafa4191-6e90-4793-9828-0d1dbe8b1e5d req-110b34a4-6081-44d3-b3af-053a2f4f5e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a5e40a-096d-493c-af54-1221c143892a", "tag": "0a5e454f-4dba-414f-b06f-6198c83650ee"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:21.739787 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-bafa4191-6e90-4793-9828-0d1dbe8b1e5d req-110b34a4-6081-44d3-b3af-053a2f4f5e08 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:21.740241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-bafa4191-6e90-4793-9828-0d1dbe8b1e5d req-110b34a4-6081-44d3-b3af-053a2f4f5e08 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:21.755507 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-bafa4191-6e90-4793-9828-0d1dbe8b1e5d req-110b34a4-6081-44d3-b3af-053a2f4f5e08 service nova] Creating event network-changed:0a5e454f-4dba-414f-b06f-6198c83650ee for instance 64a5e40a-096d-493c-af54-1221c143892a on chh1-842464-2 May 19 08:27:21.768463 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-bafa4191-6e90-4793-9828-0d1dbe8b1e5d req-110b34a4-6081-44d3-b3af-053a2f4f5e08 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057142 May 19 08:27:21.771112 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1305/2734] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:21.783521 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-0f6ba321-1502-4db3-84cd-a855cb913df2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:21.784293 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-0f6ba321-1502-4db3-84cd-a855cb913df2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:22.248138 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-0f6ba321-1502-4db3-84cd-a855cb913df2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:22.268988 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-0f6ba321-1502-4db3-84cd-a855cb913df2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1214 microversion: 2.1 time: 0.496380 May 19 08:27:22.272583 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1306/2735] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:21 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1214 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:22.279308 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:22.280703 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:22.318135 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:22.318886 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:22.321871 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:22.323737 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:22.354581 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell1:SELECT=100 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:22.444391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:22.456266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48aca76e-b065-4211-ad6c-fccbf120ba21 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1317 microversion: 2.1 time: 1.090491 May 19 08:27:22.456881 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1430/2736] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:21 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1317 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:22.463901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-740aef7d-48b0-43b9-9069-6ba29bd65796 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217bc3430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:22.737516 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_cell0:SELECT=2 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:22.770523 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:22.806892 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-dadc0c54-f5e2-4d93-a59e-a91a0ffd1a65 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.532693 May 19 08:27:22.823537 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1307/2737] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:22 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:22.838162 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:22.838780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:22.857940 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:22.858388 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:22.861535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:22.864641 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:23.000447 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:23.018051 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:23.023940 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:23.026533 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6b030e7f-55e6-4301-b60a-c7a13fe6a56c tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.192359 May 19 08:27:23.028142 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1308/2738] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:22 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:23.082383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-740aef7d-48b0-43b9-9069-6ba29bd65796 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/37dab1b1-7544-46e1-be2c-917e560175f4" status: 202 len: 0 microversion: 2.1 time: 0.623803 May 19 08:27:23.084289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1431/2739] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:22 2022] DELETE /compute/v2.1/os-security-groups/37dab1b1-7544-46e1-be2c-917e560175f4 => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:23.091805 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1953a5c9-bc7d-4b7f-8a58-5e1928cdd8ed tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f32117f8820>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:23.170064 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1953a5c9-bc7d-4b7f-8a58-5e1928cdd8ed tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/672ec95d-28b3-407f-9155-cac907593385" status: 200 len: 247 microversion: 2.1 time: 0.081973 May 19 08:27:23.170880 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1309/2740] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:27:23 2022] GET /compute/v2.1/os-security-groups/672ec95d-28b3-407f-9155-cac907593385 => generated 247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:23.185759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70a7eef7-f14e-448b-a32e-14e2d5b4997d tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f32119cf040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1333050239", "description": "tempest-description-1206853501"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:23.291054 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:23.292130 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:23.308185 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:23.308616 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:23.309484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:23.309940 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:23.385024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70a7eef7-f14e-448b-a32e-14e2d5b4997d tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.205236 May 19 08:27:23.385788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1432/2741] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:27:23 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:27:23.401845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee937ebf-f67c-4394-b38e-9436657d43d9 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3211d55700>, body: {"security_group_rule": {"parent_group_id": "e3fd8026-3d88-4284-8624-1db1e56c6730", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:23.467157 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:23.479683 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-663899d4-2cd8-4da7-9082-991a7909f266 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1272 microversion: 2.1 time: 0.192670 May 19 08:27:23.496916 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1310/2742] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:23 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:23.506606 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:23.507241 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:23.520668 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:23.522295 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:23.523167 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:23.523629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:23.789109 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:23.801064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee937ebf-f67c-4394-b38e-9436657d43d9 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.406909 May 19 08:27:23.803970 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1433/2743] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:27:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:27:23.826219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c16495e-0e6d-4628-a957-3501d598e11f tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Action: 'create', calling method: .version_select at 0x7f3211df7c10>, body: {"security_group_rule": {"parent_group_id": "e3fd8026-3d88-4284-8624-1db1e56c6730", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:23.828239 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6cea7e95-36cf-47e9-8fcd-4340d41af80c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1317 microversion: 2.1 time: 0.328872 May 19 08:27:23.829693 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1311/2744] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:23 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:23.848811 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:23.849575 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:23.862571 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:23.864335 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:23.866027 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:23.866579 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:24.278915 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:24.292870 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-88473a6b-5d66-4b0e-98b7-29b9a95f919c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.448725 May 19 08:27:24.293504 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1312/2745] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:23 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:24.300333 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:24.301682 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:24.316800 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:24.317245 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:24.319535 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:24.321479 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:24.440694 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:24.457359 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:24.473230 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:24.474484 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-c4a53412-2cf3-468f-bd87-61e72da99d42 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.179884 May 19 08:27:24.477883 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1313/2746] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:24 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:24.482899 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-147cdefb-95dc-41a4-b546-f8629670473b req-4ab7d2bb-b3e1-4e55-8804-9f89b79059b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53a05d-5149-4732-91fa-d68946239a66", "name": "network-vif-plugged", "status": "completed", "tag": "68e7277c-370c-44b3-9886-936bd40298a8"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:24.514781 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-147cdefb-95dc-41a4-b546-f8629670473b req-4ab7d2bb-b3e1-4e55-8804-9f89b79059b0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:24.515706 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-147cdefb-95dc-41a4-b546-f8629670473b req-4ab7d2bb-b3e1-4e55-8804-9f89b79059b0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:24.533596 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-147cdefb-95dc-41a4-b546-f8629670473b req-4ab7d2bb-b3e1-4e55-8804-9f89b79059b0 service nova] Creating event network-vif-plugged:68e7277c-370c-44b3-9886-936bd40298a8 for instance 1f53a05d-5149-4732-91fa-d68946239a66 on chh2-842464-2 May 19 08:27:24.539848 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-147cdefb-95dc-41a4-b546-f8629670473b req-4ab7d2bb-b3e1-4e55-8804-9f89b79059b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060575 May 19 08:27:24.541054 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1314/2747] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:24.548013 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:24.548946 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:24.568383 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:24.574284 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:24.575497 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:24.576066 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:24.612147 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c16495e-0e6d-4628-a957-3501d598e11f tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.790882 May 19 08:27:24.626497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1434/2748] 10.222.0.78 () {60 vars in 1194 bytes} [Thu May 19 08:27:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:24.641975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f30e0731-27f6-4eaa-9e56-d0c5cb369eb1 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217b34700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:25.030174 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f30e0731-27f6-4eaa-9e56-d0c5cb369eb1 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/e3fd8026-3d88-4284-8624-1db1e56c6730" status: 200 len: 665 microversion: 2.1 time: 0.399934 May 19 08:27:25.039921 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1435/2749] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:27:24 2022] GET /compute/v2.1/os-security-groups/e3fd8026-3d88-4284-8624-1db1e56c6730 => generated 665 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:25.046425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:25.047572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:25.071989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.072712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.074281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.075348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.112225 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:25.126378 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-a81c2ea5-9d19-486c-8d1e-00ce3ffcb451 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.583752 May 19 08:27:25.127251 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1315/2750] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:24 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:25.145297 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-7be3efb4-2125-423b-82d7-155648c29a99 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217ba3310>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:25.567638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:25.590242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26af8391-abfd-4c9c-b2f9-8f8d44293c96 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1317 microversion: 2.1 time: 0.548540 May 19 08:27:25.596789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1436/2751] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:25 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:25.608329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:25.608885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:25.623816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.624656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.625934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.626843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.716057 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-7be3efb4-2125-423b-82d7-155648c29a99 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/3c42f08d-2cc8-4725-88ff-5655859b0b00" status: 202 len: 0 microversion: 2.1 time: 0.587702 May 19 08:27:25.716671 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1316/2752] 10.222.0.78 () {58 vars in 1286 bytes} [Thu May 19 08:27:25 2022] DELETE /compute/v2.1/os-security-group-rules/3c42f08d-2cc8-4725-88ff-5655859b0b00 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:25.726947 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [req-2ccea77f-0181-452b-b61c-0ba74c1a6585 req-7573e0e8-cd82-4566-adf0-d86bf2ff8e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a5c2fd-32fe-41ef-9c08-6c27abbb1251", "tag": "bc3a8d20-bee2-4efc-a44a-20a3c40d262b"}]} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:25.742938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2ccea77f-0181-452b-b61c-0ba74c1a6585 req-7573e0e8-cd82-4566-adf0-d86bf2ff8e21 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.743812 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [req-2ccea77f-0181-452b-b61c-0ba74c1a6585 req-7573e0e8-cd82-4566-adf0-d86bf2ff8e21 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.766754 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.compute.server_external_events [req-2ccea77f-0181-452b-b61c-0ba74c1a6585 req-7573e0e8-cd82-4566-adf0-d86bf2ff8e21 service nova] Creating event network-changed:bc3a8d20-bee2-4efc-a44a-20a3c40d262b for instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 on chh1-842464-2 May 19 08:27:25.772422 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [req-2ccea77f-0181-452b-b61c-0ba74c1a6585 req-7573e0e8-cd82-4566-adf0-d86bf2ff8e21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054536 May 19 08:27:25.773683 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1317/2753] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:25.780504 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:25.781484 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:25.789933 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.790639 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.791634 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:25.792261 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:25.908248 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:25.925991 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:25.931823 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:25.934442 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6376a2c6-b571-4ba3-8935-5b7156f761a0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 200 len: 1266 microversion: 2.25 time: 0.159027 May 19 08:27:25.935848 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1318/2754] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:25 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:25.940277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:25.941911 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-43d5f94a-bf24-4bbf-8e66-2b385947f36e tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217a62040>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:25.957122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f89e0972-70b2-4835-960d-c65573b17774 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.356982 May 19 08:27:25.958194 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1437/2755] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:25 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:26.147241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:26.148689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:26.159394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:26.163587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:26.164708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:26.168077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:26.266198 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-43d5f94a-bf24-4bbf-8e66-2b385947f36e tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/e3fd8026-3d88-4284-8624-1db1e56c6730" status: 202 len: 0 microversion: 2.1 time: 0.329144 May 19 08:27:26.267282 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1319/2756] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:25 2022] DELETE /compute/v2.1/os-security-groups/e3fd8026-3d88-4284-8624-1db1e56c6730 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:26.275968 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217ace040>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:26.363491 chdv-842464-2 devstack@n-api.service[119073]: DEBUG neutronclient.v2_0.client [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist", "detail": ""}} {{(pid=119073) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:27:26.364116 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.network.security_group_api [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Neutron security group 37dab1b1-7544-46e1-be2c-917e560175f4 not found {{(pid=119073) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:27:26.364626 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] HTTP exception thrown: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.364626 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Request method failure captured: May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: request: DELETE /compute/v2.1/os-security-groups/37dab1b1-7544-46e1-be2c-917e560175f4 HTTP/1.1 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf9ehZ18grsVsjbmulT54C1jbROR-wSjtH-5HY9nMEyLc3QydEkp35OgQY2qWwaXDz7fDBpJpAYiFYxFqvMJiE3fsbI3jWOp2aIIRLsGXrTZ7x8CgfcWzhp42efjR4Pc5WE50Z_PseRVCcMDkl6bDPd-ah1XnDxyh44DjxPnJh34o0Y May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: 73e9054236774677827dffc4f1948cf2 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1889759685 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/73e9054236774677827dffc4f1948cf2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73e9054236774677827dffc4f1948cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_73e9054236774677827dffc4f1948cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/73e9054236774677827dffc4f1948cf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1889759685 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: 73e9054236774677827dffc4f1948cf2 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1889759685 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-SecurityGroupRulesTestJSON-1889759685-project May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 51e0385a57a048648bfb89731c71da2b May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1889759685-project May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: method: May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: exception: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '37dab1b1-7544-46e1-be2c-917e560175f4'} May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:27:26.366621 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Returning 404 to user: Security group 37dab1b1-7544-46e1-be2c-917e560175f4 does not exist May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: Neutron server returns request_ids: ['req-221ec2aa-1659-4856-a6cb-4f069a558882'] {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1391e040-6dad-43f5-af28-926eaab72a97 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/37dab1b1-7544-46e1-be2c-917e560175f4" status: 404 len: 194 microversion: 2.1 time: 0.096327 May 19 08:27:26.372644 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1320/2757] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:26 2022] DELETE /compute/v2.1/os-security-groups/37dab1b1-7544-46e1-be2c-917e560175f4 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:27:26.380772 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-e9a9e6a6-fb5d-4223-8e5e-6fbe822ae08c tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217b9dc10>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:26.516612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:26.527170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9f225bd-e4cf-4c74-98f1-ce71e1d9e0c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.386915 May 19 08:27:26.532880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1438/2758] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:26 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:26.615036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:26.615671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:26.623316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:26.624136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:26.625356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:26.625961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:26.782419 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-e9a9e6a6-fb5d-4223-8e5e-6fbe822ae08c tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/672ec95d-28b3-407f-9155-cac907593385" status: 202 len: 0 microversion: 2.1 time: 0.409344 May 19 08:27:26.783165 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1321/2759] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:26 2022] DELETE /compute/v2.1/os-security-groups/672ec95d-28b3-407f-9155-cac907593385 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:26.799745 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-4c0b79ff-605e-470a-a5bf-817ebbb1428d tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f32123a4e50>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:26.912841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:26.929061 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-179f1f84-d6f9-4c46-8728-f3007509b2d7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1467 microversion: 2.1 time: 0.318549 May 19 08:27:26.930920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1439/2760] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:26 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1467 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:27.230985 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-4c0b79ff-605e-470a-a5bf-817ebbb1428d tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/eef45c0d-7871-4dba-8be1-8a1aa0774bdb" status: 202 len: 0 microversion: 2.1 time: 0.442700 May 19 08:27:27.232177 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1322/2761] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:26 2022] DELETE /compute/v2.1/os-security-groups/eef45c0d-7871-4dba-8be1-8a1aa0774bdb => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:27:27.240699 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:27.241633 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 75b79bad-0fe9-46cb-9eca-4ccbe3e70234] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:27.259935 chdv-842464-2 devstack@n-api.service[119073]: DEBUG dbcounter [-] [119073] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:27.262288 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.264125 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.266254 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.277859 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.308523 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.wsgi [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] HTTP exception thrown: Instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 could not be found. May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Request method failure captured: May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: request: GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 HTTP/1.1 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Accept: application/json May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Accept-Encoding: identity May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Connection: close May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Content-Length: 0 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Content-Type: application/json May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Host: 10.222.0.78 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: Openstack-System-Scope: None May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: User-Agent: python-urllib3/1.26.9 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Auth-Token: gAAAAABihf1uAJdDdNwdNU4CYNt4c6fDPnYnsbuPxxSEMMM4vN4u_VN1zRNTLDYBfE0Fh6sVXDPEldd10hDh9w-bJ3EczR5n8Ws3R-uM2bgBENRegHXaKidSVvgiblWo5nza18QTBniDdG_mOEyOYg8faklozvLoKTah_p1TwIzMPMkxwhGJi88 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Id: None May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Domain-Name: None May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Identity-Status: Confirmed May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Is-Admin-Project: True May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Openstack-Nova-Api-Version: 2.25 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Id: default May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Domain-Name: Default May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Role: member,reader May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Roles: member,reader May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-User: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Id: default May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-User-Domain-Name: Default May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-User-Id: 024724b24b274d7db1c43874767de143 May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: method: > May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: exception: Instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 could not be found. May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: action_args: {'id': '75b79bad-0fe9-46cb-9eca-4ccbe3e70234'} May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 could not be found. May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 could not be found. May 19 08:27:27.310589 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 could not be found. May 19 08:27:27.314190 chdv-842464-2 devstack@n-api.service[119073]: ERROR nova.api.openstack.wsgi May 19 08:27:27.320780 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Returning 404 to user: Instance 75b79bad-0fe9-46cb-9eca-4ccbe3e70234 could not be found. {{(pid=119073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:27.322491 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-6a973e8c-176d-4e41-98d1-41683d362fbc tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234" status: 404 len: 111 microversion: 2.25 time: 0.088929 May 19 08:27:27.324017 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1323/2762] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:27 2022] GET /compute/v2.1/servers/75b79bad-0fe9-46cb-9eca-4ccbe3e70234 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:27:27.338561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:27.339216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:27.352124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.357932 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:27.358998 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.compute.api [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119073) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:27.360692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.363771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.364239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.366376 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.366838 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.368576 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.369195 chdv-842464-2 devstack@n-api.service[119073]: DEBUG oslo_concurrency.lockutils [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.655938 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.policy [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119073) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:27.679053 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-abb34129-46b0-4e8e-ba4d-5ed46093e81a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.351685 May 19 08:27:27.703475 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1324/2763] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:27 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:27.734547 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-1dcc8eb0-77e2-4ed4-b34f-7b04caab3412 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217b28dc0>' {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:27.867691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f47c707e-a00f-4f88-bbd6-d16807f69ea7 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1618 microversion: 2.1 time: 0.925345 May 19 08:27:27.879400 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1440/2764] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:26 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1618 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:27.887477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:27.890373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:27.904019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.904471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:27.905282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:27.905765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:28.165292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:28.171878 chdv-842464-2 devstack@n-api.service[119073]: INFO nova.api.openstack.requestlog [None req-1dcc8eb0-77e2-4ed4-b34f-7b04caab3412 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b8fb5e61-615b-46c5-b1b1-f9d1fa310e88" status: 202 len: 0 microversion: 2.1 time: 0.457746 May 19 08:27:28.173345 chdv-842464-2 devstack@n-api.service[119073]: [pid: 119073|app: 0|req: 1325/2765] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:27 2022] DELETE /compute/v2.1/os-security-groups/b8fb5e61-615b-46c5-b1b1-f9d1fa310e88 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:28.179998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a301b72-28dd-4d82-b537-2f51f7ec2358 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.310591 May 19 08:27:28.182525 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1441/2766] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:27 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:28.185629 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.api.openstack.wsgi [None req-9f2e441f-03cd-4da2-abfd-dc74e0918c88 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: .version_select at 0x7f3217ac9d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1400939416", "policies": ["affinity"]}} {{(pid=119073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:28.192282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb9b81fe-2383-4b8f-81f1-64372e15a5f6 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f3217bc3670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:28.241901 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-9f2e441f-03cd-4da2-abfd-dc74e0918c88 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_groups'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:28.247632 chdv-842464-2 devstack@n-api.service[119073]: DEBUG nova.quota [None req-9f2e441f-03cd-4da2-abfd-dc74e0918c88 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_groups'} {{(pid=119073) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:28.444612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb9b81fe-2383-4b8f-81f1-64372e15a5f6 tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/b9e60798-b8df-4380-a793-5cffbc548d30" status: 202 len: 0 microversion: 2.1 time: 0.260258 May 19 08:27:28.445765 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1442/2767] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:28 2022] DELETE /compute/v2.1/os-security-groups/b9e60798-b8df-4380-a793-5cffbc548d30 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:28.454603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b844c309-9e69-4400-991f-5eaadb2ce0cd tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] Calling method '.version_select at 0x7f32119cff70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:28.727181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b844c309-9e69-4400-991f-5eaadb2ce0cd tempest-SecurityGroupRulesTestJSON-1889759685 tempest-SecurityGroupRulesTestJSON-1889759685-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d371c237-8589-4197-8735-892b1e43eb80" status: 202 len: 0 microversion: 2.1 time: 0.277281 May 19 08:27:28.728572 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1443/2768] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:27:28 2022] DELETE /compute/v2.1/os-security-groups/d371c237-8589-4197-8735-892b1e43eb80 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:27:28.735989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:28.737159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:28.746988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:28.748123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:28.751295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:28.754216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:28.965334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:28.969817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:28.980868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-97ba40f4-ca6f-4610-92a4-f8e22b9f24f3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.250690 May 19 08:27:28.981718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1444/2769] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:28 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:29.200357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:29.201092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:29.215142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:29.215613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:29.223906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:29.224509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:29.466999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:29.479168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91101802-a89e-40ce-bd99-de671812688f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.283337 May 19 08:27:29.481955 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1445/2770] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:29 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:29.577944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4951ffdf-7d61-4bd3-a6fc-6d22ff70f08f req-7e0e1ef0-15c5-496a-a77d-d0b4969ec461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a5e40a-096d-493c-af54-1221c143892a", "name": "network-vif-plugged", "status": "completed", "tag": "0a5e454f-4dba-414f-b06f-6198c83650ee"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:29.604819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4951ffdf-7d61-4bd3-a6fc-6d22ff70f08f req-7e0e1ef0-15c5-496a-a77d-d0b4969ec461 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:29.609780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4951ffdf-7d61-4bd3-a6fc-6d22ff70f08f req-7e0e1ef0-15c5-496a-a77d-d0b4969ec461 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:29.642891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4951ffdf-7d61-4bd3-a6fc-6d22ff70f08f req-7e0e1ef0-15c5-496a-a77d-d0b4969ec461 service nova] Creating event network-vif-plugged:0a5e454f-4dba-414f-b06f-6198c83650ee for instance 64a5e40a-096d-493c-af54-1221c143892a on chh1-842464-2 May 19 08:27:29.664464 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4951ffdf-7d61-4bd3-a6fc-6d22ff70f08f req-7e0e1ef0-15c5-496a-a77d-d0b4969ec461 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092516 May 19 08:27:29.666360 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1446/2771] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:27:30.001865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:30.004016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:30.013781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:30.014748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:30.017029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:30.018036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:30.264415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:30.274775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b4e822a-9197-46f8-8e1e-06cf7a775fb6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1314 microversion: 2.1 time: 0.279401 May 19 08:27:30.276364 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1447/2772] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:29 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:30.498417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:30.500108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:30.507944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:30.508405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:30.509259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:30.509796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:30.711135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:30.720340 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5668879-4d14-4fb0-a122-cc94149a62d0 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.226138 May 19 08:27:30.721126 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1448/2773] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:30 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:31.294994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:31.295853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:31.305811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:31.307139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:31.312434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.312956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:31.313851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.314484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:31.563490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:31.572431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8f9f3f0-3369-4411-a317-bf3164a70160 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1501 microversion: 2.1 time: 0.283552 May 19 08:27:31.573032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1449/2774] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:31 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1501 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:31.591293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:31.592270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:31.603648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.604435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:31.605518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.606146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:31.711929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f19f612-699b-4c5a-b07b-38b48df6cb0b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.124846 May 19 08:27:31.714323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1450/2775] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:31 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 08:27:31.727188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-68f4f548-5e6e-4c93-881c-f89d2fb62d98 req-83c4b6a0-c2e0-49b4-af8d-27f63439b5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a5c2fd-32fe-41ef-9c08-6c27abbb1251", "name": "network-vif-plugged", "status": "completed", "tag": "bc3a8d20-bee2-4efc-a44a-20a3c40d262b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:31.747490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-68f4f548-5e6e-4c93-881c-f89d2fb62d98 req-83c4b6a0-c2e0-49b4-af8d-27f63439b5b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.748023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-68f4f548-5e6e-4c93-881c-f89d2fb62d98 req-83c4b6a0-c2e0-49b4-af8d-27f63439b5b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:31.772276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-68f4f548-5e6e-4c93-881c-f89d2fb62d98 req-83c4b6a0-c2e0-49b4-af8d-27f63439b5b4 service nova] Creating event network-vif-plugged:bc3a8d20-bee2-4efc-a44a-20a3c40d262b for instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 on chh1-842464-2 May 19 08:27:31.794566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-68f4f548-5e6e-4c93-881c-f89d2fb62d98 req-83c4b6a0-c2e0-49b4-af8d-27f63439b5b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075936 May 19 08:27:31.799291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1451/2776] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:31.818328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:31.821968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:31.867019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.868706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:31.870122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:31.871010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:32.200447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:32.218372 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-09457013-12cf-45ad-bc4d-613e6a3fd1a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.405955 May 19 08:27:32.232047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1452/2777] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:31 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:32.726738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:32.727950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:32.746072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:32.746821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:32.747904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:32.748366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:32.812193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4f77bfb-a7b6-49f4-9123-9d0528a92534 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.089986 May 19 08:27:32.813139 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1453/2778] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:32 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:33.236739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:33.238440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:33.250182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:33.254298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:33.255397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:33.261921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:33.895018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:33.915965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87cc47be-c16e-4d13-8cee-5fb4b677b8d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1314 microversion: 2.1 time: 0.682725 May 19 08:27:33.926069 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1454/2779] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:33 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:33.926069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:33.926069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:33.939348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:33.939712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:33.955281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:33.959985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:34.038760 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afca33bf-7b70-4296-991f-fa20ea35f511 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.120558 May 19 08:27:34.039410 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1455/2780] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:33 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:34.934400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:34.946794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:34.953403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:34.953877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:34.954672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:34.955122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:35.355422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:35.370426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4d83f2b-5789-4da1-be21-80899982fd41 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1497 microversion: 2.1 time: 0.440158 May 19 08:27:35.371250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1456/2781] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:34 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1497 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:35.376241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:35.385255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:35.397978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:35.403040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:35.404152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:35.404827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:35.520475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a48d6cb-97c3-4763-a0dc-a58f4b654adb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.147686 May 19 08:27:35.521285 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1457/2782] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:35 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:35.534479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:35.540308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:35.564617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:35.566604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:35.583028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:35.583503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:35.759953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a05c9c89-b2ab-494a-acd2-069c15b00ca4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251/action" status: 202 len: 0 microversion: 2.1 time: 0.236740 May 19 08:27:35.763417 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1458/2783] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:35 2022] POST /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:35.784561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:35.800725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:35.822935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:35.826498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:35.829096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:35.831194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:36.524051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:36.533165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1237f668-1650-4a0f-8475-78b5ba57a49b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1502 microversion: 2.1 time: 0.764703 May 19 08:27:36.538034 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1459/2784] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:35 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1502 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:36.549401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:36.551402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:36.564140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:36.568578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:36.569649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:36.570290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:36.650080 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-315f6f30-e3db-42b1-9a73-af45a88d43ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.110376 May 19 08:27:36.651495 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1460/2785] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:36 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:37.557740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:37.559463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:37.596195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:37.603438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:37.607847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:37.608329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:38.014241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:38.023110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33158145-7a0d-4fbe-9148-350b1fdaf9e2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1482 microversion: 2.1 time: 0.471746 May 19 08:27:38.028096 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1461/2786] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:37 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1482 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:38.042149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:38.043374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:38.060724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:38.066198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:38.067473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:38.069942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:38.150498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbcda9df-2b7a-4795-9afd-16b4b2f1645a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.120786 May 19 08:27:38.151813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1462/2787] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:38 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:38.157830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:38.166007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:38.174345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:38.186106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:38.187412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:38.188089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:38.252701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:27:38.269922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:38.455913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12c120a1-2851-454b-b93d-da61a81e15d6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 204 len: 0 microversion: 2.1 time: 0.302195 May 19 08:27:38.463601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1463/2788] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:27:38 2022] DELETE /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:27:38.474145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:38.475029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:38.496327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:38.496961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:38.497932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:38.498769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:39.404983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:39.420011 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1aefbee9-20d2-47ea-a776-a162661703ce tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1488 microversion: 2.1 time: 0.954041 May 19 08:27:39.420870 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1464/2789] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:38 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1488 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:39.432537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:39.438032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:39.467977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:39.468710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:39.469722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:39.470273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:39.585856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0d2ece8-dfd3-45df-ae0e-fe533bec115d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.163182 May 19 08:27:39.586993 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1465/2790] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:39 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:40.454397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:40.470163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:40.486378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:40.491130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:40.492295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:40.494201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:41.282873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:41.302636 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3182fe65-815e-4d94-af48-2f9ca1cf267a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1488 microversion: 2.1 time: 0.866229 May 19 08:27:41.303513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1466/2791] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:40 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1488 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:41.335721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:41.342895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:41.379091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:41.379557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:41.380370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:41.380806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:41.471939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a53a6c3f-e480-4a76-978a-8a0b0de05af9 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.166798 May 19 08:27:41.473913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1467/2792] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:41 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:42.146824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b5ef1afd-34c9-4c11-b9e4-8f353e86eac4 req-cdbdfaa9-ab39-4f94-9cd7-18240606b9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a5c2fd-32fe-41ef-9c08-6c27abbb1251", "name": "network-vif-deleted", "tag": "bc3a8d20-bee2-4efc-a44a-20a3c40d262b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:42.193897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b5ef1afd-34c9-4c11-b9e4-8f353e86eac4 req-cdbdfaa9-ab39-4f94-9cd7-18240606b9c8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:42.194645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b5ef1afd-34c9-4c11-b9e4-8f353e86eac4 req-cdbdfaa9-ab39-4f94-9cd7-18240606b9c8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:42.286214 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b5ef1afd-34c9-4c11-b9e4-8f353e86eac4 req-cdbdfaa9-ab39-4f94-9cd7-18240606b9c8 service nova] Creating event network-vif-deleted:bc3a8d20-bee2-4efc-a44a-20a3c40d262b for instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 on chh1-842464-2 May 19 08:27:42.305496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b5ef1afd-34c9-4c11-b9e4-8f353e86eac4 req-cdbdfaa9-ab39-4f94-9cd7-18240606b9c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163685 May 19 08:27:42.308476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1468/2793] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:27:42.322708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:42.324172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:42.342430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:42.343118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:42.344500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:42.345107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:42.436869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:42.437681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:42.438304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'fault' on Instance uuid 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:42.861181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:42.874300 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34d6d917-80e7-4c41-920a-d062065a299f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 200 len: 1304 microversion: 2.1 time: 0.556004 May 19 08:27:42.884554 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1469/2794] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:42 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 1304 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:42.897105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:42.922472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:42.959363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:42.964991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:42.966046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:42.978359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:43.134390 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10ca8ba5-4608-4c72-8ed9-959d006373a0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 14 microversion: 2.1 time: 0.244444 May 19 08:27:43.135099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1470/2795] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:42 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:27:43.255614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:43.256214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:43.271521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:43.271973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:43.272987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:43.295407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:43.401890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:27:43.618897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:43.673927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b053b77f-45a6-4fcb-b7da-d551ed35305d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 204 len: 0 microversion: 2.25 time: 0.421801 May 19 08:27:43.679261 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1471/2796] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:27:43 2022] DELETE /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 08:27:43.699736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:43.700727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:43.723398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:43.723851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:43.724660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:43.725106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:44.126232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:44.136057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:44.143376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:44.145826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6f4ae08-c126-446d-a295-7863cc1dac45 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1564 microversion: 2.25 time: 0.451192 May 19 08:27:44.160274 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1472/2797] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:43 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1564 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:44.169425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:44.170082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:44.183924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:44.184408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:44.185213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:44.187343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:44.244542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 HTTP/1.1 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '90a5c2fd-32fe-41ef-9c08-6c27abbb1251'} May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:44.246682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:27:44.250839 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:44.253793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:44.255258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c79f339-ed70-48e8-bb45-bbee7ad8df6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 404 len: 111 microversion: 2.1 time: 0.093708 May 19 08:27:44.256074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1473/2798] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:44 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:27:44.266865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:44.268279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:44.283156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:44.294666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:44.295538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:44.296000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:44.427718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe8c7abd-cc87-4fae-8354-964b0a7d9be4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action" status: 200 len: 8206 microversion: 2.1 time: 0.168962 May 19 08:27:44.435081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1474/2799] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:44 2022] POST /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a/action => generated 8206 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:44.656804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d089b7a5-9934-418b-b645-b1cf93594a7d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Action: 'create', calling method: .version_select at 0x7f32121041f0>, body: {"keypair": {"name": "tempest-keypair-31904785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9BYSYmF+85gm+Gx76LaqxDbmrRa/99AmpDFT+N9Uveo6uNekxfuJytJ56ngydham08u3I1DvCHq+EDUABIKX6bkenQWmYoq8DAVr25vdmXmfX5Q7xV0AaGKsLlb+sG1Q=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:44.701068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d089b7a5-9934-418b-b645-b1cf93594a7d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Getting quotas for project 5733d959d3c943e6867a44a49b1b4cde. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:44.711399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d089b7a5-9934-418b-b645-b1cf93594a7d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Getting quotas for user 771d7d0381fd4e68ad5d72210082a1e1 and project 5733d959d3c943e6867a44a49b1b4cde. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:44.766112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d089b7a5-9934-418b-b645-b1cf93594a7d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.329149 May 19 08:27:44.767476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1475/2800] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:27:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:44.772980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:44.776440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:44.803241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:44.804739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:44.806265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:44.835349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:45.288812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:45.306037 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed85a2b1-981c-4a80-9f1e-3b062077d8ff tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.537259 May 19 08:27:45.306638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1476/2801] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:44 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:45.327033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1402953502", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:45.435050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:27:46.596166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:27:46.598095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:27:46.598732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:27:46.599167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:27:46.599597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:27:46.626717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:46.627167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:46.633105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:46.633656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:46.689560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:46.699533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:46.735377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:27:46.738588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:27:46.859170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f37ed522-4cdc-4e39-9171-bfc444c99040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544654 May 19 08:27:46.859931 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1477/2802] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:27:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:27:46.886908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:46.889896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:46.912506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:46.913648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:46.917405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:46.918242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:47.251110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:47.267366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:47.296714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:47.298084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b32d1058-9464-4a3e-a97e-a9c6955b6bbd tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 200 len: 1522 microversion: 2.25 time: 0.434944 May 19 08:27:47.304469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1478/2803] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:46 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:47.329084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:47.336007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:47.366493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:47.373935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:47.380300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:47.380881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:48.235659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:48.246010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e5fad80-1ba4-46b7-8608-ded6c17040bf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.940389 May 19 08:27:48.246995 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1479/2804] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:47 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:48.251784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:48.257627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:48.275948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:48.277621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:48.279365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:48.280127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:48.491046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:48.500899 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c50917ae-c3ea-4372-ab03-391d0f4d9cfc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1219 microversion: 2.1 time: 0.252614 May 19 08:27:48.517709 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1480/2805] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:48 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:48.524837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-962b3337-40c3-40d7-a431-447886176a7d req-3d4e1bf8-cf2c-4e9a-8793-24405bc4faa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee67616-6551-4084-9ed3-cdaf5574749f", "name": "network-vif-deleted", "tag": "713a5191-8215-4c48-aede-a41292a8add6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:48.560676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-962b3337-40c3-40d7-a431-447886176a7d req-3d4e1bf8-cf2c-4e9a-8793-24405bc4faa8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:48.569449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-962b3337-40c3-40d7-a431-447886176a7d req-3d4e1bf8-cf2c-4e9a-8793-24405bc4faa8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:48.597446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:48.601816 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-962b3337-40c3-40d7-a431-447886176a7d req-3d4e1bf8-cf2c-4e9a-8793-24405bc4faa8 service nova] Creating event network-vif-deleted:713a5191-8215-4c48-aede-a41292a8add6 for instance 9ee67616-6551-4084-9ed3-cdaf5574749f on chh1-842464-2 May 19 08:27:48.616710 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-962b3337-40c3-40d7-a431-447886176a7d req-3d4e1bf8-cf2c-4e9a-8793-24405bc4faa8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095660 May 19 08:27:48.617711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1481/2806] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:48.632104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:48.633124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:48.654614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:48.655538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:48.658761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:48.660681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:49.322199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:49.333063 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d456722d-9965-426b-aa90-05f960187654 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.711996 May 19 08:27:49.338484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1482/2807] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:48 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:49.354590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:49.355543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 9ee67616-6551-4084-9ed3-cdaf5574749f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:49.367812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:49.368573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:49.370581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:49.375005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:49.411179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] HTTP exception thrown: Instance 9ee67616-6551-4084-9ed3-cdaf5574749f could not be found. May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Request method failure captured: May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f HTTP/1.1 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1uAJdDdNwdNU4CYNt4c6fDPnYnsbuPxxSEMMM4vN4u_VN1zRNTLDYBfE0Fh6sVXDPEldd10hDh9w-bJ3EczR5n8Ws3R-uM2bgBENRegHXaKidSVvgiblWo5nza18QTBniDdG_mOEyOYg8faklozvLoKTah_p1TwIzMPMkxwhGJi88 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.25 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 024724b24b274d7db1c43874767de143 May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9ee67616-6551-4084-9ed3-cdaf5574749f could not be found. May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9ee67616-6551-4084-9ed3-cdaf5574749f'} May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee67616-6551-4084-9ed3-cdaf5574749f could not be found. May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee67616-6551-4084-9ed3-cdaf5574749f could not be found. May 19 08:27:49.422609 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee67616-6551-4084-9ed3-cdaf5574749f could not be found. May 19 08:27:49.427590 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:49.435630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Returning 404 to user: Instance 9ee67616-6551-4084-9ed3-cdaf5574749f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:49.441890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8fd5b94-4a41-45bd-8df6-85a8801ed32d tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f" status: 404 len: 111 microversion: 2.25 time: 0.100878 May 19 08:27:49.445619 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1483/2808] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:49 2022] GET /compute/v2.1/servers/9ee67616-6551-4084-9ed3-cdaf5574749f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:27:49.457333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:49.461260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:49.468613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:49.469416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:49.471470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:49.474144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:49.915296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:49.927022 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd445ee3-da13-4fb3-a192-2ee7567c6189 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.478855 May 19 08:27:49.941774 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1484/2809] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:49 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:49.956959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:49.956959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:49.963831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:49.964300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:49.965103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:49.965728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:50.043371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:27:50.224276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d999dfe-a673-4f62-a473-16c0429178e6 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 204 len: 0 microversion: 2.25 time: 0.274947 May 19 08:27:50.225030 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1485/2810] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:27:49 2022] DELETE /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:27:50.235070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:50.235801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:50.252814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:50.255321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:50.256343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:50.256803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:50.435060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:50.448515 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db00184d-c7ea-4b11-babd-81b55e635704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1273 microversion: 2.1 time: 0.220237 May 19 08:27:50.460607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1486/2811] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:50 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:50.515013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-944608189", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f8d239e0-28aa-4056-b558-3b48b509af27"}], "security_groups": [{"name": "tempest-securitygroup--1796693719"}], "key_name": "tempest-keypair-31904785", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:51.000002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] validate_networks() for [('f8d239e0-28aa-4056-b558-3b48b509af27', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:27:52.508242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Getting quotas for project 5733d959d3c943e6867a44a49b1b4cde. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:52.515421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Getting quotas for user 771d7d0381fd4e68ad5d72210082a1e1 and project 5733d959d3c943e6867a44a49b1b4cde. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:52.531652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:27:52.532473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:27:52.533265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:27:52.533981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:27:52.535790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:27:52.545763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:52.546684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:52.547816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:52.548468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:52.572957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Getting quotas for project 5733d959d3c943e6867a44a49b1b4cde. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:27:52.579451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Getting quotas for user 771d7d0381fd4e68ad5d72210082a1e1 and project 5733d959d3c943e6867a44a49b1b4cde. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:27:52.595116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:27:52.606589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:27:52.668364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a923c662-fafc-43c6-873a-24817edbc184 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.206378 May 19 08:27:52.675006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1487/2812] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:27:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:27:52.711160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:52.713965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:52.726073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:52.726073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:52.737269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:52.738076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:52.841729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Locking {{(pid=119072) lock /opt/stack/nova/nova/compute/api.py:4700}} May 19 08:27:52.964446 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ce257ef-e4da-4a62-a1dc-dc140f74c33c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.288254 May 19 08:27:52.965885 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1488/2813] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:52 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:52.972652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:52.973427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:52.980950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:52.981988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:52.983252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:52.984004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.068234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.069052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.070163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lazy-loading 'fault' on Instance uuid c59435f3-2190-4c2e-9a1f-3867ed3a0735 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:27:53.192051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:53.213138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:53.221085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:53.224673 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55f77d39-2931-4188-bd14-52338cd06bd0 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 200 len: 1351 microversion: 2.25 time: 0.257398 May 19 08:27:53.225863 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1489/2814] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:52 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 1351 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:53.239315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:53.243172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:53.254907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.256287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.259293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.261133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.463869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:53.475005 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3d67581-3e3f-4ac1-8cbc-5286adfbc89a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1315 microversion: 2.1 time: 0.247018 May 19 08:27:53.475697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1490/2815] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:53 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:53.489690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-05bab70f-2463-4e2f-bdf9-b9849a2491ee req-7e8be3ec-d2e7-4636-ba67-9e3d5f31da21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59435f3-2190-4c2e-9a1f-3867ed3a0735", "name": "network-vif-deleted", "tag": "e69c3e55-7457-4d7f-a710-f82f4c5fe599"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:53.501110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-05bab70f-2463-4e2f-bdf9-b9849a2491ee req-7e8be3ec-d2e7-4636-ba67-9e3d5f31da21 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.501584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-05bab70f-2463-4e2f-bdf9-b9849a2491ee req-7e8be3ec-d2e7-4636-ba67-9e3d5f31da21 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.519872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-05bab70f-2463-4e2f-bdf9-b9849a2491ee req-7e8be3ec-d2e7-4636-ba67-9e3d5f31da21 service nova] Creating event network-vif-deleted:e69c3e55-7457-4d7f-a710-f82f4c5fe599 for instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 on chh1-842464-2 May 19 08:27:53.530181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-05bab70f-2463-4e2f-bdf9-b9849a2491ee req-7e8be3ec-d2e7-4636-ba67-9e3d5f31da21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051276 May 19 08:27:53.531616 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1491/2816] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:53.540552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:53.541710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:53.545524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:53.554491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.555112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.557487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.558359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.738038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:53.747039 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5c11f61-96c4-4544-8415-796462798e38 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1279 microversion: 2.1 time: 0.213641 May 19 08:27:53.747648 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1492/2817] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:53 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:53.761739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:53.762585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:53.778261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.778950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:53.779905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:53.780516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.016321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:54.031329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6738a217-fbb7-4716-ba56-858481e43a28 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.279231 May 19 08:27:54.032759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1493/2818] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:53 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:54.046025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3a301a60-e11f-40f7-911b-0db1e34e40b0 req-069f5f50-ca78-4760-a9c1-12e6273806e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7263c9fb-1255-4c44-9786-8897cf3f29b8", "tag": "697ce1b8-839b-4747-974b-3229d0fcc0ad"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:54.055642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a301a60-e11f-40f7-911b-0db1e34e40b0 req-069f5f50-ca78-4760-a9c1-12e6273806e4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.056448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a301a60-e11f-40f7-911b-0db1e34e40b0 req-069f5f50-ca78-4760-a9c1-12e6273806e4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.071221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3a301a60-e11f-40f7-911b-0db1e34e40b0 req-069f5f50-ca78-4760-a9c1-12e6273806e4 service nova] Creating event network-changed:697ce1b8-839b-4747-974b-3229d0fcc0ad for instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 on chh1-842464-2 May 19 08:27:54.076444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3a301a60-e11f-40f7-911b-0db1e34e40b0 req-069f5f50-ca78-4760-a9c1-12e6273806e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041120 May 19 08:27:54.077051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1494/2819] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:54.083341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:54.090933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.091461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.118617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] HTTP exception thrown: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 is locked May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Request method failure captured: May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action HTTP/1.1 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6ToSdzuHG-M_V__hr_nL3jNj4nAqaWb2-BlAdn9kLv37gf0SE17gUQ89LfVSKcqVaYzss4T8XuEMf5QFUuTpOQGMujssqHI6-tcMMCfEQfmueLyeV1SqtHvxIqZZIeFwwxsY0Xq9awe2aZNpUNT6Cp8G9BgxAAoZmcpdhxXbXUrWw May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b607e36aa42545dfb715c629002236ed May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b607e36aa42545dfb715c629002236ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b607e36aa42545dfb715c629002236ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-421405011 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b607e36aa42545dfb715c629002236ed May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-421405011-project May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 59f3ba2c06c045d6afccb1639ed8d083 May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-421405011-project May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: {"os-stop": {}} May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 is locked May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'c75d5c8f-8107-4a60-b50d-c1eacb348de5', 'body': {'os-stop': {}}} May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 is locked May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 is locked May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 is locked May 19 08:27:54.120410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.124804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Returning 409 to user: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 is locked {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:54.124804 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80ab8218-f4f1-490c-aa5c-df3c86bd7d9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 409 len: 107 microversion: 2.1 time: 0.043497 May 19 08:27:54.124804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1495/2820] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:54 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 107 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:27:54.130977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:54.131653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:54.138918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.139367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.140138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.140570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.179309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:54.190509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Unlocking {{(pid=119072) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 19 08:27:54.251507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa43d6d5-8698-45b3-a25a-709e9c441679 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.124665 May 19 08:27:54.252283 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1496/2821] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:54 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:27:54.257641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:54.258269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: c59435f3-2190-4c2e-9a1f-3867ed3a0735] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:54.274172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.274629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.275459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.275907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.296415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] HTTP exception thrown: Instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 could not be found. May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Request method failure captured: May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 HTTP/1.1 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1uAJdDdNwdNU4CYNt4c6fDPnYnsbuPxxSEMMM4vN4u_VN1zRNTLDYBfE0Fh6sVXDPEldd10hDh9w-bJ3EczR5n8Ws3R-uM2bgBENRegHXaKidSVvgiblWo5nza18QTBniDdG_mOEyOYg8faklozvLoKTah_p1TwIzMPMkxwhGJi88 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.25 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 024724b24b274d7db1c43874767de143 May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 could not be found. May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'c59435f3-2190-4c2e-9a1f-3867ed3a0735'} May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 could not be found. May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 could not be found. May 19 08:27:54.298174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 could not be found. May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Returning 404 to user: Instance c59435f3-2190-4c2e-9a1f-3867ed3a0735 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7272d423-1870-4623-a7b0-8ac7b0241cd1 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735" status: 404 len: 111 microversion: 2.25 time: 0.045960 May 19 08:27:54.303826 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1497/2822] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:54 2022] GET /compute/v2.1/servers/c59435f3-2190-4c2e-9a1f-3867ed3a0735 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:27:54.306167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-969a820e-5485-4f9d-88fd-b3b7395a32d0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:54.312046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-969a820e-5485-4f9d-88fd-b3b7395a32d0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.312422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-969a820e-5485-4f9d-88fd-b3b7395a32d0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.338742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-969a820e-5485-4f9d-88fd-b3b7395a32d0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:27:54.391614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-969a820e-5485-4f9d-88fd-b3b7395a32d0 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.089396 May 19 08:27:54.392734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1498/2823] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:27:54 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:27:54.399000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:54.399746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:54.410281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.410859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.411840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.412282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.442521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:27:54.551424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1b1aa41-0ae2-406e-9dc8-609a3c213b4a tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 204 len: 0 microversion: 2.25 time: 0.155735 May 19 08:27:54.556591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1499/2824] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:27:54 2022] DELETE /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:27:54.566012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:54.567554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:54.579538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.580115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.582928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.583542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.762277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:54.771070 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16631d25-4ca0-47f4-b339-820461f52d74 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.212589 May 19 08:27:54.771674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1500/2825] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:54 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:54.776393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:54.777147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:54.784770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.785257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:54.786084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:54.786550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:55.000520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:55.011035 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-409c3db2-a145-4b61-982f-bf1d242d40e6 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1315 microversion: 2.1 time: 0.238294 May 19 08:27:55.011916 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1501/2826] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:54 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:55.016194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:55.016808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:55.023444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:55.031405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:55.032345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:55.032806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:55.281938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:55.300056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:55.302455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:55.308826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfcdb93d-9225-487d-94f2-bc930b2230fa tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1565 microversion: 2.25 time: 0.296077 May 19 08:27:55.312631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1502/2827] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:55 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1565 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:55.326968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:55.327601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:55.338757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:55.339210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:55.344396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:55.344871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:55.555931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:55.564064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca888b43-15e0-4c00-8a66-73a87b0e79ed tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1335 microversion: 2.1 time: 0.249955 May 19 08:27:55.576543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1503/2828] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:55 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1335 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:55.803655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:55.805230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:55.830198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:55.832744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:55.833706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:55.834166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:56.264143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:56.282031 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa69d425-dbfc-4eff-b39a-abe14de92930 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.496439 May 19 08:27:56.283200 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1504/2829] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:55 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:27:56.289150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:56.289150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:56.311139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:56.325450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:56.325450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:56.325450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:56.684409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:56.695579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d1ff745-1b54-421d-8e1d-722180fe49e3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1315 microversion: 2.1 time: 0.410865 May 19 08:27:56.706531 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1505/2830] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:56 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:56.713229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:56.714668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:56.724011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:56.724760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:56.727806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:56.728746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.072807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:57.085462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:57.091177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '024724b24b274d7db1c43874767de143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9217796f39e4b02b0c09a4aaf552190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:57.092696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-663a19b6-12f8-4e2d-9bba-55e033de46b7 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 200 len: 1565 microversion: 2.25 time: 0.384984 May 19 08:27:57.093278 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1506/2831] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:56 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 1565 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:27:57.107415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:57.110681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:57.124576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.125024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.125842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.126284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.307736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:57.326963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd5264fb-a45f-4f1b-911a-a976b907c4e8 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1333 microversion: 2.1 time: 0.230801 May 19 08:27:57.329163 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1507/2832] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:57 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:57.342328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3837cb83-98a5-4adb-bf52-ffbe0ff2b500 req-7728f2dd-fc3b-4522-9fab-d2972d1466df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3328b332-2732-47e8-a2df-098724caaa6a", "name": "network-vif-deleted", "tag": "1fa7a994-faa2-4307-98b0-8e35a44d1fa1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:27:57.359808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3837cb83-98a5-4adb-bf52-ffbe0ff2b500 req-7728f2dd-fc3b-4522-9fab-d2972d1466df service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.363945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3837cb83-98a5-4adb-bf52-ffbe0ff2b500 req-7728f2dd-fc3b-4522-9fab-d2972d1466df service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.399691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3837cb83-98a5-4adb-bf52-ffbe0ff2b500 req-7728f2dd-fc3b-4522-9fab-d2972d1466df service nova] Creating event network-vif-deleted:1fa7a994-faa2-4307-98b0-8e35a44d1fa1 for instance 3328b332-2732-47e8-a2df-098724caaa6a on chh2-842464-2 May 19 08:27:57.408421 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3837cb83-98a5-4adb-bf52-ffbe0ff2b500 req-7728f2dd-fc3b-4522-9fab-d2972d1466df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075828 May 19 08:27:57.410354 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1508/2833] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:27:57.425170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:57.426038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:57.442090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.442421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.443253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.443699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.826270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:57.830881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:27:57.845172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c815c344-c454-44ea-b24f-3a23f39b8d40 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.429123 May 19 08:27:57.862731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1509/2834] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:57 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:57.870463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:57.874305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:57.891344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.894128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:57.898208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:57.898892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:58.315760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:58.329095 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b250e769-2019-4e29-a841-3d4acba094cd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1315 microversion: 2.1 time: 0.464631 May 19 08:27:58.330062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1510/2835] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:57 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:58.345451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:58.347003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] [instance: 3328b332-2732-47e8-a2df-098724caaa6a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:58.354033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:58.354840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:58.355909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:58.356548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:58.375845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] HTTP exception thrown: Instance 3328b332-2732-47e8-a2df-098724caaa6a could not be found. May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Request method failure captured: May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a HTTP/1.1 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf1uAJdDdNwdNU4CYNt4c6fDPnYnsbuPxxSEMMM4vN4u_VN1zRNTLDYBfE0Fh6sVXDPEldd10hDh9w-bJ3EczR5n8Ws3R-uM2bgBENRegHXaKidSVvgiblWo5nza18QTBniDdG_mOEyOYg8faklozvLoKTah_p1TwIzMPMkxwhGJi88 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.25 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a9217796f39e4b02b0c09a4aaf552190"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a9217796f39e4b02b0c09a4aaf552190 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 024724b24b274d7db1c43874767de143 May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1871741783-project May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3328b332-2732-47e8-a2df-098724caaa6a could not be found. May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3328b332-2732-47e8-a2df-098724caaa6a'} May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3328b332-2732-47e8-a2df-098724caaa6a could not be found. May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3328b332-2732-47e8-a2df-098724caaa6a could not be found. May 19 08:27:58.378705 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3328b332-2732-47e8-a2df-098724caaa6a could not be found. May 19 08:27:58.382537 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:27:58.385495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] Returning 404 to user: Instance 3328b332-2732-47e8-a2df-098724caaa6a could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:27:58.386589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7322be7-4835-403f-a4ff-3df61624a538 tempest-LiveAutoBlockMigrationV225Test-1871741783 tempest-LiveAutoBlockMigrationV225Test-1871741783-project] 10.222.0.78 "GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a" status: 404 len: 111 microversion: 2.25 time: 0.054108 May 19 08:27:58.387757 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1511/2836] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:27:58 2022] GET /compute/v2.1/servers/3328b332-2732-47e8-a2df-098724caaa6a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:27:58.398217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:58.400381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:58.413554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:58.414468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:58.416810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:58.417563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:59.294355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:59.305752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3e5e238-efa9-43d7-be2e-c17575f61e5a tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.916604 May 19 08:27:59.306362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1512/2837] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:58 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:59.319443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:59.320070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:59.340641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:59.340641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:59.341494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:59.342211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:59.827391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:27:59.842168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07067f44-629d-4570-8153-937ee619bf6e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.534645 May 19 08:27:59.843255 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1513/2838] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:59 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:27:59.848564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:27:59.849420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:27:59.856577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:59.857963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:27:59.858980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:27:59.859644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:00.276893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:00.288545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f93dfb9-f33c-48bc-b5e9-550db257dc0b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1315 microversion: 2.1 time: 0.444171 May 19 08:28:00.289632 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1514/2839] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:27:59 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:00.336365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1687d06e-fdad-4991-96e6-8252abf14013 req-37ea06e2-8b8e-4a57-b88b-3c1a48d69dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7263c9fb-1255-4c44-9786-8897cf3f29b8", "name": "network-vif-plugged", "status": "completed", "tag": "697ce1b8-839b-4747-974b-3229d0fcc0ad"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:00.360052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1687d06e-fdad-4991-96e6-8252abf14013 req-37ea06e2-8b8e-4a57-b88b-3c1a48d69dcb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:00.360987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1687d06e-fdad-4991-96e6-8252abf14013 req-37ea06e2-8b8e-4a57-b88b-3c1a48d69dcb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:00.391134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1687d06e-fdad-4991-96e6-8252abf14013 req-37ea06e2-8b8e-4a57-b88b-3c1a48d69dcb service nova] Creating event network-vif-plugged:697ce1b8-839b-4747-974b-3229d0fcc0ad for instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 on chh1-842464-2 May 19 08:28:00.398254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1687d06e-fdad-4991-96e6-8252abf14013 req-37ea06e2-8b8e-4a57-b88b-3c1a48d69dcb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079230 May 19 08:28:00.399644 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1515/2840] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:00.407210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:00.410011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:00.452630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:00.454438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:00.454438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:00.455011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:00.990757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:01.002797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26f15b77-25c8-4f65-9dcb-15a3d4cb8536 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.600669 May 19 08:28:01.015802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1516/2841] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:00 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:01.023607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-327c4706-c905-4563-93a1-b3ea9b6a0993 req-4ede4658-f392-4637-99ea-1a5b8878077f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fc9d8d-80aa-40f5-b46d-c88aa1efb882", "tag": "d3b3c9bb-c542-4225-bb00-a7e0c989bfb6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:01.037515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-327c4706-c905-4563-93a1-b3ea9b6a0993 req-4ede4658-f392-4637-99ea-1a5b8878077f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:01.038213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-327c4706-c905-4563-93a1-b3ea9b6a0993 req-4ede4658-f392-4637-99ea-1a5b8878077f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:01.053402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-327c4706-c905-4563-93a1-b3ea9b6a0993 req-4ede4658-f392-4637-99ea-1a5b8878077f service nova] Creating event network-changed:d3b3c9bb-c542-4225-bb00-a7e0c989bfb6 for instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 on chh1-842464-2 May 19 08:28:01.060875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-327c4706-c905-4563-93a1-b3ea9b6a0993 req-4ede4658-f392-4637-99ea-1a5b8878077f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043396 May 19 08:28:01.062043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1517/2842] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:01.077023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:01.077770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:01.093123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:01.093616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:01.095019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:01.095474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:01.492655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:01.501492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1de7cffd-784d-415b-8819-efb92b9f7d22 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.437456 May 19 08:28:01.502475 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1518/2843] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:01 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:01.516355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:01.525796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:01.556403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:01.556868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:01.562345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:01.564222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:01.944739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:01.955080 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-902a2a9c-3f25-4c15-8eb9-ca7fc97bcb4b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1315 microversion: 2.1 time: 0.448995 May 19 08:28:01.958692 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1519/2844] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:01 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:02.021202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:02.022172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:02.036592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:02.038585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:02.039961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:02.043552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:02.357273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:02.368307 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9d102f7-6f26-4d54-9ab5-55e4e092190d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.351205 May 19 08:28:02.369348 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1520/2845] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:02 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:28:02.521924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:02.523550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:02.538395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:02.538916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:02.540248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:02.540911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:02.566499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:02.596804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=20 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:02.846258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:02.860448 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b07430f-d41a-4904-8ae0-495a9f4210a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.344689 May 19 08:28:02.864469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1521/2846] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:02 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:02.993544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:02.998467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:03.009833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:03.012085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:03.015743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:03.016526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:03.828713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:03.837987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7bb88418-b206-4094-b28e-e05d93889834 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1498 microversion: 2.1 time: 0.862385 May 19 08:28:03.838677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1522/2847] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:02 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1498 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:03.864474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:03.871376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:03.886343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:03.888114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:03.889231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:03.889710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:04.297573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:04.310288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ff5db01-3a32-44ca-b70e-90b5ea925bd1 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.464821 May 19 08:28:04.311215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1523/2848] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:03 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:04.319076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:04.320078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:04.327711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:04.328415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:04.329505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:04.330168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:04.358435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'flavor' on Instance uuid 7263c9fb-1255-4c44-9786-8897cf3f29b8 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:28:04.751485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba5886e6-8ec1-4349-85ec-22a3ec77cbd7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8/action" status: 202 len: 0 microversion: 2.1 time: 0.438734 May 19 08:28:04.756275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1524/2849] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:28:04 2022] POST /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:04.763023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:04.764564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:04.775088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:04.777894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:04.780222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:04.780885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:05.182822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:05.194619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6dd7148-4ba9-4421-a3f6-079717df744c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.436234 May 19 08:28:05.195439 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1525/2850] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:04 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:05.201479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:05.202407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:05.210531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:05.211724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:05.212781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:05.213506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:05.258198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:05.655159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:05.664105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12151e3f-e2b3-49c4-83ca-70d3aeafbc17 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.467359 May 19 08:28:05.664700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1526/2851] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:05 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:05.681986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:05.683254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:05.695738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:05.696517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:05.698071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:05.698862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.019558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:06.033414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac9bd484-b3cf-4de7-895f-64ec471681e6 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.363221 May 19 08:28:06.037441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1527/2852] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:05 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:06.248358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e3e6cdd-c480-4d75-a209-27d131a78d9b tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Calling method '.version_select at 0x7f3211e92ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:06.353174 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e3e6cdd-c480-4d75-a209-27d131a78d9b tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 371 microversion: 2.1 time: 0.313849 May 19 08:28:06.355232 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1528/2853] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:28:06 2022] GET /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:06.367835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:06.368402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:06.376365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.377057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.379433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.380405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.569964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:06.578964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d53979a9-8bee-4214-b648-e3905a1b16ef tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1655 microversion: 2.1 time: 0.222451 May 19 08:28:06.579757 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1529/2854] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:06 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1655 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:06.585475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bafe307-cadf-4762-97a5-2e6af4f67210 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Action: 'update', calling method: .version_select at 0x7f32121069d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:06.692270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bafe307-cadf-4762-97a5-2e6af4f67210 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.693029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bafe307-cadf-4762-97a5-2e6af4f67210 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.694555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bafe307-cadf-4762-97a5-2e6af4f67210 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.695438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bafe307-cadf-4762-97a5-2e6af4f67210 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.767857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bafe307-cadf-4762-97a5-2e6af4f67210 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 328 microversion: 2.1 time: 0.186523 May 19 08:28:06.769517 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1530/2855] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:06 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 328 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:06.776638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b3adf73-12e4-4e6d-bdb7-c213b0621d71 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:06.784953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b3adf73-12e4-4e6d-bdb7-c213b0621d71 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.785645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b3adf73-12e4-4e6d-bdb7-c213b0621d71 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.854751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b3adf73-12e4-4e6d-bdb7-c213b0621d71 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 08:28:06.922510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b3adf73-12e4-4e6d-bdb7-c213b0621d71 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.151390 May 19 08:28:06.923413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1531/2856] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:28:06 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:06.943027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:06.943820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:06.946480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:06.953161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.953698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:06.954542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:06.955023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:07.263260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:07.273275 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c278ea9-a61e-4677-83e4-57b9d35c24c4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.342517 May 19 08:28:07.276018 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1532/2857] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:06 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:07.283960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:07.290004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:07.302457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:07.303196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:07.304288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:07.305763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:07.601678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:07.616999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c9b1b7e-245a-4caa-8589-f4f42f9a9073 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1664 microversion: 2.1 time: 0.336509 May 19 08:28:07.627506 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1533/2858] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:07 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1664 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:07.730911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1064585456", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:07.801009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:28:08.424168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:28:08.424714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:28:08.425159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:28:08.425598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:28:08.426014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:28:08.436675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.437252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:08.438086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.438733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:08.466470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Getting quotas for project b43abe2bdc5c4626b2e8038cd4c4c0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:08.472955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Getting quotas for user 1312e8bf49a04d528a3a1e9a1fbcd4e3 and project b43abe2bdc5c4626b2e8038cd4c4c0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:08.488742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.utils [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] cores quota exceeded for b43abe2bdc5c4626b2e8038cd4c4c0b8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119072) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 19 08:28:08.489960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Request method failure captured: May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 145 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-Us-BAm42lhgn5f4C-SHOkgxvf89Q5TkdONGNS18FgvrHFsUBdqQi3lRnmaZewGm2pQCUttMOMK63vixVjEa5nn_TzfHfg4Hb1Kp2TtlTQgYA93OXBdgAfSCz4YgDhLRz_phi9mNyPuC1sVMdw5IOST-P2EutE4rO9oWowSzvgBnw May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1312e8bf49a04d528a3a1e9a1fbcd4e3 May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1064585456", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1064585456', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452'}}} May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:28:08.506877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a09cb6de-ba2a-4c16-864d-f116278498ce tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.880006 May 19 08:28:08.510800 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1534/2859] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:28:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 882 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:28:08.519530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:08.520164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:08.528691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.529222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:08.530225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.530812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:08.689902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:08.709233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9c35cf2-060b-4080-86b1-5c3efc9923d9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.194654 May 19 08:28:08.714003 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1535/2860] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:08 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:08.721916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-44d70aa3-b717-4c81-98df-ab6e22cdc0cc req-42d85c8e-56ae-4a23-8db2-351dab31621f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fc9d8d-80aa-40f5-b46d-c88aa1efb882", "name": "network-vif-plugged", "status": "completed", "tag": "d3b3c9bb-c542-4225-bb00-a7e0c989bfb6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:08.732281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-44d70aa3-b717-4c81-98df-ab6e22cdc0cc req-42d85c8e-56ae-4a23-8db2-351dab31621f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.733067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-44d70aa3-b717-4c81-98df-ab6e22cdc0cc req-42d85c8e-56ae-4a23-8db2-351dab31621f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:08.750814 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-44d70aa3-b717-4c81-98df-ab6e22cdc0cc req-42d85c8e-56ae-4a23-8db2-351dab31621f service nova] Creating event network-vif-plugged:d3b3c9bb-c542-4225-bb00-a7e0c989bfb6 for instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 on chh1-842464-2 May 19 08:28:08.763438 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-44d70aa3-b717-4c81-98df-ab6e22cdc0cc req-42d85c8e-56ae-4a23-8db2-351dab31621f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045607 May 19 08:28:08.764597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1536/2861] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:08.779122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:08.782218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:08.804098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.804558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:08.808308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:08.808999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.116904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:09.136320 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-019580e0-862c-4708-ae2b-7c482a8125b3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.370169 May 19 08:28:09.137113 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1537/2862] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:08 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:09.141520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf1b4fc1-ae7c-4cc7-a5f9-76c3cc316604 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Action: 'update', calling method: .version_select at 0x7f3212333040>, body: {"quota_set": {"cores": 20}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:09.243919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1b4fc1-ae7c-4cc7-a5f9-76c3cc316604 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:09.244368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1b4fc1-ae7c-4cc7-a5f9-76c3cc316604 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.245161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1b4fc1-ae7c-4cc7-a5f9-76c3cc316604 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:09.245630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1b4fc1-ae7c-4cc7-a5f9-76c3cc316604 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.329179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf1b4fc1-ae7c-4cc7-a5f9-76c3cc316604 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 329 microversion: 2.1 time: 0.191044 May 19 08:28:09.330287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1538/2863] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:09 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 329 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:09.335575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:09.336539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:09.343626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:09.344371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.345439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:09.346659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.537816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:09.549592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eeefb49f-b860-44bc-8277-c1b221067e35 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.217625 May 19 08:28:09.551980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1539/2864] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:09 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:09.566673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f01fa9c2-3a36-4bf8-bd82-dcdb58ef9e37 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Calling method '.version_select at 0x7f3211ce0f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:09.691564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f01fa9c2-3a36-4bf8-bd82-dcdb58ef9e37 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 371 microversion: 2.1 time: 0.136675 May 19 08:28:09.694049 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1540/2865] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:28:09 2022] GET /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:09.704422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:09.706399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:09.718301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:09.718507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.720882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:09.722178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:09.948403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:09.958767 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd2dd967-440f-499c-9b2f-f3c02e273379 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.262200 May 19 08:28:09.959627 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1541/2866] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:09 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:09.973771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4519df76-97dc-4f5d-8bfc-81ef6e58694a tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Action: 'update', calling method: .version_select at 0x7f3211feff70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:10.043485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4519df76-97dc-4f5d-8bfc-81ef6e58694a tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.044013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4519df76-97dc-4f5d-8bfc-81ef6e58694a tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.044996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4519df76-97dc-4f5d-8bfc-81ef6e58694a tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.045687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4519df76-97dc-4f5d-8bfc-81ef6e58694a tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.117904 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4519df76-97dc-4f5d-8bfc-81ef6e58694a tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 328 microversion: 2.1 time: 0.148963 May 19 08:28:10.125482 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1542/2867] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:09 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:10.133696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:10.134444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:10.142295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.142844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.144028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.144503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.348720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:10.359253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-371428fb-b72b-4b64-8778-59734d2ac2ae tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1401 microversion: 2.1 time: 0.239595 May 19 08:28:10.360226 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1543/2868] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:10 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1401 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:10.367578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:10.368606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:10.375998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.376446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.377849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.378302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.428173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Unlocking {{(pid=119072) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 19 08:28:10.511752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-072e02e4-bd10-4e98-b7ad-e6b48f279f79 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.146952 May 19 08:28:10.511752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1544/2869] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:28:10 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:10.515109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:10.515740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:10.522814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.523223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.524054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:10.524615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:10.527799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:10.717211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:10.726010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7eaecefb-6cc1-4a9f-9e3a-cbb54e33d651 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.214755 May 19 08:28:10.736152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1545/2870] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:10 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:10.742191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1109408900", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:10.816639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:28:11.049967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:28:11.049967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:28:11.050920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:28:11.051490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:28:11.052020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:28:11.073346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.073346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.073346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.073346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.103229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Getting quotas for project b43abe2bdc5c4626b2e8038cd4c4c0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:11.111508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Getting quotas for user 1312e8bf49a04d528a3a1e9a1fbcd4e3 and project b43abe2bdc5c4626b2e8038cd4c4c0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:11.136677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.utils [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] instances quota exceeded for b43abe2bdc5c4626b2e8038cd4c4c0b8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119072) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 19 08:28:11.137578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Request method failure captured: May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 145 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-Us-BAm42lhgn5f4C-SHOkgxvf89Q5TkdONGNS18FgvrHFsUBdqQi3lRnmaZewGm2pQCUttMOMK63vixVjEa5nn_TzfHfg4Hb1Kp2TtlTQgYA93OXBdgAfSCz4YgDhLRz_phi9mNyPuC1sVMdw5IOST-P2EutE4rO9oWowSzvgBnw May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1312e8bf49a04d528a3a1e9a1fbcd4e3 May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1109408900", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1109408900', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452'}}} May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:28:11.140711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 19 08:28:11.146380 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:11.149367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:11.149367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-718f359e-65f1-48a7-9486-c0112825feaa tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.409961 May 19 08:28:11.150744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1546/2871] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:28:10 2022] POST /compute/v2.1/servers => generated 119 bytes in 414 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:28:11.156117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:11.156753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:11.165058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.165608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.166404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.166852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.326603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:11.335564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a5af6f5-13f4-477b-a957-8951567587eb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.183611 May 19 08:28:11.337672 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1547/2872] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:11 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:11.343256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f04c0a6-5068-49ad-bf11-c3d959271355 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Action: 'update', calling method: .version_select at 0x7f3212f4bf70>, body: {"quota_set": {"instances": 10}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:11.586109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f04c0a6-5068-49ad-bf11-c3d959271355 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.586730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f04c0a6-5068-49ad-bf11-c3d959271355 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.588158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f04c0a6-5068-49ad-bf11-c3d959271355 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.588158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f04c0a6-5068-49ad-bf11-c3d959271355 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.653675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f04c0a6-5068-49ad-bf11-c3d959271355 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 329 microversion: 2.1 time: 0.314406 May 19 08:28:11.654314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1548/2873] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:11 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 329 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:11.661595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:11.662271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:11.669068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.670266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.670589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.671192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.836182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:11.847013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d56ff5d-8dff-4d7c-ac64-9ffca717ecd8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.190766 May 19 08:28:11.847953 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1549/2874] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:11 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:11.852963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:11.853871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:11.860797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.861249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:11.862635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:11.863074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.036136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:12.047507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a420f96b-2fa5-4e22-b4fd-4804692c0ae9 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1588 microversion: 2.1 time: 0.198023 May 19 08:28:12.049653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1550/2875] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:11 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1588 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:12.063984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d90a4bf9-7b9a-49d9-8c47-073d0ed9e440 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Calling method '.version_select at 0x7f3217b7dd30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:12.278784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:12.301596 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d90a4bf9-7b9a-49d9-8c47-073d0ed9e440 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 371 microversion: 2.1 time: 0.244864 May 19 08:28:12.302594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1551/2876] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:28:12 2022] GET /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:12.428938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:12.429722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:12.438428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:12.438902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.440280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:12.440876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.475385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:28:12.584709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52648a97-0b42-4841-b12a-2981794f9233 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "DELETE /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 204 len: 0 microversion: 2.32 time: 0.280888 May 19 08:28:12.585506 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1552/2877] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:28:12 2022] DELETE /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:28:12.601088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:12.602595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:12.610243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:12.610962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.613175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:12.613723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.769333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:12.778339 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f2abe83-4dbe-4661-bac6-eaac4b0f071a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.186499 May 19 08:28:12.789663 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1553/2878] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:12 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:12.793529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:12.794162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:12.802406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:12.802858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.803634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:12.804073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:12.981032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:12.990351 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-117d1f2c-0678-4c6d-9ef9-389997ff8cd5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.209659 May 19 08:28:12.991204 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1554/2879] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:12 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:12.996279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:12.996980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:13.007028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.008056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.008846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.009375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.131065 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b377cec1-a29d-4d46-b6a8-da0de6655304 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138585 May 19 08:28:13.132444 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1555/2880] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:28:12 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:13.142206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33cbb274-a0be-4557-840d-ab7ab3ec86cd tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Action: 'update', calling method: .version_select at 0x7f32150bd0d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:13.230403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cbb274-a0be-4557-840d-ab7ab3ec86cd tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.231125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cbb274-a0be-4557-840d-ab7ab3ec86cd tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.232782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cbb274-a0be-4557-840d-ab7ab3ec86cd tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.233452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cbb274-a0be-4557-840d-ab7ab3ec86cd tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.321392 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33cbb274-a0be-4557-840d-ab7ab3ec86cd tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 325 microversion: 2.1 time: 0.187772 May 19 08:28:13.322449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1556/2881] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:13 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:13.327696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:13.328464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:13.336453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.337010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.338382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.338669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.733728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:13.743463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:13.746411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:13.747820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31c7bada-baf2-4ea0-ad98-bcfb8fbb62df tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2954 microversion: 2.32 time: 0.424237 May 19 08:28:13.748705 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1557/2882] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:13 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2954 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:13.753614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:13.754306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:13.760843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.761488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.762388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:13.762943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:13.856329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f900fde-f0ec-4692-b487-1121e55fabb2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.106214 May 19 08:28:13.857599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1558/2883] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:28:13 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:13.864936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1517355228", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:13.930945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:28:14.385426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:28:14.386700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:28:14.387350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:28:14.387913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:28:14.388629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:28:14.406165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:14.406990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:14.407600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:14.408985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:14.457488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Getting quotas for project b43abe2bdc5c4626b2e8038cd4c4c0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:14.463798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Getting quotas for user 1312e8bf49a04d528a3a1e9a1fbcd4e3 and project b43abe2bdc5c4626b2e8038cd4c4c0b8. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:14.481619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.utils [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] ram quota exceeded for b43abe2bdc5c4626b2e8038cd4c4c0b8, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119072) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 19 08:28:14.482265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Request method failure captured: May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 145 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-Us-BAm42lhgn5f4C-SHOkgxvf89Q5TkdONGNS18FgvrHFsUBdqQi3lRnmaZewGm2pQCUttMOMK63vixVjEa5nn_TzfHfg4Hb1Kp2TtlTQgYA93OXBdgAfSCz4YgDhLRz_phi9mNyPuC1sVMdw5IOST-P2EutE4rO9oWowSzvgBnw May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1312e8bf49a04d528a3a1e9a1fbcd4e3 May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1517355228", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1517355228', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452'}}} May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:28:14.484716 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f313fe9-29c0-49fd-a6f3-3b9ecb063ba3 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.626756 May 19 08:28:14.490579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1559/2884] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:28:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 630 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:28:14.496100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:14.496100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:14.506754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:14.507211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:14.508164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:14.508909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:14.779729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:14.792703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26cd8708-ea1d-4f87-91fa-c269d1cda315 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.302902 May 19 08:28:14.793873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1560/2885] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:14 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:14.812233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:14.816573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:14.824475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:14.826070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:14.826973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:14.827681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:15.118988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:15.132816 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-100d6e2d-feb7-46e5-8962-499a4e01e5f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1673 microversion: 2.1 time: 0.337665 May 19 08:28:15.133684 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1561/2886] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:14 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1673 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:15.140710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a182921-9c08-4f32-b18c-81b1c4740620 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Action: 'update', calling method: .version_select at 0x7f3212209dc0>, body: {"quota_set": {"ram": 51200}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:15.249155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a182921-9c08-4f32-b18c-81b1c4740620 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:15.250562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a182921-9c08-4f32-b18c-81b1c4740620 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:15.251556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a182921-9c08-4f32-b18c-81b1c4740620 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:15.253399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a182921-9c08-4f32-b18c-81b1c4740620 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:15.343096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a182921-9c08-4f32-b18c-81b1c4740620 tempest-QuotasAdminNegativeTest-834527582 tempest-QuotasAdminNegativeTest-834527582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 200 len: 329 microversion: 2.1 time: 0.208162 May 19 08:28:15.343992 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1562/2887] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:15 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:15.349450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:15.353354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:15.361810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:15.362747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:15.364054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:15.364678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:15.806038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:15.817087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:15.827280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:15.829123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:15.831729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cad4cac7-2a1c-48b9-8943-f72e5a1cfb08 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2954 microversion: 2.32 time: 0.485838 May 19 08:28:15.849508 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1563/2888] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:15 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2954 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:15.855364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:15.857554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:15.867410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:15.868557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:15.870125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:15.870736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:16.638971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:16.649675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ef5b2cb-dd6c-4551-9575-af04bdf5a66e tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1588 microversion: 2.1 time: 0.798426 May 19 08:28:16.654334 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1564/2889] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:15 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1588 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:16.655804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-477b704a-3a9a-4912-ad45-ff646712623d req-5231259d-f900-4b3f-bdf4-2aeb30881bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fc9d8d-80aa-40f5-b46d-c88aa1efb882", "tag": "d3b3c9bb-c542-4225-bb00-a7e0c989bfb6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:16.666863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-477b704a-3a9a-4912-ad45-ff646712623d req-5231259d-f900-4b3f-bdf4-2aeb30881bb0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:16.667396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-477b704a-3a9a-4912-ad45-ff646712623d req-5231259d-f900-4b3f-bdf4-2aeb30881bb0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:16.690391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-477b704a-3a9a-4912-ad45-ff646712623d req-5231259d-f900-4b3f-bdf4-2aeb30881bb0 service nova] Creating event network-changed:d3b3c9bb-c542-4225-bb00-a7e0c989bfb6 for instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 on chh1-842464-2 May 19 08:28:16.696679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-477b704a-3a9a-4912-ad45-ff646712623d req-5231259d-f900-4b3f-bdf4-2aeb30881bb0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043843 May 19 08:28:16.697211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1565/2890] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:16.703485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a73f45fc-4eb6-4710-90fd-2635783d9e70 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Action: 'update', calling method: .version_select at 0x7f32122ccd30>, body: {"quota_set": {"ram": 0}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:16.706501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a73f45fc-4eb6-4710-90fd-2635783d9e70 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1312e8bf49a04d528a3a1e9a1fbcd4e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43abe2bdc5c4626b2e8038cd4c4c0b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a73f45fc-4eb6-4710-90fd-2635783d9e70 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Request method failure captured: May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 HTTP/1.1 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 25 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-Us-BAm42lhgn5f4C-SHOkgxvf89Q5TkdONGNS18FgvrHFsUBdqQi3lRnmaZewGm2pQCUttMOMK63vixVjEa5nn_TzfHfg4Hb1Kp2TtlTQgYA93OXBdgAfSCz4YgDhLRz_phi9mNyPuC1sVMdw5IOST-P2EutE4rO9oWowSzvgBnw May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b43abe2bdc5c4626b2e8038cd4c4c0b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b43abe2bdc5c4626b2e8038cd4c4c0b8 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-810531578 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 1312e8bf49a04d528a3a1e9a1fbcd4e3 May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-QuotasAdminNegativeTest-810531578-project May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: {"quota_set": {"ram": 0}} May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b43abe2bdc5c4626b2e8038cd4c4c0b8', 'body': {'quota_set': {'ram': 0}}} May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:28:16.713411 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:16.718238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a73f45fc-4eb6-4710-90fd-2635783d9e70 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:16.719859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a73f45fc-4eb6-4710-90fd-2635783d9e70 tempest-QuotasAdminNegativeTest-810531578 tempest-QuotasAdminNegativeTest-810531578-project] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8" status: 403 len: 116 microversion: 2.1 time: 0.020463 May 19 08:28:16.729799 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1566/2891] 10.222.0.78 () {60 vars in 1261 bytes} [Thu May 19 08:28:16 2022] PUT /compute/v2.1/os-quota-sets/b43abe2bdc5c4626b2e8038cd4c4c0b8 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 19 08:28:16.746045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:16.746874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:16.757782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:16.758383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:16.759347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:16.759920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:17.336586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:17.346536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-470663d0-33a0-437f-b759-0684f8411dcb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.614666 May 19 08:28:17.347900 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1567/2892] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:16 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:17.360954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:17.362752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:17.384966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:17.385606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:17.386516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:17.387050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:17.836735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:17.847977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51e16665-db6c-4884-a05e-722700374848 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1653 microversion: 2.1 time: 0.498543 May 19 08:28:17.848852 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1568/2893] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:17 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1653 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:17.855155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:17.856113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:17.863848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:17.864669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:17.866216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:17.866802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:18.569663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:18.585739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:18.594054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:18.596544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e245ade6-6964-4578-b87a-a6dc1f5c971b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2954 microversion: 2.32 time: 0.745449 May 19 08:28:18.607912 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1569/2894] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:17 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2954 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:18.629271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:18.630170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:18.644579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:18.645470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:18.646675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:18.647364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:18.823068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-948ebe0c-c8de-4228-a38f-2860f2210d86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.208108 May 19 08:28:18.823777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1570/2895] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:28:18 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:18.830780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3dfd2498-af0d-40ee-8928-1f6d0caa86a7 req-6d0a288d-cfed-4e16-b605-b4791611cce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-unplugged", "status": "completed", "tag": "e8fc8d94-8d22-41a4-9fca-3e3794bcefc1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:18.841855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3dfd2498-af0d-40ee-8928-1f6d0caa86a7 req-6d0a288d-cfed-4e16-b605-b4791611cce3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:18.842542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3dfd2498-af0d-40ee-8928-1f6d0caa86a7 req-6d0a288d-cfed-4e16-b605-b4791611cce3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:18.864040 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3dfd2498-af0d-40ee-8928-1f6d0caa86a7 req-6d0a288d-cfed-4e16-b605-b4791611cce3 service nova] Creating event network-vif-unplugged:e8fc8d94-8d22-41a4-9fca-3e3794bcefc1 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:18.872026 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3dfd2498-af0d-40ee-8928-1f6d0caa86a7 req-6d0a288d-cfed-4e16-b605-b4791611cce3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046757 May 19 08:28:18.873268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1571/2896] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:18.881069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:18.882071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:18.891920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:18.892394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:18.893642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:18.894181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:19.627958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:19.638750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d6c8d91-208e-4202-963d-4fcc0050b9c9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.763715 May 19 08:28:19.639369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1572/2897] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:18 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:19.662347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:19.662997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:19.670681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:19.671139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:19.672080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:19.672570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:20.103554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:20.119130 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb7261ff-3d5e-4d2a-b1a7-63fe4f38f82f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.478696 May 19 08:28:20.126661 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1573/2898] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:19 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:20.131765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:20.132390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:20.146161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:20.146657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:20.147463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:20.147903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:20.584943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:20.603039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:20.606684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:20.608297 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7a998e5-2432-41f8-9bec-61b5f715e56f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2933 microversion: 2.32 time: 0.486700 May 19 08:28:20.609667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1574/2899] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:20 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2933 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:20.615709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:20.616550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:20.623782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:20.624521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:20.625795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:20.626471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:20.936947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:20.949662 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33ac9091-81c8-4606-bca6-cb23d17495e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.338085 May 19 08:28:20.950833 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1575/2900] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:20 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:21.212097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Action: 'update', calling method: .version_select at 0x7f32125550d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:21.213836 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:21.213836 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:21.215233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.215844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:21.232739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.233191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:21.264807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] HTTP exception thrown: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Request method failure captured: May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57 HTTP/1.1 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 56 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-kx40P-Bda7yU8KbCVJRO505taKT6SLQuogYZmQhi-I-YvxmstaqzPso5bSrZ0PkIna71BN9h8twR6RRgh3PPt1Tzg3KfgpKZccg4ynHpf65zezk9d2vUnjoWxahT4tWuy03oN-hc5p8pGBYTCA5w9ArDZPI0SNxBtU0d6YjI02wA May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.53 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 809123b54c1e496792da2d997e26a986 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/809123b54c1e496792da2d997e26a986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/809123b54c1e496792da2d997e26a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_809123b54c1e496792da2d997e26a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/809123b54c1e496792da2d997e26a986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 809123b54c1e496792da2d997e26a986 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b03f032f084f4071a35b7b4814c887e8 May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: {"status": "disabled", "disabled_reason": "maintenance"} May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: exception: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5d6c3562-3ce0-4838-8969-8fdcb2792d57', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:21.267443 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:21.272498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:21.275241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Returning 404 to user: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:21.276353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1acc9fb8-730a-4ada-a6b6-435a10379bc6 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57" status: 404 len: 110 microversion: 2.53 time: 0.324169 May 19 08:28:21.277158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1576/2901] 10.222.0.78 () {62 vars in 1308 bytes} [Thu May 19 08:28:20 2022] PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57 => generated 110 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:28:21.285469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:21.286533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:21.293533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.294346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:21.295707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.296368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:21.622810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:21.634263 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51400e73-2d8c-4e6a-b830-7dd79f8d4a87 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.355622 May 19 08:28:21.642211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1577/2902] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:21 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:21.648024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-unplugged", "status": "completed", "tag": "b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-unplugged", "status": "completed", "tag": "1ade10ca-5a76-44a1-b65c-a3621244ef74"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-unplugged", "status": "completed", "tag": "b1328560-4eff-4a93-823e-a34547baed16"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-unplugged", "status": "completed", "tag": "5d2075ad-5696-49b2-8373-97e00abd0329"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-unplugged", "status": "completed", "tag": "16d3d764-2d91-4ed4-9a5f-8f83a9f4f980"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:21.680461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.681101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:21.717866 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Creating event network-vif-unplugged:b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:21.718394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Creating event network-vif-unplugged:1ade10ca-5a76-44a1-b65c-a3621244ef74 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:21.718960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Creating event network-vif-unplugged:b1328560-4eff-4a93-823e-a34547baed16 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:21.719534 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Creating event network-vif-unplugged:5d2075ad-5696-49b2-8373-97e00abd0329 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:21.720054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] Creating event network-vif-unplugged:16d3d764-2d91-4ed4-9a5f-8f83a9f4f980 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:21.728483 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1bb17eb8-2454-43d6-847f-cefb5b449005 req-0af3372b-5c87-49f3-a146-4797b489d494 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.084823 May 19 08:28:21.729130 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1578/2903] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:21.741553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:21.742504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:21.770118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.770781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:21.772567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:21.773102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.162820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:22.171314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93480355-f7a8-4668-9c24-b5aa530f3799 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.440871 May 19 08:28:22.171915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1579/2904] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:21 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:22.185591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Action: 'update', calling method: .version_select at 0x7f3212167ee0>, body: {"status": "disabled"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:22.187427 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:22.187427 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:22.188726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.189185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.207714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.218119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.226730 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] HTTP exception thrown: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Request method failure captured: May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57 HTTP/1.1 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 22 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-kx40P-Bda7yU8KbCVJRO505taKT6SLQuogYZmQhi-I-YvxmstaqzPso5bSrZ0PkIna71BN9h8twR6RRgh3PPt1Tzg3KfgpKZccg4ynHpf65zezk9d2vUnjoWxahT4tWuy03oN-hc5p8pGBYTCA5w9ArDZPI0SNxBtU0d6YjI02wA May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.53 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 809123b54c1e496792da2d997e26a986 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/809123b54c1e496792da2d997e26a986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/809123b54c1e496792da2d997e26a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_809123b54c1e496792da2d997e26a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/809123b54c1e496792da2d997e26a986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 809123b54c1e496792da2d997e26a986 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b03f032f084f4071a35b7b4814c887e8 May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: {"status": "disabled"} May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: exception: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5d6c3562-3ce0-4838-8969-8fdcb2792d57', 'body': {'status': 'disabled'}} May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:22.236121 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:22.241398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Returning 404 to user: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:22.242826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18561b7b-81f9-4549-876e-63b51514793b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57" status: 404 len: 110 microversion: 2.53 time: 0.066203 May 19 08:28:22.243537 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1580/2905] 10.222.0.78 () {62 vars in 1308 bytes} [Thu May 19 08:28:22 2022] PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57 => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:28:22.258429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aa97cf37-2ec3-4504-bedc-cd28840b32ab req-05e19391-068f-44e1-97a5-98d282c8f927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-deleted", "tag": "16d3d764-2d91-4ed4-9a5f-8f83a9f4f980"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:22.276922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aa97cf37-2ec3-4504-bedc-cd28840b32ab req-05e19391-068f-44e1-97a5-98d282c8f927 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.277406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aa97cf37-2ec3-4504-bedc-cd28840b32ab req-05e19391-068f-44e1-97a5-98d282c8f927 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.306598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aa97cf37-2ec3-4504-bedc-cd28840b32ab req-05e19391-068f-44e1-97a5-98d282c8f927 service nova] Creating event network-vif-deleted:16d3d764-2d91-4ed4-9a5f-8f83a9f4f980 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:22.317258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aa97cf37-2ec3-4504-bedc-cd28840b32ab req-05e19391-068f-44e1-97a5-98d282c8f927 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072089 May 19 08:28:22.325753 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1581/2906] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:22.331509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:22.332521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:22.334232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:22.352181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.352930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.357412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.358094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.705490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:22.716305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:22.718955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:22.720971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-106dac3f-4cfc-4b7d-971c-131b713ae70f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2818 microversion: 2.32 time: 0.393977 May 19 08:28:22.733755 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1582/2907] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:22 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2818 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:22.739683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:22.740305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:22.755653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.756106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:22.756911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:22.757390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:23.061210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:23.075589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75d75912-9652-4e01-9092-56a74ae7c14d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.340321 May 19 08:28:23.096074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1583/2908] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:22 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:23.102785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Action: 'update', calling method: .version_select at 0x7f3211d92dc0>, body: {"status": "enabled"} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:23.106794 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:23.106794 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:23.111105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:23.111962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:23.121233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:23.123267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:23.134083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] HTTP exception thrown: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Request method failure captured: May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57 HTTP/1.1 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 21 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-kx40P-Bda7yU8KbCVJRO505taKT6SLQuogYZmQhi-I-YvxmstaqzPso5bSrZ0PkIna71BN9h8twR6RRgh3PPt1Tzg3KfgpKZccg4ynHpf65zezk9d2vUnjoWxahT4tWuy03oN-hc5p8pGBYTCA5w9ArDZPI0SNxBtU0d6YjI02wA May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.53 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 809123b54c1e496792da2d997e26a986 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/809123b54c1e496792da2d997e26a986"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/809123b54c1e496792da2d997e26a986"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_809123b54c1e496792da2d997e26a986"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/809123b54c1e496792da2d997e26a986"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 809123b54c1e496792da2d997e26a986 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b03f032f084f4071a35b7b4814c887e8 May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: {"status": "enabled"} May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: exception: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5d6c3562-3ce0-4838-8969-8fdcb2792d57', 'body': {'status': 'enabled'}} May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:28:23.137439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. May 19 08:28:23.143351 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:23.149763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Returning 404 to user: Service 5d6c3562-3ce0-4838-8969-8fdcb2792d57 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:23.153343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4391f6d-db46-4450-85ae-fb5e4fd1f827 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57" status: 404 len: 110 microversion: 2.53 time: 0.053586 May 19 08:28:23.153989 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1584/2909] 10.222.0.78 () {62 vars in 1308 bytes} [Thu May 19 08:28:23 2022] PUT /compute/v2.1/os-services/5d6c3562-3ce0-4838-8969-8fdcb2792d57 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:28:23.164895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:23.165552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:23.185732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:23.186196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:23.187071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:23.194536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:23.206080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:23.619302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:23.628354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba866b26-40a3-4f2b-a25f-af50b00c04ee tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.473268 May 19 08:28:23.638842 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1585/2910] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:23 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:23.652809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:23.653908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:23.669291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:23.670147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:23.671164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:23.671816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:24.358757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:24.371116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60478b17-ddf1-4b69-958f-2819f242f86d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.730693 May 19 08:28:24.372903 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1586/2911] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:23 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:24.395920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8802e932-3a49-4927-89bc-c1390bcc0823 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:24.400378 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:24.400378 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:24.405400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8802e932-3a49-4927-89bc-c1390bcc0823 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:24.406184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8802e932-3a49-4927-89bc-c1390bcc0823 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:24.410956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8802e932-3a49-4927-89bc-c1390bcc0823 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:24.411710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8802e932-3a49-4927-89bc-c1390bcc0823 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:24.473373 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8802e932-3a49-4927-89bc-c1390bcc0823 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.098978 May 19 08:28:24.474296 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1587/2912] 10.222.0.78 () {60 vars in 1177 bytes} [Thu May 19 08:28:24 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:24.495822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:24.496631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:24.504419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:24.505145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:24.509032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:24.509521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:24.913256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:24.927858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:24.934092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:24.936351 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27219e17-3ff2-4a45-8a30-91d52bab8c3f tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2657 microversion: 2.32 time: 0.460916 May 19 08:28:24.953682 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1588/2913] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:24 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2657 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:24.973508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-428ffd2f-aee5-4d8b-9c0a-cd80f0833705 req-34fc63db-37f1-43ca-9ce3-5fbfee814846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-deleted", "tag": "5d2075ad-5696-49b2-8373-97e00abd0329"}, {"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-deleted", "tag": "b1328560-4eff-4a93-823e-a34547baed16"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:25.004305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-428ffd2f-aee5-4d8b-9c0a-cd80f0833705 req-34fc63db-37f1-43ca-9ce3-5fbfee814846 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.004940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-428ffd2f-aee5-4d8b-9c0a-cd80f0833705 req-34fc63db-37f1-43ca-9ce3-5fbfee814846 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:25.042097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-428ffd2f-aee5-4d8b-9c0a-cd80f0833705 req-34fc63db-37f1-43ca-9ce3-5fbfee814846 service nova] Creating event network-vif-deleted:5d2075ad-5696-49b2-8373-97e00abd0329 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:25.042804 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-428ffd2f-aee5-4d8b-9c0a-cd80f0833705 req-34fc63db-37f1-43ca-9ce3-5fbfee814846 service nova] Creating event network-vif-deleted:b1328560-4eff-4a93-823e-a34547baed16 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:25.054614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-428ffd2f-aee5-4d8b-9c0a-cd80f0833705 req-34fc63db-37f1-43ca-9ce3-5fbfee814846 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097633 May 19 08:28:25.057998 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1589/2914] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:25.081873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:25.083007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:25.102052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.113031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:25.114828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.115301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:25.328687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=72 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:25.448607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:25.462946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0e12f8b-7c2e-4b63-8ad2-234e3ef98839 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.401672 May 19 08:28:25.464555 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1590/2915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:25 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:25.481866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-533fb97c-9c89-4d5a-9ee0-5ca41e68efc3 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:25.484177 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:25.484177 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:25.489740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-533fb97c-9c89-4d5a-9ee0-5ca41e68efc3 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.490325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-533fb97c-9c89-4d5a-9ee0-5ca41e68efc3 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:25.494299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-533fb97c-9c89-4d5a-9ee0-5ca41e68efc3 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.495475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-533fb97c-9c89-4d5a-9ee0-5ca41e68efc3 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:25.559204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-533fb97c-9c89-4d5a-9ee0-5ca41e68efc3 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.086898 May 19 08:28:25.559839 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1591/2916] 10.222.0.78 () {60 vars in 1210 bytes} [Thu May 19 08:28:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:25.574244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:25.575520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:25.583087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.583760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:25.584760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:25.585412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.162555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:26.174572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b75884f9-4cd7-4be2-9126-2824284d9ad8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.607867 May 19 08:28:26.175404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1592/2917] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:25 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:26.181874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72ca03b8-c806-4db8-8df0-1af482062c6b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:26.187571 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:26.187571 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:26.190512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ca03b8-c806-4db8-8df0-1af482062c6b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.190971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ca03b8-c806-4db8-8df0-1af482062c6b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.191777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ca03b8-c806-4db8-8df0-1af482062c6b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.195016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ca03b8-c806-4db8-8df0-1af482062c6b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.232038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72ca03b8-c806-4db8-8df0-1af482062c6b tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.053129 May 19 08:28:26.233051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1593/2918] 10.222.0.78 () {60 vars in 1177 bytes} [Thu May 19 08:28:26 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:26.238226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:26.239568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:26.247371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.248227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.250188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.251437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.614355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:26.629196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:26.633185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:26.635549 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afa0d5bc-df96-4aaf-bfa7-2a0e86bf396b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 2382 microversion: 2.32 time: 0.401143 May 19 08:28:26.637240 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1594/2919] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:26 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 2382 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:26.642010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17ad1e45-dbda-4010-8d1b-0ba023b75b6e tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:26.644238 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:26.644238 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:26.645853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ad1e45-dbda-4010-8d1b-0ba023b75b6e tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.646697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ad1e45-dbda-4010-8d1b-0ba023b75b6e tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.647737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ad1e45-dbda-4010-8d1b-0ba023b75b6e tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.648407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17ad1e45-dbda-4010-8d1b-0ba023b75b6e tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.684922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17ad1e45-dbda-4010-8d1b-0ba023b75b6e tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=chdv-842464-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.045999 May 19 08:28:26.687165 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1595/2920] 10.222.0.78 () {60 vars in 1236 bytes} [Thu May 19 08:28:26 2022] GET /compute/v2.1/os-services?host=chdv-842464-2&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:26.699387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd7baa46-f01a-4590-9d15-91ba30ded217 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:26.701018 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:26.701018 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:26.702463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7baa46-f01a-4590-9d15-91ba30ded217 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.702838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7baa46-f01a-4590-9d15-91ba30ded217 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.703659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7baa46-f01a-4590-9d15-91ba30ded217 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.704102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd7baa46-f01a-4590-9d15-91ba30ded217 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.733468 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd7baa46-f01a-4590-9d15-91ba30ded217 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.037793 May 19 08:28:26.740033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1596/2921] 10.222.0.78 () {60 vars in 1177 bytes} [Thu May 19 08:28:26 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:28:26.744744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-001f1a32-8e9d-431d-857d-20ee7d9440d4 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:26.746070 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:26.746070 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:26.747288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001f1a32-8e9d-431d-857d-20ee7d9440d4 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.747738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001f1a32-8e9d-431d-857d-20ee7d9440d4 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.748538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001f1a32-8e9d-431d-857d-20ee7d9440d4 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:26.749417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001f1a32-8e9d-431d-857d-20ee7d9440d4 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:26.783379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-001f1a32-8e9d-431d-857d-20ee7d9440d4 tempest-ServicesAdminNegativeV253TestJSON-1664131211 tempest-ServicesAdminNegativeV253TestJSON-1664131211-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.037225 May 19 08:28:26.783379 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1597/2922] 10.222.0.78 () {60 vars in 1238 bytes} [Thu May 19 08:28:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:26.925011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-688e161a-1d5c-41f3-9356-8161191bb35f tempest-ServicesAdminNegativeV253TestJSON-1910756801 tempest-ServicesAdminNegativeV253TestJSON-1910756801-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:26.926388 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:28:26.926388 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:28:26.928106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-688e161a-1d5c-41f3-9356-8161191bb35f tempest-ServicesAdminNegativeV253TestJSON-1910756801 tempest-ServicesAdminNegativeV253TestJSON-1910756801-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd1b05c3732ad434581012ece3267b6c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9959f922c3f24f8ba31bacf098051400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-688e161a-1d5c-41f3-9356-8161191bb35f tempest-ServicesAdminNegativeV253TestJSON-1910756801 tempest-ServicesAdminNegativeV253TestJSON-1910756801-project] Request method failure captured: May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-services HTTP/1.1 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-jSSGxG0qF9OSschq_qEQ0K5SMBwWUnIxqIXJqNdcj_PLdokh15ZWskwmqxTIgWOEZq-Pwht2EpwZref1h15nEJCUpw6JTPObvIzCW9NQ8Z66sBFuQHv10XpPX1q1bdtgmJYhykJpVa9UdC0KbSoSkfeQlOacdNq75fsILLGWz43g May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.53 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9959f922c3f24f8ba31bacf098051400 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1910756801 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9959f922c3f24f8ba31bacf098051400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9959f922c3f24f8ba31bacf098051400"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9959f922c3f24f8ba31bacf098051400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9959f922c3f24f8ba31bacf098051400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1910756801 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9959f922c3f24f8ba31bacf098051400 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1910756801 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1910756801-project May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d1b05c3732ad434581012ece3267b6c9 May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1910756801-project May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.force_reraise() May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise self.value May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.enforce( May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 08:28:26.930439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-688e161a-1d5c-41f3-9356-8161191bb35f tempest-ServicesAdminNegativeV253TestJSON-1910756801 tempest-ServicesAdminNegativeV253TestJSON-1910756801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:28:26.935144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-688e161a-1d5c-41f3-9356-8161191bb35f tempest-ServicesAdminNegativeV253TestJSON-1910756801 tempest-ServicesAdminNegativeV253TestJSON-1910756801-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.139567 May 19 08:28:26.942515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1598/2923] 10.222.0.78 () {60 vars in 1177 bytes} [Thu May 19 08:28:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 19 08:28:27.093376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3a6c1d66-b90c-40c3-b64d-04421e8a2ec8 req-491d7419-7148-45cf-a354-20d3b2f75bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-deleted", "tag": "e8fc8d94-8d22-41a4-9fca-3e3794bcefc1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:27.103150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a6c1d66-b90c-40c3-b64d-04421e8a2ec8 req-491d7419-7148-45cf-a354-20d3b2f75bdb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:27.103596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a6c1d66-b90c-40c3-b64d-04421e8a2ec8 req-491d7419-7148-45cf-a354-20d3b2f75bdb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:27.120395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3a6c1d66-b90c-40c3-b64d-04421e8a2ec8 req-491d7419-7148-45cf-a354-20d3b2f75bdb service nova] Creating event network-vif-deleted:e8fc8d94-8d22-41a4-9fca-3e3794bcefc1 for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:27.128143 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3a6c1d66-b90c-40c3-b64d-04421e8a2ec8 req-491d7419-7148-45cf-a354-20d3b2f75bdb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038475 May 19 08:28:27.129112 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1599/2924] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:28:27.201364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:27.202727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:27.213274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:27.213639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:27.214418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:27.214856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:27.597281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:27.616481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3e94e80-e9c1-4394-b886-5380a3998245 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.423309 May 19 08:28:27.620941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1600/2925] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:27 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:27.659518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:27.661318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:27.677378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:27.680878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:27.682034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:27.685549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:27.802638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:27.819120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:27.821896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:27.824131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc1933f6-740b-44cf-b382-d24b710862e0 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.171181 May 19 08:28:27.825639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1601/2926] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:27 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:28.009583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-794ea384-95ba-4b08-9ff0-860ecb378ae6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: .version_select at 0x7f32121cce50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1289005700", "policies": ["anti-affinity"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:28.041348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-794ea384-95ba-4b08-9ff0-860ecb378ae6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:28.049099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-794ea384-95ba-4b08-9ff0-860ecb378ae6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:28.120002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-794ea384-95ba-4b08-9ff0-860ecb378ae6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:28.130721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-794ea384-95ba-4b08-9ff0-860ecb378ae6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:28.156502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-794ea384-95ba-4b08-9ff0-860ecb378ae6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.151207 May 19 08:28:28.158581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1602/2927] 10.222.0.78 () {60 vars in 1173 bytes} [Thu May 19 08:28:28 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:28.343408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2082944333", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "bf6ca414-eb38-49b1-b8f2-d7f5e3be6a7c"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:28.409503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:28:28.826188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:28:28.827926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:28:28.829369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:28:28.830135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:28:28.830722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:28:28.871891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:28.872707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:28.873817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:28.874473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:28.899015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:28.916166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:28.943915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Going to run 2 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:28:28.959237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:28:29.025707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119072) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 19 08:28:29.077581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:29.083775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:29.088614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:29.164570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:29.170823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:29.188961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=28af06b6-ca87-4251-a89f-4a9e965773a9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:28:29.256781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:29.266932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:29.335703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:29.341729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:29.404825 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8997a777-403e-44d4-9a76-ec754273abfa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.072847 May 19 08:28:29.407956 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1603/2928] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:28:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1077 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) May 19 08:28:29.413799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:29.414419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:29.438922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:29.439778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:29.441017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:29.441818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.076154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:30.091724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc5a56b4-4808-4150-bac2-a731a09c4040 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1504 microversion: 2.1 time: 0.677212 May 19 08:28:30.092602 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1604/2929] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:29 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1504 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:30.105004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:30.108375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:30.129140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.129679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.130522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.130976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.257204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:30.271867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:30.274092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:30.276309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5359ee86-e4d7-4a52-8da2-0ccc0fdcbbdd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.182019 May 19 08:28:30.277477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1605/2930] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:30 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:30.286626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dec39ab6-dd8c-42a1-9668-3015e95f455e req-3786f71d-d704-456c-9953-61c76f2d597f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198b8e27-a23b-4f2d-9a90-8109e2fb431e", "name": "network-vif-deleted", "tag": "b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:30.299750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dec39ab6-dd8c-42a1-9668-3015e95f455e req-3786f71d-d704-456c-9953-61c76f2d597f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.300288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dec39ab6-dd8c-42a1-9668-3015e95f455e req-3786f71d-d704-456c-9953-61c76f2d597f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.320579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dec39ab6-dd8c-42a1-9668-3015e95f455e req-3786f71d-d704-456c-9953-61c76f2d597f service nova] Creating event network-vif-deleted:b406f90a-bc8e-4c86-b058-b5e1b6d5f5ab for instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e on chh2-842464-2 May 19 08:28:30.327218 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dec39ab6-dd8c-42a1-9668-3015e95f455e req-3786f71d-d704-456c-9953-61c76f2d597f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046907 May 19 08:28:30.328110 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1606/2931] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:30.334355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:30.338711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:30.339539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Searching by: {'deleted': False, 'project_id': '2eabb2e7759a4dcc908539842a4684ba'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:28:30.381513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.385426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.386350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.387050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.577089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:28:30.670873 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54adae2e-eddd-4eb1-8394-c26466035dee tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.341417 May 19 08:28:30.678443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1607/2932] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:28:30 2022] GET /compute/v2.1/servers => generated 1004 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:30.695170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:30.702947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:30.714466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.718537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.719548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:30.720093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:30.921007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:30.932702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20ccfa2c-c367-4b08-982f-22017294b9e0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1215 microversion: 2.1 time: 0.253219 May 19 08:28:30.933336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1608/2933] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:30 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:31.111899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:31.112637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:31.119680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:31.120268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:31.121064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:31.121530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:31.444150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:31.463455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-995ee4b5-46fb-496a-a04c-474e7ff3dc77 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1525 microversion: 2.1 time: 0.357796 May 19 08:28:31.464430 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1609/2934] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:31 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1525 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:31.472511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:31.477639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:31.493672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:31.494623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:31.495617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:31.498202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:31.516812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:31.743872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:31.759401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:31.761583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:31.764664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc0ff34c-8a24-4d22-9375-abd98fba6310 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.298975 May 19 08:28:31.766759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1610/2935] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:31 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:31.954597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:31.955460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:31.979820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:31.983554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:31.984783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:31.985856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:32.221170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:32.238489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6e2a7e0-49e9-4348-8382-68567f54333f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1277 microversion: 2.1 time: 0.288892 May 19 08:28:32.249792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1611/2936] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:31 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:28:32.481080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:32.481725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:32.495277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:32.495722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:32.496591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:32.497031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:33.482925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:33.500475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa61c7ca-10bb-4aa4-9e56-d209244aec35 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1525 microversion: 2.1 time: 1.023016 May 19 08:28:33.507488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1612/2937] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:32 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1525 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:28:33.525494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:33.530174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:33.553578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:33.560042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:33.562692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:33.563258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:33.769219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:33.794484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:33.812635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:33.818634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28a89436-447c-42fb-b895-30d8a7675444 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.309684 May 19 08:28:33.835235 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1613/2938] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:33 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:33.858534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:33.865823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:33.891213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:33.893676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:33.895903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:33.896628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:34.215787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:34.236019 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83b9858b-d6f2-4c00-829f-542117e393b7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1277 microversion: 2.1 time: 0.399076 May 19 08:28:34.239197 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1614/2939] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:33 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1277 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:34.525508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:34.526311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:34.536678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:34.537117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:34.538662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:34.538662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:35.342422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:35.354543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4232c748-16ef-4dc3-ba40-09a321e3eeda tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 0.833043 May 19 08:28:35.358720 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1615/2940] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:34 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:35.370761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:35.374472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:35.391826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:35.392856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:35.398431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:35.399155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:35.667314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:35.693615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:35.707139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:35.708398 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c591e15f-82c1-476f-b467-a65fa6c88b70 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.348450 May 19 08:28:35.708987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1616/2941] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:35 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:35.747082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:35.747869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:35.767909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:35.771428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:35.773970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:35.774601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:36.891339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:36.901074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f580d68a-fd14-42d4-8c9f-f1849ac14c2f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1319 microversion: 2.1 time: 1.176560 May 19 08:28:36.905475 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1617/2942] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:35 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1319 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:36.912900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:36.933427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:36.961245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:36.961626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:36.962431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:36.962871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:37.655361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:37.695805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7959f59-821f-4654-9779-5e3ca5b9b212 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 0.787525 May 19 08:28:37.697238 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1618/2943] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:36 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:37.722738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:37.727486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:37.764879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:37.765769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:37.776695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:37.780578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:38.112730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:38.133123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:38.138645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:38.139913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a994bd2-3ee5-4102-b751-f52b2f8b45bd tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.437279 May 19 08:28:38.140498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1619/2944] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:37 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:38.179092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:38.182110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:38.205963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:38.211699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:38.212459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:38.212980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:39.350089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=30 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:39.460044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:39.471938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-298732d1-8ad0-42ed-a6b9-8743be784d1d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1319 microversion: 2.1 time: 1.311967 May 19 08:28:39.472632 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1620/2945] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:38 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1319 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:39.504007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-85a2abda-a560-445c-b8fe-861eefc04de9 req-f1521ff2-705c-4f03-9dad-32057dd115ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7263c9fb-1255-4c44-9786-8897cf3f29b8", "name": "network-vif-plugged", "status": "completed", "tag": "697ce1b8-839b-4747-974b-3229d0fcc0ad"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:39.552849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-85a2abda-a560-445c-b8fe-861eefc04de9 req-f1521ff2-705c-4f03-9dad-32057dd115ab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:39.554439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-85a2abda-a560-445c-b8fe-861eefc04de9 req-f1521ff2-705c-4f03-9dad-32057dd115ab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:39.654611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-85a2abda-a560-445c-b8fe-861eefc04de9 req-f1521ff2-705c-4f03-9dad-32057dd115ab service nova] Creating event network-vif-plugged:697ce1b8-839b-4747-974b-3229d0fcc0ad for instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 on chh1-842464-2 May 19 08:28:39.669832 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-85a2abda-a560-445c-b8fe-861eefc04de9 req-f1521ff2-705c-4f03-9dad-32057dd115ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175908 May 19 08:28:39.672907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1621/2946] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:39.684734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:39.696114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:39.731622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:39.739267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:39.740312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:39.740873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:40.512752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=40 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:40.563263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:40.578158 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8eed836e-9393-4c25-8fee-3f9c56f795c3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 0.901502 May 19 08:28:40.581651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1622/2947] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:39 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:40.599262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:40.601686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:40.629825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:40.631339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:40.635626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:40.638388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:40.928206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:40.952112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:40.957836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:40.968786 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d07571f-7f71-4467-b1d4-b427f1426c24 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.382009 May 19 08:28:40.970960 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1623/2948] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:40 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:40.993732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-189915992", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "c558eae9-3be0-4c64-9f55-53acd89dda52"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:41.118142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] validate_networks() for [('c558eae9-3be0-4c64-9f55-53acd89dda52', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:28:43.185690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:28:43.186407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:28:43.186624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:28:43.187214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:28:43.187785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:28:43.216261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:43.218317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:43.220393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:43.221899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:43.300279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Getting quotas for project 9ad1d482e3d447f9829945d5e09b32a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:28:43.318958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Getting quotas for user 73cd52377ce84c7ca8c254c0068a82b7 and project 9ad1d482e3d447f9829945d5e09b32a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:28:43.349739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:28:43.356749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:28:43.397101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:43.473833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ff78395-e0f5-4f82-a0f0-9231fe6e52d0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.501106 May 19 08:28:43.476834 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1624/2949] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:28:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:28:43.499897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:43.503609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:43.526853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:43.529186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:43.533117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:43.535603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:44.442674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:44.464995 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f439314-9e36-4e1d-b981-ac05b8f7436c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1319 microversion: 2.1 time: 0.983532 May 19 08:28:44.470465 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1625/2950] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:43 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1319 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:44.490169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a2f2ce06-ea07-44eb-b5c2-0a96739f8b6b req-a79e183f-055b-45e1-83db-7c257ff4b0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbc1aade-666b-4aab-8d67-2aef2209374d", "tag": "d3fec2e4-8d3d-4cea-83ef-bb2833f1aaf9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:44.561016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2f2ce06-ea07-44eb-b5c2-0a96739f8b6b req-a79e183f-055b-45e1-83db-7c257ff4b0ca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:44.563787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2f2ce06-ea07-44eb-b5c2-0a96739f8b6b req-a79e183f-055b-45e1-83db-7c257ff4b0ca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:44.635948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a2f2ce06-ea07-44eb-b5c2-0a96739f8b6b req-a79e183f-055b-45e1-83db-7c257ff4b0ca service nova] Creating event network-changed:d3fec2e4-8d3d-4cea-83ef-bb2833f1aaf9 for instance dbc1aade-666b-4aab-8d67-2aef2209374d on chh1-842464-2 May 19 08:28:44.646986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a2f2ce06-ea07-44eb-b5c2-0a96739f8b6b req-a79e183f-055b-45e1-83db-7c257ff4b0ca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173540 May 19 08:28:44.648141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1626/2951] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:44.676894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:44.677902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:44.699602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:44.701884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:44.703031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:44.704977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:45.723202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:45.733467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a162d97-2099-4cba-b91c-0253dcb99ff7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 1.065812 May 19 08:28:45.739340 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1627/2952] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:44 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:45.750078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:45.774363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:45.821419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:45.824995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:45.827325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:45.837262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:46.062207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:46.064777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:46.076436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:46.084455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:46.090381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54b6f909-f0d7-4c8d-b413-51c1da1aad5b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.347844 May 19 08:28:46.091480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1628/2953] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:45 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:46.365401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-759e288d-40cc-4069-b107-7903d3da7e20 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Action: 'create', calling method: .version_select at 0x7f32119b8280>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:51.407400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-759e288d-40cc-4069-b107-7903d3da7e20 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.314174 May 19 08:28:51.409009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1629/2954] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:28:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:51.414104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:51.415102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:51.430018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:51.430849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:51.431870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:51.434291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:51.680937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:51.692411 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7a0397a-32e1-4acb-9a84-b014662fee2b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1318 microversion: 2.1 time: 0.282029 May 19 08:28:51.699353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1630/2955] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:51 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:51.976316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:51.977832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:51.987994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:51.989119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:51.990315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:51.991028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:52.162250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84c19309-2e29-4bf2-9e9b-2d0e7958401f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.461459 May 19 08:28:52.166082 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1631/2956] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:28:51 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:52.186428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:52.189851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:52.210947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:52.211814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:52.215325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:52.217228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:52.737665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:52.758029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5dfaf49-bdbe-41dc-b126-b518848794f0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1319 microversion: 2.1 time: 0.588479 May 19 08:28:52.759400 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1632/2957] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:52 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:52.765818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8f9e8727-d971-4864-b2d9-4383ef8798d7 req-9f9e6ae8-6819-4f32-b12d-8d3a17030219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28af06b6-ca87-4251-a89f-4a9e965773a9", "tag": "615f1818-087f-4c6b-91d5-85d6bc2b9d85"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:52.780909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8f9e8727-d971-4864-b2d9-4383ef8798d7 req-9f9e6ae8-6819-4f32-b12d-8d3a17030219 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:52.781672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8f9e8727-d971-4864-b2d9-4383ef8798d7 req-9f9e6ae8-6819-4f32-b12d-8d3a17030219 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:52.826771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8f9e8727-d971-4864-b2d9-4383ef8798d7 req-9f9e6ae8-6819-4f32-b12d-8d3a17030219 service nova] Creating event network-changed:615f1818-087f-4c6b-91d5-85d6bc2b9d85 for instance 28af06b6-ca87-4251-a89f-4a9e965773a9 on chh2-842464-2 May 19 08:28:52.835913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8f9e8727-d971-4864-b2d9-4383ef8798d7 req-9f9e6ae8-6819-4f32-b12d-8d3a17030219 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074869 May 19 08:28:52.837938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1633/2958] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:52.848004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:52.849024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:52.861824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:52.863106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:52.866611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:52.867399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.113259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:53.122680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0bfa54d-fafe-47fe-bae1-c1bbd07180ed tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 0.283246 May 19 08:28:53.123450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1634/2959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:52 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:53.129483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:53.130289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:53.138911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.139269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.140231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.140926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.237228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:53.257090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:53.276217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:53.284605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:53.285464 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d746721d-9cbe-4da3-ba48-2df09bb986f4 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.160611 May 19 08:28:53.290228 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1635/2960] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:53 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:53.300099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bdc1f1ec-35b3-4f1b-bac6-a411741a2159 req-ecc83ba8-6950-429c-9ab3-1ab467abc5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc1aade-666b-4aab-8d67-2aef2209374d", "name": "network-vif-plugged", "status": "completed", "tag": "d3fec2e4-8d3d-4cea-83ef-bb2833f1aaf9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:53.309732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bdc1f1ec-35b3-4f1b-bac6-a411741a2159 req-ecc83ba8-6950-429c-9ab3-1ab467abc5d4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.310181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bdc1f1ec-35b3-4f1b-bac6-a411741a2159 req-ecc83ba8-6950-429c-9ab3-1ab467abc5d4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.323187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bdc1f1ec-35b3-4f1b-bac6-a411741a2159 req-ecc83ba8-6950-429c-9ab3-1ab467abc5d4 service nova] Creating event network-vif-plugged:d3fec2e4-8d3d-4cea-83ef-bb2833f1aaf9 for instance dbc1aade-666b-4aab-8d67-2aef2209374d on chh1-842464-2 May 19 08:28:53.329367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bdc1f1ec-35b3-4f1b-bac6-a411741a2159 req-ecc83ba8-6950-429c-9ab3-1ab467abc5d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 May 19 08:28:53.330464 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1636/2961] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:53.335558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:53.339877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:53.340672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Searching by: {'deleted': False, 'project_id': '5733d959d3c943e6867a44a49b1b4cde'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:28:53.342705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:53.348523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.348976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.349979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.350484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.402719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:28:53.443516 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-524a39c7-e6f8-4f36-9d0c-0f125ef0df75 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.111992 May 19 08:28:53.444351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1637/2962] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:28:53 2022] GET /compute/v2.1/servers => generated 339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:53.448782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b1f82b4-3239-4815-92cf-8a65218d2206 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Calling method '.version_select at 0x7f32121f61f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:53.742110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b1f82b4-3239-4815-92cf-8a65218d2206 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/22a0d6a0-529d-4a52-a252-6cecc16ba949" status: 200 len: 142 microversion: 2.1 time: 0.294854 May 19 08:28:53.745985 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1638/2963] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:28:53 2022] GET /compute/v2.1/os-floating-ips/22a0d6a0-529d-4a52-a252-6cecc16ba949 => generated 142 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:53.758528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:53.759310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:53.768939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.769408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:53.770201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:53.770639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:54.153169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:54.167507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-389f6b2a-d91e-4d4e-a28a-bc8f7f3d4606 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1670 microversion: 2.1 time: 0.415557 May 19 08:28:54.167507 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1639/2964] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:53 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1670 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:54.171943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:54.172566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:54.193110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:54.193610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:54.194412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:54.214131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:54.636147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:54.656526 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5972ffe1-14d9-4c52-8881-84d237bd1113 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1318 microversion: 2.1 time: 0.488334 May 19 08:28:54.661327 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1640/2965] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:54 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1318 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:54.678476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:54.685277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:54.690756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Searching by: {'deleted': False, 'project_id': '5733d959d3c943e6867a44a49b1b4cde'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:28:54.715136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:54.715873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:54.716929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:54.717560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:54.850271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:28:54.981238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:55.000864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:55.003651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:55.333879 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96c0ecc7-45e0-4db2-a853-3eb34f77e43d tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.670483 May 19 08:28:55.345740 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1641/2966] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:28:54 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:55.350864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20bd4395-5d28-4a6d-a1b8-53b2763f7172 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Calling method '.version_select at 0x7f3212151b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:56.154214 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20bd4395-5d28-4a6d-a1b8-53b2763f7172 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.807230 May 19 08:28:56.155158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1642/2967] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:28:55 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:56.166232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:56.166862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:56.185227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:56.185691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:56.186551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:56.186953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:56.480411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:56.493351 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6aa868a6-4b47-42e5-8afa-6da4e7f31637 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1468 microversion: 2.1 time: 0.329659 May 19 08:28:56.499567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1643/2968] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:56 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1468 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:56.505830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:56.506953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:56.514846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:56.515918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:56.517568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:56.518289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:56.861198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:56.871988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24f8b213-6d96-4fc6-833d-9de13e989b37 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 0.370880 May 19 08:28:56.902100 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1644/2969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:56 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:56.910897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:56.911761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:56.920595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:56.921230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:56.922255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:56.923506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.050570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:57.069510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:57.076598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:57.078655 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4add9ea2-d483-44f8-b30e-ecf478119e42 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.174403 May 19 08:28:57.090078 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1645/2970] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:28:56 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:28:57.090078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9e1af389-bbc4-41e9-80f9-ca5248fcb11a req-8be43284-2c73-49bb-9d35-4fd0e261c372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18755da-8568-40c8-8b0a-8acbd13e904e", "tag": "f63a0119-dd95-4fe4-9e28-dc409203072e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:57.095159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9e1af389-bbc4-41e9-80f9-ca5248fcb11a req-8be43284-2c73-49bb-9d35-4fd0e261c372 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:57.095611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9e1af389-bbc4-41e9-80f9-ca5248fcb11a req-8be43284-2c73-49bb-9d35-4fd0e261c372 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.109841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9e1af389-bbc4-41e9-80f9-ca5248fcb11a req-8be43284-2c73-49bb-9d35-4fd0e261c372 service nova] Creating event network-changed:f63a0119-dd95-4fe4-9e28-dc409203072e for instance f18755da-8568-40c8-8b0a-8acbd13e904e on chh2-842464-2 May 19 08:28:57.115743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9e1af389-bbc4-41e9-80f9-ca5248fcb11a req-8be43284-2c73-49bb-9d35-4fd0e261c372 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 May 19 08:28:57.117094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1646/2971] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:57.123229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:57.123948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:57.136771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:57.139672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.140584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:57.144681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.462529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:57.505764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04b029e6-78ef-45ae-971d-2c4aaa1b3021 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.374580 May 19 08:28:57.506645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1647/2972] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:57 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:57.514704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df41ea2a-debb-47d2-9461-18e8ed163ac5 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:57.539253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df41ea2a-debb-47d2-9461-18e8ed163ac5 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024680 May 19 08:28:57.544614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1648/2973] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:28:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:57.552531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-94b4f483-e3e1-41c7-b71c-1eca910ddb8b req-78f9b417-5ab6-4a15-9d0a-cf71ed8c9144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28af06b6-ca87-4251-a89f-4a9e965773a9", "name": "network-vif-plugged", "status": "completed", "tag": "615f1818-087f-4c6b-91d5-85d6bc2b9d85"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:28:57.565925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-94b4f483-e3e1-41c7-b71c-1eca910ddb8b req-78f9b417-5ab6-4a15-9d0a-cf71ed8c9144 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:57.566748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-94b4f483-e3e1-41c7-b71c-1eca910ddb8b req-78f9b417-5ab6-4a15-9d0a-cf71ed8c9144 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.586731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-94b4f483-e3e1-41c7-b71c-1eca910ddb8b req-78f9b417-5ab6-4a15-9d0a-cf71ed8c9144 service nova] Creating event network-vif-plugged:615f1818-087f-4c6b-91d5-85d6bc2b9d85 for instance 28af06b6-ca87-4251-a89f-4a9e965773a9 on chh2-842464-2 May 19 08:28:57.605216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-94b4f483-e3e1-41c7-b71c-1eca910ddb8b req-78f9b417-5ab6-4a15-9d0a-cf71ed8c9144 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058450 May 19 08:28:57.607786 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1649/2974] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:28:57.621992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:57.623760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:57.634135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:57.634781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.635789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:57.636370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:57.668143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:28:57.914891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:57.927822 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c90c3e8-1d77-4b94-9d81-f4b3a2fbfd5b tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1318 microversion: 2.1 time: 0.318425 May 19 08:28:57.929390 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1650/2975] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:57 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:57.934661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea751395-5f2e-4338-afab-63bbcd994daa tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Calling method '.version_select at 0x7f32123bfa60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:59.375716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea751395-5f2e-4338-afab-63bbcd994daa tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/22a0d6a0-529d-4a52-a252-6cecc16ba949" status: 202 len: 0 microversion: 2.1 time: 1.445539 May 19 08:28:59.377456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1651/2976] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:28:57 2022] DELETE /compute/v2.1/os-floating-ips/22a0d6a0-529d-4a52-a252-6cecc16ba949 => generated 0 bytes in 1448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:28:59.382035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:59.382651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:59.406811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:59.408005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:59.408687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:59.409098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:59.711165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:28:59.728148 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77963404-6962-4d0a-be37-d33f07ab9509 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9" status: 200 len: 1468 microversion: 2.1 time: 0.349541 May 19 08:28:59.728663 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1652/2977] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:28:59 2022] GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9 => generated 1468 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:28:59.735325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:28:59.735888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:28:59.748489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:59.748937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:59.753804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:28:59.754635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:28:59.811262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:29:00.092877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ffb685f-2b22-40ed-b1b3-d563665bfe02 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 204 len: 0 microversion: 2.1 time: 0.362012 May 19 08:29:00.094039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1653/2978] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:28:59 2022] DELETE /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:29:00.100961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:00.101712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:00.109633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:00.110240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:00.111218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:00.112414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:00.364594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:00.381761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c3fd94b-ed5b-4870-98d3-6ccdfbb20e51 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1520 microversion: 2.1 time: 0.286106 May 19 08:29:00.383167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1654/2979] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:00 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:00.387407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:00.388033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:00.415323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:00.415776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:00.416571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:00.417373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:00.495271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:00.505805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:00.507387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:00.508527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-649f0273-47e2-4af9-a8de-9a729338f68d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.124858 May 19 08:29:00.521331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1655/2980] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:00 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:00.527124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:00.527741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:00.545636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:00.546185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:00.547612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:00.547812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:00.795780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:00.806251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d50a0896-ea54-4231-8e15-e5357815e0f7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1318 microversion: 2.1 time: 0.283289 May 19 08:29:00.820755 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1656/2981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:00 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:00.827259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea2632d0-0eed-4aa2-83c2-825ea3b2e309 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Action: 'create', calling method: .version_select at 0x7f3211e1e670>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:02.716838 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea2632d0-0eed-4aa2-83c2-825ea3b2e309 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.893823 May 19 08:29:02.718469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1657/2982] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:29:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:02.724335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ded73178-a3b2-4694-aa96-8014aab6fe5e req-1acb823d-ed24-416a-907f-36a322ee545a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18755da-8568-40c8-8b0a-8acbd13e904e", "name": "network-vif-plugged", "status": "completed", "tag": "f63a0119-dd95-4fe4-9e28-dc409203072e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:02.735290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ded73178-a3b2-4694-aa96-8014aab6fe5e req-1acb823d-ed24-416a-907f-36a322ee545a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:02.736544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ded73178-a3b2-4694-aa96-8014aab6fe5e req-1acb823d-ed24-416a-907f-36a322ee545a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:02.750724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ded73178-a3b2-4694-aa96-8014aab6fe5e req-1acb823d-ed24-416a-907f-36a322ee545a service nova] Creating event network-vif-plugged:f63a0119-dd95-4fe4-9e28-dc409203072e for instance f18755da-8568-40c8-8b0a-8acbd13e904e on chh2-842464-2 May 19 08:29:02.756777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ded73178-a3b2-4694-aa96-8014aab6fe5e req-1acb823d-ed24-416a-907f-36a322ee545a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036773 May 19 08:29:02.757451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1658/2983] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:02.762446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:02.766091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:02.767131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Searching by: {'reservation_id': 'r-bmdhezoe', 'deleted': False, 'project_id': '2eabb2e7759a4dcc908539842a4684ba'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:29:02.773960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:02.774411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:02.775395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:02.775882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:02.961934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:29:03.040410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:03.049096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.049698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.218708 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92421fee-a77a-41ba-8a59-633cb5220254 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-bmdhezoe" status: 200 len: 2929 microversion: 2.1 time: 0.459907 May 19 08:29:03.219642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1659/2984] 10.222.0.78 () {58 vars in 1196 bytes} [Thu May 19 08:29:02 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bmdhezoe => generated 2929 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:03.225957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:03.227522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:03.237353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.238278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.239732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.240394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.429846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771d7d0381fd4e68ad5d72210082a1e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5733d959d3c943e6867a44a49b1b4cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:03.438283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27a2b9cf-5359-42b0-9d49-49cf2f7cdd31 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 200 len: 1713 microversion: 2.1 time: 0.216209 May 19 08:29:03.444889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1660/2985] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:03 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 1713 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:03.452730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:03.453476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:03.463006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.463744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.464641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.465224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.665678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:03.676319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94240a1b-d6b1-4356-a727-c14068b5f9bd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1502 microversion: 2.1 time: 0.229643 May 19 08:29:03.687545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1661/2986] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:03 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:03.687545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:03.687545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:03.696163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.696760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.697803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.698952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.786209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:03.797044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:03.799283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:03.800509 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c1e1c9d-035d-4ece-a53f-b5b7c347167d tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.120691 May 19 08:29:03.814298 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1662/2987] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:03 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:03.818499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:03.819051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:03.825929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.826422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:03.827254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:03.827709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:04.120922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:04.133689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72f0fd26-9b96-4b67-a11b-d6a0f05a077d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1318 microversion: 2.1 time: 0.316736 May 19 08:29:04.143919 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1663/2988] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:03 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:04.143919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6d1f0cc-504a-40cc-aebd-88438ffb392f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Calling method '.version_select at 0x7f3212555940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.033464 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6d1f0cc-504a-40cc-aebd-88438ffb392f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c" status: 202 len: 0 microversion: 2.1 time: 1.898137 May 19 08:29:06.034368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1664/2989] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:29:04 2022] DELETE /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c => generated 0 bytes in 1900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:29:06.039514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccd7b1f8-a17c-48a2-92f0-19161272901d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.055990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_groups [None req-ccd7b1f8-a17c-48a2-92f0-19161272901d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Querying cell c29c5a8f-0954-4485-a835-7dab43d09458(cell1) for 2 instances {{(pid=119072) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 08:29:06.056882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd7b1f8-a17c-48a2-92f0-19161272901d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.057608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd7b1f8-a17c-48a2-92f0-19161272901d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.090830 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccd7b1f8-a17c-48a2-92f0-19161272901d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/bf6ca414-eb38-49b1-b8f2-d7f5e3be6a7c" status: 200 len: 271 microversion: 2.1 time: 0.055151 May 19 08:29:06.091415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1665/2990] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/os-server-groups/bf6ca414-eb38-49b1-b8f2-d7f5e3be6a7c => generated 271 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:06.096367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fc08b3b0-5d65-4524-bccc-86fd1df14ee3 req-47189cca-ee43-4141-9704-08fb206e322c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fc9d8d-80aa-40f5-b46d-c88aa1efb882", "name": "network-vif-deleted", "tag": "d3b3c9bb-c542-4225-bb00-a7e0c989bfb6"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:06.104987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fc08b3b0-5d65-4524-bccc-86fd1df14ee3 req-47189cca-ee43-4141-9704-08fb206e322c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.105690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fc08b3b0-5d65-4524-bccc-86fd1df14ee3 req-47189cca-ee43-4141-9704-08fb206e322c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.117690 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fc08b3b0-5d65-4524-bccc-86fd1df14ee3 req-47189cca-ee43-4141-9704-08fb206e322c service nova] Creating event network-vif-deleted:d3b3c9bb-c542-4225-bb00-a7e0c989bfb6 for instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 on chh1-842464-2 May 19 08:29:06.123441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fc08b3b0-5d65-4524-bccc-86fd1df14ee3 req-47189cca-ee43-4141-9704-08fb206e322c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030599 May 19 08:29:06.124424 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1666/2991] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:06.130864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.131764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] [instance: e9fc9d8d-80aa-40f5-b46d-c88aa1efb882] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:06.138563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.138987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.139757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.140358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.154255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] HTTP exception thrown: Instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 could not be found. May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Request method failure captured: May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 HTTP/1.1 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-AVg-r1b23sctOzl6X-m4-1IdDA98NmPYAbTPGgxKeEILPQkybMOXsqsBFjtEkxoZn5zvzu9qWCtWgo2kaDp06h7ZHZq0-SmXxX_W9fHrFLd9QXzUSMt10SgP71o4UjJ0mFJZgbCxgYBMYl-Cxv9qG_HJ7bCTN2EZQfvq4kjbFOC8 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5733d959d3c943e6867a44a49b1b4cde May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestManualDisk-1793627934 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5733d959d3c943e6867a44a49b1b4cde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5733d959d3c943e6867a44a49b1b4cde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5733d959d3c943e6867a44a49b1b4cde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5733d959d3c943e6867a44a49b1b4cde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestManualDisk-1793627934 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5733d959d3c943e6867a44a49b1b4cde May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestManualDisk-1793627934 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestManualDisk-1793627934-project May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 771d7d0381fd4e68ad5d72210082a1e1 May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestManualDisk-1793627934-project May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 could not be found. May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e9fc9d8d-80aa-40f5-b46d-c88aa1efb882'} May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 could not be found. May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 could not be found. May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:06.155968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 could not be found. May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Returning 404 to user: Instance e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:06.160757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1817e802-796b-4ba6-abe1-01eef9cf86af tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882" status: 404 len: 111 microversion: 2.1 time: 0.031671 May 19 08:29:06.162120 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1667/2992] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/servers/e9fc9d8d-80aa-40f5-b46d-c88aa1efb882 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:29:06.166133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.166743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:06.173453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.174000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.174803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.175249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.417885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:06.426033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-497cf9fa-9ea2-4a87-b9a3-c9d59a2c4bef tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 200 len: 1445 microversion: 2.1 time: 0.263370 May 19 08:29:06.433371 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1668/2993] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 1445 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:06.433371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.433371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:06.438570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.439092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.439959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.440459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.512903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:06.515331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:06.524287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:06.525822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:06.527013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9922bf3-4de0-4207-9c36-91037e7cf218 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.099403 May 19 08:29:06.538651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1669/2994] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:06.538651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.538651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:06.540413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.540900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.541806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.542372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.743170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:06.757254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77be4caa-e26d-4ae1-9bb0-fc03f87da3f9 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1507 microversion: 2.1 time: 0.228578 May 19 08:29:06.772150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1670/2995] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:06.777862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-869c66b8-6772-4127-9c2d-2d44753be4b6 req-ffc669b7-7f0f-4550-a0d3-502414a560bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7263c9fb-1255-4c44-9786-8897cf3f29b8", "name": "network-vif-unplugged", "status": "completed", "tag": "697ce1b8-839b-4747-974b-3229d0fcc0ad"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:06.787694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-869c66b8-6772-4127-9c2d-2d44753be4b6 req-ffc669b7-7f0f-4550-a0d3-502414a560bc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.788302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-869c66b8-6772-4127-9c2d-2d44753be4b6 req-ffc669b7-7f0f-4550-a0d3-502414a560bc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.806227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_external_events [req-869c66b8-6772-4127-9c2d-2d44753be4b6 req-ffc669b7-7f0f-4550-a0d3-502414a560bc service nova] Unable to find a host for instance 7263c9fb-1255-4c44-9786-8897cf3f29b8. Dropping event network-vif-unplugged {{(pid=119072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 08:29:06.807245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-869c66b8-6772-4127-9c2d-2d44753be4b6 req-ffc669b7-7f0f-4550-a0d3-502414a560bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033686 May 19 08:29:06.808352 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1671/2996] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 08:29:06.813173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bdc6781-d03a-49a6-8224-9dbf85df5095 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Calling method '.version_select at 0x7f3211b0a700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.876841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-8bdc6781-d03a-49a6-8224-9dbf85df5095 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c could not be found", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:29:06.877567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8bdc6781-d03a-49a6-8224-9dbf85df5095 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] HTTP exception thrown: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bdc6781-d03a-49a6-8224-9dbf85df5095 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Request method failure captured: May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c HTTP/1.1 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-62a6BQbwGSyJWVcZ-0BYKb8B7PtvrSjfM9rvJTIvxeGWz8mkgBaCmElRvBo5kTqt4X4PgctL2-46KdV842kVRLouMKwrNo3QB6YZ4tQ-S04iBhH927wQJASgrszvJyEfdgKH2rZ7owowaLFHGPTRo4CCkzfjeTO05p1gVdee9C0o May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e5500d61a79b4a7294199d56ed34b8c7 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPsTestJSON-1741614791 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPsTestJSON-1741614791 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e5500d61a79b4a7294199d56ed34b8c7 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1741614791 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPsTestJSON-1741614791-project May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 45776074bd2b407997cd07d7d68dbb60 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPsTestJSON-1741614791-project May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: exception: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c'} May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c could not be found May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d380e58b-0134-4194-bf00-cb94138f2e75'] May 19 08:29:06.879474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c. May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bdc6781-d03a-49a6-8224-9dbf85df5095 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Returning 404 to user: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:06.883968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bdc6781-d03a-49a6-8224-9dbf85df5095 tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c" status: 404 len: 111 microversion: 2.1 time: 0.071800 May 19 08:29:06.889297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1672/2997] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:29:06.890186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:06.890650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:06.898209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.898615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:06.899627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:06.900069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:07.086989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-490554d9-1dc2-423c-aea7-85d97283173e tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 200 len: 1619 microversion: 2.1 time: 0.198916 May 19 08:29:07.101790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1673/2998] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:06 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 1619 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:07.101790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-219f1e5a-ea73-4664-a114-236237ef8f89 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] Calling method '.version_select at 0x7f3211ad2ca0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:07.118910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:07.144630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-219f1e5a-ea73-4664-a114-236237ef8f89 tempest-ServersTestManualDisk-1793627934 tempest-ServersTestManualDisk-1793627934-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31904785" status: 202 len: 0 microversion: 2.1 time: 0.052851 May 19 08:29:07.147217 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1674/2999] 10.222.0.78 () {58 vars in 1214 bytes} [Thu May 19 08:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31904785 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:29:07.159556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:07.160072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:07.175684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:07.176984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:07.177825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:07.178274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:07.229294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:29:07.249988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Working on deleting snapshot 01ed302d-1aba-41ee-9284-b9ad89d2edc0 from shelved instance... May 19 08:29:08.003889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Doing local delete in cell c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=119072) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 19 08:29:08.009542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:08.010009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:08.010451 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 19 08:29:08.019817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] deallocate_for_instance() {{(pid=119072) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 19 08:29:08.776491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Updating instance_info_cache with network_info: [] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:29:09.211031 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd45d892-6806-41de-865f-903849d0e6ab tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 204 len: 0 microversion: 2.1 time: 2.062208 May 19 08:29:09.213380 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1675/3000] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:29:07 2022] DELETE /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 0 bytes in 2064 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:29:09.220009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37e31418-821a-49cb-b384-174a39da0b5f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Calling method '.version_select at 0x7f321198f0d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:09.289737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-37e31418-821a-49cb-b384-174a39da0b5f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c could not be found", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:29:09.290773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-37e31418-821a-49cb-b384-174a39da0b5f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] HTTP exception thrown: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37e31418-821a-49cb-b384-174a39da0b5f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Request method failure captured: May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c HTTP/1.1 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf-62a6BQbwGSyJWVcZ-0BYKb8B7PtvrSjfM9rvJTIvxeGWz8mkgBaCmElRvBo5kTqt4X4PgctL2-46KdV842kVRLouMKwrNo3QB6YZ4tQ-S04iBhH927wQJASgrszvJyEfdgKH2rZ7owowaLFHGPTRo4CCkzfjeTO05p1gVdee9C0o May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e5500d61a79b4a7294199d56ed34b8c7 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPsTestJSON-1741614791 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5500d61a79b4a7294199d56ed34b8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPsTestJSON-1741614791 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e5500d61a79b4a7294199d56ed34b8c7 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1741614791 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPsTestJSON-1741614791-project May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 45776074bd2b407997cd07d7d68dbb60 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPsTestJSON-1741614791-project May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: exception: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c'} May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c could not be found May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4a2171c-1b0f-4238-bc14-3f897834e64c'] May 19 08:29:09.292693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c. May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37e31418-821a-49cb-b384-174a39da0b5f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] Returning 404 to user: Floating IP not found for ID ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-37e31418-821a-49cb-b384-174a39da0b5f tempest-FloatingIPsTestJSON-1741614791 tempest-FloatingIPsTestJSON-1741614791-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c" status: 404 len: 111 microversion: 2.1 time: 0.079371 May 19 08:29:09.298186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1676/3001] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:29:09 2022] DELETE /compute/v2.1/os-floating-ips/ffa9cf36-e848-41e2-b8e9-9b2a5b8a612c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:29:09.303435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:09.304228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:09.315317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.315771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.316581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.317022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.507397 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-804e4be3-f85f-40fe-a9c3-e65b7a3e8c05 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9" status: 200 len: 1619 microversion: 2.1 time: 0.210921 May 19 08:29:09.508530 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1677/3002] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:09 2022] GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9 => generated 1619 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:09.513855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:09.514651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:09.528772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.529445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.530506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.531871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.666719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:09.689152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:09.695969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:09.702203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc5cff0f-cd1f-4e16-b546-685f7e8fda2b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.189030 May 19 08:29:09.707556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1678/3003] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:09 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:09.721230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2025827a-7e8f-46e4-ad8c-b42a755dab63 req-b60c4825-26c2-4cb8-b9df-c2e73dae53ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7263c9fb-1255-4c44-9786-8897cf3f29b8", "name": "network-vif-deleted", "tag": "697ce1b8-839b-4747-974b-3229d0fcc0ad"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:09.738113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2025827a-7e8f-46e4-ad8c-b42a755dab63 req-b60c4825-26c2-4cb8-b9df-c2e73dae53ab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.740578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2025827a-7e8f-46e4-ad8c-b42a755dab63 req-b60c4825-26c2-4cb8-b9df-c2e73dae53ab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.767847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_external_events [req-2025827a-7e8f-46e4-ad8c-b42a755dab63 req-b60c4825-26c2-4cb8-b9df-c2e73dae53ab service nova] Unable to find a host for instance 7263c9fb-1255-4c44-9786-8897cf3f29b8. Dropping event network-vif-deleted {{(pid=119072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 08:29:09.768751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2025827a-7e8f-46e4-ad8c-b42a755dab63 req-b60c4825-26c2-4cb8-b9df-c2e73dae53ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.059759 May 19 08:29:09.769383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1679/3004] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 08:29:09.773901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:09.782610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:09.801474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.802109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.803023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:09.803596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:09.831796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 HTTP/1.1 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7263c9fb-1255-4c44-9786-8897cf3f29b8'} May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:09.834726 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:29:09.840428 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:09.854343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:09.855536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7cf521d2-59cf-4042-b70f-ee10875c6704 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 404 len: 111 microversion: 2.1 time: 0.085166 May 19 08:29:09.865791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1680/3005] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:09 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:29:09.872838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-341682097", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1f53a05d-5149-4732-91fa-d68946239a66"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:10.004835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:29:10.703391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:29:10.704718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:29:10.705404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:29:10.714642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:29:10.715435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:29:10.796426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:10.798022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:10.803672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:10.811664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:10.866473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:10.886398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:10.939490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:29:10.941922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:29:11.008948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c1a3347d-14f9-4583-a111-6b8195ba65fa tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141197 May 19 08:29:11.015537 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1681/3006] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:29:11.021152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1516581685", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:11.107540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:29:11.941034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:29:11.942303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:29:11.943175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:29:11.943896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:29:11.944534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:29:11.957740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:11.958546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:11.959589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:11.960233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:11.986156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:11.995214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:12.012557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:29:12.015221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:29:12.080148 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc4a4d80-0e49-4abb-b6cc-81b27b6e4d22 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062667 May 19 08:29:12.081576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1682/3007] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:29:12.087077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:12.088053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:12.098053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:12.099229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:12.100678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:12.101689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:12.279049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:12.296113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:12.302033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:12.306242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36363b92-21f0-40b7-83af-2729e5788de6 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.223288 May 19 08:29:12.308227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1683/3008] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:12 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:12.324765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:12.326979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:12.337402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:12.342091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:12.343801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:12.348234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:12.537266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:12.562289 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6eadd21-89c8-4a47-85c0-cb51692b4db9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1268 microversion: 2.1 time: 0.252360 May 19 08:29:12.566629 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1684/3009] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:12 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1268 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:12.583365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e32e5ad-e05b-4791-b46a-ee971c133732 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:12.586400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e32e5ad-e05b-4791-b46a-ee971c133732 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:12.716115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e32e5ad-e05b-4791-b46a-ee971c133732 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:12.755652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e32e5ad-e05b-4791-b46a-ee971c133732 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1215 microversion: 2.1 time: 0.172164 May 19 08:29:12.756853 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1685/3010] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:12 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:13.328527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:13.330915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:13.354027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:13.354502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:13.355327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:13.356213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:13.475178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:13.512275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:13.515812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:13.520888 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-021796af-7a2e-4f31-aec1-ad25c59624f8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.197150 May 19 08:29:13.525064 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1686/3011] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:13 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:29:13.585459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:13.587187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:13.600486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:13.601210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:13.602579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:13.603479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:13.694119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:13.765816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:13.784693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c07c5868-02ae-48cc-9289-4b353b24e0a3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1274 microversion: 2.1 time: 0.203680 May 19 08:29:13.790569 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1687/3012] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:13 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:13.800894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:13.802786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:13.822801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:13.823515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:13.824294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:13.824765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:13.964672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:13.980430 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a39d6950-9875-4eef-9920-f3b44a8ba7eb tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1267 microversion: 2.1 time: 0.187490 May 19 08:29:13.982188 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1688/3013] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:13 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:14.546038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:14.547470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:14.560630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:14.561735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:14.562863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:14.564064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:14.868139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:14.892017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:14.893501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:14.900540 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c12534c3-67b9-469e-9bc6-1d24c203908a tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.354515 May 19 08:29:14.924235 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1689/3014] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:14 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:14.937573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:14.937826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:14.956202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:14.956659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:14.957484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:14.957931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:15.242254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:15.262080 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ad41d51-ae52-411f-b8ab-81ce4db7bfa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1274 microversion: 2.1 time: 0.331721 May 19 08:29:15.272840 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1690/3015] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:14 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1274 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:15.279236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:15.285406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:15.299431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:15.301262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:15.302273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:15.305666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:16.169350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:16.178556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7bc3520-97cc-4a26-a01f-805b6ed01a9a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1273 microversion: 2.1 time: 0.904168 May 19 08:29:16.184820 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1691/3016] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:15 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1273 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:16.202490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:16.209189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:16.224563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:16.226345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:16.228061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:16.229941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:16.461069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:16.474057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:16.475609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:16.476910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a4fc18c-0a0c-44c5-b9b9-35670e5e4108 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.288054 May 19 08:29:16.481030 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1692/3017] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:16 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:16.489349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:16.491146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:16.516565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:16.519425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:16.521519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:16.522855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:17.225504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:17.238655 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4a3374b-078a-41d4-97e5-b3dfdbe7beab tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.756697 May 19 08:29:17.239437 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1693/3018] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:16 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:17.258060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:17.258702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:17.276068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:17.277335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:17.281618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:17.284002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:18.161699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:18.178762 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89090105-ae00-4011-84fb-826c89b6f42f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.936049 May 19 08:29:18.180749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1694/3019] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:17 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:18.192236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:18.198259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:18.222315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:18.224193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:18.226351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:18.228523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:18.369979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:18.389523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:18.393771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:18.398383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc1aa967-ddce-4c5a-88f5-8aec3e02bf22 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.215436 May 19 08:29:18.410660 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1695/3020] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:18 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:18.424158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:18.425776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:18.436153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:18.436947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:18.438049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:18.439075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:18.880840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:18.893043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f4e0317-2389-4b9a-b43e-54071f553aef tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.479722 May 19 08:29:18.895180 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1696/3021] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:18 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:19.197970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:19.198857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:19.211049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:19.211743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:19.212679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:19.213274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:19.722186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:19.744225 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16287264-1d5a-4153-bbda-1d44572a33d4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.544339 May 19 08:29:19.744225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1697/3022] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:19 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:29:19.759976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:19.762944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:19.780668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:19.781739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:19.785557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:19.789905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:19.960062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:19.989145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:19.991357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:20.000077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6a204e2-2a04-46d3-b7db-b679365093fe tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.254697 May 19 08:29:20.012186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1698/3023] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:19 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:20.018986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d9e10eec-b4a3-455f-b752-53c6be272131 req-ab337613-8497-4a92-a86c-99ace709bee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83e0ff3-7651-419d-8b47-3eba50771c47", "tag": "67914d4d-d561-416d-bd14-e31658843af4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:20.040563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d9e10eec-b4a3-455f-b752-53c6be272131 req-ab337613-8497-4a92-a86c-99ace709bee5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:20.041298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d9e10eec-b4a3-455f-b752-53c6be272131 req-ab337613-8497-4a92-a86c-99ace709bee5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:20.055328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d9e10eec-b4a3-455f-b752-53c6be272131 req-ab337613-8497-4a92-a86c-99ace709bee5 service nova] Creating event network-changed:67914d4d-d561-416d-bd14-e31658843af4 for instance a83e0ff3-7651-419d-8b47-3eba50771c47 on chh1-842464-2 May 19 08:29:20.061638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d9e10eec-b4a3-455f-b752-53c6be272131 req-ab337613-8497-4a92-a86c-99ace709bee5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047635 May 19 08:29:20.063464 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1699/3024] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:20.072246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:20.073277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:20.087945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:20.088399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:20.089178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:20.089908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:20.422987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:20.450278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d0a6b5f-6cd8-46fb-b81f-218cdfcf54bb tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.384981 May 19 08:29:20.456389 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1700/3025] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:20 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:20.467602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dac3e288-20bc-42bf-ae69-6d16ed973873 req-ef4dd034-8162-4672-9e42-0522326052d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7d5889-0535-45b4-b298-6d8d739e58f3", "tag": "586e1b22-3765-411d-bffd-aef2714085a1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:20.498389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dac3e288-20bc-42bf-ae69-6d16ed973873 req-ef4dd034-8162-4672-9e42-0522326052d4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:20.498847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dac3e288-20bc-42bf-ae69-6d16ed973873 req-ef4dd034-8162-4672-9e42-0522326052d4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:20.525145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dac3e288-20bc-42bf-ae69-6d16ed973873 req-ef4dd034-8162-4672-9e42-0522326052d4 service nova] Creating event network-changed:586e1b22-3765-411d-bffd-aef2714085a1 for instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 on chh1-842464-2 May 19 08:29:20.531253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dac3e288-20bc-42bf-ae69-6d16ed973873 req-ef4dd034-8162-4672-9e42-0522326052d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072264 May 19 08:29:20.533215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1701/3026] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:20.766087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:20.768953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:20.800186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:20.803833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:20.805121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:20.805844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:21.107243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:21.116504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5de7a257-bcc0-405d-858d-074639be19c5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.361014 May 19 08:29:21.129687 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1702/3027] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:20 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:21.139376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:21.140950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:21.165614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:21.166221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:21.167119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:21.167678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:21.299563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:21.314064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:21.318266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:21.326892 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2836fbf-44d1-44c0-9bf4-afa947bba44c tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.195814 May 19 08:29:21.327643 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1703/3028] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:21 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:21.468853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:21.470275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:21.480033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:21.484910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:21.486068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:21.486672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:21.972402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=10 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:22.029563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:22.042741 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7eaba9a0-4629-49f3-9ede-0becae5c04c3 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.577974 May 19 08:29:22.043756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1704/3029] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:21 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:29:22.137850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:22.138487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:22.141962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:22.153648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:22.154993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:22.162881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:22.163996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:22.207678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:22.731107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=18 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:22.868901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:22.885046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94d41c99-61fa-49ac-acc5-b68f0491811b tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.749613 May 19 08:29:22.888883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1705/3030] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:22 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:29:22.908050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:22.909760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:22.945000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:22.952515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:22.956534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:22.956534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:23.245799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:23.270197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:23.271888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d8d29895e4d4ae990b7782be9b19572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca6bf8cecfe44f4895f6dfd6700c2704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:23.273167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34b1c33f-fcea-4943-83d0-601d349ef8a8 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 200 len: 1604 microversion: 2.32 time: 0.382554 May 19 08:29:23.273823 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1706/3031] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:22 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 1604 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:23.280800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:23.281454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:23.298032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:23.298716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:23.301201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:23.314373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:24.142796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:24.163230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5f3ef22-6ba5-4f88-b9d4-866a73c80d5d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.885812 May 19 08:29:24.173919 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1707/3032] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:23 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:24.189192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:24.190468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:24.206285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:24.208001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:24.209205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:24.209685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:24.679890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:24.691873 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-069a41a4-0c5b-49b1-a32c-5c903cb73838 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.525055 May 19 08:29:24.702309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1708/3033] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:24 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:24.709793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:24.710699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:24.718179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:24.718840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:24.720386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:24.720985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:24.740905 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] HTTP exception thrown: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Request method failure captured: May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e HTTP/1.1 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3sk34_iRdhFiPN_s6zJoGPkqD5pETd3hr8RykJWxpR-wxmOf5P1WPa1mnp2L2rfnBVySpOOQb9-tzsL5T7VFFADTu7ZTScwLAJTxdJIiISnBR4TqTK0GMMVPb7x1FNJkfhMRpI59oDp1UpW60bzW34lsnsAzsbut1j_MqKLhdKLfk May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.32 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ca6bf8cecfe44f4895f6dfd6700c2704 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ca6bf8cecfe44f4895f6dfd6700c2704 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TaggedBootDevicesTest-1221901556-project May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9d8d29895e4d4ae990b7782be9b19572 May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TaggedBootDevicesTest-1221901556-project May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '198b8e27-a23b-4f2d-9a90-8109e2fb431e'} May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:24.743100 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Returning 404 to user: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6da95f39-2a78-4f89-8d4f-7f4321c12d80 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 404 len: 111 microversion: 2.32 time: 0.040984 May 19 08:29:24.749561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1709/3034] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:24 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:29:24.757563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f964877-9a81-4f0b-aff9-c584e16b6296 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '.version_select at 0x7f3211c7c310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:24.777962 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f964877-9a81-4f0b-aff9-c584e16b6296 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297273046" status: 204 len: 0 microversion: 2.32 time: 0.027452 May 19 08:29:24.782884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1710/3035] 10.222.0.78 () {60 vars in 1258 bytes} [Thu May 19 08:29:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297273046 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:29:25.186836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:25.188844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:25.203399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:25.205406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:25.206520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:25.207145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:25.429441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:25.440033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f4968de-3656-4d73-aac2-75d69db84cad tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.259328 May 19 08:29:25.440626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1711/3036] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:25 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:25.717470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:25.718144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:25.725860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:25.727816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:25.729167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:25.730228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:26.330690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:26.343018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bb62b54-5eef-40a3-a61a-aea426a5753e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.627546 May 19 08:29:26.354538 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1712/3037] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:25 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:26.366711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-36402891-6182-426c-95d7-873b73d4d07c req-82aa2e95-edd3-499d-a8de-e405cd1378d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e0ff3-7651-419d-8b47-3eba50771c47", "name": "network-vif-plugged", "status": "completed", "tag": "67914d4d-d561-416d-bd14-e31658843af4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:26.390646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-36402891-6182-426c-95d7-873b73d4d07c req-82aa2e95-edd3-499d-a8de-e405cd1378d2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:26.391864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-36402891-6182-426c-95d7-873b73d4d07c req-82aa2e95-edd3-499d-a8de-e405cd1378d2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:26.410187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-36402891-6182-426c-95d7-873b73d4d07c req-82aa2e95-edd3-499d-a8de-e405cd1378d2 service nova] Creating event network-vif-plugged:67914d4d-d561-416d-bd14-e31658843af4 for instance a83e0ff3-7651-419d-8b47-3eba50771c47 on chh1-842464-2 May 19 08:29:26.416282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-36402891-6182-426c-95d7-873b73d4d07c req-82aa2e95-edd3-499d-a8de-e405cd1378d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059722 May 19 08:29:26.420895 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1713/3038] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:26.460339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:26.461047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:26.487220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:26.487699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:26.491687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:26.492528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:26.885094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:26.899015 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb44c2fb-ac4c-41a2-afda-538f694103be tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.445749 May 19 08:29:26.900156 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1714/3039] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:26 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:27.379390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:27.380500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:27.396523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:27.398577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:27.399780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:27.400378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:27.894369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:27.907963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-501de969-3c41-4d34-810d-b687d9502c98 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1315 microversion: 2.1 time: 0.548552 May 19 08:29:27.919246 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1715/3040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:27 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:29:27.940734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-210a7c9e-0586-439b-b605-50538c3dab21 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f3211ad2670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:28.007241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-210a7c9e-0586-439b-b605-50538c3dab21 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db" status: 200 len: 637 microversion: 2.1 time: 0.086695 May 19 08:29:28.014813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1716/3041] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:29:27 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db => generated 637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:28.025895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:28.030198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:28.064671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:28.068728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:28.069741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:28.070349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:28.543574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:28.552945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c438dfd9-7c4a-47bd-b3b3-2827c0d0f9c9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1316 microversion: 2.1 time: 0.536746 May 19 08:29:28.568408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1717/3042] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:28 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:28.573633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1792cd83-d210-4625-a54c-23e9cad040af tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f3217a873a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:28.652888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1792cd83-d210-4625-a54c-23e9cad040af tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:28.671566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1792cd83-d210-4625-a54c-23e9cad040af tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:29.137699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1792cd83-d210-4625-a54c-23e9cad040af tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.567768 May 19 08:29:29.139458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1718/3043] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:28 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:29.146001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-29b310a7-86a4-4eae-96d6-a009de37ff92 req-5a3f3990-f2e0-425e-99fc-f5ea688a51da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7d5889-0535-45b4-b298-6d8d739e58f3", "name": "network-vif-plugged", "status": "completed", "tag": "586e1b22-3765-411d-bffd-aef2714085a1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:29.156496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29b310a7-86a4-4eae-96d6-a009de37ff92 req-5a3f3990-f2e0-425e-99fc-f5ea688a51da service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:29.157410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29b310a7-86a4-4eae-96d6-a009de37ff92 req-5a3f3990-f2e0-425e-99fc-f5ea688a51da service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:29.170772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-29b310a7-86a4-4eae-96d6-a009de37ff92 req-5a3f3990-f2e0-425e-99fc-f5ea688a51da service nova] Creating event network-vif-plugged:586e1b22-3765-411d-bffd-aef2714085a1 for instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 on chh1-842464-2 May 19 08:29:29.178281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-29b310a7-86a4-4eae-96d6-a009de37ff92 req-5a3f3990-f2e0-425e-99fc-f5ea688a51da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037017 May 19 08:29:29.179274 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1719/3044] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:29.199471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:29.200438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:29.208855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:29.209760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:29.210704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:29.212356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:29.732637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:29.746068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48b3c7a1-1e1d-4c93-8e5a-3fb7a2aff76f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1498 microversion: 2.1 time: 0.564786 May 19 08:29:29.746683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1720/3045] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:29 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1498 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:29.763812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b377c65b-6e4e-401a-a528-cffdbf0342d6 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f3211277b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:30.410292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b377c65b-6e4e-401a-a528-cffdbf0342d6 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "DELETE /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.662336 May 19 08:29:30.411017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1721/3046] 10.222.0.78 () {58 vars in 1295 bytes} [Thu May 19 08:29:29 2022] DELETE /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata/os_version => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:29:30.646950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-770934574", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "6d73608e-9c3f-48cf-bae1-54b382632587"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:30.774400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] validate_networks() for [('6d73608e-9c3f-48cf-bae1-54b382632587', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:29:31.596524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:29:31.597204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:29:31.597986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:29:31.598510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:29:31.599030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:29:31.620554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:31.620554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:31.620554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:31.620554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:31.641373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Getting quotas for project e0b49b0268c8466d929114292647b5bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:31.647828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Getting quotas for user f147018f1ed847c8a0ce11eecdcbfed5 and project e0b49b0268c8466d929114292647b5bc. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:31.665056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:29:31.667772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:29:31.758813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f298ee5b-b588-40f6-8216-c0113bc2fe2e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.343477 May 19 08:29:31.760253 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1722/3047] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:29:31.765297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:31.766872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:31.787771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:31.799350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:31.800514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:31.801124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.104250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:32.116759 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0cc7ecd6-0aba-46dd-9df4-c342e593e8bc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1465 microversion: 2.1 time: 0.355261 May 19 08:29:32.117415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1723/3048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:31 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1465 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:32.134618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8d30387-463a-46c2-a96b-eadae97198b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:32.146075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8d30387-463a-46c2-a96b-eadae97198b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.146615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8d30387-463a-46c2-a96b-eadae97198b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.215915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8d30387-463a-46c2-a96b-eadae97198b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:29:32.276347 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8d30387-463a-46c2-a96b-eadae97198b8 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47/action" status: 202 len: 0 microversion: 2.1 time: 0.157351 May 19 08:29:32.277375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1724/3049] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:29:32 2022] POST /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:29:32.300031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-09e6a95c-dbd1-405f-8673-8477a2823158 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f32111d1ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:32.357872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-09e6a95c-dbd1-405f-8673-8477a2823158 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074792 May 19 08:29:32.367276 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1725/3050] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:29:32 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 37 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:32.369698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:32.370740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:32.381557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.382366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.383326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.383969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.412208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] HTTP exception thrown: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Request method failure captured: May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e HTTP/1.1 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3sk34_iRdhFiPN_s6zJoGPkqD5pETd3hr8RykJWxpR-wxmOf5P1WPa1mnp2L2rfnBVySpOOQb9-tzsL5T7VFFADTu7ZTScwLAJTxdJIiISnBR4TqTK0GMMVPb7x1FNJkfhMRpI59oDp1UpW60bzW34lsnsAzsbut1j_MqKLhdKLfk May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.32 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ca6bf8cecfe44f4895f6dfd6700c2704 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ca6bf8cecfe44f4895f6dfd6700c2704 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TaggedBootDevicesTest-1221901556-project May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9d8d29895e4d4ae990b7782be9b19572 May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TaggedBootDevicesTest-1221901556-project May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '198b8e27-a23b-4f2d-9a90-8109e2fb431e'} May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:32.415355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Returning 404 to user: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0f08c4e-252b-4665-9d44-0dd02c61945b tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "DELETE /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 404 len: 111 microversion: 2.32 time: 0.057564 May 19 08:29:32.420300 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1726/3051] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:32 2022] DELETE /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:29:32.427839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:32.428651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:32.435669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.443599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.445184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.445840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.539143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:32.550229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:32.553846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:32.556242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be295f33-96ae-4aea-ad73-0e736bac815b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1262 microversion: 2.21 time: 0.134092 May 19 08:29:32.557377 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1727/3052] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:32 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:32.563633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:32.564426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:32.571362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.572521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.575009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.575988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.771144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3af3162c-7d6f-43ab-9ebd-9e6259dde08a tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1616 microversion: 2.1 time: 0.212282 May 19 08:29:32.773012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1728/3053] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:32 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1616 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:32.778562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:32.779673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:32.829168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.830916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.834274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:32.836703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:32.871131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:33.034508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:33.042593 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92ab4d7e-0b81-4221-917f-8ba98109a640 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.268159 May 19 08:29:33.043382 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1729/3054] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:32 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:33.049250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-846fc344-bf5d-41b8-a742-984d21b0fa80 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f32111d1670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:33.119126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-846fc344-bf5d-41b8-a742-984d21b0fa80 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:33.126573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-846fc344-bf5d-41b8-a742-984d21b0fa80 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:33.652181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-846fc344-bf5d-41b8-a742-984d21b0fa80 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.607697 May 19 08:29:33.652826 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1730/3055] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:33 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:33.658356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:33.669934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] [instance: 198b8e27-a23b-4f2d-9a90-8109e2fb431e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:33.706038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:33.706620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:33.707528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:33.707930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:33.756268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] HTTP exception thrown: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Request method failure captured: May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e HTTP/1.1 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf3sk34_iRdhFiPN_s6zJoGPkqD5pETd3hr8RykJWxpR-wxmOf5P1WPa1mnp2L2rfnBVySpOOQb9-tzsL5T7VFFADTu7ZTScwLAJTxdJIiISnBR4TqTK0GMMVPb7x1FNJkfhMRpI59oDp1UpW60bzW34lsnsAzsbut1j_MqKLhdKLfk May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.32 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ca6bf8cecfe44f4895f6dfd6700c2704 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca6bf8cecfe44f4895f6dfd6700c2704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ca6bf8cecfe44f4895f6dfd6700c2704 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1221901556 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TaggedBootDevicesTest-1221901556-project May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9d8d29895e4d4ae990b7782be9b19572 May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TaggedBootDevicesTest-1221901556-project May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '198b8e27-a23b-4f2d-9a90-8109e2fb431e'} May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:33.762348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. May 19 08:29:33.768601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:33.771760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] Returning 404 to user: Instance 198b8e27-a23b-4f2d-9a90-8109e2fb431e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:33.773627 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7fd90f4-b810-41ea-9ed6-71f7f8651a46 tempest-TaggedBootDevicesTest-1221901556 tempest-TaggedBootDevicesTest-1221901556-project] 10.222.0.78 "GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e" status: 404 len: 111 microversion: 2.32 time: 0.119773 May 19 08:29:33.774870 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1731/3056] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:33 2022] GET /compute/v2.1/servers/198b8e27-a23b-4f2d-9a90-8109e2fb431e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:29:33.780672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-447493452", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1f53a05d-5149-4732-91fa-d68946239a66"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:33.862221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:29:34.659592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:29:34.660283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:29:34.660956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:29:34.661590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:29:34.662168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:29:34.682022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:34.682706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:34.683881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:34.684485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:34.714440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:34.721209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:34.737435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:29:34.741755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:29:34.821674 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77a5f9dd-2e0a-43fb-bf9c-4f7fba505ef2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040492 May 19 08:29:34.823974 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1732/3057] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:29:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:29:34.837063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:34.838125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:34.852088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:34.852878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:34.854044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:34.855467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:35.179224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:35.204632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:35.215062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:35.220390 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eeb5e029-1e12-44bf-878a-b71f52343cb4 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1358 microversion: 2.21 time: 0.390696 May 19 08:29:35.221661 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1733/3058] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:34 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:35.236928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a0d0e49-3354-4b8a-ab9b-8838aa710550 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f32111c9550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:35.322350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a0d0e49-3354-4b8a-ab9b-8838aa710550 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.098012 May 19 08:29:35.327961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1734/3059] 10.222.0.78 () {58 vars in 1289 bytes} [Thu May 19 08:29:35 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata/os_distro => generated 33 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:35.328173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:35.340674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:35.349505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:35.360850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:35.361862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:35.362319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:35.974546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:35.983487 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27cdc662-dd60-4b1b-95bc-c63e566a5e99 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.659443 May 19 08:29:35.987420 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1735/3060] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:35 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:35.994248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:36.007534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:36.028198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:36.028955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:36.031474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:36.032161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:36.431700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:36.442939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c03c4807-35c7-4904-a8f5-01ec83677859 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1268 microversion: 2.1 time: 0.454153 May 19 08:29:36.443528 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1736/3061] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:35 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1268 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:36.459261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72a733a7-7e01-483a-9d17-fe4f0c049d8c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f32111fcca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:36.543581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-72a733a7-7e01-483a-9d17-fe4f0c049d8c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:36.566478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:36.581699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-72a733a7-7e01-483a-9d17-fe4f0c049d8c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:37.029799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72a733a7-7e01-483a-9d17-fe4f0c049d8c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.585172 May 19 08:29:37.031589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1737/3062] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:36 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:37.035933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:37.036576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:37.043486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:37.043933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:37.044705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:37.045142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:37.371713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:37.383464 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb139124-5b46-4a99-862c-9e22c9bd337e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.351454 May 19 08:29:37.384289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1738/3063] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:37 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:37.389421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5fbd5e56-316b-4496-b100-44a04158d28f req-9c59533d-dffb-4106-a462-2bdaeb83a85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532cb5d6-aafa-457c-8e26-54344975dfda", "tag": "87d802bc-9555-4729-830e-05d08c6e1495"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:37.401792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5fbd5e56-316b-4496-b100-44a04158d28f req-9c59533d-dffb-4106-a462-2bdaeb83a85e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:37.402738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5fbd5e56-316b-4496-b100-44a04158d28f req-9c59533d-dffb-4106-a462-2bdaeb83a85e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:37.418320 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5fbd5e56-316b-4496-b100-44a04158d28f req-9c59533d-dffb-4106-a462-2bdaeb83a85e service nova] Creating event network-changed:87d802bc-9555-4729-830e-05d08c6e1495 for instance 532cb5d6-aafa-457c-8e26-54344975dfda on chh2-842464-2 May 19 08:29:37.425233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5fbd5e56-316b-4496-b100-44a04158d28f req-9c59533d-dffb-4106-a462-2bdaeb83a85e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038967 May 19 08:29:37.426044 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1739/3064] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:37.431823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:37.432656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:37.439720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:37.440330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:37.441190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:37.441737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:38.118794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:38.130903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:38.139250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:38.142888 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-771dfa2e-10ab-40e3-a9bf-106863eec85e tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1358 microversion: 2.21 time: 0.713969 May 19 08:29:38.153087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1740/3065] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:37 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1358 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:38.154803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:38.158214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:38.170330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:38.170791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:38.175322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:38.175811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:38.857888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:38.881657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9dbbdce-b95b-4809-91b7-9c60d897df00 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.734808 May 19 08:29:38.883299 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1741/3066] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:38 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:38.899511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13e18c26-a123-48e6-8960-61b85eaa06e0 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f32111fcee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:38.967630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13e18c26-a123-48e6-8960-61b85eaa06e0 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.081275 May 19 08:29:38.968974 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1742/3067] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:29:38 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:38.974161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:38.980111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:38.989429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:38.990007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:38.992952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:38.993537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:39.711493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:39.740965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ae52179-f2e0-4fe3-88c0-42b241a032df tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.770528 May 19 08:29:39.752752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1743/3068] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:38 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:39.754713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:39.755355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:39.772474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:39.774920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:39.775892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:39.776365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:40.100265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:40.116060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9cd6ffee-c495-4447-9c8d-4616c975725b tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1316 microversion: 2.1 time: 0.373314 May 19 08:29:40.117377 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1744/3069] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:39 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:40.129064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67805ad0-84a1-4ee2-8d9c-ff8c7e23a4bf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f32119b83a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:40.212458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-67805ad0-84a1-4ee2-8d9c-ff8c7e23a4bf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:40.228283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-67805ad0-84a1-4ee2-8d9c-ff8c7e23a4bf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:40.918719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67805ad0-84a1-4ee2-8d9c-ff8c7e23a4bf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.800020 May 19 08:29:40.919491 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1745/3070] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:40 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:40.925278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:40.930245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:40.958823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:40.959743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:40.962474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:40.964595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:41.564323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:41.584639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:41.587099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:41.588881 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82380da2-4406-4eed-989a-4ff26477f76b tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1358 microversion: 2.21 time: 0.668061 May 19 08:29:41.606642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1746/3071] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:40 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1358 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:41.612568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:41.615637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:41.631160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:41.631930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:41.632967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:41.633655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:42.054506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:42.062505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-917dc21c-c8b9-4bae-94e6-e8135558ee00 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.454575 May 19 08:29:42.076618 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1747/3072] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:41 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:42.079981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:42.080783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:42.087466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:42.088086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:42.089149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:42.089728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:42.344650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:42.363911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e4886a7-54fe-45ea-96d8-811811a41c3e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.295187 May 19 08:29:42.365286 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1748/3073] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:42 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:42.385152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0f3cb76e-d64d-443b-a0ec-1ca5fd00fab1 req-260c014c-343c-4712-99c0-7dd96a72048c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d4133c-882c-4849-a7ba-512ca78d677d", "tag": "f1a7b20f-7d85-447b-b144-27b6e41bfb14"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:42.420463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0f3cb76e-d64d-443b-a0ec-1ca5fd00fab1 req-260c014c-343c-4712-99c0-7dd96a72048c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:42.420920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0f3cb76e-d64d-443b-a0ec-1ca5fd00fab1 req-260c014c-343c-4712-99c0-7dd96a72048c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:42.449931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0f3cb76e-d64d-443b-a0ec-1ca5fd00fab1 req-260c014c-343c-4712-99c0-7dd96a72048c service nova] Creating event network-changed:f1a7b20f-7d85-447b-b144-27b6e41bfb14 for instance 38d4133c-882c-4849-a7ba-512ca78d677d on chh1-842464-2 May 19 08:29:42.457381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0f3cb76e-d64d-443b-a0ec-1ca5fd00fab1 req-260c014c-343c-4712-99c0-7dd96a72048c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088477 May 19 08:29:42.458977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1749/3074] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:42.467377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-380aa404-4e51-468a-924f-86cac59cf008 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f32111c95e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:42.544536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-380aa404-4e51-468a-924f-86cac59cf008 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:42.577223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-380aa404-4e51-468a-924f-86cac59cf008 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:43.072868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-380aa404-4e51-468a-924f-86cac59cf008 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 64 microversion: 2.1 time: 0.610780 May 19 08:29:43.074102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1750/3075] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:42 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 64 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:43.083302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-98583138-20df-41c1-8945-b2370fc218f3 req-87c4bbdd-8a01-4e7c-8531-99649c86a7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532cb5d6-aafa-457c-8e26-54344975dfda", "name": "network-vif-plugged", "status": "completed", "tag": "87d802bc-9555-4729-830e-05d08c6e1495"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:43.093118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-98583138-20df-41c1-8945-b2370fc218f3 req-87c4bbdd-8a01-4e7c-8531-99649c86a7a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:43.093854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-98583138-20df-41c1-8945-b2370fc218f3 req-87c4bbdd-8a01-4e7c-8531-99649c86a7a1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:43.107475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-98583138-20df-41c1-8945-b2370fc218f3 req-87c4bbdd-8a01-4e7c-8531-99649c86a7a1 service nova] Creating event network-vif-plugged:87d802bc-9555-4729-830e-05d08c6e1495 for instance 532cb5d6-aafa-457c-8e26-54344975dfda on chh2-842464-2 May 19 08:29:43.115859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-98583138-20df-41c1-8945-b2370fc218f3 req-87c4bbdd-8a01-4e7c-8531-99649c86a7a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039407 May 19 08:29:43.117320 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1751/3076] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:43.127698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:43.129553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:43.140659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:43.142438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:43.144363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:43.145064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:43.620674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:43.629282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22ee2e28-6edf-4e4f-a31e-7e09c63d0c20 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1316 microversion: 2.1 time: 0.510421 May 19 08:29:43.658790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1752/3077] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:43 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:43.658790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:43.658790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:43.664993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:43.665482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:43.666271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:43.666713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:43.988270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:43.995945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7a72d21-2a0f-4bd7-b89f-181f6b96d59b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.352264 May 19 08:29:43.999756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1753/3078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:43 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:44.004614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:44.005239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:44.022568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:44.023036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:44.023848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:44.024294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:44.279842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:44.289102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:44.290637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:44.291773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50925ce2-edd0-49e8-a3a2-dc65991569ad tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1358 microversion: 2.21 time: 0.290956 May 19 08:29:44.292342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1754/3079] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:43 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:44.314273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2d010d3-4da5-408e-a96c-89611f230669 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f32111ebe50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:44.366601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2d010d3-4da5-408e-a96c-89611f230669 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 64 microversion: 2.1 time: 0.069551 May 19 08:29:44.367183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1755/3080] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:29:44 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 64 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:44.378734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96e5930a-7445-41ea-ac9f-5a6f8a9d18c9", "device": "/dev/sdb"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:44.380289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:44.403443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:44.404138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:44.405093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:44.406794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:44.436764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:44.704203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:44.898763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0853d1c-75b6-4380-95cc-eb893cde11fe tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "POST /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530026 May 19 08:29:44.899321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1756/3081] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:29:44 2022] POST /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:44.907187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:44.908236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:44.915311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:44.915988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:44.917776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:44.918389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:45.150986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:45.161210 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5a9bf7f-927a-42e4-9ab6-44f017e835df tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.260661 May 19 08:29:45.163829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1757/3082] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:44 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:45.169373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1404926736", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "6106690e-bca7-4255-9662-43648d2ed217"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:45.285001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] validate_networks() for [('6106690e-bca7-4255-9662-43648d2ed217', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:29:46.248238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:29:46.248826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:29:46.249920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:29:46.251975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:29:46.252597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:29:46.277982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:46.280103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:46.282761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:46.283795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:46.335334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:46.343137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for user 59f3ba2c06c045d6afccb1639ed8d083 and project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:46.365142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:29:46.370565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:29:46.520101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56a676c5-afdb-4d7b-94e7-b0f9c20e4928 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.354700 May 19 08:29:46.525468 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1758/3083] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:29:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:29:46.537194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f4aa29d-609d-47ba-a039-ab6e864ebba3 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f3211200a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:46.663548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3f4aa29d-609d-47ba-a039-ab6e864ebba3 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:46.684409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3f4aa29d-609d-47ba-a039-ab6e864ebba3 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:47.279817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f4aa29d-609d-47ba-a039-ab6e864ebba3 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.758056 May 19 08:29:47.285643 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1759/3084] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:46 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:47.292371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:47.293149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:47.305198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:47.310113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:47.311090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:47.311615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:47.642406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:47.653542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65978e2d-a490-426e-9c2e-aa6b146a4d8d tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1316 microversion: 2.1 time: 0.366079 May 19 08:29:47.654429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1760/3085] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:47 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:47.659788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:47.664018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:47.694070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:47.694798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:47.695851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:47.696499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:47.949547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:47.960754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:47.962751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:47.964266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84c76b99-fe61-43e9-8ded-78057d2afd6d tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1552 microversion: 2.21 time: 0.308733 May 19 08:29:47.977574 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1761/3086] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:47 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1552 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:47.990506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:47.991482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:48.006396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:48.006873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:48.007700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:48.008138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:48.324424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:48.350274 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a1dbde0-abd5-4659-86a7-0ab1f61a48a4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.370569 May 19 08:29:48.365144 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1762/3087] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:47 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:48.381827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:48.382479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:48.417273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:48.417819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:48.420356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:48.420813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:48.537733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:48.548018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b40a1ae1-1200-4ccb-8cd7-17c23d0df6c3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1285 microversion: 2.1 time: 0.181672 May 19 08:29:48.549347 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1763/3088] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:48 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:48.555669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dec7ea08-d196-4d17-9158-ad3092ad2588 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update', calling method: .version_select at 0x7f32112184c0>, body: {"meta": {"os_version": "alt"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:48.623701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dec7ea08-d196-4d17-9158-ad3092ad2588 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:48.631808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dec7ea08-d196-4d17-9158-ad3092ad2588 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:49.241928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dec7ea08-d196-4d17-9158-ad3092ad2588 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.691443 May 19 08:29:49.243388 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1764/3089] 10.222.0.78 () {60 vars in 1312 bytes} [Thu May 19 08:29:48 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata/os_version => generated 31 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:49.248682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:49.249465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:49.259815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:49.261728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:49.262683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:49.266882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:49.307979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:29:49.440840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:49.450286 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7cf10b24-c47d-4082-b655-ce77273056ca tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "DELETE /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 204 len: 0 microversion: 2.21 time: 0.205364 May 19 08:29:49.454792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1765/3090] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:49 2022] DELETE /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:29:49.468039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a5c8f7ca-bff4-421f-94e7-3e9f3eaf4bda req-ff01a992-0266-431b-9e4a-8415a9583889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d4133c-882c-4849-a7ba-512ca78d677d", "name": "network-vif-plugged", "status": "completed", "tag": "f1a7b20f-7d85-447b-b144-27b6e41bfb14"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:49.488351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a5c8f7ca-bff4-421f-94e7-3e9f3eaf4bda req-ff01a992-0266-431b-9e4a-8415a9583889 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:49.490204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a5c8f7ca-bff4-421f-94e7-3e9f3eaf4bda req-ff01a992-0266-431b-9e4a-8415a9583889 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:49.519696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a5c8f7ca-bff4-421f-94e7-3e9f3eaf4bda req-ff01a992-0266-431b-9e4a-8415a9583889 service nova] Creating event network-vif-plugged:f1a7b20f-7d85-447b-b144-27b6e41bfb14 for instance 38d4133c-882c-4849-a7ba-512ca78d677d on chh1-842464-2 May 19 08:29:49.538055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a5c8f7ca-bff4-421f-94e7-3e9f3eaf4bda req-ff01a992-0266-431b-9e4a-8415a9583889 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069780 May 19 08:29:49.539210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1766/3091] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:49.560410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:49.561357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:49.569992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:49.571418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:49.572318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:49.572862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:50.247922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:50.259055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d26decd-4822-41b1-acff-d261915baa9f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1316 microversion: 2.1 time: 0.704277 May 19 08:29:50.259521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1767/3092] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:49 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:50.268952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06819858-5f69-44c8-9ae6-5b6a2d1cf4b3 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f32112185e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:50.352399 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06819858-5f69-44c8-9ae6-5b6a2d1cf4b3 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 58 microversion: 2.1 time: 0.088660 May 19 08:29:50.353081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1768/3093] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:29:50 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 58 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:50.366470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:50.369423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:50.393481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:50.393985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:50.394763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:50.395196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:50.620241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:50.631218 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a974481-548c-4ee1-abb6-b357e82a83c2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.274999 May 19 08:29:50.643880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1769/3094] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:50 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:50.648803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:50.649683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:50.656803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:50.657760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:50.660710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:50.661274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:51.068416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:51.077869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:51.080173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f147018f1ed847c8a0ce11eecdcbfed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b49b0268c8466d929114292647b5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:51.081571 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b783476-8e51-4e3a-bf4f-69f967195a66 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 200 len: 1558 microversion: 2.21 time: 0.436486 May 19 08:29:51.083268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1770/3095] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:50 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 1558 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:29:51.093584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:51.094998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:51.112057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:51.112653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:51.113594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:51.115991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:51.457895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:51.478299 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5f40bd7-fecb-4f94-b6a9-ebd182ce27bc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1315 microversion: 2.1 time: 0.391270 May 19 08:29:51.479028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1771/3096] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:51 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:51.532170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-915ccce4-fdb5-43e1-a9cf-abde58ec3dcf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'update_all', calling method: .version_select at 0x7f3211ad20d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:51.633944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-915ccce4-fdb5-43e1-a9cf-abde58ec3dcf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:51.659791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-915ccce4-fdb5-43e1-a9cf-abde58ec3dcf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:52.259329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-915ccce4-fdb5-43e1-a9cf-abde58ec3dcf tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 61 microversion: 2.1 time: 0.777394 May 19 08:29:52.260612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1772/3097] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:51 2022] PUT /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 61 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:52.270075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:52.270787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:52.285397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:52.285854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:52.286647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:52.287092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:52.776208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:52.793973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2abb5260-dd50-4b42-b9fc-a7b16e0fc393 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1465 microversion: 2.1 time: 0.529027 May 19 08:29:52.799373 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1773/3098] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:52 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1465 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:52.804623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:52.805660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:52.823081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:52.824045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:52.825542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:52.826492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:53.363428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:53.375573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f242bf05-6e02-4900-a760-717cf0993141 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.574075 May 19 08:29:53.378164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1774/3099] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:52 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:53.383683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:53.384823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:53.397443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:53.397907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:53.398892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:53.399340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:53.425711 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] HTTP exception thrown: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Request method failure captured: May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda HTTP/1.1 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf_oLW7jR-USUsoj8VAeQIXxrnOTiWrIcn91btNbtbslk-wwnHrS5c70onuZrO6QJeYGolvVRls74CvX_m1HjP6-pzAI8PeF7xvMpc6Yuzq0L9nlNd-UC61INesCNxelpFz09XaL5VyJNA3A0uXHsYBUdHNDPBfXPpPudDbwrrxELVU May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.21 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e0b49b0268c8466d929114292647b5bc May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e0b49b0268c8466d929114292647b5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e0b49b0268c8466d929114292647b5bc May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsV221TestJSON-2037899706-project May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f147018f1ed847c8a0ce11eecdcbfed5 May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsV221TestJSON-2037899706-project May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '532cb5d6-aafa-457c-8e26-54344975dfda'} May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:53.427394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Returning 404 to user: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8a82a3a-7fce-4b0d-b232-f3972a4c8bfa tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 404 len: 111 microversion: 2.21 time: 0.049687 May 19 08:29:53.432765 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1775/3100] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:53 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:29:53.434653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3640699-50b1-4d5b-aa73-bb863c72726c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Action: 'create', calling method: .version_select at 0x7f32111eb940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:53.494567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=51 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:53.502688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e3640699-50b1-4d5b-aa73-bb863c72726c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:53.516772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e3640699-50b1-4d5b-aa73-bb863c72726c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Getting quotas for user e74cd98456ac457597528bf11e89eca3 and project c8f87c6322014652a3057985d21930cd. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:54.023907 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3640699-50b1-4d5b-aa73-bb863c72726c tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "POST /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 85 microversion: 2.1 time: 0.593495 May 19 08:29:54.025609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1776/3101] 10.222.0.78 () {60 vars in 1280 bytes} [Thu May 19 08:29:53 2022] POST /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 85 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:54.049803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3f9c43c6-aac5-45a4-8715-93f3a7a29597 req-9aa8d243-4124-406b-bf31-50cd162377e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532cb5d6-aafa-457c-8e26-54344975dfda", "name": "network-vif-deleted", "tag": "87d802bc-9555-4729-830e-05d08c6e1495"}, {"name": "network-changed", "server_uuid": "dafb0de6-d5a1-4cc2-9365-2309651bc29f", "tag": "faeafd9a-db49-4546-95f9-7612b6ba8741"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:54.075374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3f9c43c6-aac5-45a4-8715-93f3a7a29597 req-9aa8d243-4124-406b-bf31-50cd162377e7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.076101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3f9c43c6-aac5-45a4-8715-93f3a7a29597 req-9aa8d243-4124-406b-bf31-50cd162377e7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.087912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:29:54.101622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3f9c43c6-aac5-45a4-8715-93f3a7a29597 req-9aa8d243-4124-406b-bf31-50cd162377e7 service nova] Creating event network-vif-deleted:87d802bc-9555-4729-830e-05d08c6e1495 for instance 532cb5d6-aafa-457c-8e26-54344975dfda on chh2-842464-2 May 19 08:29:54.102450 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3f9c43c6-aac5-45a4-8715-93f3a7a29597 req-9aa8d243-4124-406b-bf31-50cd162377e7 service nova] Creating event network-changed:faeafd9a-db49-4546-95f9-7612b6ba8741 for instance dafb0de6-d5a1-4cc2-9365-2309651bc29f on chh2-842464-2 May 19 08:29:54.112510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3f9c43c6-aac5-45a4-8715-93f3a7a29597 req-9aa8d243-4124-406b-bf31-50cd162377e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069716 May 19 08:29:54.113602 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1777/3102] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:54.119441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:54.120405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:54.129762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.130385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.131725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.132289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.344676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:54.355073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74edffe0-614a-408b-b338-1ab088400594 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1315 microversion: 2.1 time: 0.239684 May 19 08:29:54.356331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1778/3103] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:54 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:54.361764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:54.362678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:54.371565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.372518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.373690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.374356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.539315 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25b5ba3b-10cf-465c-adc6-c3f75ea82444 tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1616 microversion: 2.1 time: 0.181546 May 19 08:29:54.540123 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1779/3104] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:54 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1616 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:54.546065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '.version_select at 0x7f3217a59670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:54.547379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:54.554989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.555436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.556221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.556807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.647164 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0469f512-0b79-45fd-865c-e1f8a68a5970 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.104713 May 19 08:29:54.647908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1780/3105] 10.222.0.78 () {60 vars in 1336 bytes} [Thu May 19 08:29:54 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda/os-instance-actions => generated 611 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:29:54.660487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2a4bed7-7598-4c9e-b81c-4e36ce2c25f1 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] Calling method '.version_select at 0x7f32111eb820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:54.725920 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2a4bed7-7598-4c9e-b81c-4e36ce2c25f1 tempest-ImagesMetadataTestJSON-1216471808 tempest-ImagesMetadataTestJSON-1216471808-project] 10.222.0.78 "GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata" status: 200 len: 85 microversion: 2.1 time: 0.069158 May 19 08:29:54.727096 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1781/3106] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:29:54 2022] GET /compute/v2.1/images/0dde9858-465c-4e30-82f3-5c12df5880db/metadata => generated 85 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:29:54.732237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:54.733030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:54.762788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.762788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:54.762788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:54.762788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:55.125248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:55.138819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67227bcf-6d75-4417-964b-f5d79ff5af86 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.410124 May 19 08:29:55.140032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1782/3107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:54 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:55.147492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:55.148270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:55.155904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:55.157899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:55.159060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:55.159691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:55.193669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] HTTP exception thrown: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Request method failure captured: May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda HTTP/1.1 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf_oLW7jR-USUsoj8VAeQIXxrnOTiWrIcn91btNbtbslk-wwnHrS5c70onuZrO6QJeYGolvVRls74CvX_m1HjP6-pzAI8PeF7xvMpc6Yuzq0L9nlNd-UC61INesCNxelpFz09XaL5VyJNA3A0uXHsYBUdHNDPBfXPpPudDbwrrxELVU May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.21 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e0b49b0268c8466d929114292647b5bc May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e0b49b0268c8466d929114292647b5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e0b49b0268c8466d929114292647b5bc May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsV221TestJSON-2037899706-project May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f147018f1ed847c8a0ce11eecdcbfed5 May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsV221TestJSON-2037899706-project May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '532cb5d6-aafa-457c-8e26-54344975dfda'} May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:55.197879 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:55.201982 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:55.206604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Returning 404 to user: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:55.208593 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92147b35-e5ef-4d8c-ad3a-6be73a251a5f tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "DELETE /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 404 len: 111 microversion: 2.21 time: 0.065830 May 19 08:29:55.212214 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1783/3108] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:29:55 2022] DELETE /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:29:55.224131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1752313250", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1f53a05d-5149-4732-91fa-d68946239a66"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:55.326590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:29:55.816163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:29:55.816849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:29:55.817601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:29:55.818267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:29:55.818860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:29:55.837687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:55.840333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:55.841431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:55.842059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:55.886813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:29:55.900461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Getting quotas for user c1af603a8f2a4346b8f9482ae1b83ef3 and project 2eabb2e7759a4dcc908539842a4684ba. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:29:55.943092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:29:55.951442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:29:56.028593 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ce8210e-7c8a-40df-adb2-24b18db50412 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815225 May 19 08:29:56.030047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1784/3109] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:29:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:29:56.042880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:56.044549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] [instance: 532cb5d6-aafa-457c-8e26-54344975dfda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:56.072325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:56.073284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:56.102547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:56.105367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:56.161707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] HTTP exception thrown: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Request method failure captured: May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda HTTP/1.1 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf_oLW7jR-USUsoj8VAeQIXxrnOTiWrIcn91btNbtbslk-wwnHrS5c70onuZrO6QJeYGolvVRls74CvX_m1HjP6-pzAI8PeF7xvMpc6Yuzq0L9nlNd-UC61INesCNxelpFz09XaL5VyJNA3A0uXHsYBUdHNDPBfXPpPudDbwrrxELVU May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.21 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e0b49b0268c8466d929114292647b5bc May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e0b49b0268c8466d929114292647b5bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e0b49b0268c8466d929114292647b5bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e0b49b0268c8466d929114292647b5bc May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2037899706 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsV221TestJSON-2037899706-project May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f147018f1ed847c8a0ce11eecdcbfed5 May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsV221TestJSON-2037899706-project May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '532cb5d6-aafa-457c-8e26-54344975dfda'} May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:56.168824 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. May 19 08:29:56.173828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:29:56.178654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] Returning 404 to user: Instance 532cb5d6-aafa-457c-8e26-54344975dfda could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:29:56.180085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2602cb9-3619-40c9-a4ea-6784aa170e74 tempest-InstanceActionsV221TestJSON-2037899706 tempest-InstanceActionsV221TestJSON-2037899706-project] 10.222.0.78 "GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda" status: 404 len: 111 microversion: 2.21 time: 0.148799 May 19 08:29:56.182851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1785/3110] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:29:56 2022] GET /compute/v2.1/servers/532cb5d6-aafa-457c-8e26-54344975dfda => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:29:56.193002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:56.202121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:56.236836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:56.237675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:56.240063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:56.242841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:56.549239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:56.558498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bfd15310-f45f-4b73-9b92-8a1a396b5798 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1315 microversion: 2.1 time: 0.370634 May 19 08:29:56.560401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1786/3111] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:56 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:56.590686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcdc82a3-3443-459a-91f1-72fc3d968329 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:56.593856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bcdc82a3-3443-459a-91f1-72fc3d968329 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:56.770094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bcdc82a3-3443-459a-91f1-72fc3d968329 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:56.778805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bcdc82a3-3443-459a-91f1-72fc3d968329 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1217 microversion: 2.1 time: 0.215938 May 19 08:29:56.780640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1787/3112] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:56 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:56.829342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:56.830104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:56.857585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:56.857585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:56.857585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:56.857585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:57.310235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:57.330693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52069b2e-73a3-4358-a5c8-16a216a7449e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1508 microversion: 2.1 time: 0.547769 May 19 08:29:57.332145 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1788/3113] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:56 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:57.351914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9450e617-1d56-432c-912f-13659c4878ae req-60fdf3f6-a4fd-4d72-9f99-e9820c3e196e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb0de6-d5a1-4cc2-9365-2309651bc29f", "name": "network-vif-plugged", "status": "completed", "tag": "faeafd9a-db49-4546-95f9-7612b6ba8741"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:29:57.404654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9450e617-1d56-432c-912f-13659c4878ae req-60fdf3f6-a4fd-4d72-9f99-e9820c3e196e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:57.405796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9450e617-1d56-432c-912f-13659c4878ae req-60fdf3f6-a4fd-4d72-9f99-e9820c3e196e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:57.429697 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9450e617-1d56-432c-912f-13659c4878ae req-60fdf3f6-a4fd-4d72-9f99-e9820c3e196e service nova] Creating event network-vif-plugged:faeafd9a-db49-4546-95f9-7612b6ba8741 for instance dafb0de6-d5a1-4cc2-9365-2309651bc29f on chh2-842464-2 May 19 08:29:57.437209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9450e617-1d56-432c-912f-13659c4878ae req-60fdf3f6-a4fd-4d72-9f99-e9820c3e196e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103562 May 19 08:29:57.439173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1789/3114] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:29:57.576787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:57.577690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:57.592712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:57.593799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:57.598216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:57.599180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:57.843476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:57.852595 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b1ea898-e65b-4efc-8949-57a306039157 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1315 microversion: 2.1 time: 0.280299 May 19 08:29:57.854230 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1790/3115] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:57 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:29:57.862341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:57.863466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:57.873884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:57.875586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:57.877151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:57.878858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:57.963238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:57.983500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c906c39-6b34-4af7-a5b0-7ada4d56b74e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1277 microversion: 2.1 time: 0.127459 May 19 08:29:57.987035 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1791/3116] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:57 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:58.353088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:58.354896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:58.367690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:58.368155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:58.369060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:58.369547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:58.845298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:58.857071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b659cdd-829e-4008-a8d0-16c4e85362f3 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1485 microversion: 2.1 time: 0.508929 May 19 08:29:58.869335 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1792/3117] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:58 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1485 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:29:58.872974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:58.875238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:58.892106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:58.894818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:58.896626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:58.897081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:59.565267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:29:59.579917 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-831b1dc1-2cf8-4301-ad00-86c3c633f82a tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1315 microversion: 2.1 time: 0.708265 May 19 08:29:59.581223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1793/3118] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:29:58 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:29:59.591361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:29:59.592185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:29:59.608399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:59.610721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:59.615159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:29:59.619940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:29:59.801609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:00.046750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adddc40c-9d0f-45dc-9100-2405d7788714 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 204 len: 0 microversion: 2.1 time: 0.459924 May 19 08:30:00.047830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1794/3119] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:29:59 2022] DELETE /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:00.058422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:00.061325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:00.090181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:00.091697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:00.092743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:00.093428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:00.785959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:00.805253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e5ae8e9-54b1-4e39-9d5d-870b40baaf1e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1317 microversion: 2.1 time: 0.755815 May 19 08:30:00.806431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1795/3120] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:00 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1317 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:00.842955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:00.848873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:00.869539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:00.869991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:00.870784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:00.883346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:01.599658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:01.611859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7cae222-fbf5-4a2e-855f-5023b8153aa7 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 200 len: 1491 microversion: 2.1 time: 0.791685 May 19 08:30:01.625375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1796/3121] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:00 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 1491 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:02.039731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7672c51-55e2-43e1-b0fe-cbf13288b55f tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Calling method '.version_select at 0x7f3211200160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:02.072649 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f7672c51-55e2-43e1-b0fe-cbf13288b55f tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] HTTP exception thrown: Image not found. May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7672c51-55e2-43e1-b0fe-cbf13288b55f tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Request method failure captured: May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/85abc972-f554-4166-a575-6bffb29bb42c/metadata/os_distro HTTP/1.1 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAHw0YqlInzlwnPIEmPUXF_zYa85U8DxijIDyYB2fOds_1k0AiRFq-C3NzRqYMNsB-AJeaoFW5N9uOQ5cok57b80qaLozChG_5N5ArqizKUK410t05G-Kqqmx3FSFjfLjZ-YPXTki02wgLARuRq_jrafjBk0ebZkDfonQBCimRgMxU May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7497a415f2c47c882f0da91130133c0 May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'image_id': '85abc972-f554-4166-a575-6bffb29bb42c', 'id': 'os_distro'} May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 85abc972-f554-4166-a575-6bffb29bb42c May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:30:02.080174 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 85abc972-f554-4166-a575-6bffb29bb42c could not be found. May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7672c51-55e2-43e1-b0fe-cbf13288b55f tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7672c51-55e2-43e1-b0fe-cbf13288b55f tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] 10.222.0.78 "DELETE /compute/v2.1/images/85abc972-f554-4166-a575-6bffb29bb42c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.455251 May 19 08:30:02.085244 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1797/3122] 10.222.0.78 () {58 vars in 1292 bytes} [Thu May 19 08:30:01 2022] DELETE /compute/v2.1/images/85abc972-f554-4166-a575-6bffb29bb42c/metadata/os_distro => generated 62 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:02.091900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:02.091900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:02.101186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:02.101677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:02.102462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:02.102902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:02.140584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:02.802889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:02.824332 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac081737-825f-4355-a572-456d32a94c52 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1502 microversion: 2.1 time: 0.740176 May 19 08:30:02.827394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1798/3123] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:02 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1502 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:02.855496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f295f14a-90a0-4108-8b78-7f85df9c5289 req-8922f46a-215d-4833-ac36-d5de4d5cb266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae06d11d-0ef0-46ee-b50a-a8cc6cb97221", "tag": "20bae17f-760d-4671-8bb2-a6687a00b38e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:02.880858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f295f14a-90a0-4108-8b78-7f85df9c5289 req-8922f46a-215d-4833-ac36-d5de4d5cb266 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:02.881657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f295f14a-90a0-4108-8b78-7f85df9c5289 req-8922f46a-215d-4833-ac36-d5de4d5cb266 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:02.930776 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f295f14a-90a0-4108-8b78-7f85df9c5289 req-8922f46a-215d-4833-ac36-d5de4d5cb266 service nova] Creating event network-changed:20bae17f-760d-4671-8bb2-a6687a00b38e for instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 on chh2-842464-2 May 19 08:30:02.960870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f295f14a-90a0-4108-8b78-7f85df9c5289 req-8922f46a-215d-4833-ac36-d5de4d5cb266 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130865 May 19 08:30:02.965028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1799/3124] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:02.971029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:02.983072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:03.013061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:03.015808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:03.018354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:03.018961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:03.701815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:03.724407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d356b7a1-5f3e-4ff7-a4c4-d2b33b74373e tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1317 microversion: 2.1 time: 0.757785 May 19 08:30:03.732526 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1800/3125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:02 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:03.747922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a73369da-ed33-41ed-8ee5-2214a17d2b57 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Calling method '.version_select at 0x7f3211176e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:03.814520 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a73369da-ed33-41ed-8ee5-2214a17d2b57 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] HTTP exception thrown: Image not found. May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a73369da-ed33-41ed-8ee5-2214a17d2b57 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Request method failure captured: May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/images/36838568-e2f1-4e56-b6fd-112e75ceaef6/metadata/os_version HTTP/1.1 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAHw0YqlInzlwnPIEmPUXF_zYa85U8DxijIDyYB2fOds_1k0AiRFq-C3NzRqYMNsB-AJeaoFW5N9uOQ5cok57b80qaLozChG_5N5ArqizKUK410t05G-Kqqmx3FSFjfLjZ-YPXTki02wgLARuRq_jrafjBk0ebZkDfonQBCimRgMxU May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7497a415f2c47c882f0da91130133c0 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'image_id': '36838568-e2f1-4e56-b6fd-112e75ceaef6', 'id': 'os_version'} May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 36838568-e2f1-4e56-b6fd-112e75ceaef6 May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:30:03.819772 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 36838568-e2f1-4e56-b6fd-112e75ceaef6 could not be found. May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:30:03.824278 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.833530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a73369da-ed33-41ed-8ee5-2214a17d2b57 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:03.834618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a73369da-ed33-41ed-8ee5-2214a17d2b57 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] 10.222.0.78 "GET /compute/v2.1/images/36838568-e2f1-4e56-b6fd-112e75ceaef6/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.097701 May 19 08:30:03.842459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1801/3126] 10.222.0.78 () {58 vars in 1292 bytes} [Thu May 19 08:30:03 2022] GET /compute/v2.1/images/36838568-e2f1-4e56-b6fd-112e75ceaef6/metadata/os_version => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:03.847926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:03.848769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:03.853452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:03.864218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:03.864919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:03.866010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:03.868382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:03.940415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 HTTP/1.1 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a83e0ff3-7651-419d-8b47-3eba50771c47'} May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:03.942208 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:03.947427 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:03.949756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:03.951113 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64fb46d4-1653-4c43-81ef-ebcf20837a0f tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 404 len: 111 microversion: 2.1 time: 0.107176 May 19 08:30:03.956240 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1802/3127] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:03 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:03.961556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:03.962383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:03.987269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:03.990203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:03.996427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:03.997220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:04.265102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Removing security group 307a0d42-6d92-424e-b24a-270a04e6773b from port faeafd9a-db49-4546-95f9-7612b6ba8741 May 19 08:30:05.709841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e9dcd2a-0b94-44a3-8a99-8e1cc9ad2e73 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f/action" status: 202 len: 0 microversion: 2.1 time: 1.752128 May 19 08:30:05.710831 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1803/3128] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:30:03 2022] POST /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f/action => generated 0 bytes in 1754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:05.716277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fa4590a4-d7ec-4cb7-a4f6-6c27925c12cc req-1979a401-9a71-4d09-acc7-6c2cccc64544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83e0ff3-7651-419d-8b47-3eba50771c47", "name": "network-vif-deleted", "tag": "67914d4d-d561-416d-bd14-e31658843af4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:05.740304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fa4590a4-d7ec-4cb7-a4f6-6c27925c12cc req-1979a401-9a71-4d09-acc7-6c2cccc64544 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:05.740751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fa4590a4-d7ec-4cb7-a4f6-6c27925c12cc req-1979a401-9a71-4d09-acc7-6c2cccc64544 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:05.778934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fa4590a4-d7ec-4cb7-a4f6-6c27925c12cc req-1979a401-9a71-4d09-acc7-6c2cccc64544 service nova] Creating event network-vif-deleted:67914d4d-d561-416d-bd14-e31658843af4 for instance a83e0ff3-7651-419d-8b47-3eba50771c47 on chh1-842464-2 May 19 08:30:05.800194 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fa4590a4-d7ec-4cb7-a4f6-6c27925c12cc req-1979a401-9a71-4d09-acc7-6c2cccc64544 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088059 May 19 08:30:05.800992 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1804/3129] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:05.819747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39f3011e-f555-44d1-beb7-c40e071a4cda tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Calling method '.version_select at 0x7f321110df70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:05.863032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:05.878354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-39f3011e-f555-44d1-beb7-c40e071a4cda tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] HTTP exception thrown: Image not found. May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39f3011e-f555-44d1-beb7-c40e071a4cda tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Request method failure captured: May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/images/a9df6c39-bc97-4bcd-9e28-1c5c4df5cd8e/metadata HTTP/1.1 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAHw0YqlInzlwnPIEmPUXF_zYa85U8DxijIDyYB2fOds_1k0AiRFq-C3NzRqYMNsB-AJeaoFW5N9uOQ5cok57b80qaLozChG_5N5ArqizKUK410t05G-Kqqmx3FSFjfLjZ-YPXTki02wgLARuRq_jrafjBk0ebZkDfonQBCimRgMxU May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7497a415f2c47c882f0da91130133c0 May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'image_id': 'a9df6c39-bc97-4bcd-9e28-1c5c4df5cd8e'} May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9df6c39-bc97-4bcd-9e28-1c5c4df5cd8e May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:30:05.882340 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9df6c39-bc97-4bcd-9e28-1c5c4df5cd8e could not be found. May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:30:05.886890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:05.891250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39f3011e-f555-44d1-beb7-c40e071a4cda tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:05.892375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39f3011e-f555-44d1-beb7-c40e071a4cda tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] 10.222.0.78 "GET /compute/v2.1/images/a9df6c39-bc97-4bcd-9e28-1c5c4df5cd8e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.089698 May 19 08:30:05.893126 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1805/3130] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:30:05 2022] GET /compute/v2.1/images/a9df6c39-bc97-4bcd-9e28-1c5c4df5cd8e/metadata => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:05.899065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-39957125", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4494b8e8-8c17-4143-b0c2-bb4ba2649b30"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:06.060713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] validate_networks() for [('4494b8e8-8c17-4143-b0c2-bb4ba2649b30', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:30:06.676965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:30:06.677426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:30:06.677913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:30:06.678328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:30:06.678750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:30:06.709466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:06.709935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:06.716480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:06.716989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:06.782794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:06.802302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Getting quotas for user 62999389d3fa41fb98d9a31c298bbe8e and project 70755fb6ec1a4686ac33cbdb47b74207. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:06.848521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:30:06.856218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:30:06.990678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-504e8452-770b-4e44-95d0-ab4dfd397c20 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095838 May 19 08:30:06.992814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1806/3131] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:30:07.004119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:07.005162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:07.014149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:07.015080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:07.016375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:07.017938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:07.170341 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:30:07.173000 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:30:07.345354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:07.353625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a73dcc8-b8cc-40a4-8930-44ced45f7aa0 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1317 microversion: 2.1 time: 0.359102 May 19 08:30:07.354468 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1807/3132] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:06 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:07.475628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1902960768", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "03a0f0b1-07a8-4a6e-aa2e-f59034bae065"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:07.595748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] validate_networks() for [('03a0f0b1-07a8-4a6e-aa2e-f59034bae065', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:30:08.672454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:30:08.673033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:30:08.673381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:30:08.674144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:30:08.674725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:30:08.702732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:08.705100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:08.706282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:08.706842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:08.740909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Getting quotas for project f6318be9233846abaaf1bccca267113a. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:08.759133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Getting quotas for user 220de61761ab4460b48d94be38cd1886 and project f6318be9233846abaaf1bccca267113a. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:08.779410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Going to run 3 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:30:08.799002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:30:08.847226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=46021773-0fdc-4891-a5f4-058a0170e1f9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:30:08.887568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=dc94846a-cff3-4ee2-920a-9c3ab525a061,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:30:08.964360 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-237b68cd-32de-4bb2-9a52-37086dbe101e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605876 May 19 08:30:08.965631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1808/3133] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:30:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:30:08.971913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:08.973038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:08.981635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:08.982443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:08.983651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:08.984947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:09.196985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:09.208469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f17ff1cc-2aa9-4dae-b8a7-b19272741b9c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1460 microversion: 2.1 time: 0.241459 May 19 08:30:09.209982 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1809/3134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:08 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1460 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:09.226124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a63e10e7-9bda-422c-afe4-27db3f76fde4 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Action: 'update_all', calling method: .version_select at 0x7f321119b1f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:09.284257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a63e10e7-9bda-422c-afe4-27db3f76fde4 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] HTTP exception thrown: Image not found. May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a63e10e7-9bda-422c-afe4-27db3f76fde4 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Request method failure captured: May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/images/d5463f99-f421-4471-aae9-8f3bf770b29f/metadata HTTP/1.1 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 57 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAHw0YqlInzlwnPIEmPUXF_zYa85U8DxijIDyYB2fOds_1k0AiRFq-C3NzRqYMNsB-AJeaoFW5N9uOQ5cok57b80qaLozChG_5N5ArqizKUK410t05G-Kqqmx3FSFjfLjZ-YPXTki02wgLARuRq_jrafjBk0ebZkDfonQBCimRgMxU May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7497a415f2c47c882f0da91130133c0 May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'image_id': 'd5463f99-f421-4471-aae9-8f3bf770b29f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d5463f99-f421-4471-aae9-8f3bf770b29f May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:30:09.287853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d5463f99-f421-4471-aae9-8f3bf770b29f could not be found. May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:30:09.291998 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:09.300336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a63e10e7-9bda-422c-afe4-27db3f76fde4 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:09.301485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a63e10e7-9bda-422c-afe4-27db3f76fde4 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] 10.222.0.78 "PUT /compute/v2.1/images/d5463f99-f421-4471-aae9-8f3bf770b29f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.090111 May 19 08:30:09.302680 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1810/3135] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:30:09 2022] PUT /compute/v2.1/images/d5463f99-f421-4471-aae9-8f3bf770b29f/metadata => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:09.332569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:09.334335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:09.343190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:09.345051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:09.345899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:09.348160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:09.631209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:09.643271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb3297f8-968b-48df-bf49-0e30a700ba48 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1271 microversion: 2.1 time: 0.336518 May 19 08:30:09.656328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1811/3136] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:09 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1271 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:09.704966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bd7279c2-5815-4270-bcc1-b5235b275bb6 req-3474bd50-824f-4084-b83e-487eaaf71b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dafb0de6-d5a1-4cc2-9365-2309651bc29f", "tag": "faeafd9a-db49-4546-95f9-7612b6ba8741"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:09.732872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bd7279c2-5815-4270-bcc1-b5235b275bb6 req-3474bd50-824f-4084-b83e-487eaaf71b51 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:09.733459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bd7279c2-5815-4270-bcc1-b5235b275bb6 req-3474bd50-824f-4084-b83e-487eaaf71b51 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:09.765617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bd7279c2-5815-4270-bcc1-b5235b275bb6 req-3474bd50-824f-4084-b83e-487eaaf71b51 service nova] Creating event network-changed:faeafd9a-db49-4546-95f9-7612b6ba8741 for instance dafb0de6-d5a1-4cc2-9365-2309651bc29f on chh2-842464-2 May 19 08:30:09.774406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bd7279c2-5815-4270-bcc1-b5235b275bb6 req-3474bd50-824f-4084-b83e-487eaaf71b51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102742 May 19 08:30:09.775014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1812/3137] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:09.782084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:09.783383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:09.791021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:09.791483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:09.792275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:09.792714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:10.207315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:10.228099 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44b10c4f-ce0b-48c2-a695-603b9df08aa7 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1317 microversion: 2.1 time: 0.451658 May 19 08:30:10.239209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1813/3138] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:09 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:10.253859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:10.257363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:10.258228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:10.281034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:10.281618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:10.282707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:10.283220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:10.313883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:30:10.363684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Listed batch of 1 results from cell out of 997 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:30:10.412600 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c85c0222-c223-4f4d-8909-8dcbb0c8469d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.171316 May 19 08:30:10.414006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1814/3139] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:30:10 2022] GET /compute/v2.1/servers => generated 1018 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:10.419929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:10.421807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:10.431213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:10.432132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:10.433261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:10.434064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:11.296054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:11.329250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b99d5686-abe2-4be4-943e-3ad8210bc951 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.913715 May 19 08:30:11.338665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1815/3140] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:10 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:11.353933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d6ea511-2f23-4747-94dc-407a86a7a340 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Action: 'update', calling method: .version_select at 0x7f3211176700>, body: {"meta": {"os_distro": "alt"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:11.404055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3d6ea511-2f23-4747-94dc-407a86a7a340 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] HTTP exception thrown: Image not found. May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d6ea511-2f23-4747-94dc-407a86a7a340 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Request method failure captured: May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/images/83a32ed6-9ecb-4b0c-a844-73f3c718044c/metadata/os_distro HTTP/1.1 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 30 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAHw0YqlInzlwnPIEmPUXF_zYa85U8DxijIDyYB2fOds_1k0AiRFq-C3NzRqYMNsB-AJeaoFW5N9uOQ5cok57b80qaLozChG_5N5ArqizKUK410t05G-Kqqmx3FSFjfLjZ-YPXTki02wgLARuRq_jrafjBk0ebZkDfonQBCimRgMxU May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7497a415f2c47c882f0da91130133c0 May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: {"meta": {"os_distro": "alt"}} May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'image_id': '83a32ed6-9ecb-4b0c-a844-73f3c718044c', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83a32ed6-9ecb-4b0c-a844-73f3c718044c May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:30:11.408330 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83a32ed6-9ecb-4b0c-a844-73f3c718044c could not be found. May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:30:11.412469 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:11.421339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d6ea511-2f23-4747-94dc-407a86a7a340 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:11.421339 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d6ea511-2f23-4747-94dc-407a86a7a340 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] 10.222.0.78 "PUT /compute/v2.1/images/83a32ed6-9ecb-4b0c-a844-73f3c718044c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.080532 May 19 08:30:11.421339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1816/3141] 10.222.0.78 () {60 vars in 1309 bytes} [Thu May 19 08:30:11 2022] PUT /compute/v2.1/images/83a32ed6-9ecb-4b0c-a844-73f3c718044c/metadata/os_distro => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:11.428058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9d34f234-a88c-424c-86d7-ac970c741d0a req-d276af37-d3a4-445f-bfcd-2472d7c934dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae06d11d-0ef0-46ee-b50a-a8cc6cb97221", "name": "network-vif-plugged", "status": "completed", "tag": "20bae17f-760d-4671-8bb2-a6687a00b38e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:11.455728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9d34f234-a88c-424c-86d7-ac970c741d0a req-d276af37-d3a4-445f-bfcd-2472d7c934dc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:11.456289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9d34f234-a88c-424c-86d7-ac970c741d0a req-d276af37-d3a4-445f-bfcd-2472d7c934dc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:11.480703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9d34f234-a88c-424c-86d7-ac970c741d0a req-d276af37-d3a4-445f-bfcd-2472d7c934dc service nova] Creating event network-vif-plugged:20bae17f-760d-4671-8bb2-a6687a00b38e for instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 on chh2-842464-2 May 19 08:30:11.486200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9d34f234-a88c-424c-86d7-ac970c741d0a req-d276af37-d3a4-445f-bfcd-2472d7c934dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062162 May 19 08:30:11.487414 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1817/3142] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:11.494399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:11.495284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:11.502888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:11.503597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:11.504606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:11.505249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:11.757460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:11.778274 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ae9771c-fc03-4a22-a083-250158be6f34 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1275 microversion: 2.1 time: 0.286253 May 19 08:30:11.782908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1818/3143] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:11 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:11.804752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:11.807624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:11.820085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:11.820913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:11.822036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:11.822647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:12.370285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:12.412205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e53b0d67-7248-4199-96b5-aee6ae24f615 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.594238 May 19 08:30:12.413692 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1819/3144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:11 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:12.426452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:12.427724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:12.441264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:12.442797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:12.444001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:12.445412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:13.617559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:13.630616 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99da2717-200d-457c-9be2-361a0fcc3044 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1317 microversion: 2.1 time: 1.215219 May 19 08:30:13.634217 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1820/3145] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:12 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1317 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:13.646616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:13.647748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:13.658122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:13.658995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:13.659995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:13.660641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:14.282006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:14.296402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9feef2b-071f-453b-83a8-bd917ab0727b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.655927 May 19 08:30:14.309556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1821/3146] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:13 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:14.316881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dff5dc23-9a3b-4235-b2f7-cb9e8c731196 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Action: 'create', calling method: .version_select at 0x7f321485eaf0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:14.357034 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-dff5dc23-9a3b-4235-b2f7-cb9e8c731196 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] HTTP exception thrown: Image not found. May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dff5dc23-9a3b-4235-b2f7-cb9e8c731196 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Request method failure captured: May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/images/d7e2f3dd-573c-4d7b-af69-10dfce414674/metadata HTTP/1.1 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 57 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAHw0YqlInzlwnPIEmPUXF_zYa85U8DxijIDyYB2fOds_1k0AiRFq-C3NzRqYMNsB-AJeaoFW5N9uOQ5cok57b80qaLozChG_5N5ArqizKUK410t05G-Kqqmx3FSFjfLjZ-YPXTki02wgLARuRq_jrafjBk0ebZkDfonQBCimRgMxU May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/133aedff8a474a1aa7a7fa70b8afb537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 133aedff8a474a1aa7a7fa70b8afb537 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-478865922 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c7497a415f2c47c882f0da91130133c0 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-478865922-project May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'image_id': 'd7e2f3dd-573c-4d7b-af69-10dfce414674', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d7e2f3dd-573c-4d7b-af69-10dfce414674 May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:30:14.362033 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7e2f3dd-573c-4d7b-af69-10dfce414674 could not be found. May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:30:14.368808 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:14.380850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dff5dc23-9a3b-4235-b2f7-cb9e8c731196 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:14.382375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dff5dc23-9a3b-4235-b2f7-cb9e8c731196 tempest-ImagesMetadataNegativeTestJSON-478865922 tempest-ImagesMetadataNegativeTestJSON-478865922-project] 10.222.0.78 "POST /compute/v2.1/images/d7e2f3dd-573c-4d7b-af69-10dfce414674/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071336 May 19 08:30:14.389529 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1822/3147] 10.222.0.78 () {60 vars in 1280 bytes} [Thu May 19 08:30:14 2022] POST /compute/v2.1/images/d7e2f3dd-573c-4d7b-af69-10dfce414674/metadata => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:14.397614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:14.398494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:14.407719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:14.409934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:14.411943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:14.413078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:14.766705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:14.773509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:14.811588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80279486-68f1-4f63-8dd1-ff561ef1e283 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1281 microversion: 2.1 time: 0.419862 May 19 08:30:14.812662 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1823/3148] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:14 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1281 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:14.846338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:14.850533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:14.883124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:14.897240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:14.902357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:14.903007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:15.458215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:15.470183 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-045e8387-60c9-48ab-80a6-0fc439ef0dc9 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.656062 May 19 08:30:15.472909 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1824/3149] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:14 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:15.489253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:15.490014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:15.503113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:15.503566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:15.514367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:15.515276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:16.818712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:16.834122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c32357b5-e905-4221-9acf-bd70d1aa8ee6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 1.359693 May 19 08:30:16.834730 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1825/3150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:15 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:16.853884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:16.854571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:16.868648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:16.874228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:16.875744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:16.876416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:17.353133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:17.372084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-095ba65d-dbae-4bc5-aee0-c97284179d55 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1466 microversion: 2.1 time: 0.525012 May 19 08:30:17.386767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1826/3151] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:16 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1466 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:17.398204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b020d250-351d-4161-947a-2235726fd979 req-f0732bbc-2b75-4463-b9b7-c9bfa5a124a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86426fb8-31bf-427d-bfbf-8a1e09998692", "tag": "6fcafdb9-7048-4056-82fb-99468bb400e3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:17.413121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b020d250-351d-4161-947a-2235726fd979 req-f0732bbc-2b75-4463-b9b7-c9bfa5a124a5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:17.413895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b020d250-351d-4161-947a-2235726fd979 req-f0732bbc-2b75-4463-b9b7-c9bfa5a124a5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:17.435689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b020d250-351d-4161-947a-2235726fd979 req-f0732bbc-2b75-4463-b9b7-c9bfa5a124a5 service nova] Creating event network-changed:6fcafdb9-7048-4056-82fb-99468bb400e3 for instance 86426fb8-31bf-427d-bfbf-8a1e09998692 on chh1-842464-2 May 19 08:30:17.443483 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b020d250-351d-4161-947a-2235726fd979 req-f0732bbc-2b75-4463-b9b7-c9bfa5a124a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054522 May 19 08:30:17.445286 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1827/3152] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:17.460189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-003a3144-9e16-4284-8e6e-8fc573fdd115 req-a2d919a4-aaf6-4c72-92b6-5ecf91268df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc94846a-cff3-4ee2-920a-9c3ab525a061", "tag": "b25fa891-8461-4a7f-9422-654af9e00f9d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:17.472182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-003a3144-9e16-4284-8e6e-8fc573fdd115 req-a2d919a4-aaf6-4c72-92b6-5ecf91268df4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:17.473026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-003a3144-9e16-4284-8e6e-8fc573fdd115 req-a2d919a4-aaf6-4c72-92b6-5ecf91268df4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:17.504223 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-003a3144-9e16-4284-8e6e-8fc573fdd115 req-a2d919a4-aaf6-4c72-92b6-5ecf91268df4 service nova] Creating event network-changed:b25fa891-8461-4a7f-9422-654af9e00f9d for instance dc94846a-cff3-4ee2-920a-9c3ab525a061 on chh1-842464-2 May 19 08:30:17.564226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-003a3144-9e16-4284-8e6e-8fc573fdd115 req-a2d919a4-aaf6-4c72-92b6-5ecf91268df4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102479 May 19 08:30:17.565201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1828/3153] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:17.571666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:17.576690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:17.588688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:17.589452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:17.590640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:17.591290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:18.277648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:18.296173 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3820bc0c-4104-403a-b9a2-1dd422ba1650 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.729476 May 19 08:30:18.297146 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1829/3154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:17 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:18.301824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:18.310292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:18.332961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:18.333559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:18.341198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:18.342356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:18.702538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:18.719714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aeb698be-4271-415c-afab-413a08d739b5 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.421296 May 19 08:30:18.720585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1830/3155] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:18 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:18.733806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:18.735721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:18.742633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:18.743094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:18.743866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:18.744298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:18.769703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=23 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:19.126599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:19.147844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f1171db-0387-47b3-913f-a6f3eb84bb86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.425630 May 19 08:30:19.154659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1831/3156] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:18 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:19.160381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:19.161015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:19.174761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:19.175511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:19.176248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:19.176710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:19.619672 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-97bdb52d-4130-4365-8f0a-acb8bc4c07ae tempest-ServersOnMultiNodesTest-1084249221 tempest-ServersOnMultiNodesTest-1084249221-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1617 microversion: 2.1 time: 0.463544 May 19 08:30:19.633970 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1832/3157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:19 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1617 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:19.805764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8162a9f4-83ef-45a8-99fd-aa376785cb2a tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Action: 'create', calling method: .version_select at 0x7f32111d1430>, body: {"keypair": {"name": "tempest-keypair-2066384154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHutO9srOSsKqsMVGSU7gogTvcrlWMj9CuMromX0Ax311WGui3j0sT1YA9q4z6/HuusNYsyYcipQJEykTf0TlI8omTNyZaRcH3BWjg/mp2obrsRYl9nhMvDUPDRJ7RVs7A=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:19.832077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8162a9f4-83ef-45a8-99fd-aa376785cb2a tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:19.838523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8162a9f4-83ef-45a8-99fd-aa376785cb2a tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for user ce7e2b450d7c4ee2a82ec24dd63293a2 and project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:19.867013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:19.876365 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8162a9f4-83ef-45a8-99fd-aa376785cb2a tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239307 May 19 08:30:19.877799 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1833/3158] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:30:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:19.884233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:19.885286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:19.897010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:19.898215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:19.899364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:19.900182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:20.296237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:20.536900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:20.552658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05e28fe4-3109-49d0-91ae-ce65f0b2a689 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.668869 May 19 08:30:20.562843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1834/3159] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:19 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:20.570131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-59864760", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "6106690e-bca7-4255-9662-43648d2ed217"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:20.658757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] validate_networks() for [('6106690e-bca7-4255-9662-43648d2ed217', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:30:22.281578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:30:22.282286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:30:22.282472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:30:22.282886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:30:22.283293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:30:22.306873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.307419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:22.308099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.308535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:22.331574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:22.338877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Getting quotas for user 59f3ba2c06c045d6afccb1639ed8d083 and project b607e36aa42545dfb715c629002236ed. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:22.355481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:30:22.357917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:30:22.476284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db889379-89f0-4a70-b3b0-37c72a8e149d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918406 May 19 08:30:22.492521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1835/3160] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:30:22.497807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f1d2adf5-f552-4038-a6f7-9d842d58cfa6 req-e773c5a2-d108-48f5-8f88-c0995bb5d168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46021773-0fdc-4891-a5f4-058a0170e1f9", "tag": "189d292a-2be1-490c-b842-344d228ce329"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:22.542817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1d2adf5-f552-4038-a6f7-9d842d58cfa6 req-e773c5a2-d108-48f5-8f88-c0995bb5d168 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.543603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1d2adf5-f552-4038-a6f7-9d842d58cfa6 req-e773c5a2-d108-48f5-8f88-c0995bb5d168 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:22.585164 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f1d2adf5-f552-4038-a6f7-9d842d58cfa6 req-e773c5a2-d108-48f5-8f88-c0995bb5d168 service nova] Creating event network-changed:189d292a-2be1-490c-b842-344d228ce329 for instance 46021773-0fdc-4891-a5f4-058a0170e1f9 on chh2-842464-2 May 19 08:30:22.596352 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f1d2adf5-f552-4038-a6f7-9d842d58cfa6 req-e773c5a2-d108-48f5-8f88-c0995bb5d168 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101286 May 19 08:30:22.597516 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1836/3161] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:22.607631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:22.608493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:22.622418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.623129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:22.624071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.626721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:22.661372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:22.804531 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3805b24-822d-4666-af59-23232b8c1bd9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 204 len: 0 microversion: 2.1 time: 0.203461 May 19 08:30:22.805369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1837/3162] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:22 2022] DELETE /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:22.823001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:22.823713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:22.853024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.853544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:22.854368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:22.854805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:23.405446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:23.419415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-57718205-61e7-4074-92a7-28f6d05bc4ae tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.612928 May 19 08:30:23.427167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1838/3163] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:22 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:23.446432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b62f6c50-efd4-4636-b84b-537d8b1ecbdb tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f3211218f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:23.501460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b62f6c50-efd4-4636-b84b-537d8b1ecbdb tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-2066384154" status: 200 len: 498 microversion: 2.1 time: 0.069983 May 19 08:30:23.510136 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1839/3164] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:30:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2066384154 => generated 498 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:23.523883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ee232721-8f18-4909-b065-b9d6eb171871 req-22c3984d-ba72-43c3-839e-0f1dc6be348d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ed9f46-a07e-4af6-aebb-09e89e42700b", "tag": "c8e677ee-fe05-48ff-9de7-2b02584cf243"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:23.576252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ee232721-8f18-4909-b065-b9d6eb171871 req-22c3984d-ba72-43c3-839e-0f1dc6be348d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:23.581102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ee232721-8f18-4909-b065-b9d6eb171871 req-22c3984d-ba72-43c3-839e-0f1dc6be348d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:23.612404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ee232721-8f18-4909-b065-b9d6eb171871 req-22c3984d-ba72-43c3-839e-0f1dc6be348d service nova] Creating event network-changed:c8e677ee-fe05-48ff-9de7-2b02584cf243 for instance 17ed9f46-a07e-4af6-aebb-09e89e42700b on chh2-842464-2 May 19 08:30:23.625529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ee232721-8f18-4909-b065-b9d6eb171871 req-22c3984d-ba72-43c3-839e-0f1dc6be348d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112424 May 19 08:30:23.628008 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1840/3165] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:23.638495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:23.641236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:23.652527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:23.656160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:23.659890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:23.665904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:24.150217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:24.162444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d5256e2-e98f-4fea-8350-bb7d4ad7f4ae tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.532789 May 19 08:30:24.163074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1841/3166] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:23 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:24.178983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:24.181726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:24.200092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:24.200555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:24.201632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:24.202082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:24.465229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:24.494721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a5a589f-dc56-4c5a-a5a4-60e9d3662727 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1273 microversion: 2.1 time: 0.324873 May 19 08:30:24.496889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1842/3167] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:24 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1273 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:24.502373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a0a0bf6a-6938-45db-9354-ab9fcae2c3de req-7cd57ce9-df4c-4aed-8487-e745268afda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc94846a-cff3-4ee2-920a-9c3ab525a061", "name": "network-vif-plugged", "status": "completed", "tag": "b25fa891-8461-4a7f-9422-654af9e00f9d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:24.511799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a0a0bf6a-6938-45db-9354-ab9fcae2c3de req-7cd57ce9-df4c-4aed-8487-e745268afda6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:24.514467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a0a0bf6a-6938-45db-9354-ab9fcae2c3de req-7cd57ce9-df4c-4aed-8487-e745268afda6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:24.528411 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a0a0bf6a-6938-45db-9354-ab9fcae2c3de req-7cd57ce9-df4c-4aed-8487-e745268afda6 service nova] Creating event network-vif-plugged:b25fa891-8461-4a7f-9422-654af9e00f9d for instance dc94846a-cff3-4ee2-920a-9c3ab525a061 on chh1-842464-2 May 19 08:30:24.534973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a0a0bf6a-6938-45db-9354-ab9fcae2c3de req-7cd57ce9-df4c-4aed-8487-e745268afda6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 May 19 08:30:24.536246 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1843/3168] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:24.542769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:24.542973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:24.550518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:24.550973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:24.551765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:24.552205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:25.085338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:25.093090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:25.096504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b21a6e69-a882-4257-940d-b2dc01461cc2 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 200 len: 1472 microversion: 2.1 time: 0.559019 May 19 08:30:25.097094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1844/3169] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:24 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 1472 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:25.105415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4b81ece-65f8-48bc-b95b-0f1c31a26417 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f3211218940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:25.136168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4b81ece-65f8-48bc-b95b-0f1c31a26417 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066384154" status: 202 len: 0 microversion: 2.1 time: 0.037827 May 19 08:30:25.137419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1845/3170] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2066384154 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:25.143901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:25.145974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:25.153045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:25.153994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:25.155191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:25.156524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:26.099270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:26.119761 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:30:26.120333 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:30:26.124047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-453c2f97-5bde-4c97-8c41-d803209988a2 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.985162 May 19 08:30:26.124961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1846/3171] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:25 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:26.137575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d8b8e51-31e9-48b7-afb5-72208b638b50 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Action: 'create', calling method: .version_select at 0x7f3211a01160>, body: {"keypair": {"name": "tempest-keypair-1608538900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEJ/Zd/v0XlYnvCNZFzkfZoYZB/O6H4qFMc1dBZRLsS8u8W6BXlxLDkbe1T+OmuXri8LkR5O76zomrpAti7DziBMNlehQUXu5YEqLxmUuk3xF9FC/y73nvREoBOiHr0/Q=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:26.164176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5d8b8e51-31e9-48b7-afb5-72208b638b50 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:26.170825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5d8b8e51-31e9-48b7-afb5-72208b638b50 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for user ce7e2b450d7c4ee2a82ec24dd63293a2 and project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:26.200024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d8b8e51-31e9-48b7-afb5-72208b638b50 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073827 May 19 08:30:26.207449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1847/3172] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:30:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:26.215284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:26.215901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:26.232066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:26.237993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:26.238994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:26.240014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:27.063812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:27.110525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c0b647a-5769-4f67-b577-1d196cc2424d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.901445 May 19 08:30:27.111329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1848/3173] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:26 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:27.119574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:27.120454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:27.137140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:27.143197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:27.144966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:27.145718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:27.975483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:27.993699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be49e1bc-351e-4def-a5f1-0f33221f7bf4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 0.881039 May 19 08:30:27.995450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1849/3174] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:27 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:28.009047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:28.011833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: ae06d11d-0ef0-46ee-b50a-a8cc6cb97221] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:28.049893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.050293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.051085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.051526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.101443 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] HTTP exception thrown: Instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 could not be found. May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Request method failure captured: May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 HTTP/1.1 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9ao8YeOtI1439Uk0ZdgxO3uZ_rwyDZ8if3e9TJfucEA4NPF8I7KplTlLtE9VK2U1ciHQNj3JlkVMLnbjI95M0sZyzvv4_HuWjs_p85j0zdBz2dnLfARU28JiLDzZEF00mw_gYL2s7gal7nawOKAHxvgS4kuRTLB1SvrdmUqEsz6x8 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c1af603a8f2a4346b8f9482ae1b83ef3 May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 could not be found. May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ae06d11d-0ef0-46ee-b50a-a8cc6cb97221'} May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 could not be found. May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 could not be found. May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:28.105110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 could not be found. May 19 08:30:28.109937 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:28.114711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Returning 404 to user: Instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:28.115914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea02810f-807a-4181-9e32-a67a33d5cab8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221" status: 404 len: 111 microversion: 2.1 time: 0.119470 May 19 08:30:28.116820 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1850/3175] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:27 2022] GET /compute/v2.1/servers/ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:28.121970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d94ac29c-203a-465e-a698-9dc04a328787 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f321115ec10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:28.177293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d94ac29c-203a-465e-a698-9dc04a328787 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608538900" status: 202 len: 0 microversion: 2.1 time: 0.056948 May 19 08:30:28.179249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1851/3176] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:30:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608538900 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:28.204218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-82222855-6bf5-4891-ba1f-8b8039a21e13 req-87e79aff-e481-4809-a4c0-9fd60288909b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae06d11d-0ef0-46ee-b50a-a8cc6cb97221", "name": "network-vif-deleted", "tag": "20bae17f-760d-4671-8bb2-a6687a00b38e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:28.230709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-82222855-6bf5-4891-ba1f-8b8039a21e13 req-87e79aff-e481-4809-a4c0-9fd60288909b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.231161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-82222855-6bf5-4891-ba1f-8b8039a21e13 req-87e79aff-e481-4809-a4c0-9fd60288909b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.270556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-82222855-6bf5-4891-ba1f-8b8039a21e13 req-87e79aff-e481-4809-a4c0-9fd60288909b service nova] Creating event network-vif-deleted:20bae17f-760d-4671-8bb2-a6687a00b38e for instance ae06d11d-0ef0-46ee-b50a-a8cc6cb97221 on chh2-842464-2 May 19 08:30:28.294353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-82222855-6bf5-4891-ba1f-8b8039a21e13 req-87e79aff-e481-4809-a4c0-9fd60288909b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094969 May 19 08:30:28.296679 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1852/3177] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:28.306075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8fe1d5d5-86fa-4451-8939-3b9b60df56ca req-b59b4f75-8e16-4373-a860-c9cc48da8537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86426fb8-31bf-427d-bfbf-8a1e09998692", "name": "network-vif-plugged", "status": "completed", "tag": "6fcafdb9-7048-4056-82fb-99468bb400e3"}, {"server_uuid": "46021773-0fdc-4891-a5f4-058a0170e1f9", "name": "network-vif-plugged", "status": "completed", "tag": "189d292a-2be1-490c-b842-344d228ce329"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:28.323592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8fe1d5d5-86fa-4451-8939-3b9b60df56ca req-b59b4f75-8e16-4373-a860-c9cc48da8537 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.329080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8fe1d5d5-86fa-4451-8939-3b9b60df56ca req-b59b4f75-8e16-4373-a860-c9cc48da8537 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.361461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8fe1d5d5-86fa-4451-8939-3b9b60df56ca req-b59b4f75-8e16-4373-a860-c9cc48da8537 service nova] Creating event network-vif-plugged:6fcafdb9-7048-4056-82fb-99468bb400e3 for instance 86426fb8-31bf-427d-bfbf-8a1e09998692 on chh1-842464-2 May 19 08:30:28.362345 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8fe1d5d5-86fa-4451-8939-3b9b60df56ca req-b59b4f75-8e16-4373-a860-c9cc48da8537 service nova] Creating event network-vif-plugged:189d292a-2be1-490c-b842-344d228ce329 for instance 46021773-0fdc-4891-a5f4-058a0170e1f9 on chh2-842464-2 May 19 08:30:28.380152 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8fe1d5d5-86fa-4451-8939-3b9b60df56ca req-b59b4f75-8e16-4373-a860-c9cc48da8537 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080646 May 19 08:30:28.380985 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1853/3178] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:28.408487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:28.413760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:28.428779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.432102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.433464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.434081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.900536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:28.918479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f61ea19b-3c91-4385-8dbc-a83a977e2c1d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.535642 May 19 08:30:28.918479 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1854/3179] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:28 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:28.924061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:28.924820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:28.949028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.949813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:28.951552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:28.952152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:29.001343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:29.118226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06ab76c8-ba3e-4df7-b97d-4db1e392418f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 204 len: 0 microversion: 2.1 time: 0.198083 May 19 08:30:29.119636 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1855/3180] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:28 2022] DELETE /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:29.137846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:29.142727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:29.157544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:29.157999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:29.158793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:29.159232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:29.553436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:29.567864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f434a38f-3e87-47e6-90ff-6f39cc63342b tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.447551 May 19 08:30:29.568472 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1856/3181] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:29 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:29.590055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9dc23f77-f362-4d4e-bc5d-8fc59b28330f tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Action: 'create', calling method: .version_select at 0x7f321110d040>, body: {"keypair": {"name": "tempest-keypair-107030205", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:29.645560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9dc23f77-f362-4d4e-bc5d-8fc59b28330f tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:29.652529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9dc23f77-f362-4d4e-bc5d-8fc59b28330f tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for user ce7e2b450d7c4ee2a82ec24dd63293a2 and project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:29.725425 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9dc23f77-f362-4d4e-bc5d-8fc59b28330f tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.154822 May 19 08:30:29.726038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1857/3182] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:30:29 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:29.731265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:29.731889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:29.743320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:29.760354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:29.761197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:29.763630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:29.773040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:30.109848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:30.122641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dac1d5b4-fffc-4abc-a91e-fbd155ad07ae tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 0.394527 May 19 08:30:30.127062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1858/3183] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:29 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:30.140520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:30.141239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:30.159058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:30.159522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:30.160543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:30.161150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:30.500876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:30.511753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec7cb2fc-707e-4d55-a5f9-cf39f3bbebae tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1471 microversion: 2.1 time: 0.382322 May 19 08:30:30.511753 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1859/3184] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:30 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:30.519420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c68d79f-d9bd-45c8-856d-a98e0f296e2d tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f32111eb1f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:30.545086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c68d79f-d9bd-45c8-856d-a98e0f296e2d tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107030205" status: 202 len: 0 microversion: 2.1 time: 0.032378 May 19 08:30:30.547526 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1860/3185] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107030205 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:30.583986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:30.585024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:30.603752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:30.604510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:30.605536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:30.606142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:30.920923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:30.929989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25de1910-52f0-4695-80cc-d84956c82494 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1313 microversion: 2.1 time: 0.380937 May 19 08:30:30.936029 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1861/3186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:30 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:30.942376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-29bca5ce-450f-4b01-87ba-f1242159ef2c req-b8f0da3d-8637-4f27-9e6d-70ecf132fd0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ad4c36-79d1-48bc-ab62-99ef48cbb72b", "tag": "9039bcd7-9044-46b2-bf3d-931f15eb34af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:30.995016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29bca5ce-450f-4b01-87ba-f1242159ef2c req-b8f0da3d-8637-4f27-9e6d-70ecf132fd0b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:30.995481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29bca5ce-450f-4b01-87ba-f1242159ef2c req-b8f0da3d-8637-4f27-9e6d-70ecf132fd0b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:31.057686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-29bca5ce-450f-4b01-87ba-f1242159ef2c req-b8f0da3d-8637-4f27-9e6d-70ecf132fd0b service nova] Creating event network-changed:9039bcd7-9044-46b2-bf3d-931f15eb34af for instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b on chh1-842464-2 May 19 08:30:31.072360 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-29bca5ce-450f-4b01-87ba-f1242159ef2c req-b8f0da3d-8637-4f27-9e6d-70ecf132fd0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131710 May 19 08:30:31.079752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1862/3187] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:31.087375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e77b69ca-11f8-46b1-95ef-30638401f764 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Action: 'create', calling method: .version_select at 0x7f321121b430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-700544306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr+lEMr7qvhRCU9AvwLbCJ+A9ZuvEir2cTTXy9n3IHh6/k4jgIwWuqouerkHzhNW9Yf1idmmMlzVaZUuQTVOk33AcBigUhPDM+Mxf9V6uZdjE2/6frTD+X+kBMzWuebcg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:31.112889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e77b69ca-11f8-46b1-95ef-30638401f764 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:31.120310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e77b69ca-11f8-46b1-95ef-30638401f764 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for user ce7e2b450d7c4ee2a82ec24dd63293a2 and project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:31.167180 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e77b69ca-11f8-46b1-95ef-30638401f764 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.083221 May 19 08:30:31.176882 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1863/3188] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:30:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:31.179818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:31.180573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:31.200232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:31.202655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:31.203971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:31.204838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:31.575029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:31.594325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3c0a6f2-3762-491e-a34f-a783b2264ca7 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.422185 May 19 08:30:31.595314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1864/3189] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:31 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:31.607629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:31.609510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:31.623731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:31.630385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:31.638882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:31.639342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:32.225684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:32.236269 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf57730a-c2c2-4263-84d2-14c6bbd512b4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 0.639572 May 19 08:30:32.237508 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1865/3190] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:31 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:32.243909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07c4000d-34cf-4d4f-974f-1e4644023b7d tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Action: 'create', calling method: .version_select at 0x7f3211176dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1076521811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARATPPSYQmmq6jZQPJNlR+VmBQ5Zy5fdebe/2SF3OQBMDXjr8rlijguF3f5anKP8UbyTkh14dcA1FF4KUl3e/D118d0JENPd1ebzzMr477sYpqNdZJv7YisnHLkj9LICA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:32.274976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-07c4000d-34cf-4d4f-974f-1e4644023b7d tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:32.282881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-07c4000d-34cf-4d4f-974f-1e4644023b7d tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for user ce7e2b450d7c4ee2a82ec24dd63293a2 and project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:32.322822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:32.349325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07c4000d-34cf-4d4f-974f-1e4644023b7d tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.109232 May 19 08:30:32.351412 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1866/3191] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:30:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:32.362376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:32.363547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:32.391522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:32.392634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:32.394634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:32.395452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:32.739442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:32.760844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fdb1cf35-98f3-432a-91c9-33dcebcae87f tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 200 len: 1471 microversion: 2.1 time: 0.408080 May 19 08:30:32.762020 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1867/3192] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:32 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:32.770248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:32.776097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:32.798582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:32.799043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:32.799878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:32.800327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:33.222345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:33.248526 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ce18a8e-c673-4a66-a430-60d7599bf140 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1496 microversion: 2.1 time: 0.485157 May 19 08:30:33.271631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1868/3193] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:32 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1496 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:33.303804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78bcc07c-6053-41bc-920f-4fb0ef4854b1 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Action: 'create', calling method: .version_select at 0x7f3217a919d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2101464638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCATtm+iw5rlTdMgA8BV1tse8MlvD88TienPO46AikfhbNJnoEFbQpTqsc7L3eTUDfQrCL23K8E7SpFtcYwCZ5ku44bB5a6xvRg58Nz6JGOhXiGLrj+Cb6O7Ut1otPlkAg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:33.379758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-78bcc07c-6053-41bc-920f-4fb0ef4854b1 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:33.407978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-78bcc07c-6053-41bc-920f-4fb0ef4854b1 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Getting quotas for user ce7e2b450d7c4ee2a82ec24dd63293a2 and project 15f483dcac3041a1a64bf90ca20be262. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:33.480784 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78bcc07c-6053-41bc-920f-4fb0ef4854b1 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.207320 May 19 08:30:33.493756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1869/3194] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:30:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:33.508125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d52e928d-e7fd-4029-a2d0-ef150abae761 req-f196fbc1-fc25-4de3-95a0-00d90126008a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ed9f46-a07e-4af6-aebb-09e89e42700b", "name": "network-vif-plugged", "status": "completed", "tag": "c8e677ee-fe05-48ff-9de7-2b02584cf243"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:33.523579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d52e928d-e7fd-4029-a2d0-ef150abae761 req-f196fbc1-fc25-4de3-95a0-00d90126008a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:33.525936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d52e928d-e7fd-4029-a2d0-ef150abae761 req-f196fbc1-fc25-4de3-95a0-00d90126008a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:33.542879 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d52e928d-e7fd-4029-a2d0-ef150abae761 req-f196fbc1-fc25-4de3-95a0-00d90126008a service nova] Creating event network-vif-plugged:c8e677ee-fe05-48ff-9de7-2b02584cf243 for instance 17ed9f46-a07e-4af6-aebb-09e89e42700b on chh2-842464-2 May 19 08:30:33.554486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d52e928d-e7fd-4029-a2d0-ef150abae761 req-f196fbc1-fc25-4de3-95a0-00d90126008a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059011 May 19 08:30:33.565796 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1870/3195] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:33.586498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:33.587600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:33.607224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:33.616683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:33.618754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:33.619684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:33.702104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:34.148818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:34.164325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4dba8bd5-0273-4c24-b3af-b10f40fb5f20 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1323 microversion: 2.1 time: 0.596493 May 19 08:30:34.185441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1871/3196] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:33 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1323 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:34.198255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:34.198880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:34.211546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:34.212248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:34.213414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:34.216824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.218963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:35.227441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff7c8545-38bf-46a6-aedf-c09f20c76361 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 1.039180 May 19 08:30:35.234790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1872/3197] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:34 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:35.244455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:35.245384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:35.260541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.263930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.265213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.266264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.333783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lazy-loading 'flavor' on Instance uuid 86426fb8-31bf-427d-bfbf-8a1e09998692 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:30:35.568624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c3ef3f2-08c0-4d5a-9848-5bebb43dcb7d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "POST /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692/action" status: 202 len: 0 microversion: 2.1 time: 0.329124 May 19 08:30:35.578047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1873/3198] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:30:35 2022] POST /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:35.595469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9a1a4ae7-2034-4dc1-ac10-8d825cc9b939 req-3a41f95b-0887-4a26-b6ba-f4fe4f224da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d4133c-882c-4849-a7ba-512ca78d677d", "name": "network-vif-deleted", "tag": "f1a7b20f-7d85-447b-b144-27b6e41bfb14"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:35.609260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9a1a4ae7-2034-4dc1-ac10-8d825cc9b939 req-3a41f95b-0887-4a26-b6ba-f4fe4f224da2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.610205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9a1a4ae7-2034-4dc1-ac10-8d825cc9b939 req-3a41f95b-0887-4a26-b6ba-f4fe4f224da2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.628091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9a1a4ae7-2034-4dc1-ac10-8d825cc9b939 req-3a41f95b-0887-4a26-b6ba-f4fe4f224da2 service nova] Creating event network-vif-deleted:f1a7b20f-7d85-447b-b144-27b6e41bfb14 for instance 38d4133c-882c-4849-a7ba-512ca78d677d on chh1-842464-2 May 19 08:30:35.634038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9a1a4ae7-2034-4dc1-ac10-8d825cc9b939 req-3a41f95b-0887-4a26-b6ba-f4fe4f224da2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051400 May 19 08:30:35.635442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1874/3199] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:35.649437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-695f4144-f62d-4477-817a-4e5d13967aa0 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f3217a87550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:35.653680 chdv-842464-2 devstack@n-api.service[119072]: WARNING oslo_db.sqlalchemy.utils [None req-695f4144-f62d-4477-817a-4e5d13967aa0 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 08:30:35.662381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-695f4144-f62d-4477-817a-4e5d13967aa0 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.024416 May 19 08:30:35.663601 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1875/3200] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:30:35 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:35.670571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:35.671724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 38d4133c-882c-4849-a7ba-512ca78d677d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:35.680980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.681861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.683133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.684153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.709563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] HTTP exception thrown: Instance 38d4133c-882c-4849-a7ba-512ca78d677d could not be found. May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Request method failure captured: May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d HTTP/1.1 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9ao8YeOtI1439Uk0ZdgxO3uZ_rwyDZ8if3e9TJfucEA4NPF8I7KplTlLtE9VK2U1ciHQNj3JlkVMLnbjI95M0sZyzvv4_HuWjs_p85j0zdBz2dnLfARU28JiLDzZEF00mw_gYL2s7gal7nawOKAHxvgS4kuRTLB1SvrdmUqEsz6x8 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c1af603a8f2a4346b8f9482ae1b83ef3 May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 38d4133c-882c-4849-a7ba-512ca78d677d could not be found. May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '38d4133c-882c-4849-a7ba-512ca78d677d'} May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d4133c-882c-4849-a7ba-512ca78d677d could not be found. May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d4133c-882c-4849-a7ba-512ca78d677d could not be found. May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:35.711919 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d4133c-882c-4849-a7ba-512ca78d677d could not be found. May 19 08:30:35.716416 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:35.716997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Returning 404 to user: Instance 38d4133c-882c-4849-a7ba-512ca78d677d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:35.717747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db547f89-c60c-4633-896a-732d44c0d192 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d" status: 404 len: 111 microversion: 2.1 time: 0.052995 May 19 08:30:35.721590 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1876/3201] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:35 2022] GET /compute/v2.1/servers/38d4133c-882c-4849-a7ba-512ca78d677d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:35.730725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:35.731956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:35.740068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.741032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:35.743248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:35.743708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:36.196425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:36.210074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52ba0eca-13ea-4289-8951-892b2751cc09 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 200 len: 1516 microversion: 2.1 time: 0.488612 May 19 08:30:36.215483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1877/3202] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:35 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 1516 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:36.220985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:36.228652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:36.238000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:36.239777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:36.241645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:36.242255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:36.482137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:36.497758 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5de649c-6582-45d7-96e8-8d81f7bc9960 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1487 microversion: 2.1 time: 0.278516 May 19 08:30:36.500539 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1878/3203] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:36 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1487 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:36.521599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a77d334-38c7-49e2-b7e8-842bca239bc6 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f3217a91670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:36.565496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a77d334-38c7-49e2-b7e8-842bca239bc6 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2101464638" status: 202 len: 0 microversion: 2.1 time: 0.057098 May 19 08:30:36.574186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1879/3204] 10.222.0.78 () {58 vars in 1277 bytes} [Thu May 19 08:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2101464638 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:36.588447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:36.593812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:36.622867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:36.623372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:36.630990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:36.631580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:36.728244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:37.064641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d3c222b-d471-4c2d-b829-7c8969ebc66c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 204 len: 0 microversion: 2.1 time: 0.488455 May 19 08:30:37.065966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1880/3205] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:36 2022] DELETE /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:37.072576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:37.079643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:37.100558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:37.101142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:37.105205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:37.106097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:37.519078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:37.534779 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39967097-97c6-43ad-9d45-27a21211a472 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061" status: 200 len: 1516 microversion: 2.1 time: 0.466862 May 19 08:30:37.538552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1881/3206] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:37 2022] GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061 => generated 1516 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:37.556122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:37.557295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:37.578139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:37.579189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:37.583122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:37.583597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:38.228853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:38.255708 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6d91578-4ae1-433a-90f7-a056c458be2d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 0.715171 May 19 08:30:38.276415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1882/3207] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:37 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:38.310138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:38.312583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:38.349492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:38.351370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:38.352227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:38.357493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:38.444169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:38.674949 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-675fb6c7-7d3f-436b-805e-0e68ac50c189 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 204 len: 0 microversion: 2.1 time: 0.397144 May 19 08:30:38.679331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1883/3208] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:38 2022] DELETE /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:38.695764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60dd861a-55e4-41de-8653-127b79c17743 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f32111c9550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:38.727847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:38.748410 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60dd861a-55e4-41de-8653-127b79c17743 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1076521811" status: 202 len: 0 microversion: 2.1 time: 0.065033 May 19 08:30:38.753797 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1884/3209] 10.222.0.78 () {58 vars in 1277 bytes} [Thu May 19 08:30:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1076521811 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:38.758266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:38.759034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:38.769542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:38.775191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:38.779178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:38.779568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:39.393516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:39.407915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a13811e1-e876-4503-8884-a3b4686e97a6 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 200 len: 1471 microversion: 2.1 time: 0.654579 May 19 08:30:39.410255 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1885/3210] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:38 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:39.416262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:39.417061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:39.440949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:39.442889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:39.443752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:39.444203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:39.902519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:39.917981 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-408a74c4-0eeb-499e-b225-fe880fda61ea tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 200 len: 1517 microversion: 2.1 time: 0.506332 May 19 08:30:39.918606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1886/3211] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:39 2022] GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 1517 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:39.934806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:39.935436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:39.949538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:39.949957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:39.950869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:39.951617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:39.971580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:40.463205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62999389d3fa41fb98d9a31c298bbe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70755fb6ec1a4686ac33cbdb47b74207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:40.475774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e9dc91e-2dac-4ce3-ba58-5a9e760663fc tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 200 len: 1493 microversion: 2.1 time: 0.554973 May 19 08:30:40.479328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1887/3212] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:39 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 1493 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:40.505079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb228b52-dc07-4c2b-8693-77170d86c4b2 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] Calling method '.version_select at 0x7f3211218a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:40.558283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb228b52-dc07-4c2b-8693-77170d86c4b2 tempest-KeyPairsV2TestJSON-648153462 tempest-KeyPairsV2TestJSON-648153462-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-700544306" status: 202 len: 0 microversion: 2.1 time: 0.074695 May 19 08:30:40.565554 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1888/3213] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:30:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-700544306 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:40.583184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:40.584209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:40.611422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:40.612392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:40.614757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:40.615420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:42.980053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:42.999906 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62571d2a-d8d1-498c-99db-b2d5e1e254f1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 2.428846 May 19 08:30:43.001439 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1889/3214] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:40 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:43.018214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:43.019192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:43.059569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.077607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:43.083261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.087230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:43.167356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:43.310188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-57b374b3-0aac-4f24-9519-ae77e8c5ab96 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "DELETE /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 204 len: 0 microversion: 2.1 time: 0.306311 May 19 08:30:43.311203 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1890/3215] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:43 2022] DELETE /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:43.422221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=30 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:43.684492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8ccff1d0-5a4b-432d-9fa8-73af0bdf700d req-cac79964-6225-42f6-82c2-d9a3eff66c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7d5889-0535-45b4-b298-6d8d739e58f3", "name": "network-vif-deleted", "tag": "586e1b22-3765-411d-bffd-aef2714085a1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:43.742426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8ccff1d0-5a4b-432d-9fa8-73af0bdf700d req-cac79964-6225-42f6-82c2-d9a3eff66c3c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.745892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8ccff1d0-5a4b-432d-9fa8-73af0bdf700d req-cac79964-6225-42f6-82c2-d9a3eff66c3c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:43.783790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8ccff1d0-5a4b-432d-9fa8-73af0bdf700d req-cac79964-6225-42f6-82c2-d9a3eff66c3c service nova] Creating event network-vif-deleted:586e1b22-3765-411d-bffd-aef2714085a1 for instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 on chh1-842464-2 May 19 08:30:43.795085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8ccff1d0-5a4b-432d-9fa8-73af0bdf700d req-cac79964-6225-42f6-82c2-d9a3eff66c3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.482010 May 19 08:30:43.800484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1891/3216] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:43.821466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:43.822438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 9c7d5889-0535-45b4-b298-6d8d739e58f3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:43.845980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.846363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:43.847215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.847611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:43.927877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] HTTP exception thrown: Instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 could not be found. May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Request method failure captured: May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 HTTP/1.1 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9ao8YeOtI1439Uk0ZdgxO3uZ_rwyDZ8if3e9TJfucEA4NPF8I7KplTlLtE9VK2U1ciHQNj3JlkVMLnbjI95M0sZyzvv4_HuWjs_p85j0zdBz2dnLfARU28JiLDzZEF00mw_gYL2s7gal7nawOKAHxvgS4kuRTLB1SvrdmUqEsz6x8 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c1af603a8f2a4346b8f9482ae1b83ef3 May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 could not be found. May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9c7d5889-0535-45b4-b298-6d8d739e58f3'} May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 could not be found. May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 could not be found. May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:43.929544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 could not be found. May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Returning 404 to user: Instance 9c7d5889-0535-45b4-b298-6d8d739e58f3 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:43.933753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1049ee29-d7ce-410d-b336-071a20300be4 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3" status: 404 len: 111 microversion: 2.1 time: 0.129079 May 19 08:30:43.934769 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1892/3217] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:43 2022] GET /compute/v2.1/servers/9c7d5889-0535-45b4-b298-6d8d739e58f3 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:43.951616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:43.952948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:43.994183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.994799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:43.995478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:43.995925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:44.041224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 HTTP/1.1 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '86426fb8-31bf-427d-bfbf-8a1e09998692'} May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:44.051173 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:44.055321 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:44.058393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:44.062566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31f8bfaa-5e5a-464f-a661-8dccb283ea6d tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 404 len: 111 microversion: 2.1 time: 0.126251 May 19 08:30:44.063458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1893/3218] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:43 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:44.089782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-96afc914-c8aa-422c-95f2-2f7c878e4ed2 req-18286495-d844-4aa7-9706-7db700ea39ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86426fb8-31bf-427d-bfbf-8a1e09998692", "name": "network-vif-deleted", "tag": "6fcafdb9-7048-4056-82fb-99468bb400e3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:44.142594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-96afc914-c8aa-422c-95f2-2f7c878e4ed2 req-18286495-d844-4aa7-9706-7db700ea39ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:44.146469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-96afc914-c8aa-422c-95f2-2f7c878e4ed2 req-18286495-d844-4aa7-9706-7db700ea39ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:44.257020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-96afc914-c8aa-422c-95f2-2f7c878e4ed2 req-18286495-d844-4aa7-9706-7db700ea39ee service nova] Creating event network-vif-deleted:6fcafdb9-7048-4056-82fb-99468bb400e3 for instance 86426fb8-31bf-427d-bfbf-8a1e09998692 on chh1-842464-2 May 19 08:30:44.286209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-96afc914-c8aa-422c-95f2-2f7c878e4ed2 req-18286495-d844-4aa7-9706-7db700ea39ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218498 May 19 08:30:44.292974 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1894/3219] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:44.329884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:44.337619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:44.350189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:44.356849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:44.360396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:44.363244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:44.895442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:44.904666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8cf612bf-3cef-4c3f-baad-a8b66fd49cdd tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 200 len: 1523 microversion: 2.1 time: 0.600765 May 19 08:30:44.910182 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1895/3220] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:44 2022] GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:44.922932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9052f52d-5d70-4e40-b47f-eb88016860f3 req-35caba3c-dda1-4732-ba9d-f44e088908e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ad4c36-79d1-48bc-ab62-99ef48cbb72b", "name": "network-vif-plugged", "status": "completed", "tag": "9039bcd7-9044-46b2-bf3d-931f15eb34af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:44.943781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9052f52d-5d70-4e40-b47f-eb88016860f3 req-35caba3c-dda1-4732-ba9d-f44e088908e9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:44.947932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9052f52d-5d70-4e40-b47f-eb88016860f3 req-35caba3c-dda1-4732-ba9d-f44e088908e9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:44.986794 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9052f52d-5d70-4e40-b47f-eb88016860f3 req-35caba3c-dda1-4732-ba9d-f44e088908e9 service nova] Creating event network-vif-plugged:9039bcd7-9044-46b2-bf3d-931f15eb34af for instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b on chh1-842464-2 May 19 08:30:45.001334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9052f52d-5d70-4e40-b47f-eb88016860f3 req-35caba3c-dda1-4732-ba9d-f44e088908e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086682 May 19 08:30:45.005844 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1896/3221] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:45.028812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:45.047678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:45.070279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:45.074594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:45.075142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:45.075616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:45.181130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:45.402876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c1042ff7-4f6d-412a-adce-00738a6769dc tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9" status: 204 len: 0 microversion: 2.1 time: 0.385956 May 19 08:30:45.404733 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1897/3222] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:45 2022] DELETE /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:45.425700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:45.428576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:45.451587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:45.451587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:45.453674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:45.454153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.123564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:46.188684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99f3c49e-46f1-4c87-b182-19c60b6950bb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 0.768154 May 19 08:30:46.189716 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1898/3223] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:45 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:46.194824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:46.212217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:46.221750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:46.222578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.223623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:46.224333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.295074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 HTTP/1.1 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '86426fb8-31bf-427d-bfbf-8a1e09998692'} May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:46.317445 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:46.322191 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:46.326882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:46.328723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b604277-c61f-48bd-ab21-c57ca8ee6479 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 404 len: 111 microversion: 2.1 time: 0.137760 May 19 08:30:46.330606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1899/3224] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:46 2022] DELETE /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:46.338753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:46.341152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:46.371063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:46.372093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.377723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:46.378438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.447025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:46.703731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4387f9e4-a79f-4868-90b4-3ce7810b208a tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 204 len: 0 microversion: 2.1 time: 0.370685 May 19 08:30:46.709052 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1900/3225] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:46 2022] DELETE /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:46.732827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:46.740318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:46.759143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:46.760006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.768971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:46.770272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:46.956921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:46.968154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f95d20cc-d309-41e7-bdb5-baeb63c7c8e3 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 200 len: 1481 microversion: 2.1 time: 0.255360 May 19 08:30:46.973656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1901/3226] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:46 2022] GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 1481 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:46.978577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:46.979195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 86426fb8-31bf-427d-bfbf-8a1e09998692] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:47.006164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.010080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.011644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.012099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.057788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 HTTP/1.1 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '86426fb8-31bf-427d-bfbf-8a1e09998692'} May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:47.060171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.064450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 86426fb8-31bf-427d-bfbf-8a1e09998692 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:47.066934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dae26f9b-81f4-4cf2-8d9c-7127e69d4946 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692" status: 404 len: 111 microversion: 2.1 time: 0.086934 May 19 08:30:47.067800 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1902/3227] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:46 2022] GET /compute/v2.1/servers/86426fb8-31bf-427d-bfbf-8a1e09998692 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:47.075454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:47.081629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:47.100402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.100850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.101875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.102586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.439762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:47.466900 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9f18b9c-49fa-40a9-829f-eb2cfe7e8fb9 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9" status: 200 len: 1474 microversion: 2.1 time: 0.386695 May 19 08:30:47.471907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1903/3228] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:47 2022] GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9 => generated 1474 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:47.502203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:47.505634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:47.521880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.522920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.523706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.524318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.554266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 HTTP/1.1 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a83e0ff3-7651-419d-8b47-3eba50771c47'} May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:47.557271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:47.562022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:47.562852 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31b26b5d-ce1c-47f9-b7a1-0277c9bdfcff tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 404 len: 111 microversion: 2.1 time: 0.088507 May 19 08:30:47.564535 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1904/3229] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:47 2022] DELETE /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:47.572411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cbf783e0-07b5-4724-bc1a-767fe5f87ea0 req-740ff148-0daf-4bad-a6ea-e76301dd9b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46021773-0fdc-4891-a5f4-058a0170e1f9", "name": "network-vif-deleted", "tag": "189d292a-2be1-490c-b842-344d228ce329"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:47.583177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cbf783e0-07b5-4724-bc1a-767fe5f87ea0 req-740ff148-0daf-4bad-a6ea-e76301dd9b4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.583727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cbf783e0-07b5-4724-bc1a-767fe5f87ea0 req-740ff148-0daf-4bad-a6ea-e76301dd9b4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.588346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:47.617281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cbf783e0-07b5-4724-bc1a-767fe5f87ea0 req-740ff148-0daf-4bad-a6ea-e76301dd9b4e service nova] Creating event network-vif-deleted:189d292a-2be1-490c-b842-344d228ce329 for instance 46021773-0fdc-4891-a5f4-058a0170e1f9 on chh2-842464-2 May 19 08:30:47.622679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cbf783e0-07b5-4724-bc1a-767fe5f87ea0 req-740ff148-0daf-4bad-a6ea-e76301dd9b4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056493 May 19 08:30:47.623677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1905/3230] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:47.629481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:47.630432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:47.640888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.641641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:47.642737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:47.643369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.050935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:48.068226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7affb5a9-712e-4cc1-89be-afa7ca23fccf tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1313 microversion: 2.1 time: 0.440853 May 19 08:30:48.069805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1906/3231] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:47 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:48.488446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55c82ab2-a382-4480-92cb-08e21eae6b4c tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Calling method '.version_select at 0x7f3217a87c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:48.515921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55c82ab2-a382-4480-92cb-08e21eae6b4c tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.517069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55c82ab2-a382-4480-92cb-08e21eae6b4c tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.523810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55c82ab2-a382-4480-92cb-08e21eae6b4c tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.526007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55c82ab2-a382-4480-92cb-08e21eae6b4c tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.576827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55c82ab2-a382-4480-92cb-08e21eae6b4c tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.505203 May 19 08:30:48.579209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1907/3232] 10.222.0.78 () {58 vars in 1121 bytes} [Thu May 19 08:30:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:48.586665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:48.587805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: a83e0ff3-7651-419d-8b47-3eba50771c47] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:48.597345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.598072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.599086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.599748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.620809 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 HTTP/1.1 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a83e0ff3-7651-419d-8b47-3eba50771c47'} May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:48.622566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance a83e0ff3-7651-419d-8b47-3eba50771c47 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbc5569c-33a7-47b1-8bbc-f71a9dd0f12a tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47" status: 404 len: 111 microversion: 2.1 time: 0.043581 May 19 08:30:48.627814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1908/3233] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:48 2022] GET /compute/v2.1/servers/a83e0ff3-7651-419d-8b47-3eba50771c47 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:48.631057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:48.631540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:48.637851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.638300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.639082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.640068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:48.773854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lazy-loading 'services' on Instance uuid f18755da-8568-40c8-8b0a-8acbd13e904e {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:30:48.951062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdf95c24-6146-4096-a281-bc65cc6cf71d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e/os-volume_attachments/96e5930a-7445-41ea-ac9f-5a6f8a9d18c9" status: 202 len: 0 microversion: 2.1 time: 0.324663 May 19 08:30:48.952075 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1909/3234] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:30:48 2022] DELETE /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e/os-volume_attachments/96e5930a-7445-41ea-ac9f-5a6f8a9d18c9 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:48.966440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5e959f91-26ae-47d3-a15f-e6f73af45e28 req-10388087-345c-4eb7-8712-e0208b3758ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28af06b6-ca87-4251-a89f-4a9e965773a9", "name": "network-vif-deleted", "tag": "615f1818-087f-4c6b-91d5-85d6bc2b9d85"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:48.988080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5e959f91-26ae-47d3-a15f-e6f73af45e28 req-10388087-345c-4eb7-8712-e0208b3758ed service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:48.988527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5e959f91-26ae-47d3-a15f-e6f73af45e28 req-10388087-345c-4eb7-8712-e0208b3758ed service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.016372 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5e959f91-26ae-47d3-a15f-e6f73af45e28 req-10388087-345c-4eb7-8712-e0208b3758ed service nova] Creating event network-vif-deleted:615f1818-087f-4c6b-91d5-85d6bc2b9d85 for instance 28af06b6-ca87-4251-a89f-4a9e965773a9 on chh2-842464-2 May 19 08:30:49.025768 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5e959f91-26ae-47d3-a15f-e6f73af45e28 req-10388087-345c-4eb7-8712-e0208b3758ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070787 May 19 08:30:49.028032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1910/3235] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:49.038174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:49.039059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:49.058126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:49.058611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.059515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:49.059998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.096526 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] HTTP exception thrown: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 HTTP/1.1 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '46021773-0fdc-4891-a5f4-058a0170e1f9'} May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.104938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:49.110468 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.112585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 404 to user: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:49.113773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0587ea8-f871-43cd-a251-aaea289e3445 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 404 len: 111 microversion: 2.1 time: 0.084388 May 19 08:30:49.118927 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1911/3236] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:49 2022] GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:49.129573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:49.133206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 28af06b6-ca87-4251-a89f-4a9e965773a9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:49.146519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:49.149609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.150694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:49.151259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.183850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] HTTP exception thrown: Instance 28af06b6-ca87-4251-a89f-4a9e965773a9 could not be found. May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Request method failure captured: May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9 HTTP/1.1 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9ao8YeOtI1439Uk0ZdgxO3uZ_rwyDZ8if3e9TJfucEA4NPF8I7KplTlLtE9VK2U1ciHQNj3JlkVMLnbjI95M0sZyzvv4_HuWjs_p85j0zdBz2dnLfARU28JiLDzZEF00mw_gYL2s7gal7nawOKAHxvgS4kuRTLB1SvrdmUqEsz6x8 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c1af603a8f2a4346b8f9482ae1b83ef3 May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 28af06b6-ca87-4251-a89f-4a9e965773a9 could not be found. May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '28af06b6-ca87-4251-a89f-4a9e965773a9'} May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28af06b6-ca87-4251-a89f-4a9e965773a9 could not be found. May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28af06b6-ca87-4251-a89f-4a9e965773a9 could not be found. May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.185493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28af06b6-ca87-4251-a89f-4a9e965773a9 could not be found. May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Returning 404 to user: Instance 28af06b6-ca87-4251-a89f-4a9e965773a9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e904cd9-480d-4434-b814-b861e7944b91 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9" status: 404 len: 111 microversion: 2.1 time: 0.067442 May 19 08:30:49.191619 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1912/3237] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:49 2022] GET /compute/v2.1/servers/28af06b6-ca87-4251-a89f-4a9e965773a9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:49.205077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:49.205635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:49.224798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:49.225265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.226120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:49.226575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:49.248354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 HTTP/1.1 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7263c9fb-1255-4c44-9786-8897cf3f29b8'} May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:49.253466 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06339cb5-f0e3-4668-93b0-085daa69cf46 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 404 len: 111 microversion: 2.1 time: 0.068233 May 19 08:30:49.261611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1913/3238] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:49 2022] DELETE /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:49.269420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-937829098", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:49.349709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:30:49.931208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Getting quotas for project 76ade84cf3b6491eb1010ffecbfbd535. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:30:49.949147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Getting quotas for user d5d918bd63e740ebb4a7012a1ce1d3bf and project 76ade84cf3b6491eb1010ffecbfbd535. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:30:49.980709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Request method failure captured: May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 1751 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgA334RwRwsWHgcUpmu49tv8bRM2FP8CchvhZoEmqhc6otSgBApWK76FoYtUrvhWZrGbZhzBKkUPfVRF2ks1hn1slDBdIDq98bxolNXIkNzGMj5MEYWBTZdt9_TwKZDTKvoy9tn2AdkkXySKF4-LsqFg-sKkCxytGqbzmIS_ZltBZe4 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 76ade84cf3b6491eb1010ffecbfbd535 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-2110699660 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/76ade84cf3b6491eb1010ffecbfbd535"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76ade84cf3b6491eb1010ffecbfbd535"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_76ade84cf3b6491eb1010ffecbfbd535"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76ade84cf3b6491eb1010ffecbfbd535"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-2110699660 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 76ade84cf3b6491eb1010ffecbfbd535 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-2110699660 May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d5d918bd63e740ebb4a7012a1ce1d3bf May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-937829098", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:49.991899 chdv-842464-2 devstack@n-api.service[119072]: exception: Maximum number of metadata items exceeds 128 May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-937829098', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:49.994326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c69a92e-e3cd-4f27-bd2e-f028ba439c4a tempest-AbsoluteLimitsNegativeTestJSON-2110699660 tempest-AbsoluteLimitsNegativeTestJSON-2110699660-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.734922 May 19 08:30:49.997124 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1914/3239] 10.222.0.78 () {60 vars in 1147 bytes} [Thu May 19 08:30:49 2022] POST /compute/v2.1/servers => generated 87 bytes in 736 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 19 08:30:50.012271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:50.013510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:50.031434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:50.031927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:50.036404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:50.037602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:50.698669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:50.709010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98138b54-1518-4c2f-9156-0a4da5a1e8d2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1500 microversion: 2.1 time: 0.708361 May 19 08:30:50.722557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1915/3240] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:49 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1500 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:50.728008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:50.742000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:50.745919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:50.760578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:50.761141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:50.766571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:50.767422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:50.985246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c164f62-9770-40ea-a561-f54a190c2e17 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.261101 May 19 08:30:50.986017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1916/3241] 10.222.0.78 () {58 vars in 1229 bytes} [Thu May 19 08:30:50 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:30:51.007025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:51.014386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: dbc1aade-666b-4aab-8d67-2aef2209374d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:51.032521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.033455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.036017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.036815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.072657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] HTTP exception thrown: Instance dbc1aade-666b-4aab-8d67-2aef2209374d could not be found. May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Request method failure captured: May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d HTTP/1.1 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9ao8YeOtI1439Uk0ZdgxO3uZ_rwyDZ8if3e9TJfucEA4NPF8I7KplTlLtE9VK2U1ciHQNj3JlkVMLnbjI95M0sZyzvv4_HuWjs_p85j0zdBz2dnLfARU28JiLDzZEF00mw_gYL2s7gal7nawOKAHxvgS4kuRTLB1SvrdmUqEsz6x8 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c1af603a8f2a4346b8f9482ae1b83ef3 May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dbc1aade-666b-4aab-8d67-2aef2209374d could not be found. May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dbc1aade-666b-4aab-8d67-2aef2209374d'} May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbc1aade-666b-4aab-8d67-2aef2209374d could not be found. May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbc1aade-666b-4aab-8d67-2aef2209374d could not be found. May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.079996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbc1aade-666b-4aab-8d67-2aef2209374d could not be found. May 19 08:30:51.084097 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.088677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Returning 404 to user: Instance dbc1aade-666b-4aab-8d67-2aef2209374d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:51.096646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4227149-bd4d-4828-b36b-0e5a80cedf0c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d" status: 404 len: 111 microversion: 2.1 time: 0.093506 May 19 08:30:51.097498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1917/3242] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:50 2022] GET /compute/v2.1/servers/dbc1aade-666b-4aab-8d67-2aef2209374d => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:51.114762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:51.116887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7263c9fb-1255-4c44-9786-8897cf3f29b8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:51.120456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:51.142232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.156374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.162171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.164582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.197390 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 HTTP/1.1 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7263c9fb-1255-4c44-9786-8897cf3f29b8'} May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.201791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. May 19 08:30:51.212754 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.216333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 7263c9fb-1255-4c44-9786-8897cf3f29b8 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:51.218015 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ee4c8d2-0db0-4320-9166-ac8776fe7be4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8" status: 404 len: 111 microversion: 2.1 time: 0.117525 May 19 08:30:51.220249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1918/3243] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:51 2022] GET /compute/v2.1/servers/7263c9fb-1255-4c44-9786-8897cf3f29b8 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:51.230371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:51.232253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:51.243265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.244103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.245446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.246549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.412869 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6c546bc-d587-42ca-8a21-75889be2ca01 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b/action" status: 202 len: 0 microversion: 2.1 time: 0.188275 May 19 08:30:51.416531 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1919/3244] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:30:51 2022] POST /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:51.425278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70ff467e-d104-4651-bd8c-af675b178bc2 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70ff467e-d104-4651-bd8c-af675b178bc2 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance[0]: May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '2011/01/01' May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 19 08:30:51.436456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70ff467e-d104-4651-bd8c-af675b178bc2 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70ff467e-d104-4651-bd8c-af675b178bc2 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018669 May 19 08:30:51.441263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1920/3245] 10.222.0.78 () {58 vars in 1181 bytes} [Thu May 19 08:30:51 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:30:51.454908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1adcbc5-e881-4c0a-91ec-3c30e6b040df tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:51.557373 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1adcbc5-e881-4c0a-91ec-3c30e6b040df tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/bf6ca414-eb38-49b1-b8f2-d7f5e3be6a7c" status: 204 len: 0 microversion: 2.1 time: 0.113906 May 19 08:30:51.561918 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1921/3246] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:30:51 2022] DELETE /compute/v2.1/os-server-groups/bf6ca414-eb38-49b1-b8f2-d7f5e3be6a7c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:51.580421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6d2a62b3-735e-479d-b621-91a5c757a62f req-cf5e1834-4584-492d-ad31-4bf290e0bf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbc1aade-666b-4aab-8d67-2aef2209374d", "name": "network-vif-deleted", "tag": "d3fec2e4-8d3d-4cea-83ef-bb2833f1aaf9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:51.604367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6d2a62b3-735e-479d-b621-91a5c757a62f req-cf5e1834-4584-492d-ad31-4bf290e0bf00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.606486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6d2a62b3-735e-479d-b621-91a5c757a62f req-cf5e1834-4584-492d-ad31-4bf290e0bf00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.647950 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6d2a62b3-735e-479d-b621-91a5c757a62f req-cf5e1834-4584-492d-ad31-4bf290e0bf00 service nova] Creating event network-vif-deleted:d3fec2e4-8d3d-4cea-83ef-bb2833f1aaf9 for instance dbc1aade-666b-4aab-8d67-2aef2209374d on chh1-842464-2 May 19 08:30:51.662538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6d2a62b3-735e-479d-b621-91a5c757a62f req-cf5e1834-4584-492d-ad31-4bf290e0bf00 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095781 May 19 08:30:51.664780 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1922/3247] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:51.681638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:51.682717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:51.692409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.694328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.696172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.696915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.722093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 HTTP/1.1 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '90a5c2fd-32fe-41ef-9c08-6c27abbb1251'} May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:51.734231 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:51.739021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:51.740754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea1d0b06-96df-45fc-ba2e-060a39961188 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 404 len: 111 microversion: 2.1 time: 0.070419 May 19 08:30:51.742311 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1923/3248] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:51 2022] DELETE /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:51.749870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:51.750968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:51.793523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.794427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:51.795758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:51.796598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.281102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:52.305721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-870989a6-c79b-4a8e-a9b4-cbdc09c57010 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1485 microversion: 2.1 time: 0.562191 May 19 08:30:52.328105 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1924/3249] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:51 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1485 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:52.335271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:52.351964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:52.352912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:52.360658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.361483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.362599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.364075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.401877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:30:52.452841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e443966-2e98-4b37-88b3-5e713218357d tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.120947 May 19 08:30:52.464560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1925/3250] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:30:52 2022] GET /compute/v2.1/servers => generated 683 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:52.478589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:52.479658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:52.488040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.488809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.490341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.491023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.564238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:52.828017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90e96018-7534-4037-b517-19f4296a8e4c tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 204 len: 0 microversion: 2.1 time: 0.353687 May 19 08:30:52.831586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1926/3251] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:52 2022] DELETE /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:52.839778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:52.842882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 90a5c2fd-32fe-41ef-9c08-6c27abbb1251] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:52.862802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.863293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.864766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.865221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.913431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 HTTP/1.1 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '90a5c2fd-32fe-41ef-9c08-6c27abbb1251'} May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:52.919576 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:52.924312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 90a5c2fd-32fe-41ef-9c08-6c27abbb1251 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:52.926091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22b864a7-bd46-4200-8d2b-fc717033e5aa tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251" status: 404 len: 111 microversion: 2.1 time: 0.094589 May 19 08:30:52.927752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1927/3252] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:52 2022] GET /compute/v2.1/servers/90a5c2fd-32fe-41ef-9c08-6c27abbb1251 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:52.943886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:52.946014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:52.960550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.961006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:52.965909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:52.969876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:53.049011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lazy-loading 'flavor' on Instance uuid e1ad4c36-79d1-48bc-ab62-99ef48cbb72b {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:30:53.206018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:53.835904 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ae46847-e147-4726-99d5-371095fc9e5c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b/action" status: 202 len: 0 microversion: 2.1 time: 0.906431 May 19 08:30:53.838280 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1928/3253] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:30:52 2022] POST /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:30:53.858982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:53.887388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:53.890640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.servers [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Removing options 'limit' from query {{(pid=119072) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 19 08:30:53.893812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:53.906008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:53.907680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:53.910594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:53.926599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.014941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:30:54.068400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bac929ad-9bd5-4601-919b-4ec421139f16 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.227553 May 19 08:30:54.069026 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1929/3254] 10.222.0.78 () {58 vars in 1143 bytes} [Thu May 19 08:30:53 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:54.081257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.082112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:54.089101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.089599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.090684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.091410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.410687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:54.422515 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90d54708-20ec-4482-ad3b-ca440dfd24f5 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1473 microversion: 2.1 time: 0.345000 May 19 08:30:54.423428 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1930/3255] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:54.428377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.429102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:54.438669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.439472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.440483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.441074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.479737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f HTTP/1.1 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5c40c329-0112-47e2-839e-b9f9b7bd973f'} May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:54.482993 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.488781 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.491253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:54.492060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c313408-0350-43fb-9e1a-a219bdcc86e4 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 404 len: 111 microversion: 2.1 time: 0.067499 May 19 08:30:54.493223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1931/3256] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:54 2022] DELETE /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:54.497964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.502915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:54.510674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.511274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.512935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.513646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.721577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:54.731834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa67d9d0-4bc4-4efd-a3cc-d29920e57a7c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1512 microversion: 2.1 time: 0.237214 May 19 08:30:54.733412 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1932/3257] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:54.739074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b732d1ce-9b8f-4ede-a87b-eb62bf7eb3a5 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b732d1ce-9b8f-4ede-a87b-eb62bf7eb3a5 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance[0]: May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '-1' May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 19 08:30:54.744062 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b732d1ce-9b8f-4ede-a87b-eb62bf7eb3a5 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b732d1ce-9b8f-4ede-a87b-eb62bf7eb3a5 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.011673 May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1933/3258] 10.222.0.78 () {58 vars in 1141 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.760439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 5c40c329-0112-47e2-839e-b9f9b7bd973f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:54.768062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.768635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.769570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.769912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.791620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f HTTP/1.1 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5c40c329-0112-47e2-839e-b9f9b7bd973f'} May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.793347 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 5c40c329-0112-47e2-839e-b9f9b7bd973f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d086ea2b-c367-4a73-8e1c-82535a07a324 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f" status: 404 len: 111 microversion: 2.1 time: 0.040298 May 19 08:30:54.799523 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1934/3259] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers/5c40c329-0112-47e2-839e-b9f9b7bd973f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:54.823945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2109b3c6-8853-4471-9a62-116b53d63605 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2109b3c6-8853-4471-9a62-116b53d63605 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: action_args: {} May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance[0]: May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'testing' May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 19 08:30:54.827876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2109b3c6-8853-4471-9a62-116b53d63605 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2109b3c6-8853-4471-9a62-116b53d63605 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.031400 May 19 08:30:54.833220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1935/3260] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:30:54.844563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0e4e496-799b-4dde-b4ac-80580fd855bb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.849188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0e4e496-799b-4dde-b4ac-80580fd855bb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:54.850355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0e4e496-799b-4dde-b4ac-80580fd855bb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:54.858819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.servers [None req-b0e4e496-799b-4dde-b4ac-80580fd855bb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Flavor 'non_existing_flavor' could not be found {{(pid=119072) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 19 08:30:54.860344 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0e4e496-799b-4dde-b4ac-80580fd855bb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.019951 May 19 08:30:54.861582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1936/3261] 10.222.0.78 () {58 vars in 1177 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:30:54.874542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:54.878436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:54.879199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:54.885133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.887839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:54.888680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:54.889277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.036903 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5df37403-da2e-489c-9a7d-8a2eb6aa8e37 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.166907 May 19 08:30:55.037973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1937/3262] 10.222.0.78 () {58 vars in 1173 bytes} [Thu May 19 08:30:54 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:30:55.049203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:55.053395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:55.054081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:55.060767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.061336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.062096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.062540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.168913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2acfdf74-d1e0-47d9-a0e8-8d9a935e209c tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.124061 May 19 08:30:55.169865 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1938/3263] 10.222.0.78 () {58 vars in 1183 bytes} [Thu May 19 08:30:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:30:55.181090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:55.187889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:55.188924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:55.194536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.195239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.196834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.197562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.231453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:30:55.281669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:55.290693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.291490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.472511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4cc0076b-a0da-4b30-bdf2-70345e8c8151 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.295149 May 19 08:30:55.473134 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1939/3264] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:30:55 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:30:55.481411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:55.482002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:55.496765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.497488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.500093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.501956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.706190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:55.720180 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edfa5c02-126e-470d-b9b0-2bd221dc7281 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1473 microversion: 2.1 time: 0.245511 May 19 08:30:55.730152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1940/3265] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:55 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:55.748019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2e7e2cb-1d83-4b5b-8ab8-d1c5d731c475 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:55.754928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2e7e2cb-1d83-4b5b-8ab8-d1c5d731c475 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:55.757668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2e7e2cb-1d83-4b5b-8ab8-d1c5d731c475 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.024433 May 19 08:30:55.769042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1941/3266] 10.222.0.78 () {58 vars in 1177 bytes} [Thu May 19 08:30:55 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:30:55.777442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:55.779338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:55.793415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.796639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:55.798893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:55.799349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.039735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:56.070435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24bea2b6-ff07-4ec2-8259-9580d00ad4c7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1512 microversion: 2.1 time: 0.299101 May 19 08:30:56.071370 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1942/3267] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:55 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:56.089814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:56.094288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:56.094970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Searching by: {'deleted': False, 'project_id': 'f6318be9233846abaaf1bccca267113a'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:30:56.115965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.116204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.117946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.119263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.160239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:30:56.206041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb8babdc-662f-4fcc-a30c-3c618f1acae1 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.123873 May 19 08:30:56.207305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1943/3268] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:30:56 2022] GET /compute/v2.1/servers => generated 683 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:56.222696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:56.223461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:56.236835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.237476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.238419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.238988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.255617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] HTTP exception thrown: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 HTTP/1.1 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '46021773-0fdc-4891-a5f4-058a0170e1f9'} May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:56.257279 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 404 to user: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bd628fe-e89c-4c86-9f21-103366e44e11 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "DELETE /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 404 len: 111 microversion: 2.1 time: 0.041078 May 19 08:30:56.261186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1944/3269] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:56 2022] DELETE /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:30:56.277054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:56.277587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:56.288045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.288402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.289192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.289654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.353691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:56.533889 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85f6f2f1-980d-4f7b-91ee-df994434ba1e tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061" status: 204 len: 0 microversion: 2.1 time: 0.256473 May 19 08:30:56.535800 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1945/3270] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:56 2022] DELETE /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:56.546041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8c06d70d-dbb6-4846-8265-0bdc8ae63974 req-7595da3d-2b5a-4209-8d0a-d5a0950c5933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f53a05d-5149-4732-91fa-d68946239a66", "name": "network-vif-deleted", "tag": "68e7277c-370c-44b3-9886-936bd40298a8"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:30:56.557122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8c06d70d-dbb6-4846-8265-0bdc8ae63974 req-7595da3d-2b5a-4209-8d0a-d5a0950c5933 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.557737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8c06d70d-dbb6-4846-8265-0bdc8ae63974 req-7595da3d-2b5a-4209-8d0a-d5a0950c5933 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.575911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8c06d70d-dbb6-4846-8265-0bdc8ae63974 req-7595da3d-2b5a-4209-8d0a-d5a0950c5933 service nova] Creating event network-vif-deleted:68e7277c-370c-44b3-9886-936bd40298a8 for instance 1f53a05d-5149-4732-91fa-d68946239a66 on chh2-842464-2 May 19 08:30:56.586550 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8c06d70d-dbb6-4846-8265-0bdc8ae63974 req-7595da3d-2b5a-4209-8d0a-d5a0950c5933 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048746 May 19 08:30:56.587904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1946/3271] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:30:56.597544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:56.598422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:56.610964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.611830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.613606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.614336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.662031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:30:56.796570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:30:56.865802 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffdb8e26-f174-47a6-a18b-f08d57279c75 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "DELETE /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 204 len: 0 microversion: 2.1 time: 0.276295 May 19 08:30:56.866933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1947/3272] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:30:56 2022] DELETE /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:30:56.876183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:56.883741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:56.890993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.891460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.892295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.892733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.984217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:56.991370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:56.992047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lazy-loading 'fault' on Instance uuid 1f53a05d-5149-4732-91fa-d68946239a66 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:30:57.188395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1af603a8f2a4346b8f9482ae1b83ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eabb2e7759a4dcc908539842a4684ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:57.214707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5464f01-9c35-47ee-bdde-6a68e6d2fe30 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 200 len: 1307 microversion: 2.1 time: 0.345810 May 19 08:30:57.226324 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1948/3273] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:56 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:57.235847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:57.236488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 46021773-0fdc-4891-a5f4-058a0170e1f9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:57.251461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:57.251914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:57.252697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:57.253137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:57.283817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] HTTP exception thrown: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 HTTP/1.1 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '46021773-0fdc-4891-a5f4-058a0170e1f9'} May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:57.290456 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 404 to user: Instance 46021773-0fdc-4891-a5f4-058a0170e1f9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c416c30e-bae7-41e6-81aa-c33ea7a9bbfc tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9" status: 404 len: 111 microversion: 2.1 time: 0.066683 May 19 08:30:57.297873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1949/3274] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:57 2022] GET /compute/v2.1/servers/46021773-0fdc-4891-a5f4-058a0170e1f9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:57.304149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:57.307067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:57.324858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:57.325407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:57.326109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:57.327337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:57.685262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:57.716385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93aa0113-9b55-40c2-8529-561856a63394 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1512 microversion: 2.1 time: 0.418316 May 19 08:30:57.731370 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1950/3275] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:57 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:57.738547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:57.739507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:57.747396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:57.747955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:57.749254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:57.749926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:58.253856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:30:58.268066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d54c1ce-1b89-4a18-b2d8-6549930cfed0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061" status: 200 len: 1522 microversion: 2.1 time: 0.535358 May 19 08:30:58.268973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1951/3276] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:57 2022] GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:30:58.615020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Calling method '.version_select at 0x7f321198fc10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:58.659386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:30:58.660353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Neutron security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:30:58.661094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] HTTP exception thrown: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.661094 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Request method failure captured: May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-security-groups/d3c5170c-ade5-41ee-83b1-d8d3455bd072 HTTP/1.1 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBBotBdCxScBQUcC6q9Joj74iUxTx3hH4LNlXEwISp4cYX2_9S88mnCT-ZlLZVKVjVLmrOmMBXw_0XIJGPn4CFmK5pJ55sy8it8KfOYa03Unak1Kq9X_aCyoGNltg73x484WQWIRRYKErr-zMf9dKYrpqECI1ikZMrpAReX_w5jHAg May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2b36b7e846c940ef988ab3ceb36f62fa May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd3c5170c-ade5-41ee-83b1-d8d3455bd072'} May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:30:58.663303 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] May 19 08:30:58.668116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.673718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Returning 404 to user: Security group d3c5170c-ade5-41ee-83b1-d8d3455bd072 does not exist May 19 08:30:58.673718 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b684e895-5603-4d05-a4ae-4d09ab7d0322'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:58.674842 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ebe91b6-fe5c-49ff-9b80-c81a33943a7e tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d3c5170c-ade5-41ee-83b1-d8d3455bd072" status: 404 len: 194 microversion: 2.1 time: 0.403564 May 19 08:30:58.675599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1952/3277] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:30:58 2022] DELETE /compute/v2.1/os-security-groups/d3c5170c-ade5-41ee-83b1-d8d3455bd072 => generated 194 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:58.682488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:58.684291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] [instance: 1f53a05d-5149-4732-91fa-d68946239a66] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:58.695067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:58.695777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:58.696719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:58.697414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:58.715394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] HTTP exception thrown: Instance 1f53a05d-5149-4732-91fa-d68946239a66 could not be found. May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Request method failure captured: May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 HTTP/1.1 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf9ao8YeOtI1439Uk0ZdgxO3uZ_rwyDZ8if3e9TJfucEA4NPF8I7KplTlLtE9VK2U1ciHQNj3JlkVMLnbjI95M0sZyzvv4_HuWjs_p85j0zdBz2dnLfARU28JiLDzZEF00mw_gYL2s7gal7nawOKAHxvgS4kuRTLB1SvrdmUqEsz6x8 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2eabb2e7759a4dcc908539842a4684ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 2eabb2e7759a4dcc908539842a4684ba May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025697634 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: c1af603a8f2a4346b8f9482ae1b83ef3 May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersOnMultiNodesTest-1025697634-project May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1f53a05d-5149-4732-91fa-d68946239a66 could not be found. May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1f53a05d-5149-4732-91fa-d68946239a66'} May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f53a05d-5149-4732-91fa-d68946239a66 could not be found. May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f53a05d-5149-4732-91fa-d68946239a66 could not be found. May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:30:58.718763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f53a05d-5149-4732-91fa-d68946239a66 could not be found. May 19 08:30:58.723952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:30:58.726391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] Returning 404 to user: Instance 1f53a05d-5149-4732-91fa-d68946239a66 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:30:58.727575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-792e65fe-139c-44b2-89b3-8032fdc1c8f8 tempest-ServersOnMultiNodesTest-1025697634 tempest-ServersOnMultiNodesTest-1025697634-project] 10.222.0.78 "GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66" status: 404 len: 111 microversion: 2.1 time: 0.050917 May 19 08:30:58.731913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1953/3278] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:58 2022] GET /compute/v2.1/servers/1f53a05d-5149-4732-91fa-d68946239a66 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:30:58.738777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0bbf5417-0387-477f-8c7c-564d19bbf569 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005624 May 19 08:30:58.739764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1954/3279] 10.222.0.78 () {58 vars in 1163 bytes} [Thu May 19 08:30:58 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 08:30:58.755002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f897d2eb-e399-4f93-905d-bfa6fe845406 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Calling method '.version_select at 0x7f3211b75a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:59.631831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f897d2eb-e399-4f93-905d-bfa6fe845406 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.881965 May 19 08:30:59.633639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1955/3280] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:30:58 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:30:59.640551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:30:59.642934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:30:59.664601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:59.668068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:30:59.669109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:30:59.670117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:00.216093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:00.243033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ad96bea-fdb5-4b73-8fd3-1ec00a6c9650 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.607863 May 19 08:31:00.246273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1956/3281] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:30:59 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:00.252977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:00.255540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:00.264010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:00.265461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:00.270410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:00.272180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:00.333155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:00.333794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:00.334282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lazy-loading 'fault' on Instance uuid dc94846a-cff3-4ee2-920a-9c3ab525a061 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:31:00.432036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220de61761ab4460b48d94be38cd1886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6318be9233846abaaf1bccca267113a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:00.446131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-437e6c78-d672-4282-959d-0c252fc786a0 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061" status: 200 len: 1313 microversion: 2.1 time: 0.195252 May 19 08:31:00.447385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1957/3282] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:00 2022] GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:00.460395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2c571b5-9572-4edf-b649-8cce4dfe89cc tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Calling method '.version_select at 0x7f3211ca4f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:00.842901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-d2c571b5-9572-4edf-b649-8cce4dfe89cc tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:31:00.844176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d2c571b5-9572-4edf-b649-8cce4dfe89cc tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] HTTP exception thrown: Insufficient rights for removing default security group. May 19 08:31:00.844176 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2c571b5-9572-4edf-b649-8cce4dfe89cc tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Request method failure captured: May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-security-groups/74ab0984-e4ee-4ff6-94f0-ed1839b2b60f HTTP/1.1 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBBotBdCxScBQUcC6q9Joj74iUxTx3hH4LNlXEwISp4cYX2_9S88mnCT-ZlLZVKVjVLmrOmMBXw_0XIJGPn4CFmK5pJ55sy8it8KfOYa03Unak1Kq9X_aCyoGNltg73x484WQWIRRYKErr-zMf9dKYrpqECI1ikZMrpAReX_w5jHAg May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2b36b7e846c940ef988ab3ceb36f62fa May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: exception: Insufficient rights for removing default security group. May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '74ab0984-e4ee-4ff6-94f0-ed1839b2b60f'} May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:31:00.846319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2c571b5-9572-4edf-b649-8cce4dfe89cc tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Returning 400 to user: Insufficient rights for removing default security group. May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b170d2ea-8696-47b8-9b1b-4bd02a4775e6'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2c571b5-9572-4edf-b649-8cce4dfe89cc tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/74ab0984-e4ee-4ff6-94f0-ed1839b2b60f" status: 400 len: 182 microversion: 2.1 time: 0.398735 May 19 08:31:00.851951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1958/3283] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:31:00 2022] DELETE /compute/v2.1/os-security-groups/74ab0984-e4ee-4ff6-94f0-ed1839b2b60f => generated 182 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:31:00.864863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2688cfb4-80a6-4d8b-816b-9caf9386fa7e req-ce15b0f4-e84c-46aa-b05c-17411dd1dd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc94846a-cff3-4ee2-920a-9c3ab525a061", "name": "network-vif-deleted", "tag": "b25fa891-8461-4a7f-9422-654af9e00f9d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:00.901283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2688cfb4-80a6-4d8b-816b-9caf9386fa7e req-ce15b0f4-e84c-46aa-b05c-17411dd1dd31 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:00.907393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2688cfb4-80a6-4d8b-816b-9caf9386fa7e req-ce15b0f4-e84c-46aa-b05c-17411dd1dd31 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:00.950033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2688cfb4-80a6-4d8b-816b-9caf9386fa7e req-ce15b0f4-e84c-46aa-b05c-17411dd1dd31 service nova] Creating event network-vif-deleted:b25fa891-8461-4a7f-9422-654af9e00f9d for instance dc94846a-cff3-4ee2-920a-9c3ab525a061 on chh1-842464-2 May 19 08:31:00.964702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2688cfb4-80a6-4d8b-816b-9caf9386fa7e req-ce15b0f4-e84c-46aa-b05c-17411dd1dd31 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114812 May 19 08:31:00.969999 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1959/3284] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:00.992120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3c71a999-2ae7-4572-bb4f-188f53352512 req-b2880576-505e-4864-b804-097bb42f36bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ed9f46-a07e-4af6-aebb-09e89e42700b", "name": "network-vif-deleted", "tag": "c8e677ee-fe05-48ff-9de7-2b02584cf243"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:01.054423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3c71a999-2ae7-4572-bb4f-188f53352512 req-b2880576-505e-4864-b804-097bb42f36bf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.054888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3c71a999-2ae7-4572-bb4f-188f53352512 req-b2880576-505e-4864-b804-097bb42f36bf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.111511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3c71a999-2ae7-4572-bb4f-188f53352512 req-b2880576-505e-4864-b804-097bb42f36bf service nova] Creating event network-vif-deleted:c8e677ee-fe05-48ff-9de7-2b02584cf243 for instance 17ed9f46-a07e-4af6-aebb-09e89e42700b on chh2-842464-2 May 19 08:31:01.140045 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3c71a999-2ae7-4572-bb4f-188f53352512 req-b2880576-505e-4864-b804-097bb42f36bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167611 May 19 08:31:01.144917 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1960/3285] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:01.161253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Calling method '.version_select at 0x7f3211ca40d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:01.236835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:31:01.237705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Neutron security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:31:01.239084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] HTTP exception thrown: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.239084 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Request method failure captured: May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-security-groups/a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 HTTP/1.1 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBBotBdCxScBQUcC6q9Joj74iUxTx3hH4LNlXEwISp4cYX2_9S88mnCT-ZlLZVKVjVLmrOmMBXw_0XIJGPn4CFmK5pJ55sy8it8KfOYa03Unak1Kq9X_aCyoGNltg73x484WQWIRRYKErr-zMf9dKYrpqECI1ikZMrpAReX_w5jHAg May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2b36b7e846c940ef988ab3ceb36f62fa May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2'} May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:31:01.241502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] May 19 08:31:01.245579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.254304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Returning 404 to user: Security group a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 does not exist May 19 08:31:01.254304 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-b80cc26e-9fd8-46ab-ad7d-4a75d0193db7'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:01.255858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2bc3fa5b-d979-48eb-9c55-bd4f6258d866 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2" status: 404 len: 194 microversion: 2.1 time: 0.109440 May 19 08:31:01.256811 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1961/3286] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:31:01 2022] GET /compute/v2.1/os-security-groups/a0ff443f-f3d8-4dfd-846e-2ac43f9fbfb2 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:01.288920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:01.289737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:01.302460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:01.310730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.312060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.314419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.315118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.589676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:01.602313 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ca47ab8-684f-43d9-8323-82531bdffe6c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.343723 May 19 08:31:01.603515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1962/3287] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:01 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:01.609914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Action: 'update', calling method: .version_select at 0x7f321198f280>, body: {"security_group": {"name": "tempest-sg-389092077", "description": "tempest-description-241907784"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:01.641643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:31:01.642568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Neutron security group 3e543098-a24b-4aac-9651-43944fe1179f not found {{(pid=119072) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 19 08:31:01.643256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] HTTP exception thrown: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.643256 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Request method failure captured: May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/os-security-groups/3e543098-a24b-4aac-9651-43944fe1179f HTTP/1.1 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 100 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBBotBdCxScBQUcC6q9Joj74iUxTx3hH4LNlXEwISp4cYX2_9S88mnCT-ZlLZVKVjVLmrOmMBXw_0XIJGPn4CFmK5pJ55sy8it8KfOYa03Unak1Kq9X_aCyoGNltg73x484WQWIRRYKErr-zMf9dKYrpqECI1ikZMrpAReX_w5jHAg May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/49cd48fc6f45484883761bc8cca801a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 49cd48fc6f45484883761bc8cca801a6 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087 May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2b36b7e846c940ef988ab3ceb36f62fa May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1982536087-project May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: {"security_group": {"name": "tempest-sg-389092077", "description": "tempest-description-241907784"}} May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: exception: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3e543098-a24b-4aac-9651-43944fe1179f', 'body': {'security_group': {'name': 'tempest-sg-389092077', 'description': 'tempest-description-241907784'}}} May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:31:01.645646 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] May 19 08:31:01.650152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.654587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] Returning 404 to user: Security group 3e543098-a24b-4aac-9651-43944fe1179f does not exist May 19 08:31:01.654587 chdv-842464-2 devstack@n-api.service[119072]: Neutron server returns request_ids: ['req-0fb7185e-40d0-4645-8522-4668630fd38f'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:01.655972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83edc8aa-7a1c-46a5-a865-6eaa10760426 tempest-SecurityGroupsNegativeTestJSON-1982536087 tempest-SecurityGroupsNegativeTestJSON-1982536087-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/3e543098-a24b-4aac-9651-43944fe1179f" status: 404 len: 194 microversion: 2.1 time: 0.050970 May 19 08:31:01.657168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1963/3288] 10.222.0.78 () {60 vars in 1289 bytes} [Thu May 19 08:31:01 2022] PUT /compute/v2.1/os-security-groups/3e543098-a24b-4aac-9651-43944fe1179f => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:01.671479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:01.672354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: dc94846a-cff3-4ee2-920a-9c3ab525a061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:01.684210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.687605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.692151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.692919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.735886 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] HTTP exception thrown: Instance dc94846a-cff3-4ee2-920a-9c3ab525a061 could not be found. May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061 HTTP/1.1 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dc94846a-cff3-4ee2-920a-9c3ab525a061 could not be found. May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dc94846a-cff3-4ee2-920a-9c3ab525a061'} May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc94846a-cff3-4ee2-920a-9c3ab525a061 could not be found. May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc94846a-cff3-4ee2-920a-9c3ab525a061 could not be found. May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.742021 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc94846a-cff3-4ee2-920a-9c3ab525a061 could not be found. May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 404 to user: Instance dc94846a-cff3-4ee2-920a-9c3ab525a061 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a93a5df-05ea-4f7f-afa1-08ca72960dbb tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061" status: 404 len: 111 microversion: 2.1 time: 0.087138 May 19 08:31:01.748415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1964/3289] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:01 2022] GET /compute/v2.1/servers/dc94846a-cff3-4ee2-920a-9c3ab525a061 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:01.757545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:01.758391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] [instance: 17ed9f46-a07e-4af6-aebb-09e89e42700b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:01.766872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.767849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.769006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.770225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.797921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] HTTP exception thrown: Instance 17ed9f46-a07e-4af6-aebb-09e89e42700b could not be found. May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Request method failure captured: May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b HTTP/1.1 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgAM-CjIIr0HUWxhLHduHmP_ywMPerEhTZG7eYEum3DZH1FPb_NeCM5vBWSGvqIwYGoR6CCX5RL-ghhb7prGqNiPy63ciAmu9aT0rsvWtR_Kul2HduUpfVdFZEhSkig4J5Hxm4kGXi-m4PkSvWDRc9fNMuuwkKbPt44XdawmuFx9nT0 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f6318be9233846abaaf1bccca267113a May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6318be9233846abaaf1bccca267113a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6318be9233846abaaf1bccca267113a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6318be9233846abaaf1bccca267113a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServersNegativeTestJSON-746025417 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f6318be9233846abaaf1bccca267113a May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-746025417 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 220de61761ab4460b48d94be38cd1886 May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServersNegativeTestJSON-746025417-project May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 17ed9f46-a07e-4af6-aebb-09e89e42700b could not be found. May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '17ed9f46-a07e-4af6-aebb-09e89e42700b'} May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ed9f46-a07e-4af6-aebb-09e89e42700b could not be found. May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ed9f46-a07e-4af6-aebb-09e89e42700b could not be found. May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:01.801603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ed9f46-a07e-4af6-aebb-09e89e42700b could not be found. May 19 08:31:01.806940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:01.809151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] Returning 404 to user: Instance 17ed9f46-a07e-4af6-aebb-09e89e42700b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:01.810922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-950ac2d6-c4a9-47ae-9f58-224ef3b636c8 tempest-ListServersNegativeTestJSON-746025417 tempest-ListServersNegativeTestJSON-746025417-project] 10.222.0.78 "GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b" status: 404 len: 111 microversion: 2.1 time: 0.058262 May 19 08:31:01.812773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1965/3290] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:01 2022] GET /compute/v2.1/servers/17ed9f46-a07e-4af6-aebb-09e89e42700b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:31:01.822509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-87549728-761b-4e27-b07c-dd7b69f2e474 req-a43e6be8-7b1b-4dad-954d-4ed261b271d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ad4c36-79d1-48bc-ab62-99ef48cbb72b", "name": "network-vif-plugged", "status": "completed", "tag": "9039bcd7-9044-46b2-bf3d-931f15eb34af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:01.834607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87549728-761b-4e27-b07c-dd7b69f2e474 req-a43e6be8-7b1b-4dad-954d-4ed261b271d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:01.835231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87549728-761b-4e27-b07c-dd7b69f2e474 req-a43e6be8-7b1b-4dad-954d-4ed261b271d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:01.851704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-87549728-761b-4e27-b07c-dd7b69f2e474 req-a43e6be8-7b1b-4dad-954d-4ed261b271d3 service nova] Creating event network-vif-plugged:9039bcd7-9044-46b2-bf3d-931f15eb34af for instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b on chh1-842464-2 May 19 08:31:01.872590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-87549728-761b-4e27-b07c-dd7b69f2e474 req-a43e6be8-7b1b-4dad-954d-4ed261b271d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058227 May 19 08:31:01.875628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1966/3291] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:02.624245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:02.626024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:02.645921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:02.647139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:02.649544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:02.651834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:02.995503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:03.006677 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05500b74-6063-4969-9d23-942e3cdeaf7e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.388717 May 19 08:31:03.008312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1967/3292] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:02 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:04.024045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:04.024707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:04.039920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:04.040253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:04.041049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:04.042994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:04.566219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:04.581799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6d17ff6-b482-4854-80fc-bf0e6b9e380e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.561500 May 19 08:31:04.600470 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1968/3293] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:04 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:05.607248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:05.608498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:05.616012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:05.636918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:05.637567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:05.638758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:05.643654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:06.134565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=16 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:06.174004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:06.182987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c082da3c-bf82-4b9a-a26e-697b84ccffeb tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.582584 May 19 08:31:06.230206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1969/3294] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:05 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:07.240019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:07.242688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:07.263654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:07.265863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:07.269465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:07.270444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:08.353881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:08.365283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc4e13aa-4aca-4d00-9415-07a62d3a69ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 1.132506 May 19 08:31:08.371300 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1970/3295] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:07 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:09.421190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:09.424718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:09.471501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:09.473700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:09.482530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:09.486381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:10.463724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:10.480380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-163ba24a-5e85-4698-9edd-b47dbffdba86 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 1.091826 May 19 08:31:10.481255 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1971/3296] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:09 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:31:10.781233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50348353-8322-4e61-b723-0ebadfc23b2a tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1149136837", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:10.784825 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-50348353-8322-4e61-b723-0ebadfc23b2a tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] HTTP exception thrown: min_count must be <= max_count May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50348353-8322-4e61-b723-0ebadfc23b2a tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Request method failure captured: May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 184 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBNjN0iKtKmT6Iwn165Fc4iGZoUFwNtDKY8le7ScbVqbBth6RlWC_c28IUcq6BT_N_CXvLnpIfMtVFoPBuQaQ8AfEfPvEjxdMbgeh7pWACJCpcFLdk3pMjSm7KoI9Wr8OI6vQOBywsCd0EsskTGHccTovW-2pnsNCUeBlrl_rGhbXk May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/835ab00584934086bbb150561a5e0a92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_835ab00584934086bbb150561a5e0a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e32c7f8e375a458cab8e2929abed1b00 May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1149136837", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: exception: min_count must be <= max_count May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1149136837', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 19 08:31:10.790665 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:10.799904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50348353-8322-4e61-b723-0ebadfc23b2a tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Returning 400 to user: min_count must be <= max_count {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:10.804579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50348353-8322-4e61-b723-0ebadfc23b2a tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.319878 May 19 08:31:10.805536 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1972/3297] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:10 2022] POST /compute/v2.1/servers => generated 74 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:31:10.828977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:10.829944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:10.882414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:10.885698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:10.887059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:10.887817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:10.986580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:31:11.062479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:11.110956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e567b1a-ed41-4077-b23b-65e5829d19f0 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 204 len: 0 microversion: 2.1 time: 0.303847 May 19 08:31:11.112260 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1973/3298] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:31:10 2022] DELETE /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:31:11.120664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd25d487-1c36-4d3c-9f35-586fa7322661 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1752636637", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "max_count": 0}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd25d487-1c36-4d3c-9f35-586fa7322661 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Request method failure captured: May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 168 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBNjN0iKtKmT6Iwn165Fc4iGZoUFwNtDKY8le7ScbVqbBth6RlWC_c28IUcq6BT_N_CXvLnpIfMtVFoPBuQaQ8AfEfPvEjxdMbgeh7pWACJCpcFLdk3pMjSm7KoI9Wr8OI6vQOBywsCd0EsskTGHccTovW-2pnsNCUeBlrl_rGhbXk May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/835ab00584934086bbb150561a5e0a92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_835ab00584934086bbb150561a5e0a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e32c7f8e375a458cab8e2929abed1b00 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1752636637", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "max_count": 0}} May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1752636637', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'max_count': 0}}} May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 0 May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:31:11.125467 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 19 08:31:11.132155 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:11.135881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd25d487-1c36-4d3c-9f35-586fa7322661 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:11.137400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd25d487-1c36-4d3c-9f35-586fa7322661 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022854 May 19 08:31:11.138669 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1974/3299] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:11 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:31:11.166569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:11.167768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:11.211012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:11.211476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:11.212286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:11.212749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:12.290219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:12.303817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8315adc0-a0eb-44a9-bc28-8a853ba0a8e7 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1513 microversion: 2.1 time: 1.161570 May 19 08:31:12.305694 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1975/3300] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:11 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1513 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:12.319392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8728f17-3d6f-4daa-bd31-29295b6af304 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1564508586", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "max_count": 2.5}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8728f17-3d6f-4daa-bd31-29295b6af304 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Request method failure captured: May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 170 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBNjN0iKtKmT6Iwn165Fc4iGZoUFwNtDKY8le7ScbVqbBth6RlWC_c28IUcq6BT_N_CXvLnpIfMtVFoPBuQaQ8AfEfPvEjxdMbgeh7pWACJCpcFLdk3pMjSm7KoI9Wr8OI6vQOBywsCd0EsskTGHccTovW-2pnsNCUeBlrl_rGhbXk May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/835ab00584934086bbb150561a5e0a92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_835ab00584934086bbb150561a5e0a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e32c7f8e375a458cab8e2929abed1b00 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1564508586", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "max_count": 2.5}} May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1564508586', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'max_count': 2.5}}} May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 2.5 May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:31:12.323801 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8728f17-3d6f-4daa-bd31-29295b6af304 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:12.329671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8728f17-3d6f-4daa-bd31-29295b6af304 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018509 May 19 08:31:12.343094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1976/3301] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:31:12.344682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:12.345622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:12.365293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:12.368739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:12.370852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:12.371388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:12.686341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:12.696490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92801098-f867-4272-993f-3be30de309dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.360797 May 19 08:31:12.697294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1977/3302] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:12 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:12.713105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54dc0cbc-e114-4444-8ab4-ea6ccb72eeda tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1785491887", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 0}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54dc0cbc-e114-4444-8ab4-ea6ccb72eeda tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Request method failure captured: May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 168 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBNjN0iKtKmT6Iwn165Fc4iGZoUFwNtDKY8le7ScbVqbBth6RlWC_c28IUcq6BT_N_CXvLnpIfMtVFoPBuQaQ8AfEfPvEjxdMbgeh7pWACJCpcFLdk3pMjSm7KoI9Wr8OI6vQOBywsCd0EsskTGHccTovW-2pnsNCUeBlrl_rGhbXk May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/835ab00584934086bbb150561a5e0a92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_835ab00584934086bbb150561a5e0a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e32c7f8e375a458cab8e2929abed1b00 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1785491887", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 0}} May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1785491887', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'min_count': 0}}} May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 0 May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:31:12.721232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 19 08:31:12.727239 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.730051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54dc0cbc-e114-4444-8ab4-ea6ccb72eeda tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:12.731046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54dc0cbc-e114-4444-8ab4-ea6ccb72eeda tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027510 May 19 08:31:12.732057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1978/3303] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:12 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:31:12.843996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d96b1735-cb01-4a2e-9ded-44c773bbdfb4 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1268554939", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 2.5}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d96b1735-cb01-4a2e-9ded-44c773bbdfb4 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Request method failure captured: May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 170 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBNjN0iKtKmT6Iwn165Fc4iGZoUFwNtDKY8le7ScbVqbBth6RlWC_c28IUcq6BT_N_CXvLnpIfMtVFoPBuQaQ8AfEfPvEjxdMbgeh7pWACJCpcFLdk3pMjSm7KoI9Wr8OI6vQOBywsCd0EsskTGHccTovW-2pnsNCUeBlrl_rGhbXk May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/835ab00584934086bbb150561a5e0a92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_835ab00584934086bbb150561a5e0a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835ab00584934086bbb150561a5e0a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 835ab00584934086bbb150561a5e0a92 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1946039456 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: e32c7f8e375a458cab8e2929abed1b00 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1946039456-project May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1268554939", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 2.5}} May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1268554939', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'min_count': 2.5}}} May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 2.5 May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:31:12.846806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 19 08:31:12.851749 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:12.852890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d96b1735-cb01-4a2e-9ded-44c773bbdfb4 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:12.854915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d96b1735-cb01-4a2e-9ded-44c773bbdfb4 tempest-MultipleCreateNegativeTestJSON-1946039456 tempest-MultipleCreateNegativeTestJSON-1946039456-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015374 May 19 08:31:12.857516 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1979/3304] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:12 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:31:13.322796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:13.323827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:13.344000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:13.365647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:13.368159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:13.375306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:14.128444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:14.149956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a9147b5-1815-44ea-8c5e-80c49efedbf3 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1513 microversion: 2.1 time: 0.827564 May 19 08:31:14.151696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1980/3305] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:13 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1513 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:14.166314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:14.168909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:14.187481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:14.188240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:14.191495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:14.192428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:15.101154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:15.115221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7a2f72d-3d3a-45c8-8fa2-ea5e219412ad tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.958608 May 19 08:31:15.125876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1981/3306] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:14 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:15.168861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:15.171308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:15.187825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:15.190646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:15.191703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:15.196862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:16.516048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:16.546695 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c1e1191-eed7-49e2-a0cc-c49e23779a7f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 200 len: 1513 microversion: 2.1 time: 1.382466 May 19 08:31:16.569402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1982/3307] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:15 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 1513 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:16.583326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:16.588982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:16.603968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:16.604852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:16.607033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:16.611784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:18.066587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:18.079266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63a27670-3f11-4b23-ae91-fef423c6b4a7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 1.507721 May 19 08:31:18.087343 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1983/3308] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:16 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:18.107022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4c75b7a8-20a9-4a89-be93-6553060110ec req-4b8775af-4dbe-4b33-84cb-e42d70a0d1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18755da-8568-40c8-8b0a-8acbd13e904e", "name": "network-vif-deleted", "tag": "f63a0119-dd95-4fe4-9e28-dc409203072e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:18.155927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4c75b7a8-20a9-4a89-be93-6553060110ec req-4b8775af-4dbe-4b33-84cb-e42d70a0d1e0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:18.156725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4c75b7a8-20a9-4a89-be93-6553060110ec req-4b8775af-4dbe-4b33-84cb-e42d70a0d1e0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:18.206557 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4c75b7a8-20a9-4a89-be93-6553060110ec req-4b8775af-4dbe-4b33-84cb-e42d70a0d1e0 service nova] Creating event network-vif-deleted:f63a0119-dd95-4fe4-9e28-dc409203072e for instance f18755da-8568-40c8-8b0a-8acbd13e904e on chh2-842464-2 May 19 08:31:18.243281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4c75b7a8-20a9-4a89-be93-6553060110ec req-4b8775af-4dbe-4b33-84cb-e42d70a0d1e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146040 May 19 08:31:18.255475 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1984/3309] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:18.286528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:18.287173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: f18755da-8568-40c8-8b0a-8acbd13e904e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:18.323111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:18.323612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:18.333165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:18.338568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:18.411660 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] HTTP exception thrown: Instance f18755da-8568-40c8-8b0a-8acbd13e904e could not be found. May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Request method failure captured: May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e HTTP/1.1 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf83FXIkb04zP0PjjgbkcJHRXSpeo41h6QKi_fTW8y23p-YAn5WTcYo5UthTrFE7QGCi8nqTf1WSItL0ixsIBHHp4qaENXgUDy0yIdqZ3ToviAa73BOwefWZ2SXXEasnVoJdETLVb5cHdDIb1Kk8adn81c-0VFGsf13istDWNYDOdcc May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9ad1d482e3d447f9829945d5e09b32a1 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesSnapshotTestJSON-737754770 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesSnapshotTestJSON-737754770 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9ad1d482e3d447f9829945d5e09b32a1 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-737754770 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesSnapshotTestJSON-737754770-project May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 73cd52377ce84c7ca8c254c0068a82b7 May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesSnapshotTestJSON-737754770-project May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f18755da-8568-40c8-8b0a-8acbd13e904e could not be found. May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f18755da-8568-40c8-8b0a-8acbd13e904e'} May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f18755da-8568-40c8-8b0a-8acbd13e904e could not be found. May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f18755da-8568-40c8-8b0a-8acbd13e904e could not be found. May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:18.415753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f18755da-8568-40c8-8b0a-8acbd13e904e could not be found. May 19 08:31:18.421823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:18.427301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Returning 404 to user: Instance f18755da-8568-40c8-8b0a-8acbd13e904e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:18.431134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd3ce0c1-ad00-409f-82c3-59f91f7bb797 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e" status: 404 len: 111 microversion: 2.1 time: 0.173275 May 19 08:31:18.433850 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1985/3310] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:18 2022] GET /compute/v2.1/servers/f18755da-8568-40c8-8b0a-8acbd13e904e => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:19.122790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:19.124856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:19.192488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:19.193602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:19.195289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:19.198299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:20.802785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:20.820890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5e55624-e49b-478f-b057-d0da5d07fe0f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 1.714910 May 19 08:31:20.821941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1986/3311] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:19 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:31:21.867273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:21.867917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:21.925451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:21.932994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:21.938431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:21.946676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.111581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:25.128571 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7819f068-267e-4c8e-a538-e7f83e60993b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 3.265478 May 19 08:31:25.140730 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1987/3312] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:21 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 3278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:31:25.149016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:25.159268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:25.214444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.223822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.225051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.230901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.314402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d HTTP/1.1 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4c2d627a-8b5c-49b5-9a3b-5c255187b78d'} May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:25.320102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.324479 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.340032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:25.342884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-465ea832-cf2d-42ca-8e85-1239b1dca519 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 404 len: 111 microversion: 2.1 time: 0.200014 May 19 08:31:25.346971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1988/3313] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:31:25 2022] DELETE /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:25.391222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:25.406845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 4c2d627a-8b5c-49b5-9a3b-5c255187b78d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:25.452257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.470079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.488847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.490472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.546646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d HTTP/1.1 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4c2d627a-8b5c-49b5-9a3b-5c255187b78d'} May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.555775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. May 19 08:31:25.559823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.565814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 4c2d627a-8b5c-49b5-9a3b-5c255187b78d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:25.567236 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd3af12a-a82b-4d09-b688-971652488e55 tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d" status: 404 len: 111 microversion: 2.1 time: 0.215803 May 19 08:31:25.579184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1989/3314] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:25 2022] GET /compute/v2.1/servers/4c2d627a-8b5c-49b5-9a3b-5c255187b78d => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:25.598692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:25.608524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:25.632889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.634388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.640789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.649771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.724727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 HTTP/1.1 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7978275d-cb9b-440e-9a41-14a9abc98448'} May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:25.727418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.733119 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.735125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:25.743471 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-890ef6aa-acef-4a8c-a6b9-c9a6987acadd tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 404 len: 111 microversion: 2.1 time: 0.162687 May 19 08:31:25.749569 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1990/3315] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:31:25 2022] DELETE /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:25.756189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:25.762639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] [instance: 7978275d-cb9b-440e-9a41-14a9abc98448] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:25.803831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.805107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.816227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:25.817091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:25.876755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] HTTP exception thrown: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Request method failure captured: May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 HTTP/1.1 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf7hMQ-A2IarOqsrahbRqPTKJw1u4qJYZUA3ttcoWOcdOsP517TC_ZLHpIGseYgXpMvmM0OgrC2F2J5ebDEl5O5zGUDb_QUVVyPaxPeyhhK84yBLZGJ5mXBoJcSdE7DlwULMxzxgq9pIh6eKJJ0Z_lxpnz6uuPSJlTdl9KeCMKGVkR0 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70755fb6ec1a4686ac33cbdb47b74207"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 70755fb6ec1a4686ac33cbdb47b74207 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1381454002 May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 62999389d3fa41fb98d9a31c298bbe8e May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1381454002-project May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7978275d-cb9b-440e-9a41-14a9abc98448'} May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:31:25.886877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] Returning 404 to user: Instance 7978275d-cb9b-440e-9a41-14a9abc98448 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:31:25.892912 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4cb7838c-ce4f-4a82-b2d4-c10c199f122e tempest-DeleteServersTestJSON-1381454002 tempest-DeleteServersTestJSON-1381454002-project] 10.222.0.78 "GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448" status: 404 len: 111 microversion: 2.1 time: 0.137731 May 19 08:31:25.895431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1991/3316] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:25 2022] GET /compute/v2.1/servers/7978275d-cb9b-440e-9a41-14a9abc98448 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:31:26.156466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:26.157113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:26.169583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:26.170139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:26.199487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:26.199487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:26.681242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:26.690309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9025f31-7979-4db2-bc41-81572453e1d4 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1507 microversion: 2.1 time: 0.538307 May 19 08:31:26.691592 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1992/3317] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:26 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1507 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:31:27.791251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-9346908", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "225e149a-6f7d-4e18-b88b-ad1397d0cef4"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:35.919468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] validate_networks() for [('225e149a-6f7d-4e18-b88b-ad1397d0cef4', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:31:36.687087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=66 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:37.793345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:31:37.793892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:31:37.794077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:31:37.795343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:31:37.796210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:31:37.805982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:37.836803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:37.838424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:37.842814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:37.845783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:37.946058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Getting quotas for project 91eb610b12fb40039a498d0e79e28d5b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:37.972529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Getting quotas for user 33971107a60f4c86bca26fb5ef596a2d and project 91eb610b12fb40039a498d0e79e28d5b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:38.015280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:31:38.028738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:31:38.193945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15926591-7a1f-4bfb-8ae2-072a563bfadd tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 10.776134 May 19 08:31:38.203459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1993/3318] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 10781 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:31:38.211929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:38.212553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:38.238649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:38.239566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:38.239866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:38.243100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:39.598235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:39.609671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f96b0d08-5012-4534-94d6-acabf402bcfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1504 microversion: 2.1 time: 1.409720 May 19 08:31:39.610476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1994/3319] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:38 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1504 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:39.937636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41e6c93f-52d5-4b2b-a337-1386243e0157 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Action: 'create', calling method: .version_select at 0x7f32119b8e50>, body: {"keypair": {"name": "tempest-keypair-549674085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONjzxqVHGLN/sjmHx73JVvI8rAm7kbPBNDNvxBdhd9Ko3gFi5mga1QEoVYJdcR4Qqfl/51vRMfGaBA3M/WVVpseWu3EXOG23ktJ0/HCpSC48Kex7StOAgFvUvOlP1KaBQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:39.994586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-41e6c93f-52d5-4b2b-a337-1386243e0157 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Getting quotas for project 9e9508e472fa49d68b091e2c3a427dcb. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:40.017835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-41e6c93f-52d5-4b2b-a337-1386243e0157 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Getting quotas for user 8a9ba37cdb5a414ea29c5604ede0a9aa and project 9e9508e472fa49d68b091e2c3a427dcb. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:40.107679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41e6c93f-52d5-4b2b-a337-1386243e0157 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.468726 May 19 08:31:40.110278 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1995/3320] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:31:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:40.204540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5cd2264a-b639-4cb4-a8f2-979a87722de1 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Action: 'create', calling method: .version_select at 0x7f3211fcd5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2106392184", "policies": ["affinity"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:40.247656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5cd2264a-b639-4cb4-a8f2-979a87722de1 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:40.271528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5cd2264a-b639-4cb4-a8f2-979a87722de1 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:40.370709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5cd2264a-b639-4cb4-a8f2-979a87722de1 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:40.378146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5cd2264a-b639-4cb4-a8f2-979a87722de1 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:40.394479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5cd2264a-b639-4cb4-a8f2-979a87722de1 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.281929 May 19 08:31:40.395934 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1996/3321] 10.222.0.78 () {60 vars in 1173 bytes} [Thu May 19 08:31:40 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:40.405849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:40.406923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:40.417987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:40.418916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:40.421109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:40.422188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:40.689975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:40.710545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:40.718234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:40.720137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc9490ad-0206-48e8-8224-62a5472fabd0 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1311 microversion: 2.26 time: 0.322855 May 19 08:31:40.725290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1997/3322] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:31:40 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1311 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:31:40.739053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afd74247-1104-4ac6-a56e-6970ec5c2ce7 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Action: 'create', calling method: .version_select at 0x7f321223bf70>, body: {"server_group": {"name": "tempest-server-group-364424123", "policies": ["affinity"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:40.786760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-afd74247-1104-4ac6-a56e-6970ec5c2ce7 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:40.814465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-afd74247-1104-4ac6-a56e-6970ec5c2ce7 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:40.990451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-afd74247-1104-4ac6-a56e-6970ec5c2ce7 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:41.004940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-afd74247-1104-4ac6-a56e-6970ec5c2ce7 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:41.044128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afd74247-1104-4ac6-a56e-6970ec5c2ce7 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.316429 May 19 08:31:41.045413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1998/3323] 10.222.0.78 () {60 vars in 1172 bytes} [Thu May 19 08:31:40 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:41.050333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:41.057080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:41.069718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:41.070389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:41.071326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:41.071950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:41.586632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:41.601154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc5bcdca-4ae9-4bcc-a7c7-8fddfb7b87d7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1504 microversion: 2.1 time: 0.550093 May 19 08:31:41.602612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 1999/3324] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:41 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:41.614348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc61632b-0d2b-4824-bee0-43c4ef9ec8ee tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Action: 'create', calling method: .version_select at 0x7f3211fcd280>, body: {"server_group": {"name": "tempest-server-group-364424123", "policies": ["affinity"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:41.669552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fc61632b-0d2b-4824-bee0-43c4ef9ec8ee tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:41.686855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fc61632b-0d2b-4824-bee0-43c4ef9ec8ee tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:41.824126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:41.891071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fc61632b-0d2b-4824-bee0-43c4ef9ec8ee tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:41.897654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fc61632b-0d2b-4824-bee0-43c4ef9ec8ee tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:41.963941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc61632b-0d2b-4824-bee0-43c4ef9ec8ee tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.359847 May 19 08:31:41.964576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2000/3325] 10.222.0.78 () {60 vars in 1172 bytes} [Thu May 19 08:31:41 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:41.977141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:41.978733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:42.004546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:42.005193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:42.006689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:42.009090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:42.519480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:42.567221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:42.575343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:42.584739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38f2c5a2-5b3c-4459-a134-ce37a3d7437c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1319 microversion: 2.26 time: 0.616225 May 19 08:31:42.604188 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2001/3326] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:31:41 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:31:42.635397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81d2dd89-7d88-4093-9616-13a708b2c338 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:42.769184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81d2dd89-7d88-4093-9616-13a708b2c338 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/bbaca444-2a39-406b-b275-e9658b18aba6" status: 204 len: 0 microversion: 2.1 time: 0.160470 May 19 08:31:42.771894 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2002/3327] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:31:42 2022] DELETE /compute/v2.1/os-server-groups/bbaca444-2a39-406b-b275-e9658b18aba6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:31:42.800846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:42.802602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:42.829881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:42.831318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:42.832620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:42.834427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:44.726077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:44.740658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd32d75c-d24b-4864-a6e1-4d53825db7f6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 200 len: 1447 microversion: 2.1 time: 1.963445 May 19 08:31:44.741215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2003/3328] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:42 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 1447 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:44.757405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89bba432-2338-45ea-a51d-cd36ee66efeb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:44.793931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89bba432-2338-45ea-a51d-cd36ee66efeb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.049345 May 19 08:31:44.805186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2004/3329] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:31:44 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:45.012365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-996efbd2-2232-442b-ae02-54d5d29b64f2 req-4a97bd55-04ad-428c-8c9d-d547bb2cf175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ad4c36-79d1-48bc-ab62-99ef48cbb72b", "name": "network-vif-unplugged", "status": "completed", "tag": "9039bcd7-9044-46b2-bf3d-931f15eb34af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:45.026971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-996efbd2-2232-442b-ae02-54d5d29b64f2 req-4a97bd55-04ad-428c-8c9d-d547bb2cf175 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:45.027423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-996efbd2-2232-442b-ae02-54d5d29b64f2 req-4a97bd55-04ad-428c-8c9d-d547bb2cf175 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:45.071936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_external_events [req-996efbd2-2232-442b-ae02-54d5d29b64f2 req-4a97bd55-04ad-428c-8c9d-d547bb2cf175 service nova] Unable to find a host for instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b. Dropping event network-vif-unplugged {{(pid=119072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 08:31:45.072882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-996efbd2-2232-442b-ae02-54d5d29b64f2 req-4a97bd55-04ad-428c-8c9d-d547bb2cf175 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.266370 May 19 08:31:45.075597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2005/3330] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 270 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 08:31:45.088445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:45.089850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:45.105962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:45.106552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:45.107981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:45.108431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:45.639386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:45.651993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:45.657156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:45.658564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4de34589-4c58-48c7-a184-f53089af1851 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1359 microversion: 2.26 time: 0.581780 May 19 08:31:45.659178 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2006/3331] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:31:45 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1359 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:31:45.677924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-296772857", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "c558eae9-3be0-4c64-9f55-53acd89dda52"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:45.792806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] validate_networks() for [('c558eae9-3be0-4c64-9f55-53acd89dda52', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:31:47.394050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:31:47.395224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:31:47.395967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:31:47.396589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:31:47.397260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:31:47.412796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:47.426155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:47.427639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:47.428356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:47.499451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Getting quotas for project 9ad1d482e3d447f9829945d5e09b32a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:47.518410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Getting quotas for user 73cd52377ce84c7ca8c254c0068a82b7 and project 9ad1d482e3d447f9829945d5e09b32a1. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:47.566893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:31:47.569401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:31:47.665793 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-889d0d33-9684-4301-934b-e64f1ac80681 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.995274 May 19 08:31:47.667211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2007/3332] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:31:47.675415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:47.676417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:47.683292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:47.684271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:47.686400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:47.687114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:48.660817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:48.680274 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0aab9188-7718-4f23-97df-8909e09950ba tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 1.009235 May 19 08:31:48.681915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2008/3333] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:47 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:48.704844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6c9cc23-d9dd-4a82-8c18-2e82664e0a01 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:48.770636 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6c9cc23-d9dd-4a82-8c18-2e82664e0a01 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/ef80cb2c-d94c-4052-aab5-bb9d4b737505" status: 204 len: 0 microversion: 2.1 time: 0.084160 May 19 08:31:48.772148 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2009/3334] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:31:48 2022] DELETE /compute/v2.1/os-server-groups/ef80cb2c-d94c-4052-aab5-bb9d4b737505 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:31:48.783164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:48.785348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:48.822237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:48.823254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:48.838291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:48.840848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:49.147695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:49.167837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:49.172046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:49.173749 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d17b31cb-5183-421e-bdc0-a27574803519 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1359 microversion: 2.26 time: 0.399305 May 19 08:31:49.186891 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2010/3335] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:31:48 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:31:49.192659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3a18614e-55b6-4c8f-b83d-4943e2266b0d req-448b49b5-aad0-49d9-a1d6-cb01a525d90b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "646518b7-2aee-45a4-b8da-8869f84ca81f", "tag": "fb158996-0285-4bf0-8ebb-5b81e86f6ffa"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:49.204499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a18614e-55b6-4c8f-b83d-4943e2266b0d req-448b49b5-aad0-49d9-a1d6-cb01a525d90b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:49.205266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a18614e-55b6-4c8f-b83d-4943e2266b0d req-448b49b5-aad0-49d9-a1d6-cb01a525d90b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:49.229238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3a18614e-55b6-4c8f-b83d-4943e2266b0d req-448b49b5-aad0-49d9-a1d6-cb01a525d90b service nova] Creating event network-changed:fb158996-0285-4bf0-8ebb-5b81e86f6ffa for instance 646518b7-2aee-45a4-b8da-8869f84ca81f on chh1-842464-2 May 19 08:31:49.238365 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3a18614e-55b6-4c8f-b83d-4943e2266b0d req-448b49b5-aad0-49d9-a1d6-cb01a525d90b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049868 May 19 08:31:49.239323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2011/3336] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:49.244980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:49.245975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:49.260484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:49.263076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:49.278540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:49.279488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:49.448195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:49.460795 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-951bcb47-db3d-43a1-9f0b-7cda581818db tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1270 microversion: 2.1 time: 0.220200 May 19 08:31:49.461653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2012/3337] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:49 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:49.468348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:49.481279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:49.500700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:49.501682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:49.502668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:49.503476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:50.081353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:50.107727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e27bbc5-f5de-45e8-a730-9c37f67e3d2e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.644800 May 19 08:31:50.119858 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2013/3338] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:49 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:50.131678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-135101510", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d622c8a2-87e3-4807-a24f-c74a9d4a1cc1"}], "security_groups": [{"name": "tempest-securitygroup--345473537"}], "key_name": "tempest-keypair-549674085", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:50.698600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] validate_networks() for [('d622c8a2-87e3-4807-a24f-c74a9d4a1cc1', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:31:52.749734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Getting quotas for project 9e9508e472fa49d68b091e2c3a427dcb. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:52.766205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Getting quotas for user 8a9ba37cdb5a414ea29c5604ede0a9aa and project 9e9508e472fa49d68b091e2c3a427dcb. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:52.823574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:31:52.824176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:31:52.824661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:31:52.825063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:31:52.827944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:31:52.861079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:52.862679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:52.864085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:52.865032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:52.910689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Getting quotas for project 9e9508e472fa49d68b091e2c3a427dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:52.917212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Getting quotas for user 8a9ba37cdb5a414ea29c5604ede0a9aa and project 9e9508e472fa49d68b091e2c3a427dcb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:52.973892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:31:52.985397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:31:53.430669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a37af31b-246f-47e8-a0f4-b93ed302741b tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.289302 May 19 08:31:53.446181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2014/3339] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:31:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 3326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:31:53.482846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bc32851-3299-4b34-9933-d0b83313fa60 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:53.507856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1bc32851-3299-4b34-9933-d0b83313fa60 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.060029 May 19 08:31:53.523028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2015/3340] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:31:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:53.528490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:53.533526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:53.549294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:53.555667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:53.558047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:53.558664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:54.153225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:54.162136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9234969a-115b-4d0e-8bb0-d748dd9418f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.637535 May 19 08:31:54.162740 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2016/3341] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:53 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:54.187413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:54.187914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:54.215560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:54.216356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:54.217197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:54.223678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:54.753144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:54.764706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:54.768389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:54.771566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bd567a9-e8d0-4e3b-aa75-a62980174f2b tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1359 microversion: 2.26 time: 0.600972 May 19 08:31:54.775111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2017/3342] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:31:54 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1359 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:31:54.786706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:54.790885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:54.822640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:54.824700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:54.850191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:54.856853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:55.320441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:55.342754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7994e1b8-7803-45f8-9460-5e042ba100bd tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1318 microversion: 2.1 time: 0.565327 May 19 08:31:55.352363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2018/3343] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:54 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:55.352363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:55.352363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:55.375541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:55.414873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:55.415325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:55.416123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:55.416560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:55.719781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:55.734020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e6f4e0c-dcb7-4bec-883a-0c2e84f8496f tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1320 microversion: 2.1 time: 0.389096 May 19 08:31:55.744206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2019/3344] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:55 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:55.758717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84e0ba9f-c732-451c-bc75-02a40ca74e6e tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Action: 'create', calling method: .version_select at 0x7f321223bf70>, body: {"server_group": {"name": "tempest-server-group-1576102522", "policies": ["affinity"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:55.850417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-84e0ba9f-c732-451c-bc75-02a40ca74e6e tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:55.892289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-84e0ba9f-c732-451c-bc75-02a40ca74e6e tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:56.034775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-84e0ba9f-c732-451c-bc75-02a40ca74e6e tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:31:56.044779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-84e0ba9f-c732-451c-bc75-02a40ca74e6e tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:31:56.106119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84e0ba9f-c732-451c-bc75-02a40ca74e6e tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.360274 May 19 08:31:56.111635 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2020/3345] 10.222.0.78 () {60 vars in 1172 bytes} [Thu May 19 08:31:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:56.126294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:56.127675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:56.151277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:56.155685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:56.158244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:56.165060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:56.680441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:56.691847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:31:56.694465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5b9b90c-f3d3-4275-8cc2-43451d054b9b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.581661 May 19 08:31:56.701703 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2021/3346] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:56 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:56.707279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:56.712440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:56.727183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:56.734225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:56.735559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:56.742228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:57.617267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:57.629773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:57.636785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:57.638580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07e677fe-6b7d-49c3-886f-c0890f67d4b5 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1359 microversion: 2.26 time: 0.935246 May 19 08:31:57.639728 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2022/3347] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:31:56 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1359 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:31:57.649692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3c47e53-ad3d-474d-962f-0d167ba23574 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:57.743501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3c47e53-ad3d-474d-962f-0d167ba23574 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/96d279cf-e388-4a27-906a-0fe1f33769de" status: 204 len: 0 microversion: 2.1 time: 0.102434 May 19 08:31:57.744141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2023/3348] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:31:57 2022] DELETE /compute/v2.1/os-server-groups/96d279cf-e388-4a27-906a-0fe1f33769de => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:31:57.767516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:57.770444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:57.788337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:57.795289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:57.798769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:57.802335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:58.352560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:58.366192 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7e07629-95de-4366-87ce-95ed43ad33aa tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1318 microversion: 2.1 time: 0.608932 May 19 08:31:58.371595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2024/3349] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:57 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:58.589717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8c4627e5-ff69-4d99-a803-5733b47eb75c req-89c04ede-04c0-4d11-983c-7ad03157314b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f37cfb6-2e4b-42c9-b78d-69c4e18ed686", "tag": "5126af38-3211-4235-b21e-dc6cb7088ab7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:58.604216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8c4627e5-ff69-4d99-a803-5733b47eb75c req-89c04ede-04c0-4d11-983c-7ad03157314b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:58.610892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8c4627e5-ff69-4d99-a803-5733b47eb75c req-89c04ede-04c0-4d11-983c-7ad03157314b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:58.638028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8c4627e5-ff69-4d99-a803-5733b47eb75c req-89c04ede-04c0-4d11-983c-7ad03157314b service nova] Creating event network-changed:5126af38-3211-4235-b21e-dc6cb7088ab7 for instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 on chh2-842464-2 May 19 08:31:58.649186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8c4627e5-ff69-4d99-a803-5733b47eb75c req-89c04ede-04c0-4d11-983c-7ad03157314b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272676 May 19 08:31:58.654363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2025/3350] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:58.667739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba4f139d-8239-4d35-86b4-107a2649edfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:58.684402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba4f139d-8239-4d35-86b4-107a2649edfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:58.687458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba4f139d-8239-4d35-86b4-107a2649edfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:58.762459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba4f139d-8239-4d35-86b4-107a2649edfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:31:58.931703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba4f139d-8239-4d35-86b4-107a2649edfc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.271739 May 19 08:31:58.939643 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2026/3351] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:31:58 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:31:58.960089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:58.971947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:31:59.013606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:59.019599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:59.025551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:59.035929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:59.787517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:31:59.807141 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c050a77d-87ca-4195-9ec8-299b39da87ef tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 0.859457 May 19 08:31:59.822618 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2027/3352] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:31:58 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:31:59.831606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-390db17f-fe4e-4b44-87ea-41114299d007 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:31:59.888319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-390db17f-fe4e-4b44-87ea-41114299d007 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.063912 May 19 08:31:59.894086 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2028/3353] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:31:59 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:31:59.911636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aa7056d7-b0ab-4ceb-bc39-de285f4012c0 req-3fe2b0e4-0bf3-4ee2-ab42-eb3a44c41675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646518b7-2aee-45a4-b8da-8869f84ca81f", "name": "network-vif-plugged", "status": "completed", "tag": "fb158996-0285-4bf0-8ebb-5b81e86f6ffa"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:31:59.939176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aa7056d7-b0ab-4ceb-bc39-de285f4012c0 req-3fe2b0e4-0bf3-4ee2-ab42-eb3a44c41675 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:31:59.940277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aa7056d7-b0ab-4ceb-bc39-de285f4012c0 req-3fe2b0e4-0bf3-4ee2-ab42-eb3a44c41675 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:31:59.989638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aa7056d7-b0ab-4ceb-bc39-de285f4012c0 req-3fe2b0e4-0bf3-4ee2-ab42-eb3a44c41675 service nova] Creating event network-vif-plugged:fb158996-0285-4bf0-8ebb-5b81e86f6ffa for instance 646518b7-2aee-45a4-b8da-8869f84ca81f on chh1-842464-2 May 19 08:32:00.004994 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aa7056d7-b0ab-4ceb-bc39-de285f4012c0 req-3fe2b0e4-0bf3-4ee2-ab42-eb3a44c41675 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109189 May 19 08:32:00.010041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2029/3354] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:00.051313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:00.054894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:00.074123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:00.078822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:00.081915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:00.087894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:00.959034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:00.994317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:01.005903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:01.008554 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cf99842-d8e0-4b00-b15b-d4461a855a5c tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1359 microversion: 2.26 time: 0.996718 May 19 08:32:01.015052 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2030/3355] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:00 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1359 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:01.033246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:01.039421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:01.065564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:01.068335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:01.069158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:01.069632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:01.427879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:01.442054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8045dcbd-30e5-4529-aa9e-c9bbf927bde8 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.424054 May 19 08:32:01.453139 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2031/3356] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:01 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:01.460238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:01.461190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:01.471164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:01.491893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:01.493250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:01.494518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:02.264053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:02.276058 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9bccc99-4578-4e6f-b628-642b1103cc01 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1318 microversion: 2.1 time: 0.821266 May 19 08:32:02.297819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2032/3357] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:01 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:02.304115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e19eefe7-0e7f-4650-975f-c7c651d2ff90 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Action: 'create', calling method: .version_select at 0x7f3211ca4dc0>, body: {"server_group": {"name": "tempest-server-group-1062173708", "policies": ["anti-affinity"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:02.338878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e19eefe7-0e7f-4650-975f-c7c651d2ff90 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:02.353338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e19eefe7-0e7f-4650-975f-c7c651d2ff90 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:02.463964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e19eefe7-0e7f-4650-975f-c7c651d2ff90 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:02.483508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e19eefe7-0e7f-4650-975f-c7c651d2ff90 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:02.536044 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e19eefe7-0e7f-4650-975f-c7c651d2ff90 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.236506 May 19 08:32:02.545484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2033/3358] 10.222.0.78 () {60 vars in 1172 bytes} [Thu May 19 08:32:02 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:02.556247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:02.560656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:02.581216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:02.582175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:02.583268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:02.585968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:02.883369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:03.435469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:03.449288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d71be8c-c481-426d-bd0e-cf240a8afa9e tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 0.902024 May 19 08:32:03.452674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2034/3359] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:02 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:03.463551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:03.464557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:03.510356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:03.511786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:03.516221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:03.517280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:03.933399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:03.951958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:03.954330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:03.955754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbd1b716-45f5-47d4-b05a-d35dd5acc569 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1542 microversion: 2.26 time: 0.501271 May 19 08:32:03.962072 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2035/3360] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:03 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1542 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:03.981148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:03.990415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:03.998828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:04.002664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:04.003988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:04.005940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:04.700048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:04.717901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af975325-384a-40ed-ba0d-e89a5c1eee76 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.746536 May 19 08:32:04.734843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2036/3361] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:03 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:04.748703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f677033-185c-451b-bf5a-bbe4d0a3f8ea tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:04.828943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f677033-185c-451b-bf5a-bbe4d0a3f8ea tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/28e78cfe-10f1-4dbf-b288-07f5a48260b1" status: 204 len: 0 microversion: 2.1 time: 0.092092 May 19 08:32:04.833177 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2037/3362] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:32:04 2022] DELETE /compute/v2.1/os-server-groups/28e78cfe-10f1-4dbf-b288-07f5a48260b1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:32:04.838447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:04.843606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:04.848565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:04.880987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:04.882409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:04.882754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:04.892616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.252415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:05.269952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b16e0e20-993e-45f5-b187-7e1e91146d9a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1318 microversion: 2.1 time: 0.435332 May 19 08:32:05.270792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2038/3363] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:04 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:05.282711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f321200f430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:05.344072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.344304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.344851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:05.373724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.376666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.377947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.393509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.511585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.512301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.549111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.549654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.628186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:05.651944 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e03fc2a-ec9d-4a7f-85c6-dd37dcb763ef tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-2007036667" status: 201 len: 0 microversion: 2.26 time: 0.379447 May 19 08:32:05.653579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2039/3364] 10.222.0.78 () {62 vars in 1379 bytes} [Thu May 19 08:32:05 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-2007036667 => generated 0 bytes in 382 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 08:32:05.661671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8b2d3c6d-71f7-4087-bf05-5fbce47d4d1c req-27c6a888-b9db-42b7-a580-98aebd004b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c", "tag": "64725787-d9b3-4fe4-abe9-3227fd4a9b5f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:05.679101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b2d3c6d-71f7-4087-bf05-5fbce47d4d1c req-27c6a888-b9db-42b7-a580-98aebd004b36 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.679759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b2d3c6d-71f7-4087-bf05-5fbce47d4d1c req-27c6a888-b9db-42b7-a580-98aebd004b36 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.697831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8b2d3c6d-71f7-4087-bf05-5fbce47d4d1c req-27c6a888-b9db-42b7-a580-98aebd004b36 service nova] Creating event network-changed:64725787-d9b3-4fe4-abe9-3227fd4a9b5f for instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c on chh1-842464-2 May 19 08:32:05.704856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8b2d3c6d-71f7-4087-bf05-5fbce47d4d1c req-27c6a888-b9db-42b7-a580-98aebd004b36 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048956 May 19 08:32:05.705811 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2040/3365] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:05.714244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:05.716311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:05.724312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.725206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.726515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:05.727506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:05.963571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:05.967469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:05.985006 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea6f7e50-6d34-4592-af43-4e5039b2bada tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 0.277565 May 19 08:32:05.985941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2041/3366] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:05 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:06.004349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d64a0f3-c5b8-4f42-b83d-dc00dcc4c9d0 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:06.032453 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d64a0f3-c5b8-4f42-b83d-dc00dcc4c9d0 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037095 May 19 08:32:06.033497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2042/3367] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:32:05 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:06.038622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4a0c7df9-bf87-4481-af07-0ac74da1b5c1 req-3824bbf2-c5db-48d2-b6e7-fed747663e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f37cfb6-2e4b-42c9-b78d-69c4e18ed686", "name": "network-vif-plugged", "status": "completed", "tag": "5126af38-3211-4235-b21e-dc6cb7088ab7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:06.076366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4a0c7df9-bf87-4481-af07-0ac74da1b5c1 req-3824bbf2-c5db-48d2-b6e7-fed747663e91 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:06.085392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4a0c7df9-bf87-4481-af07-0ac74da1b5c1 req-3824bbf2-c5db-48d2-b6e7-fed747663e91 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:06.108982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4a0c7df9-bf87-4481-af07-0ac74da1b5c1 req-3824bbf2-c5db-48d2-b6e7-fed747663e91 service nova] Creating event network-vif-plugged:5126af38-3211-4235-b21e-dc6cb7088ab7 for instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 on chh2-842464-2 May 19 08:32:06.118562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4a0c7df9-bf87-4481-af07-0ac74da1b5c1 req-3824bbf2-c5db-48d2-b6e7-fed747663e91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083411 May 19 08:32:06.119639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2043/3368] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:06.126395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0aa3ff5e-0559-4274-bf9f-50ecf330f45d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f321200f1f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:06.149635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aa3ff5e-0559-4274-bf9f-50ecf330f45d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:06.150113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aa3ff5e-0559-4274-bf9f-50ecf330f45d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:06.183589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0aa3ff5e-0559-4274-bf9f-50ecf330f45d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-2007036667" status: 204 len: 0 microversion: 2.26 time: 0.062601 May 19 08:32:06.184512 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2044/3369] 10.222.0.78 () {60 vars in 1360 bytes} [Thu May 19 08:32:06 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-2007036667 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:06.189738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:06.190829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:06.197907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:06.198520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:06.199291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:06.199738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:06.546289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:06.572604 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13cf50cd-de03-47e6-a62c-a6858c6366b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.386658 May 19 08:32:06.583989 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2045/3370] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:06 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:06.588888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-232515114", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "00778a24-7917-443f-b83c-ce4fbfd6c2d9"}]}, "os:scheduler_hints": {"group": "6933f316-9b7c-4759-9b42-17d200d86ed4"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:06.724366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] validate_networks() for [('00778a24-7917-443f-b83c-ce4fbfd6c2d9', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:32:07.884075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:32:07.884893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:32:07.885020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:32:07.885433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:32:07.886113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:32:07.905060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=67 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:07.929582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:07.930037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:07.931172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:07.931800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:07.975663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:07.996912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:08.038336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:32:08.041616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:32:08.218680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:08.240819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:08.306759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:08.315673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Getting quotas for user 31f0bec753aa40fda7616b8abfe0107e and project 37429262a5e54f61b0564df32dc90ac4. Resources: {'server_group_members'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:08.356961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-caa16ea5-1eb4-46ec-ad57-d31160b6a1e4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.771689 May 19 08:32:08.358261 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2046/3371] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:32:08.363857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3211b2c3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:08.376862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.379440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.380150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:08.393643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.394114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.396422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.402110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.453079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.453484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.501194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:08.526268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9fb6e57-89ca-4349-b0a8-9e04cd694327 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 204 len: 0 microversion: 2.26 time: 0.166925 May 19 08:32:08.527266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2047/3372] 10.222.0.78 () {60 vars in 1294 bytes} [Thu May 19 08:32:08 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:08.543283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:08.544429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:08.555798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.556278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.557275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.557762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.874156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:08.897164 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74fb3a55-84a3-4275-8e05-90d142d6658a tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1507 microversion: 2.1 time: 0.368570 May 19 08:32:08.898204 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2048/3373] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:08 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:08.915878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:08.916516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:08.938967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.939433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:08.940232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:08.940679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.238232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:09.249432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c9f81b1-7413-4bb0-87e7-f945ddfd7ed8 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 0.349496 May 19 08:32:09.260344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2049/3374] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:08 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:09.278951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:09.279590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:09.296354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.298763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.301676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.303920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.620455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:09.634731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed0b95d9-f422-41b9-867f-44d1fe7b9dbe tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1678 microversion: 2.1 time: 0.372947 May 19 08:32:09.645486 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2050/3375] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:09 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1678 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:09.650500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:09.651132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:09.663185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.663430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.664359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.665567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.770572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:09.783742 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22952b3a-f053-4ac2-94d7-3ccc1db86d9f tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1208 microversion: 2.1 time: 0.137009 May 19 08:32:09.784960 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2051/3376] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:09 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:09.801042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a0c6534-9bdc-4714-ab5d-961c2b875201 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f32120651f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:09.824256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a0c6534-9bdc-4714-ab5d-961c2b875201 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.826272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a0c6534-9bdc-4714-ab5d-961c2b875201 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.855102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a0c6534-9bdc-4714-ab5d-961c2b875201 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 200 len: 12 microversion: 2.26 time: 0.065420 May 19 08:32:09.861076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2052/3377] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:32:09 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:09.870181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa2f3b73-91e0-4770-8898-2daae8d07633", "device": "/dev/sdb"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:09.871740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:09.882120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.882606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:09.884465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:09.884923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:10.713183 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91ae835f-e0ee-435f-bddb-96d9a604acdc tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "POST /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852800 May 19 08:32:10.715273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2053/3378] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:32:09 2022] POST /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:10.756221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3211e98550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:10.793976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:10.823835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:10.827754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:10.848599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:10.849057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:10.849874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:10.850315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:11.025424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:11.026206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:11.074814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:11.082682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:11.134467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:11.182429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac538755-ad6b-41db-b777-3ebcc88b4fe2 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-173074243" status: 201 len: 0 microversion: 2.26 time: 0.452931 May 19 08:32:11.187331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2054/3379] 10.222.0.78 () {62 vars in 1376 bytes} [Thu May 19 08:32:10 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-173074243 => generated 0 bytes in 471 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 19 08:32:11.194770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:11.197599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:11.213651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:11.214493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:11.224974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:11.226886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:12.567530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:12.586317 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36279ddd-a290-4cda-a8c7-5ffdeafd11fd tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 1.394830 May 19 08:32:12.587684 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2055/3380] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:11 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:12.611747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:12.624925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:12.641480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:12.645434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:12.646625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:12.648967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:13.102393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:13.115728 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-535bdcbb-9a71-41c6-908b-d21718f6f249 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1655 microversion: 2.1 time: 0.525853 May 19 08:32:13.119408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2056/3381] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:12 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1655 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:13.132828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:13.138956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:13.157649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:13.160611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:13.161658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:13.163951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:13.877210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:13.886882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6eab4162-2691-4f09-932f-f9a5c41bd383 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 0.764302 May 19 08:32:13.894960 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2057/3382] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:13 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:13.901720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-409f586e-02bc-41ff-835f-b69f02b971d6 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3211d92670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:13.921408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-409f586e-02bc-41ff-835f-b69f02b971d6 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:13.923433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-409f586e-02bc-41ff-835f-b69f02b971d6 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:13.942570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:13.949257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-409f586e-02bc-41ff-835f-b69f02b971d6 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 200 len: 35 microversion: 2.26 time: 0.052860 May 19 08:32:13.962735 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2058/3383] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:32:13 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 35 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:13.969130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3093954-74a2-42ba-aa17-14185c4645a6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:13.976497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3093954-74a2-42ba-aa17-14185c4645a6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:13.977242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3093954-74a2-42ba-aa17-14185c4645a6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:14.005098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3093954-74a2-42ba-aa17-14185c4645a6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 08:32:14.088230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3093954-74a2-42ba-aa17-14185c4645a6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.122100 May 19 08:32:14.088947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2059/3384] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:32:13 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:32:14.103115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:14.103998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:14.124043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:14.124534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:14.125404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:14.128888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.228628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:15.237932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2569d2d-90d1-49e8-bc01-bb2405c764cb tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 1.144562 May 19 08:32:15.239117 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2060/3385] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:14 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:15.245598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ceef7c9d-c5a2-481f-914d-98afd53a1530 req-dc641dc6-839d-40ad-a83b-35493b639e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c", "name": "network-vif-plugged", "status": "completed", "tag": "64725787-d9b3-4fe4-abe9-3227fd4a9b5f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:15.254838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ceef7c9d-c5a2-481f-914d-98afd53a1530 req-dc641dc6-839d-40ad-a83b-35493b639e8c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.255796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ceef7c9d-c5a2-481f-914d-98afd53a1530 req-dc641dc6-839d-40ad-a83b-35493b639e8c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.271082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ceef7c9d-c5a2-481f-914d-98afd53a1530 req-dc641dc6-839d-40ad-a83b-35493b639e8c service nova] Creating event network-vif-plugged:64725787-d9b3-4fe4-abe9-3227fd4a9b5f for instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c on chh1-842464-2 May 19 08:32:15.280049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ceef7c9d-c5a2-481f-914d-98afd53a1530 req-dc641dc6-839d-40ad-a83b-35493b639e8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 May 19 08:32:15.282393 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2061/3386] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:15.299299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3211b2caf0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:15.317192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.319763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.320992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:15.339177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.342688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.344161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.344784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.397784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.398517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.439563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:15.458178 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2dc02a5e-8d60-46d6-a2cf-af2e6a44c962 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-173074243" status: 204 len: 0 microversion: 2.26 time: 0.172111 May 19 08:32:15.459103 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2062/3387] 10.222.0.78 () {60 vars in 1360 bytes} [Thu May 19 08:32:15 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-173074243 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:15.468169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:15.468824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:15.477273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.478022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.478978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.479420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.892371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:15.910341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21f22bad-f80f-42a4-a9fb-0b93e186ab4e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1664 microversion: 2.1 time: 0.449563 May 19 08:32:15.924883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2063/3388] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:15 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1664 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:15.939019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:15.939748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:15.943516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:15.954017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.967206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:15.971869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:15.972893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:16.366397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:16.381195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb57677a-822c-4bc5-849d-c8c011f436ff tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 0.454854 May 19 08:32:16.382766 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2064/3389] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:15 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:16.407949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a0cd1d2-5b0c-4def-9925-fa803d70acd8 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f32122cc4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:16.425146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a0cd1d2-5b0c-4def-9925-fa803d70acd8 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:16.425646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a0cd1d2-5b0c-4def-9925-fa803d70acd8 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:16.446856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a0cd1d2-5b0c-4def-9925-fa803d70acd8 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 200 len: 12 microversion: 2.26 time: 0.062300 May 19 08:32:16.453205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2065/3390] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:32:16 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:16.460581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7d41fa89-c787-44bb-a9ae-2f07f868e8c2 req-b74bcf49-885d-455b-b653-9be06067e03b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a88f46-1746-4bb1-941a-3b219c08fb3f", "tag": "f37ff269-ec1b-4257-9e00-9944e7be36c9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:16.470779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7d41fa89-c787-44bb-a9ae-2f07f868e8c2 req-b74bcf49-885d-455b-b653-9be06067e03b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:16.471531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7d41fa89-c787-44bb-a9ae-2f07f868e8c2 req-b74bcf49-885d-455b-b653-9be06067e03b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:16.484946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7d41fa89-c787-44bb-a9ae-2f07f868e8c2 req-b74bcf49-885d-455b-b653-9be06067e03b service nova] Creating event network-changed:f37ff269-ec1b-4257-9e00-9944e7be36c9 for instance d8a88f46-1746-4bb1-941a-3b219c08fb3f on chh2-842464-2 May 19 08:32:16.490324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7d41fa89-c787-44bb-a9ae-2f07f868e8c2 req-b74bcf49-885d-455b-b653-9be06067e03b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035823 May 19 08:32:16.491287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2066/3391] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:16.497714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:16.499072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:16.507473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:16.508352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:16.509763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:16.510751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.007324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:17.030642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab019ce7-6fde-4134-b7ec-65bf8d870025 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1393 microversion: 2.1 time: 0.537738 May 19 08:32:17.040371 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2067/3392] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:16 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1393 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:17.040371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3212163dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:17.064675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.065392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.066027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:17.080905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.089832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.091187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.091811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.154215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.154578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.182875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:17.215629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbb806a1-bbeb-4cdf-a8ab-d841d0044d0a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 204 len: 0 microversion: 2.26 time: 0.182345 May 19 08:32:17.219555 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2068/3393] 10.222.0.78 () {60 vars in 1294 bytes} [Thu May 19 08:32:17 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:17.245101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:17.245910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:17.269029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.269518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.270314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.270750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.866460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:17.878592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6f26f83-0966-4515-8751-ef218a305f3e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.657793 May 19 08:32:17.882063 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2069/3394] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:17 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:17.892368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f321206d820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:17.912348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.917805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.920234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:17.931569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.934162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.938392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:17.939129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:17.949626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:18.005859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:18.011286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:18.039541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:18.040390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:18.096145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:18.145696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd22364a-8763-4d34-97dc-6c1ecc45f1cf tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-511996531" status: 201 len: 0 microversion: 2.26 time: 0.261441 May 19 08:32:18.151215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2070/3395] 10.222.0.78 () {62 vars in 1376 bytes} [Thu May 19 08:32:17 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-511996531 => generated 0 bytes in 268 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 19 08:32:18.158085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:18.166144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:18.191456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:18.194905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:18.196211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:18.198068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:18.333343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:18.691613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:18.717903 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53e68fd9-0c09-4032-b656-05769817b100 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 0.564677 May 19 08:32:18.731196 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2071/3396] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:18 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:18.751150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:18.755537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:18.772104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:18.773452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:18.776573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:18.777666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:19.768914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:19.792652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:19.798381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6110c0d5-b3e3-4bd0-8f54-2438d922124b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 1.061124 May 19 08:32:19.817272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2072/3397] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:18 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:19.840007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:19.849126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:19.893252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:19.928175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:19.930245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:19.933461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.561541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:20.577716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-419a6015-a34e-4ca9-96f2-dc1fd5d4752c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1574 microversion: 2.1 time: 0.756858 May 19 08:32:20.579628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2073/3398] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:19 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1574 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:20.613562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3212025940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:20.639257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.642195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.643049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:20.657462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.661425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.668035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.669681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.761167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.762146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.799651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.800781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.866526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:20.908563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3cfe3dc-af00-44ec-a432-3a9b720a9b7d tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-1892831937" status: 201 len: 0 microversion: 2.26 time: 0.299580 May 19 08:32:20.910154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2074/3399] 10.222.0.78 () {62 vars in 1379 bytes} [Thu May 19 08:32:20 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-1892831937 => generated 0 bytes in 302 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 08:32:20.915700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:20.920035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:20.963566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.964622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:20.968758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:20.969328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:21.283333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:21.296163 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c692fe7d-3e88-4d97-81ef-1e114b744cbd tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 0.384472 May 19 08:32:21.298739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2075/3400] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:20 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:21.305934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:21.306881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:21.331027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:21.331824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:21.332816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:21.333464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:21.713428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:21.730473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88ab104a-c5e3-4cb5-95ee-6ccfcee766d3 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.430056 May 19 08:32:21.732405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2076/3401] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:21 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:21.738482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:21.743633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:21.763146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:21.763995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:21.765584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:21.766725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:21.976258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb5a4513-db15-4735-ba4e-cb51b7a2b547 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242225 May 19 08:32:21.978608 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2077/3402] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:32:21 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:21.984576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f321200fe50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:22.007321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:22.008054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:22.008742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:22.025697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:22.026433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:22.028092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:22.028954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:22.083083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:22.083921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:22.116860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:22.161270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee2a031b-ecc7-4143-bb63-870f44036a4a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 204 len: 0 microversion: 2.26 time: 0.181288 May 19 08:32:22.162561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2078/3403] 10.222.0.78 () {60 vars in 1294 bytes} [Thu May 19 08:32:21 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:22.167698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:22.168584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:22.191633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:22.192408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:22.193449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:22.194066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:23.541476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:23.564929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75a554e5-e12f-496b-abbe-7cf3bc4a00dc tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 1.400769 May 19 08:32:23.578445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2079/3404] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:22 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:23.589465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afe5f5fe-d216-409e-9c7e-782a3504479a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3211e88c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:23.617520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afe5f5fe-d216-409e-9c7e-782a3504479a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:23.618461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afe5f5fe-d216-409e-9c7e-782a3504479a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:23.642796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afe5f5fe-d216-409e-9c7e-782a3504479a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 200 len: 12 microversion: 2.26 time: 0.062829 May 19 08:32:23.643896 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2080/3405] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:32:23 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 12 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:23.659154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:23.660315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:23.668028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:23.669077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:23.670306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:23.670987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.285703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:24.302065 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91542322-3bf3-4c96-b2ab-28be86ac6680 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 0.650815 May 19 08:32:24.303394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2081/3406] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:23 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:24.308247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:24.309096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:24.321046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.326715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.328105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.328755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.748796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:24.758891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18621f7d-1241-4f4d-9c33-3f9137ddf818 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.454155 May 19 08:32:24.765946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2082/3407] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:24 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:24.771319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3212006ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:24.797168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.797920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.801378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:24.817093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.817822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.818782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.819389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.866935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.867400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.893863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:24.942870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f8bd927-55c3-49a9-8075-9093c70e4d73 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 204 len: 0 microversion: 2.26 time: 0.175372 May 19 08:32:24.943510 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2083/3408] 10.222.0.78 () {60 vars in 1294 bytes} [Thu May 19 08:32:24 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:24.948757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:24.952941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:24.965030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.966487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:24.971681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:24.972352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.021675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lazy-loading 'flavor' on Instance uuid c75d5c8f-8107-4a60-b50d-c1eacb348de5 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:25.176574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0d4986b-2312-4679-af67-e7f32e169a92 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.231731 May 19 08:32:25.177242 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2084/3409] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:32:24 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:32:25.203457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f3211fcd5e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:25.227202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.228224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.251144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:25.270717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.271398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.272592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.285389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.362853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.363598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.380989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:25.391372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.392200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.461118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:25.513227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-931557ec-821c-4270-ae87-fb4678e22f51 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-305730512" status: 201 len: 0 microversion: 2.26 time: 0.334273 May 19 08:32:25.521727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2085/3410] 10.222.0.78 () {62 vars in 1376 bytes} [Thu May 19 08:32:25 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-305730512 => generated 0 bytes in 344 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 19 08:32:25.531667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:25.532568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:25.557696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.558579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:25.559894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:25.560918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:26.492275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:26.517097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf778a33-e78c-488d-bb93-8b0b6404c032 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1676 microversion: 2.1 time: 0.993768 May 19 08:32:26.523087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2086/3411] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:25 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1676 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:26.528330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:26.538990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:26.558318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:26.561359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:26.573653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:26.574302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.124347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:27.144017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adfba8e2-622e-49b3-8eea-ac4b8c076f50 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 0.619369 May 19 08:32:27.149360 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2087/3412] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:26 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:27.157677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f321206dc10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:27.176503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.176503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.179502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:27.203004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.203589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.212408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.213219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.257367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.258244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.269682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.271236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.306639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:27.335823 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c61ba9e-ff0c-4083-9b98-888482549e92 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-1810290881" status: 201 len: 0 microversion: 2.26 time: 0.185123 May 19 08:32:27.337480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2088/3413] 10.222.0.78 () {62 vars in 1379 bytes} [Thu May 19 08:32:27 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags/tempest-tag-1810290881 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 19 08:32:27.346191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-78a16816-e687-4206-877a-12957d743a95 req-54563f68-a022-47b3-bb3f-8b6bb0553302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a88f46-1746-4bb1-941a-3b219c08fb3f", "name": "network-vif-plugged", "status": "completed", "tag": "f37ff269-ec1b-4257-9e00-9944e7be36c9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:27.359357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-78a16816-e687-4206-877a-12957d743a95 req-54563f68-a022-47b3-bb3f-8b6bb0553302 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.360082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-78a16816-e687-4206-877a-12957d743a95 req-54563f68-a022-47b3-bb3f-8b6bb0553302 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.380793 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-78a16816-e687-4206-877a-12957d743a95 req-54563f68-a022-47b3-bb3f-8b6bb0553302 service nova] Creating event network-vif-plugged:f37ff269-ec1b-4257-9e00-9944e7be36c9 for instance d8a88f46-1746-4bb1-941a-3b219c08fb3f on chh2-842464-2 May 19 08:32:27.425587 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-78a16816-e687-4206-877a-12957d743a95 req-54563f68-a022-47b3-bb3f-8b6bb0553302 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085573 May 19 08:32:27.429760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2089/3414] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:27.449986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:27.465065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:27.478776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.485356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.488197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.489529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.889524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:27.901599 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f807b3e5-9914-424a-a092-9ad6a2aea834 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1574 microversion: 2.1 time: 0.462248 May 19 08:32:27.902527 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2090/3415] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:27 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1574 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:27.926427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2f90ee3c-09d4-4084-be3a-054f39f71a72 req-7b0d0b09-f562-4cb6-88b0-d61e6ab6b994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c", "tag": "64725787-d9b3-4fe4-abe9-3227fd4a9b5f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:27.941358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2f90ee3c-09d4-4084-be3a-054f39f71a72 req-7b0d0b09-f562-4cb6-88b0-d61e6ab6b994 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:27.945175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2f90ee3c-09d4-4084-be3a-054f39f71a72 req-7b0d0b09-f562-4cb6-88b0-d61e6ab6b994 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:27.971593 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2f90ee3c-09d4-4084-be3a-054f39f71a72 req-7b0d0b09-f562-4cb6-88b0-d61e6ab6b994 service nova] Creating event network-changed:64725787-d9b3-4fe4-abe9-3227fd4a9b5f for instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c on chh1-842464-2 May 19 08:32:27.986750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2f90ee3c-09d4-4084-be3a-054f39f71a72 req-7b0d0b09-f562-4cb6-88b0-d61e6ab6b994 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060347 May 19 08:32:27.988213 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2091/3416] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:28.010766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Action: 'update_all', calling method: .version_select at 0x7f3211f8cca0>, body: {"tags": ["tempest-tag-2063819882", "tempest-tag-1920758279"]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:28.032119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.037526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.038745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:28.050241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.051935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.052891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.057931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.104160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.108008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.154114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:28.186239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fab0c60e-cf8d-4d11-91b4-3a0a26233104 tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 200 len: 62 microversion: 2.26 time: 0.196526 May 19 08:32:28.187415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2092/3417] 10.222.0.78 () {62 vars in 1311 bytes} [Thu May 19 08:32:27 2022] PUT /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 62 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:28.198940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:28.199920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:28.212334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.217037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.218203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.218818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.757821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:28.767658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-239fd2ca-ac3d-4e80-a2d0-671b2959d809 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1659 microversion: 2.1 time: 0.578968 May 19 08:32:28.779413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2093/3418] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:28 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1659 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:28.793392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:28.793392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:28.822354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.825740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:28.827356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:28.830714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.152316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:30.161127 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8decccbe-7fe9-4a71-bae9-5074b5c634eb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1312 microversion: 2.1 time: 1.380448 May 19 08:32:30.171967 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2094/3419] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:28 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1312 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:30.177088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86b86037-bee3-4d30-8200-dc331296182f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f32124375e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:30.197968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86b86037-bee3-4d30-8200-dc331296182f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.202929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86b86037-bee3-4d30-8200-dc331296182f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.260226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86b86037-bee3-4d30-8200-dc331296182f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 200 len: 62 microversion: 2.26 time: 0.085002 May 19 08:32:30.267297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2095/3420] 10.222.0.78 () {60 vars in 1291 bytes} [Thu May 19 08:32:30 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 62 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:30.290982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:30.297894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:30.314052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.314528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.315807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.321772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.512305 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f810f24-bd08-4a58-b061-b542725c402f tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action" status: 202 len: 0 microversion: 2.1 time: 0.243260 May 19 08:32:30.518050 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2096/3421] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:32:30 2022] POST /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:32:30.535783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b556aec9-b6fd-4e76-b87e-066fc7a4f1eb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Action: 'create', calling method: .version_select at 0x7f321198f550>, body: {"keypair": {"name": "tempest-keypair-514807272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETGG53nKyCT8jITiiYyTx8xQ+03+lZj9RQOrCJ6A/z/K/0lDo+eCtgPiJn522DmBY/MlVdbIKkPzujYFGd3qlxH1i5x9wZcyDS+QAmQjKZ7zhSpEo8CKL21KE0Bn7Wmxg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:30.558449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b556aec9-b6fd-4e76-b87e-066fc7a4f1eb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Getting quotas for project 12ffb0dc38014b07bf39a33b520e0502. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:30.572053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b556aec9-b6fd-4e76-b87e-066fc7a4f1eb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Getting quotas for user b0126ef7c31e4cf2b1149b77645f5a74 and project 12ffb0dc38014b07bf39a33b520e0502. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:30.608533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b556aec9-b6fd-4e76-b87e-066fc7a4f1eb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.090008 May 19 08:32:30.615020 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2097/3422] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:32:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 08:32:30.650512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '.version_select at 0x7f32124375e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:30.699021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.699568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.700421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:30.719583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.720259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.722332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.722804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.784683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.785142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.836816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lazy-loading 'flavor' on Instance uuid 646518b7-2aee-45a4-b8da-8869f84ca81f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:32:30.886223 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c176f31d-ae21-4525-938b-ac05d25c91fc tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags" status: 204 len: 0 microversion: 2.26 time: 0.269758 May 19 08:32:30.888197 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2098/3423] 10.222.0.78 () {60 vars in 1294 bytes} [Thu May 19 08:32:30 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f/tags => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:30.898111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:30.901853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:30.916599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.924454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.925597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:30.926773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:30.940843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:31.205802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:31.215941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98caa02d-7b23-47bc-a139-2e9dc72c9662 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1665 microversion: 2.1 time: 0.323782 May 19 08:32:31.219421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2099/3424] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:30 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1665 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:31.235386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:31.236155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:31.240632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:31.258821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:31.259313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:31.260161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:31.260609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:31.316490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:32:31.520216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d95d8170-33f1-4afc-afb2-97dbed891bcb tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 204 len: 0 microversion: 2.26 time: 0.290169 May 19 08:32:31.521100 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2100/3425] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:32:31 2022] DELETE /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:32:31.527242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:31.528018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:31.548365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:31.548831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:31.549662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:31.550114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:32.379466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:32.394627 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5eabecc-dd43-4319-82b6-4a22ffa3e326 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1497 microversion: 2.1 time: 0.872084 May 19 08:32:32.397488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2101/3426] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:31 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1497 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:32.416235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:32.417504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:32.439719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:32.442311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:32.445050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:32.447566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:33.086622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:33.103236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:33.111029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:33.116891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6aca34f0-c7fb-43d8-9315-8ef8ebb5837a tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1548 microversion: 2.26 time: 0.713454 May 19 08:32:33.123396 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2102/3427] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:32 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1548 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:33.149266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:33.149957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:33.181125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:33.181611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:33.182433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:33.182881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:33.853498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:33.864326 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bee56caf-9f7f-497d-8bad-1fea392ab581 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1665 microversion: 2.1 time: 0.725798 May 19 08:32:33.864917 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2103/3428] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:33 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1665 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:33.874999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a326e342-e1c7-4674-941d-c34236448415 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:33.913004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_groups [None req-a326e342-e1c7-4674-941d-c34236448415 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Querying cell c29c5a8f-0954-4485-a835-7dab43d09458(cell1) for 1 instances {{(pid=119072) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 08:32:33.913831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a326e342-e1c7-4674-941d-c34236448415 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:33.914457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a326e342-e1c7-4674-941d-c34236448415 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:33.961389 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a326e342-e1c7-4674-941d-c34236448415 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/6933f316-9b7c-4759-9b42-17d200d86ed4" status: 200 len: 222 microversion: 2.1 time: 0.090377 May 19 08:32:33.962276 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2104/3429] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:32:33 2022] GET /compute/v2.1/os-server-groups/6933f316-9b7c-4759-9b42-17d200d86ed4 => generated 222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:33.972505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:33.972999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:33.989051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:33.989440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:33.990226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:33.990662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:34.057377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:32:34.236111 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f655d606-fa9c-4c91-b72f-a757021f2fe2 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 204 len: 0 microversion: 2.1 time: 0.267010 May 19 08:32:34.238043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2105/3430] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:32:33 2022] DELETE /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:32:34.245868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:34.246836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:34.254771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:34.255604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:34.256707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:34.257558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:34.558053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:34.570009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:34.588761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33971107a60f4c86bca26fb5ef596a2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91eb610b12fb40039a498d0e79e28d5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:34.590376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92c4235e-6931-4675-ab98-b1d3ad00496e tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 200 len: 1548 microversion: 2.26 time: 0.350914 May 19 08:32:34.591161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2106/3431] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:34 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 1548 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:34.596784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:34.603119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:34.617814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:34.619322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:34.620355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:34.621287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:34.912958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f0bec753aa40fda7616b8abfe0107e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37429262a5e54f61b0564df32dc90ac4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:34.921014 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-455d21ff-91c0-4baf-ad86-101041a8cdf4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 200 len: 1503 microversion: 2.1 time: 0.328647 May 19 08:32:34.929854 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2107/3432] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:34 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:35.071011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2975c16-307c-44db-a4b8-d306ec77f4e6 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Action: 'create', calling method: .version_select at 0x7f3211cf0310>, body: {"keypair": {"name": "tempest-keypair-329882362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiJRRV9d1CCQv4phukrSgYR8S5s/sIytiWP0rDoDUZyE8r3VkncIjA7QjsXLikvgREOiXvbnMLYWk6oFBLOR47Np3zD1V7FfhvXMfoew8cWH0G1ePv0Anmpk9NQRqceMw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:35.088173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b2975c16-307c-44db-a4b8-d306ec77f4e6 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Getting quotas for project 216a7075606b4df0b6bb7c1d9d0e1250. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:35.094930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b2975c16-307c-44db-a4b8-d306ec77f4e6 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Getting quotas for user d8c7190576064231b0370b6e1e592ea7 and project 216a7075606b4df0b6bb7c1d9d0e1250. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:35.125096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2975c16-307c-44db-a4b8-d306ec77f4e6 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.193950 May 19 08:32:35.129539 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2108/3433] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:32:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:35.137539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d0cbe811-717c-470d-a38b-62f7490085d5 req-71bc33ac-fe07-4da0-a023-2f5fff84c688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "646518b7-2aee-45a4-b8da-8869f84ca81f", "name": "network-vif-deleted", "tag": "fb158996-0285-4bf0-8ebb-5b81e86f6ffa"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:35.148602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0cbe811-717c-470d-a38b-62f7490085d5 req-71bc33ac-fe07-4da0-a023-2f5fff84c688 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:35.149066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0cbe811-717c-470d-a38b-62f7490085d5 req-71bc33ac-fe07-4da0-a023-2f5fff84c688 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:35.168761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d0cbe811-717c-470d-a38b-62f7490085d5 req-71bc33ac-fe07-4da0-a023-2f5fff84c688 service nova] Creating event network-vif-deleted:fb158996-0285-4bf0-8ebb-5b81e86f6ffa for instance 646518b7-2aee-45a4-b8da-8869f84ca81f on chh1-842464-2 May 19 08:32:35.175936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d0cbe811-717c-470d-a38b-62f7490085d5 req-71bc33ac-fe07-4da0-a023-2f5fff84c688 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045045 May 19 08:32:35.176902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2109/3434] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:35.182444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:35.182762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:35.210127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:35.211251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:35.212290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:35.212975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:35.441140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:35.452049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21ba945c-99df-4650-9dbd-678533bfe666 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1665 microversion: 2.1 time: 0.273856 May 19 08:32:35.462210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2110/3435] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:35 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1665 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:35.603548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1910433773", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4a7b0e8e-3c56-43ce-beb9-b4bf08ccbd2b"}, {"port": "c906b65b-8f2b-4c8c-b6a4-072396e4a00d", "tag": "port-1"}, {"port": "54802d14-fe37-40ec-9d4e-45c5506a6a30", "tag": "port-2"}, {"uuid": "c199a187-73d9-43c7-a027-7910caef7022", "tag": "net-1"}, {"uuid": "c199a187-73d9-43c7-a027-7910caef7022"}, {"uuid": "178a03c1-f882-4ea2-9a18-15d5f2cee527", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "178a03c1-f882-4ea2-9a18-15d5f2cee527", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "05963eac-f2ac-431d-9df0-09a51aaf1e0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ff6078b8-252b-4620-8c22-4b6580fd5af5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d1812889-c830-4c77-ad36-2d4105aee11e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--545486780"}], "key_name": "tempest-keypair-514807272", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:35.754296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] validate_networks() for [('4a7b0e8e-3c56-43ce-beb9-b4bf08ccbd2b', None, None, None, None, None), (None, None, 'c906b65b-8f2b-4c8c-b6a4-072396e4a00d', None, None, None), (None, None, '54802d14-fe37-40ec-9d4e-45c5506a6a30', None, None, None), ('c199a187-73d9-43c7-a027-7910caef7022', None, None, None, None, None), ('c199a187-73d9-43c7-a027-7910caef7022', None, None, None, None, None), ('178a03c1-f882-4ea2-9a18-15d5f2cee527', '10.2.2.100', None, None, None, None), ('178a03c1-f882-4ea2-9a18-15d5f2cee527', '10.2.2.200', None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:32:40.537868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:32:40.538529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:32:40.539064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:32:40.539587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:32:40.540309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:32:40.551760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:40.552858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:40.554549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:40.555461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:40.578855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Getting quotas for project 12ffb0dc38014b07bf39a33b520e0502. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:40.589016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Getting quotas for user b0126ef7c31e4cf2b1149b77645f5a74 and project 12ffb0dc38014b07bf39a33b520e0502. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:40.797995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:32:40.808055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='05963eac-f2ac-431d-9df0-09a51aaf1e0c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ff6078b8-252b-4620-8c22-4b6580fd5af5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1812889-c830-4c77-ad36-2d4105aee11e',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:32:41.289255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef70c49a-e889-47a5-bbdf-45b44830adc0 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.691620 May 19 08:32:41.295568 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2111/3436] 10.222.0.78 () {62 vars in 1188 bytes} [Thu May 19 08:32:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 5693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 08:32:41.301337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:41.302075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] [instance: 646518b7-2aee-45a4-b8da-8869f84ca81f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:41.310864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.311568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.312539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.313028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.330986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] HTTP exception thrown: Instance 646518b7-2aee-45a4-b8da-8869f84ca81f could not be found. May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Request method failure captured: May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f HTTP/1.1 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBe2wyWiXvKY_tZT0pYVioS5iWl1L4c7oIqI4KA3hf7yW4BHHTG6ntT__MOX8A9oDvwgTsOLPn0NdHxx_RRsrBj-9RSh3d81MQZ5kXAnHg2UtiWqb2xClIBHeM76OGiWmUxa4GHt_fjV34N8M0bkeeUNiufiyJi_l1nA5kw02cG38w May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.26 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 91eb610b12fb40039a498d0e79e28d5b May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerTagsTestJSON-1690211636 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/91eb610b12fb40039a498d0e79e28d5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/91eb610b12fb40039a498d0e79e28d5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_91eb610b12fb40039a498d0e79e28d5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/91eb610b12fb40039a498d0e79e28d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerTagsTestJSON-1690211636 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 91eb610b12fb40039a498d0e79e28d5b May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerTagsTestJSON-1690211636 May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerTagsTestJSON-1690211636-project May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 33971107a60f4c86bca26fb5ef596a2d May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerTagsTestJSON-1690211636-project May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 646518b7-2aee-45a4-b8da-8869f84ca81f could not be found. May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '646518b7-2aee-45a4-b8da-8869f84ca81f'} May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 646518b7-2aee-45a4-b8da-8869f84ca81f could not be found. May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 646518b7-2aee-45a4-b8da-8869f84ca81f could not be found. May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:41.337603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 646518b7-2aee-45a4-b8da-8869f84ca81f could not be found. May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] Returning 404 to user: Instance 646518b7-2aee-45a4-b8da-8869f84ca81f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3ab6f23-5ced-4380-8bb6-c31f756e399f tempest-ServerTagsTestJSON-1690211636 tempest-ServerTagsTestJSON-1690211636-project] 10.222.0.78 "GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f" status: 404 len: 111 microversion: 2.26 time: 0.047796 May 19 08:32:41.342295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2112/3437] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:41 2022] GET /compute/v2.1/servers/646518b7-2aee-45a4-b8da-8869f84ca81f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:32:41.346409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:41.347091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:41.355235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.355710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.356942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.357415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.383956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f HTTP/1.1 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd8a88f46-1746-4bb1-941a-3b219c08fb3f'} May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:41.388003 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:41.393326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:41.396935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e622297-a45a-4f66-ad16-5f42ac283702 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 404 len: 111 microversion: 2.1 time: 0.055185 May 19 08:32:41.397932 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2113/3438] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:41 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:41.410649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:41.422730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:41.441573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.442040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.445513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.447144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.790665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:41.804204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9e13bf7-3a08-413f-8742-495cbda205e1 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.405183 May 19 08:32:41.807605 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2114/3439] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:41 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:41.820054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-909a64f8-a798-4392-ac18-48c736ca5c81 req-a1199926-b222-4265-b57a-76187aff3edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a88f46-1746-4bb1-941a-3b219c08fb3f", "name": "network-vif-deleted", "tag": "f37ff269-ec1b-4257-9e00-9944e7be36c9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:41.844918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-909a64f8-a798-4392-ac18-48c736ca5c81 req-a1199926-b222-4265-b57a-76187aff3edd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:41.847099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-909a64f8-a798-4392-ac18-48c736ca5c81 req-a1199926-b222-4265-b57a-76187aff3edd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:41.881915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-909a64f8-a798-4392-ac18-48c736ca5c81 req-a1199926-b222-4265-b57a-76187aff3edd service nova] Creating event network-vif-deleted:f37ff269-ec1b-4257-9e00-9944e7be36c9 for instance d8a88f46-1746-4bb1-941a-3b219c08fb3f on chh2-842464-2 May 19 08:32:41.893103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-909a64f8-a798-4392-ac18-48c736ca5c81 req-a1199926-b222-4265-b57a-76187aff3edd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083518 May 19 08:32:41.897416 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2115/3440] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:41.908245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1226531401", "imageRef": "c9ad1413-9741-43bb-b56d-7e7a576b18ab", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cafe4abc-feac-4355-84de-525eaccf9fc4"}], "security_groups": [{"name": "tempest-securitygroup--1457571667"}], "key_name": "tempest-keypair-329882362", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:42.134137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] validate_networks() for [('cafe4abc-feac-4355-84de-525eaccf9fc4', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:32:42.976723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:32:42.977967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:32:42.979198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:32:42.979753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:32:42.980404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:32:42.994311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:42.994944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:42.995902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:42.996610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:43.119038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Getting quotas for project 216a7075606b4df0b6bb7c1d9d0e1250. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:32:43.146471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Getting quotas for user d8c7190576064231b0370b6e1e592ea7 and project 216a7075606b4df0b6bb7c1d9d0e1250. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:32:43.192848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:32:43.201803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9ad1413-9741-43bb-b56d-7e7a576b18ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:32:43.337128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a4466e0-fb52-4d8c-a4b7-b8c17d8d910b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.438109 May 19 08:32:43.350249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2116/3441] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:32:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:32:43.362910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:43.365346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:43.379184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:43.379914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:43.382279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:43.382995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:43.541413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:43.544594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:43.562836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:43.569246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:43.570876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed519b83-a882-4455-bd9f-a495d02ba8ea tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1575 microversion: 2.42 time: 0.219195 May 19 08:32:43.571631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2117/3442] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:43 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:43.578989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-acafbe51-993f-49a6-abe0-a7e9aae29cd4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:43.619936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_groups [None req-acafbe51-993f-49a6-abe0-a7e9aae29cd4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Querying cell c29c5a8f-0954-4485-a835-7dab43d09458(cell1) for 1 instances {{(pid=119072) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 08:32:43.620775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-acafbe51-993f-49a6-abe0-a7e9aae29cd4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:43.621234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-acafbe51-993f-49a6-abe0-a7e9aae29cd4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:43.642948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-acafbe51-993f-49a6-abe0-a7e9aae29cd4 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.068590 May 19 08:32:43.651445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2118/3443] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:32:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:43.669667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:43.671123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:43.692403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:43.694190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:43.695152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:43.695755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:44.178398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:44.191648 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f43f561-527c-4160-9b0c-cb538e365c32 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1668 microversion: 2.1 time: 0.538449 May 19 08:32:44.209673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2119/3444] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:43 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1668 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:44.223437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:44.224642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:44.246335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:44.247979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:44.251351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:44.252054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:44.453961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:44.467719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50361cf4-0432-4278-95ba-4012260cc615 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1249 microversion: 2.1 time: 0.255860 May 19 08:32:44.468312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2120/3445] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:44 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1249 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:44.473966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-938ea7df-c34e-4509-a7bd-cd83a0a774bb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:44.482728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:44.517996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_groups [None req-938ea7df-c34e-4509-a7bd-cd83a0a774bb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Querying cell c29c5a8f-0954-4485-a835-7dab43d09458(cell1) for 1 instances {{(pid=119072) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 19 08:32:44.521417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-938ea7df-c34e-4509-a7bd-cd83a0a774bb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:44.522617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-938ea7df-c34e-4509-a7bd-cd83a0a774bb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:44.544269 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-938ea7df-c34e-4509-a7bd-cd83a0a774bb tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/6933f316-9b7c-4759-9b42-17d200d86ed4" status: 200 len: 184 microversion: 2.1 time: 0.073229 May 19 08:32:44.545080 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2121/3446] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:32:44 2022] GET /compute/v2.1/os-server-groups/6933f316-9b7c-4759-9b42-17d200d86ed4 => generated 184 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:44.563413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:44.564097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:44.577415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:44.578449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:44.579473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:44.580083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:44.642432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:32:44.652572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Working on deleting snapshot 8d10c01d-4bd0-4adb-825c-eaddd96a1bfc from shelved instance... May 19 08:32:45.811146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Doing local delete in cell c29c5a8f-0954-4485-a835-7dab43d09458(cell1) {{(pid=119072) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 19 08:32:45.813735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:45.814659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:45.818626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 19 08:32:45.823957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] deallocate_for_instance() {{(pid=119072) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 19 08:32:49.771658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Updating instance_info_cache with network_info: [] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:32:50.206911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a7e5da5-8a09-4823-9b54-baa7aef63470 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 204 len: 0 microversion: 2.1 time: 5.660428 May 19 08:32:50.210528 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2122/3447] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:32:44 2022] DELETE /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 0 bytes in 5662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:32:50.222427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:50.222707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:50.238845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:50.239297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:50.240198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:50.240517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:50.273686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f HTTP/1.1 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd8a88f46-1746-4bb1-941a-3b219c08fb3f'} May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:32:50.275508 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:50.281550 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e878f02-8cb8-4d12-bd01-6bcb5d6617c9 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 404 len: 111 microversion: 2.1 time: 0.065292 May 19 08:32:50.284877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2123/3448] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:32:50 2022] DELETE /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:50.289820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:50.290430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:50.309694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:50.313338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:50.318714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:50.319408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:51.489757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:51.513635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:51.518479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:51.526124 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1660 microversion: 2.42 time: 1.239271 May 19 08:32:51.532398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2124/3449] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:50 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1660 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:51.533634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:51.542502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56797b92-fab9-422d-a7e0-ecf2ec76c53e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.009040 May 19 08:32:51.542901 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2125/3450] 10.222.0.78 () {56 vars in 885 bytes} [Thu May 19 08:32:51 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 08:32:51.562821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:51.563749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:51.596308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:51.597362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:51.598461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:51.603263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:52.745283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:52.766003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5302f48-8a1f-4fa2-ad0d-9c51296a5f61 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1371 microversion: 2.1 time: 1.217337 May 19 08:32:52.776176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2126/3451] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:51 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1371 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:52.801146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a8c8c2b5-ab84-4091-afdd-46ea1d3d67f8 req-e92dab72-1fce-43be-a97b-77f5123db4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ad4c36-79d1-48bc-ab62-99ef48cbb72b", "name": "network-vif-deleted", "tag": "9039bcd7-9044-46b2-bf3d-931f15eb34af"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:52.894440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a8c8c2b5-ab84-4091-afdd-46ea1d3d67f8 req-e92dab72-1fce-43be-a97b-77f5123db4c7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:52.896545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a8c8c2b5-ab84-4091-afdd-46ea1d3d67f8 req-e92dab72-1fce-43be-a97b-77f5123db4c7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:52.943288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_external_events [req-a8c8c2b5-ab84-4091-afdd-46ea1d3d67f8 req-e92dab72-1fce-43be-a97b-77f5123db4c7 service nova] Unable to find a host for instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b. Dropping event network-vif-deleted {{(pid=119072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 08:32:52.946506 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a8c8c2b5-ab84-4091-afdd-46ea1d3d67f8 req-e92dab72-1fce-43be-a97b-77f5123db4c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.168679 May 19 08:32:52.966311 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2127/3452] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 187 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 08:32:52.973462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:52.979331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: e1ad4c36-79d1-48bc-ab62-99ef48cbb72b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:52.999737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:53.000223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:53.001046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:53.001535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:53.061125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:53.072299 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] HTTP exception thrown: Instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b could not be found. May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Request method failure captured: May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b HTTP/1.1 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6ToSdzuHG-M_V__hr_nL3jNj4nAqaWb2-BlAdn9kLv37gf0SE17gUQ89LfVSKcqVaYzss4T8XuEMf5QFUuTpOQGMujssqHI6-tcMMCfEQfmueLyeV1SqtHvxIqZZIeFwwxsY0Xq9awe2aZNpUNT6Cp8G9BgxAAoZmcpdhxXbXUrWw May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b607e36aa42545dfb715c629002236ed May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b607e36aa42545dfb715c629002236ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b607e36aa42545dfb715c629002236ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-421405011 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b607e36aa42545dfb715c629002236ed May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-421405011-project May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 59f3ba2c06c045d6afccb1639ed8d083 May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-421405011-project May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b could not be found. May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e1ad4c36-79d1-48bc-ab62-99ef48cbb72b'} May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b could not be found. May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b could not be found. May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:53.077524 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b could not be found. May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Returning 404 to user: Instance e1ad4c36-79d1-48bc-ab62-99ef48cbb72b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:53.083034 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51f8a64d-4f53-43b8-8e0b-2e5ecfebec3c tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b" status: 404 len: 111 microversion: 2.1 time: 0.111392 May 19 08:32:53.089815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2128/3453] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:52 2022] GET /compute/v2.1/servers/e1ad4c36-79d1-48bc-ab62-99ef48cbb72b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:53.109152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:53.116494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] [instance: d8a88f46-1746-4bb1-941a-3b219c08fb3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:53.162369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:53.170533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:53.174358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:53.174893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:53.175325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=20 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:53.239525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f HTTP/1.1 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd8a88f46-1746-4bb1-941a-3b219c08fb3f'} May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:53.241171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance d8a88f46-1746-4bb1-941a-3b219c08fb3f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b29bcd0-3b93-4508-b166-8c4d5c194106 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f" status: 404 len: 111 microversion: 2.1 time: 0.151691 May 19 08:32:53.247533 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2129/3454] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:53 2022] GET /compute/v2.1/servers/d8a88f46-1746-4bb1-941a-3b219c08fb3f => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:53.267010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:53.271231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:53.301721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:53.302244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:53.303148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:53.303656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:55.532873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:55.557499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:55.560564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:55.565592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b03f3ea-4156-48db-8913-75496b8fa8fa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1660 microversion: 2.42 time: 2.311096 May 19 08:32:55.566792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2130/3455] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:53 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1660 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:55.580311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:55.587630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:55.594410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Searching by: {'deleted': False, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:32:55.617425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:55.618925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:55.623217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:55.626953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:55.736769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:32:55.917290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-865a9bcc-82b7-4d78-92b1-4852b22e67fc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.349113 May 19 08:32:55.926577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2131/3456] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:32:55 2022] GET /compute/v2.1/servers => generated 333 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:55.935927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:55.936431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:56.015154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:56.019042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:56.021334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:56.032385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:56.095605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:32:56.099701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:32:56.400909 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4332f0b-7a08-4b43-83ee-8c9bfad9a2fd tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 204 len: 0 microversion: 2.1 time: 0.472648 May 19 08:32:56.402088 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2132/3457] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:32:55 2022] DELETE /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:32:56.428595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41b0493e-b01e-4545-8f0e-039c1cee47df tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:56.442341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-41b0493e-b01e-4545-8f0e-039c1cee47df tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance group 28e78cfe-10f1-4dbf-b288-07f5a48260b1 could not be found. May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41b0493e-b01e-4545-8f0e-039c1cee47df tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-server-groups/28e78cfe-10f1-4dbf-b288-07f5a48260b1 HTTP/1.1 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance group 28e78cfe-10f1-4dbf-b288-07f5a48260b1 could not be found. May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '28e78cfe-10f1-4dbf-b288-07f5a48260b1'} May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 28e78cfe-10f1-4dbf-b288-07f5a48260b1 could not be found. May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 28e78cfe-10f1-4dbf-b288-07f5a48260b1 could not be found. May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:56.497324 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 28e78cfe-10f1-4dbf-b288-07f5a48260b1 could not be found. May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41b0493e-b01e-4545-8f0e-039c1cee47df tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance group 28e78cfe-10f1-4dbf-b288-07f5a48260b1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41b0493e-b01e-4545-8f0e-039c1cee47df tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/28e78cfe-10f1-4dbf-b288-07f5a48260b1" status: 404 len: 117 microversion: 2.1 time: 0.095538 May 19 08:32:56.502859 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2133/3458] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:32:56 2022] DELETE /compute/v2.1/os-server-groups/28e78cfe-10f1-4dbf-b288-07f5a48260b1 => generated 117 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:56.505009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:56.509734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:56.546154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:56.546893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:56.547599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:56.548056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:57.031709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:57.043391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbc31fc5-e570-4200-b028-ba090bdd5989 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1371 microversion: 2.1 time: 0.542152 May 19 08:32:57.044249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2134/3459] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:56 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1371 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:57.050635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:57.062464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:57.065193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Searching by: {'deleted': False, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:32:57.098836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:57.113967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:57.115420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:57.116526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:57.183986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:32:57.313322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:57.347961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:57.349061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:57.705149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2013f496-ebb9-40f8-8a8c-b3808864459d tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.657892 May 19 08:32:57.711231 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2135/3460] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:32:57 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:57.723774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:57.725863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:57.743268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:57.751424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:57.752998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:57.754045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:57.926193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:57.942454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26f8a619-090b-434b-9edc-0157a1c99547 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1466 microversion: 2.1 time: 0.227905 May 19 08:32:57.953872 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2136/3461] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:57 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1466 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:32:57.965378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1ea43b8-a65c-4579-bdee-75b9e2e8723b tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:57.979934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c1ea43b8-a65c-4579-bdee-75b9e2e8723b tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance group 96d279cf-e388-4a27-906a-0fe1f33769de could not be found. May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1ea43b8-a65c-4579-bdee-75b9e2e8723b tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-server-groups/96d279cf-e388-4a27-906a-0fe1f33769de HTTP/1.1 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance group 96d279cf-e388-4a27-906a-0fe1f33769de could not be found. May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '96d279cf-e388-4a27-906a-0fe1f33769de'} May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 96d279cf-e388-4a27-906a-0fe1f33769de could not be found. May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 96d279cf-e388-4a27-906a-0fe1f33769de could not be found. May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:57.990350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:57.995780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:57.995780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:57.995780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:57.995780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:57.995780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 96d279cf-e388-4a27-906a-0fe1f33769de could not be found. May 19 08:32:57.995780 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:58.000974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1ea43b8-a65c-4579-bdee-75b9e2e8723b tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance group 96d279cf-e388-4a27-906a-0fe1f33769de could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:58.007668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c1ea43b8-a65c-4579-bdee-75b9e2e8723b tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/96d279cf-e388-4a27-906a-0fe1f33769de" status: 404 len: 117 microversion: 2.1 time: 0.049129 May 19 08:32:58.017137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2137/3462] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:32:57 2022] DELETE /compute/v2.1/os-server-groups/96d279cf-e388-4a27-906a-0fe1f33769de => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:58.033823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:58.042790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:58.075818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:58.077290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:58.080321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:58.083027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:58.963012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:58.988489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:58.991435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:32:58.992834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5a12f87-728b-4b48-8175-f99807c6b21b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1752 microversion: 2.42 time: 0.973161 May 19 08:32:58.993463 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2138/3463] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:32:58 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1752 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:32:59.010358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ca1b402a-32e8-427f-9009-52fd688d62f6 req-bc3c7433-71a7-4e72-9d25-13877ae752d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a56363-0605-49d5-8019-3537b2318fda", "tag": "5c6ca18d-4831-4118-a223-7504d55f04a0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:32:59.029980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ca1b402a-32e8-427f-9009-52fd688d62f6 req-bc3c7433-71a7-4e72-9d25-13877ae752d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:59.030583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ca1b402a-32e8-427f-9009-52fd688d62f6 req-bc3c7433-71a7-4e72-9d25-13877ae752d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:59.066148 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ca1b402a-32e8-427f-9009-52fd688d62f6 req-bc3c7433-71a7-4e72-9d25-13877ae752d5 service nova] Creating event network-changed:5c6ca18d-4831-4118-a223-7504d55f04a0 for instance 64a56363-0605-49d5-8019-3537b2318fda on chh2-842464-2 May 19 08:32:59.083982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ca1b402a-32e8-427f-9009-52fd688d62f6 req-bc3c7433-71a7-4e72-9d25-13877ae752d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083070 May 19 08:32:59.085987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2139/3464] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:59.339441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1ef7262-5e08-4824-ba9a-350169fb7234 tempest-ExtensionsTest-432340880 tempest-ExtensionsTest-432340880-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:59.341961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1ef7262-5e08-4824-ba9a-350169fb7234 tempest-ExtensionsTest-432340880 tempest-ExtensionsTest-432340880-project] 10.222.0.78 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.253493 May 19 08:32:59.347138 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2140/3465] 10.222.0.78 () {58 vars in 1169 bytes} [Thu May 19 08:32:59 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:59.361335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34c92731-9ece-437a-83c6-e4be41f509dc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:59.396249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34c92731-9ece-437a-83c6-e4be41f509dc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044814 May 19 08:32:59.397138 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2141/3466] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:32:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:32:59.411243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dea2417-3a0f-4be0-9058-a610a81a9f55 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:59.426408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8dea2417-3a0f-4be0-9058-a610a81a9f55 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance group ef80cb2c-d94c-4052-aab5-bb9d4b737505 could not be found. May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dea2417-3a0f-4be0-9058-a610a81a9f55 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-server-groups/ef80cb2c-d94c-4052-aab5-bb9d4b737505 HTTP/1.1 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance group ef80cb2c-d94c-4052-aab5-bb9d4b737505 could not be found. May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ef80cb2c-d94c-4052-aab5-bb9d4b737505'} May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ef80cb2c-d94c-4052-aab5-bb9d4b737505 could not be found. May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ef80cb2c-d94c-4052-aab5-bb9d4b737505 could not be found. May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:59.428652 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:32:59.433688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:32:59.433688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:32:59.433688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:32:59.433688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:32:59.433688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ef80cb2c-d94c-4052-aab5-bb9d4b737505 could not be found. May 19 08:32:59.433688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:32:59.437287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dea2417-3a0f-4be0-9058-a610a81a9f55 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance group ef80cb2c-d94c-4052-aab5-bb9d4b737505 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:32:59.438519 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8dea2417-3a0f-4be0-9058-a610a81a9f55 tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/ef80cb2c-d94c-4052-aab5-bb9d4b737505" status: 404 len: 117 microversion: 2.1 time: 0.040202 May 19 08:32:59.444722 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2142/3467] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:32:59 2022] DELETE /compute/v2.1/os-server-groups/ef80cb2c-d94c-4052-aab5-bb9d4b737505 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:32:59.456587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:32:59.457864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:32:59.474048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:59.474801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:32:59.478901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:32:59.479547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:00.312734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:00.326887 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36b6c423-00ae-425a-9ac8-c830b52ac7fb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1371 microversion: 2.1 time: 0.880381 May 19 08:33:00.342535 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2143/3468] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:32:59 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1371 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:00.353587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:00.357795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:00.374532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:00.375282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:00.380849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:00.381559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:00.539611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:00.550414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-388135e1-4929-4e8b-a579-d9711aea3fb7 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 200 len: 1466 microversion: 2.1 time: 0.205880 May 19 08:33:00.550414 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2144/3469] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:00 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 1466 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:00.564676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-178b1464-082d-441b-b36d-ecf8063493bd tempest-ExtensionsTest-432340880 tempest-ExtensionsTest-432340880-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:00.571570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-178b1464-082d-441b-b36d-ecf8063493bd tempest-ExtensionsTest-432340880 tempest-ExtensionsTest-432340880-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.017196 May 19 08:33:00.573453 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2145/3470] 10.222.0.78 () {58 vars in 1133 bytes} [Thu May 19 08:33:00 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:33:00.586210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-400579dc-e370-4e67-9a00-dd7609b7075d tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:00.596704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-400579dc-e370-4e67-9a00-dd7609b7075d tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] HTTP exception thrown: Instance group bbaca444-2a39-406b-b275-e9658b18aba6 could not be found. May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-400579dc-e370-4e67-9a00-dd7609b7075d tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Request method failure captured: May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-server-groups/bbaca444-2a39-406b-b275-e9658b18aba6 HTTP/1.1 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBpiiV_ea9s3kym-1ZQBX1mVMjO8gmbFlXTNd7pRhbIdZErngF4uuBtvQ16xN0tE0cCRaXH0maDGaaEtKAKl8kZZfBYJ6yNKBc_Tq7CgKfDeSsqYGVryKtpQQUps0I_5OzcnYWtnqttbk7FSMNF3iSSd-zGRbUZPHLx-jJSZP6HenY May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/37429262a5e54f61b0564df32dc90ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroupTestJSON-1532498406 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 37429262a5e54f61b0564df32dc90ac4 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroupTestJSON-1532498406 May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroupTestJSON-1532498406-project May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 31f0bec753aa40fda7616b8abfe0107e May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroupTestJSON-1532498406-project May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance group bbaca444-2a39-406b-b275-e9658b18aba6 could not be found. May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'bbaca444-2a39-406b-b275-e9658b18aba6'} May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bbaca444-2a39-406b-b275-e9658b18aba6 could not be found. May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bbaca444-2a39-406b-b275-e9658b18aba6 could not be found. May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:00.618353 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:00.624386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:00.624386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:00.624386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:00.624386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:00.624386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bbaca444-2a39-406b-b275-e9658b18aba6 could not be found. May 19 08:33:00.624386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:00.628516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-400579dc-e370-4e67-9a00-dd7609b7075d tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Returning 404 to user: Instance group bbaca444-2a39-406b-b275-e9658b18aba6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:00.629749 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-400579dc-e370-4e67-9a00-dd7609b7075d tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/bbaca444-2a39-406b-b275-e9658b18aba6" status: 404 len: 117 microversion: 2.1 time: 0.054558 May 19 08:33:00.634043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2146/3471] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:33:00 2022] DELETE /compute/v2.1/os-server-groups/bbaca444-2a39-406b-b275-e9658b18aba6 => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:00.648097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:00.656379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:00.680307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:00.685294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:00.686332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:00.687956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:00.766082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:01.127824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1ed46c7-0f6e-4c2a-9c6a-9958f840bb45 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 204 len: 0 microversion: 2.1 time: 0.491848 May 19 08:33:01.134094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2147/3472] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:33:00 2022] DELETE /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:01.143950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:01.149850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:01.171345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:01.186138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:01.190398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:01.191186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:01.885833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:01.935764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:01.940458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:01.943824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d866754-6912-4406-85a2-3f68578d7a59 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1752 microversion: 2.42 time: 0.808100 May 19 08:33:01.945559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2148/3473] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:01 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1752 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:01.952651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d20fa953-3e56-4b00-9738-07fe8246ef7a tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:02.030787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d20fa953-3e56-4b00-9738-07fe8246ef7a tempest-ServerGroupTestJSON-1532498406 tempest-ServerGroupTestJSON-1532498406-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/6933f316-9b7c-4759-9b42-17d200d86ed4" status: 204 len: 0 microversion: 2.1 time: 0.074985 May 19 08:33:02.031814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2149/3474] 10.222.0.78 () {58 vars in 1265 bytes} [Thu May 19 08:33:01 2022] DELETE /compute/v2.1/os-server-groups/6933f316-9b7c-4759-9b42-17d200d86ed4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:02.071566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-114010f4-bb8b-4eeb-a65c-04165ce74dd4 req-cb0a6592-4a9e-4222-a565-2356f693fc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dafb0de6-d5a1-4cc2-9365-2309651bc29f", "name": "network-vif-deleted", "tag": "faeafd9a-db49-4546-95f9-7612b6ba8741"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:02.119694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-114010f4-bb8b-4eeb-a65c-04165ce74dd4 req-cb0a6592-4a9e-4222-a565-2356f693fc28 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:02.123312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-114010f4-bb8b-4eeb-a65c-04165ce74dd4 req-cb0a6592-4a9e-4222-a565-2356f693fc28 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:02.153275 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-114010f4-bb8b-4eeb-a65c-04165ce74dd4 req-cb0a6592-4a9e-4222-a565-2356f693fc28 service nova] Creating event network-vif-deleted:faeafd9a-db49-4546-95f9-7612b6ba8741 for instance dafb0de6-d5a1-4cc2-9365-2309651bc29f on chh2-842464-2 May 19 08:33:02.165422 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-114010f4-bb8b-4eeb-a65c-04165ce74dd4 req-cb0a6592-4a9e-4222-a565-2356f693fc28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126938 May 19 08:33:02.168857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2150/3475] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:02.193394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:02.202670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:02.230510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:02.231881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:02.232961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:02.233701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:02.692494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:02.704738 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19b10afe-84eb-4d71-80d2-280ccbe2eee4 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1699 microversion: 2.1 time: 0.534397 May 19 08:33:02.721267 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2151/3476] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:02 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1699 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:02.721670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:02.722529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:02.737741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:02.741420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:02.750454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:02.751077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.028482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:03.040062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c90ff4cb-feb1-4227-97a1-6a1aaa03cfb2 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1371 microversion: 2.1 time: 0.324198 May 19 08:33:03.040801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2152/3477] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:02 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:03.046035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:03.057743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: dafb0de6-d5a1-4cc2-9365-2309651bc29f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:03.079269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.080253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.081340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.082008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.109678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] HTTP exception thrown: Instance dafb0de6-d5a1-4cc2-9365-2309651bc29f could not be found. May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Request method failure captured: May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f HTTP/1.1 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6ToSdzuHG-M_V__hr_nL3jNj4nAqaWb2-BlAdn9kLv37gf0SE17gUQ89LfVSKcqVaYzss4T8XuEMf5QFUuTpOQGMujssqHI6-tcMMCfEQfmueLyeV1SqtHvxIqZZIeFwwxsY0Xq9awe2aZNpUNT6Cp8G9BgxAAoZmcpdhxXbXUrWw May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b607e36aa42545dfb715c629002236ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b607e36aa42545dfb715c629002236ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-421405011 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 59f3ba2c06c045d6afccb1639ed8d083 May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dafb0de6-d5a1-4cc2-9365-2309651bc29f could not be found. May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dafb0de6-d5a1-4cc2-9365-2309651bc29f'} May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dafb0de6-d5a1-4cc2-9365-2309651bc29f could not be found. May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dafb0de6-d5a1-4cc2-9365-2309651bc29f could not be found. May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:03.111828 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dafb0de6-d5a1-4cc2-9365-2309651bc29f could not be found. May 19 08:33:03.116268 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:03.122315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Returning 404 to user: Instance dafb0de6-d5a1-4cc2-9365-2309651bc29f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:03.130500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21979ed7-9b57-43ce-82ff-c7c47953b72d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f" status: 404 len: 111 microversion: 2.1 time: 0.088370 May 19 08:33:03.131559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2153/3478] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:03 2022] GET /compute/v2.1/servers/dafb0de6-d5a1-4cc2-9365-2309651bc29f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:03.136502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:03.138020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:03.161971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.162886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.163968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.164645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.539946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:03.549073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:03.550850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:03.552083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f024e815-96e4-4b13-b97d-e07c12015497 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1798 microversion: 2.42 time: 0.419347 May 19 08:33:03.552956 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2154/3479] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:03 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1798 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:03.561059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:03.561586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:03.570537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.571033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.571803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.572237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.611191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:03.635416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:03.862083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-460240dd-e898-4456-9bdf-4e86fcece40d tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 204 len: 0 microversion: 2.1 time: 0.307198 May 19 08:33:03.864156 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2155/3480] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:33:03 2022] DELETE /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:03.888368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:03.891718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:03.909505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:03.916335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.918538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:03.922580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:03.923879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:04.500459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9ba37cdb5a414ea29c5604ede0a9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9508e472fa49d68b091e2c3a427dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:04.525485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c3e0171-8ed4-4a29-ae5f-63945c17288c tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 200 len: 1632 microversion: 2.1 time: 0.656692 May 19 08:33:04.529484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2156/3481] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:03 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 1632 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:04.539502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:04.542898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:04.555068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:04.555998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:04.557807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:04.561262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:05.172144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:05.190700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5033c8d5-e6c4-4913-94fc-ceac61ccd387 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 200 len: 1507 microversion: 2.1 time: 0.658537 May 19 08:33:05.191759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2157/3482] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:04 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 1507 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:05.208885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:05.209808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:05.229391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:05.230230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:05.231342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:05.232184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:05.672195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:05.681910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8acffd7d-86fc-420d-b567-e55b23913f0b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1371 microversion: 2.1 time: 0.479270 May 19 08:33:05.697371 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2158/3483] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:05 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:05.710263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:05.711428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:05.726154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:05.729258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:05.734522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:05.735197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:07.128617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:07.291515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:07.965510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:08.004102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:08.011048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:08.016560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6f2c616-c2f6-4de7-a556-0f0ba37e5c09 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1844 microversion: 2.42 time: 2.317580 May 19 08:33:08.017683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2159/3484] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:05 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1844 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:08.026448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:08.031193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] [instance: bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:08.049417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.057926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.061995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.062560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.129404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] HTTP exception thrown: Instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c could not be found. May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Request method failure captured: May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c HTTP/1.1 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBoFW7auY-EHASls8LsDF5fft3SyyjfiPPjk_2_b7HaDgeWyfgr6egwIx9EIbeUkKvfv5H0FRTsoBd6RLr1P69EIhMYUzB7bd1JrWtVqfBixmjKJUv1cibpU_Wz3Lyo9nY_1TVmSorPYn-wXEaTORFQN9XJ5CrsgujKtYngDuTiydQ May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9e9508e472fa49d68b091e2c3a427dcb May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-860911634 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9e9508e472fa49d68b091e2c3a427dcb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9e9508e472fa49d68b091e2c3a427dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9e9508e472fa49d68b091e2c3a427dcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9e9508e472fa49d68b091e2c3a427dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-860911634 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9e9508e472fa49d68b091e2c3a427dcb May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-860911634 May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-860911634-project May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8a9ba37cdb5a414ea29c5604ede0a9aa May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-860911634-project May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c could not be found. May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c'} May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c could not be found. May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c could not be found. May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.133274 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c could not be found. May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Returning 404 to user: Instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:08.144195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c1f972f-eaf3-4ee3-a46d-c8b112eb4ebc tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c" status: 404 len: 111 microversion: 2.1 time: 0.112514 May 19 08:33:08.147596 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2160/3485] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:08 2022] GET /compute/v2.1/servers/bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:08.158086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-962fd6a3-4114-47ec-81b1-851e149f637c req-fa7725d4-2986-45d4-a6d7-5a5db6e91c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c", "name": "network-vif-deleted", "tag": "64725787-d9b3-4fe4-abe9-3227fd4a9b5f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:08.192750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-962fd6a3-4114-47ec-81b1-851e149f637c req-fa7725d4-2986-45d4-a6d7-5a5db6e91c0f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.193198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-962fd6a3-4114-47ec-81b1-851e149f637c req-fa7725d4-2986-45d4-a6d7-5a5db6e91c0f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.232722 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-962fd6a3-4114-47ec-81b1-851e149f637c req-fa7725d4-2986-45d4-a6d7-5a5db6e91c0f service nova] Creating event network-vif-deleted:64725787-d9b3-4fe4-abe9-3227fd4a9b5f for instance bf55e2f7-8ec1-405c-9ef0-ee0cfd44ca2c on chh1-842464-2 May 19 08:33:08.241862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-962fd6a3-4114-47ec-81b1-851e149f637c req-fa7725d4-2986-45d4-a6d7-5a5db6e91c0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085930 May 19 08:33:08.242746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2161/3486] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:08.254770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:08.257060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 64a5e40a-096d-493c-af54-1221c143892a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:08.268694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.276298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.277365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.278794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.324216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] HTTP exception thrown: Instance 64a5e40a-096d-493c-af54-1221c143892a could not be found. May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Request method failure captured: May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a HTTP/1.1 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6ToSdzuHG-M_V__hr_nL3jNj4nAqaWb2-BlAdn9kLv37gf0SE17gUQ89LfVSKcqVaYzss4T8XuEMf5QFUuTpOQGMujssqHI6-tcMMCfEQfmueLyeV1SqtHvxIqZZIeFwwxsY0Xq9awe2aZNpUNT6Cp8G9BgxAAoZmcpdhxXbXUrWw May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b607e36aa42545dfb715c629002236ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b607e36aa42545dfb715c629002236ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-421405011 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 59f3ba2c06c045d6afccb1639ed8d083 May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64a5e40a-096d-493c-af54-1221c143892a could not be found. May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64a5e40a-096d-493c-af54-1221c143892a'} May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a5e40a-096d-493c-af54-1221c143892a could not be found. May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a5e40a-096d-493c-af54-1221c143892a could not be found. May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:08.328418 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a5e40a-096d-493c-af54-1221c143892a could not be found. May 19 08:33:08.334394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:08.337629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Returning 404 to user: Instance 64a5e40a-096d-493c-af54-1221c143892a could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:08.339074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1cbde579-9e79-4350-ab25-b514cbbd71b2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a" status: 404 len: 111 microversion: 2.1 time: 0.094555 May 19 08:33:08.339925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2162/3487] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:08 2022] GET /compute/v2.1/servers/64a5e40a-096d-493c-af54-1221c143892a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:08.346411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:08.352553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:08.385199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.385959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.389021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.394499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.887896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:08.899992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44db0134-2224-42bc-bdbf-4dfe08d29ceb tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1371 microversion: 2.1 time: 0.557398 May 19 08:33:08.901368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2163/3488] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:08 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:08.906721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7fe03def-9b5c-4885-8be4-f88d278ce735 req-6662c060-cf5e-4222-969e-25bb52b3b652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a56363-0605-49d5-8019-3537b2318fda", "name": "network-vif-plugged", "status": "completed", "tag": "5c6ca18d-4831-4118-a223-7504d55f04a0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:08.927857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7fe03def-9b5c-4885-8be4-f88d278ce735 req-6662c060-cf5e-4222-969e-25bb52b3b652 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:08.929215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7fe03def-9b5c-4885-8be4-f88d278ce735 req-6662c060-cf5e-4222-969e-25bb52b3b652 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:08.945713 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7fe03def-9b5c-4885-8be4-f88d278ce735 req-6662c060-cf5e-4222-969e-25bb52b3b652 service nova] Creating event network-vif-plugged:5c6ca18d-4831-4118-a223-7504d55f04a0 for instance 64a56363-0605-49d5-8019-3537b2318fda on chh2-842464-2 May 19 08:33:08.979237 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7fe03def-9b5c-4885-8be4-f88d278ce735 req-6662c060-cf5e-4222-969e-25bb52b3b652 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076103 May 19 08:33:08.982565 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2164/3489] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:08.996363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-34e2a278-246c-4121-b54a-84f05d1155c3 req-316e7f52-ea86-421f-9b5f-eb96866a4bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a5e40a-096d-493c-af54-1221c143892a", "name": "network-vif-deleted", "tag": "0a5e454f-4dba-414f-b06f-6198c83650ee"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:09.018134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-34e2a278-246c-4121-b54a-84f05d1155c3 req-316e7f52-ea86-421f-9b5f-eb96866a4bde service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.019989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-34e2a278-246c-4121-b54a-84f05d1155c3 req-316e7f52-ea86-421f-9b5f-eb96866a4bde service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:09.086599 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-34e2a278-246c-4121-b54a-84f05d1155c3 req-316e7f52-ea86-421f-9b5f-eb96866a4bde service nova] Creating event network-vif-deleted:0a5e454f-4dba-414f-b06f-6198c83650ee for instance 64a5e40a-096d-493c-af54-1221c143892a on chh1-842464-2 May 19 08:33:09.100714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-34e2a278-246c-4121-b54a-84f05d1155c3 req-316e7f52-ea86-421f-9b5f-eb96866a4bde service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114367 May 19 08:33:09.103596 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2165/3490] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:09.114680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b27f6f4-2c67-467a-b189-8fd8f38f66d3 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] Calling method '.version_select at 0x7f3217ad2310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:09.163296 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b27f6f4-2c67-467a-b189-8fd8f38f66d3 tempest-ServersTestJSON-860911634 tempest-ServersTestJSON-860911634-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549674085" status: 202 len: 0 microversion: 2.1 time: 0.058387 May 19 08:33:09.164761 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2166/3491] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549674085 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:33:09.170810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:09.178426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:09.193104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.194281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:09.195704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.196469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:09.238432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:09.408558 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac0724c4-3761-458b-a8b8-0d1c54df40f2 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "DELETE /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 204 len: 0 microversion: 2.1 time: 0.241688 May 19 08:33:09.408758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2167/3492] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:33:09 2022] DELETE /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:09.420580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:09.421479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:09.446668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.447104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:09.447988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.448717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:09.883132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:09.894734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:09.897002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:09.898787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77052ae0-d818-4d5e-9990-d61659f87b40 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1865 microversion: 2.42 time: 0.487803 May 19 08:33:09.900089 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2168/3493] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:09 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1865 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:09.941222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:09.943856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:09.963079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.963862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:09.971447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:09.972101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:10.659970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:10.671013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2b6e7a0-aa9d-4b5f-979b-3be100c9e6e5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 200 len: 1494 microversion: 2.1 time: 0.769597 May 19 08:33:10.671626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2169/3494] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:09 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 1494 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:10.686173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:10.686608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:10.704103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:10.704579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:10.705425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:10.705879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:10.863444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lazy-loading 'services' on Instance uuid 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:33:11.001010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10c4a6d5-c1db-4586-84f3-717f6dce937f tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686/os-volume_attachments/aa2f3b73-91e0-4770-8898-2daae8d07633" status: 202 len: 0 microversion: 2.1 time: 0.328128 May 19 08:33:11.002026 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2170/3495] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:33:10 2022] DELETE /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686/os-volume_attachments/aa2f3b73-91e0-4770-8898-2daae8d07633 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:33:11.026695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:11.028511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:11.066032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:11.066793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:11.073794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:11.074393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:12.037650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:12.051220 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae52a90b-3f81-4916-9e6f-965d553146cc tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1558 microversion: 2.1 time: 1.046738 May 19 08:33:12.064101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2171/3496] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:11 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1558 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:12.272413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-940727768", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": "none"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:12.346206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:33:12.346699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:33:12.347242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:33:12.347715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:33:12.348192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:33:12.357947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:12.358475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:12.360738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:12.361592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:12.388172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Getting quotas for project 8e60a6c58f514d8d88d1fcecd08a8621. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:33:12.394095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Getting quotas for user 66ecf6d3ad2747a0a399cdba5b61648e and project 8e60a6c58f514d8d88d1fcecd08a8621. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:33:12.409536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:33:12.411861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:33:12.469013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30f4122a-8045-4d41-890c-9bea36e9bcab tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.403367 May 19 08:33:12.476581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2172/3497] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:33:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:33:12.555638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3dc407f-3966-48d9-bdbe-610e363b6cd9 tempest-ComputeTenantNetworksTest-334849479 tempest-ComputeTenantNetworksTest-334849479-project] Calling method '.version_select at 0x7f3217b04940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:13.131542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3dc407f-3966-48d9-bdbe-610e363b6cd9 tempest-ComputeTenantNetworksTest-334849479 tempest-ComputeTenantNetworksTest-334849479-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.653030 May 19 08:33:13.132464 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2173/3498] 10.222.0.78 () {58 vars in 1157 bytes} [Thu May 19 08:33:12 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:13.139136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:13.140058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:13.148580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.149463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.150472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.151392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.158340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:13.555071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:13.578475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:13.580136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:13.584496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ab23daa-235d-49c0-b8f8-637c57cf442b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.447943 May 19 08:33:13.585109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2174/3499] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:13 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:13.594129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f26f5c61-1efb-4fbf-b2fc-21987ab03af5 req-2c331507-95f6-41f4-878b-0c4fa17ee372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c9cc78-f8e7-4279-848f-d656e6e20c5f", "name": "network-vif-deleted", "tag": "b7074007-c11b-4547-827a-d95d357fbf8a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:13.607728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f26f5c61-1efb-4fbf-b2fc-21987ab03af5 req-2c331507-95f6-41f4-878b-0c4fa17ee372 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.608467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f26f5c61-1efb-4fbf-b2fc-21987ab03af5 req-2c331507-95f6-41f4-878b-0c4fa17ee372 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.620952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f26f5c61-1efb-4fbf-b2fc-21987ab03af5 req-2c331507-95f6-41f4-878b-0c4fa17ee372 service nova] Creating event network-vif-deleted:b7074007-c11b-4547-827a-d95d357fbf8a for instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f on chh2-842464-2 May 19 08:33:13.647499 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f26f5c61-1efb-4fbf-b2fc-21987ab03af5 req-2c331507-95f6-41f4-878b-0c4fa17ee372 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060612 May 19 08:33:13.648640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2175/3500] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:13.659733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dfff527e-b511-403c-9c46-5ebe5d901078 req-b4c3b770-322f-4b23-ae89-2f476ddcbafa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "b0bc770d-5102-4981-80bd-f484c3748df7"}, {"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "c906b65b-8f2b-4c8c-b6a4-072396e4a00d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:13.683155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dfff527e-b511-403c-9c46-5ebe5d901078 req-b4c3b770-322f-4b23-ae89-2f476ddcbafa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.685243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dfff527e-b511-403c-9c46-5ebe5d901078 req-b4c3b770-322f-4b23-ae89-2f476ddcbafa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.716641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dfff527e-b511-403c-9c46-5ebe5d901078 req-b4c3b770-322f-4b23-ae89-2f476ddcbafa service nova] Creating event network-changed:b0bc770d-5102-4981-80bd-f484c3748df7 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:13.717659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dfff527e-b511-403c-9c46-5ebe5d901078 req-b4c3b770-322f-4b23-ae89-2f476ddcbafa service nova] Creating event network-changed:c906b65b-8f2b-4c8c-b6a4-072396e4a00d for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:13.730242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dfff527e-b511-403c-9c46-5ebe5d901078 req-b4c3b770-322f-4b23-ae89-2f476ddcbafa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079334 May 19 08:33:13.733429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2176/3501] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:13.749369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:13.750740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: 06c9cc78-f8e7-4279-848f-d656e6e20c5f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:13.766820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.769719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.774306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.775311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.794718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] HTTP exception thrown: Instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f could not be found. May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Request method failure captured: May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f HTTP/1.1 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6ToSdzuHG-M_V__hr_nL3jNj4nAqaWb2-BlAdn9kLv37gf0SE17gUQ89LfVSKcqVaYzss4T8XuEMf5QFUuTpOQGMujssqHI6-tcMMCfEQfmueLyeV1SqtHvxIqZZIeFwwxsY0Xq9awe2aZNpUNT6Cp8G9BgxAAoZmcpdhxXbXUrWw May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b607e36aa42545dfb715c629002236ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b607e36aa42545dfb715c629002236ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-421405011 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 59f3ba2c06c045d6afccb1639ed8d083 May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f could not be found. May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '06c9cc78-f8e7-4279-848f-d656e6e20c5f'} May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f could not be found. May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f could not be found. May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:13.798768 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f could not be found. May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:13.804122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Returning 404 to user: Instance 06c9cc78-f8e7-4279-848f-d656e6e20c5f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:13.805331 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e499ad7e-e222-4ba5-8a77-ec89f36df67b tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f" status: 404 len: 111 microversion: 2.1 time: 0.067161 May 19 08:33:13.810450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2177/3502] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:13 2022] GET /compute/v2.1/servers/06c9cc78-f8e7-4279-848f-d656e6e20c5f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:13.816737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:13.817482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:13.824262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.824937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:13.825880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:13.826438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:14.044721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c5e0bfd-ec71-4a3c-8231-211c823377ab tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232727 May 19 08:33:14.045330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2178/3503] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:33:13 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:14.056552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:14.057185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:14.071054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:14.071512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:14.072301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:14.073928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:14.226202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:14.238244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:14.240136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:14.241910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08a2ed8b-5100-419b-adc5-05f89d415b1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14" status: 200 len: 1347 microversion: 2.47 time: 0.189152 May 19 08:33:14.261403 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2179/3504] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:14 2022] GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14 => generated 1347 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:14.275612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c5d12fe-6954-4db5-ad49-edb07607f9db tempest-ComputeTenantNetworksTest-334849479 tempest-ComputeTenantNetworksTest-334849479-project] Calling method '.version_select at 0x7f3212905a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:14.561275 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c5d12fe-6954-4db5-ad49-edb07607f9db tempest-ComputeTenantNetworksTest-334849479 tempest-ComputeTenantNetworksTest-334849479-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks/1ebd6115-40fd-4d7a-8eeb-1d71f4529edd" status: 200 len: 140 microversion: 2.1 time: 0.292776 May 19 08:33:14.562147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2180/3505] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:33:14 2022] GET /compute/v2.1/os-tenant-networks/1ebd6115-40fd-4d7a-8eeb-1d71f4529edd => generated 140 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:14.572830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:14.573519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:14.593171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:14.601121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:14.603762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:14.612875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:14.656594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:14.804693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21f59a9b-2dc8-407b-8696-6657ebf4d4ee tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 204 len: 0 microversion: 2.1 time: 0.240020 May 19 08:33:14.805425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2181/3506] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:33:14 2022] DELETE /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:14.825561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1281021160", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": "none"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:14.922790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:33:14.923430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:33:14.924588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:33:14.925706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:33:14.929653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:33:14.952395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:14.954635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:14.955726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:14.958758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:15.008671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Getting quotas for project 8e60a6c58f514d8d88d1fcecd08a8621. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:33:15.022422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Getting quotas for user 66ecf6d3ad2747a0a399cdba5b61648e and project 8e60a6c58f514d8d88d1fcecd08a8621. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:33:15.066061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:33:15.076347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:33:15.174723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-334fefe1-9e8b-4619-aae9-8faa3e4caa3b tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.367917 May 19 08:33:15.176997 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2182/3507] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:33:15.192104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:15.193129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:15.208119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:15.209511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:15.214345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:15.215898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:16.747857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:16.763015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:16.764794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:16.769845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f26b9612-ae1c-4e5e-8518-6b27261a5dad tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.584612 May 19 08:33:16.773686 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2183/3508] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:15 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:16.782490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:16.784606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:16.797158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:16.801071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:16.802241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:16.813955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:17.769491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:17.782474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0092c17-382d-40a1-b52f-6bb4cc11e84e tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1674 microversion: 2.1 time: 1.007236 May 19 08:33:17.786708 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2184/3509] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:16 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1674 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:17.798473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:17.805039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:17.821099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:17.825490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:17.829033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:17.829796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:17.873476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df1ab203-8f1b-4a98-8ec6-9cbeeb50b944 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "PUT /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1048 microversion: 2.47 time: 0.084729 May 19 08:33:17.874754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2185/3510] 10.222.0.78 () {62 vars in 1296 bytes} [Thu May 19 08:33:17 2022] PUT /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1048 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:17.879673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-024c4f6a-0f08-4f1e-912b-3b39969bb99f req-ede12149-fa9b-40c0-86fa-d0fb1a2c5965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "54802d14-fe37-40ec-9d4e-45c5506a6a30"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:17.890387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-024c4f6a-0f08-4f1e-912b-3b39969bb99f req-ede12149-fa9b-40c0-86fa-d0fb1a2c5965 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:17.891490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-024c4f6a-0f08-4f1e-912b-3b39969bb99f req-ede12149-fa9b-40c0-86fa-d0fb1a2c5965 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:17.912030 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-024c4f6a-0f08-4f1e-912b-3b39969bb99f req-ede12149-fa9b-40c0-86fa-d0fb1a2c5965 service nova] Creating event network-changed:54802d14-fe37-40ec-9d4e-45c5506a6a30 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:17.922078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-024c4f6a-0f08-4f1e-912b-3b39969bb99f req-ede12149-fa9b-40c0-86fa-d0fb1a2c5965 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045851 May 19 08:33:17.923323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2186/3511] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:17.934881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:17.936195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:17.941098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:17.948661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:17.949989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:17.951473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:17.952402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:18.906576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:18.922164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:18.925072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:18.927156 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd6466f3-539e-4042-a46f-c8eb03b6e80d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.002463 May 19 08:33:18.928248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2187/3512] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:17 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:18.945471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:18.946722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:18.982248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:18.983782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:18.985155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:18.986110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:19.122025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:19.136497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:19.143860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:19.151482 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f949c081-f957-45a3-b0ff-9b1f34763447 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1336 microversion: 2.47 time: 0.220902 May 19 08:33:19.157777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2188/3513] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:18 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1336 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:19.164783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:19.179440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:19.192336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:19.198081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:19.199132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:19.199893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:19.444712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59f3ba2c06c045d6afccb1639ed8d083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b607e36aa42545dfb715c629002236ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:19.485894 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-984f3b2c-74d6-4a09-ae30-118210899988 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 200 len: 1606 microversion: 2.1 time: 0.325680 May 19 08:33:19.494459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2189/3514] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:19 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 1606 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:19.949939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:19.951392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:19.981487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:19.983652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:19.990100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:19.994098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:20.806756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:20.833742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:20.840952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:20.844656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de43de4d-5ab8-46e3-a9cf-16fdfcc17f3c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.898417 May 19 08:33:20.845791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2190/3515] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:19 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:20.862497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b0b61585-2384-483b-a44c-b35a7f050dcc req-4f6be344-686c-4e8a-8376-55432f38d58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "35b433fc-d79e-466a-bec4-224d739093ed"}, {"name": "network-changed", "server_uuid": "64a56363-0605-49d5-8019-3537b2318fda", "tag": "5c6ca18d-4831-4118-a223-7504d55f04a0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:20.881296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b0b61585-2384-483b-a44c-b35a7f050dcc req-4f6be344-686c-4e8a-8376-55432f38d58e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:20.881770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b0b61585-2384-483b-a44c-b35a7f050dcc req-4f6be344-686c-4e8a-8376-55432f38d58e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:20.939569 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b0b61585-2384-483b-a44c-b35a7f050dcc req-4f6be344-686c-4e8a-8376-55432f38d58e service nova] Creating event network-changed:35b433fc-d79e-466a-bec4-224d739093ed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:20.940083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b0b61585-2384-483b-a44c-b35a7f050dcc req-4f6be344-686c-4e8a-8376-55432f38d58e service nova] Creating event network-changed:5c6ca18d-4831-4118-a223-7504d55f04a0 for instance 64a56363-0605-49d5-8019-3537b2318fda on chh2-842464-2 May 19 08:33:20.984435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b0b61585-2384-483b-a44c-b35a7f050dcc req-4f6be344-686c-4e8a-8376-55432f38d58e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.132597 May 19 08:33:20.985859 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2191/3516] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:21.008871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aedc8461-f685-4228-8141-6cac327ffa98 req-29a79bcd-5579-419c-9ed5-1493bd301147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c75d5c8f-8107-4a60-b50d-c1eacb348de5", "name": "network-vif-deleted", "tag": "68a02a20-7ce2-4593-bfcf-b683a17c2044"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:21.035621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aedc8461-f685-4228-8141-6cac327ffa98 req-29a79bcd-5579-419c-9ed5-1493bd301147 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.036375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aedc8461-f685-4228-8141-6cac327ffa98 req-29a79bcd-5579-419c-9ed5-1493bd301147 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.063455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aedc8461-f685-4228-8141-6cac327ffa98 req-29a79bcd-5579-419c-9ed5-1493bd301147 service nova] Creating event network-vif-deleted:68a02a20-7ce2-4593-bfcf-b683a17c2044 for instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 on chh2-842464-2 May 19 08:33:21.084860 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aedc8461-f685-4228-8141-6cac327ffa98 req-29a79bcd-5579-419c-9ed5-1493bd301147 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093512 May 19 08:33:21.089004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2192/3517] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:21.101662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:21.103858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:21.120222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.125105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.126396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.129339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.557852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:21.580966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:21.587340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:21.588764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1619b697-087b-450e-99c0-06f4ebfc98dd tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1357 microversion: 2.47 time: 0.497565 May 19 08:33:21.591011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2193/3518] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:21 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1357 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:21.604488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:21.605134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] [instance: c75d5c8f-8107-4a60-b50d-c1eacb348de5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:21.623182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.623701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.626708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.627437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.664465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] HTTP exception thrown: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 could not be found. May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Request method failure captured: May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 HTTP/1.1 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf6ToSdzuHG-M_V__hr_nL3jNj4nAqaWb2-BlAdn9kLv37gf0SE17gUQ89LfVSKcqVaYzss4T8XuEMf5QFUuTpOQGMujssqHI6-tcMMCfEQfmueLyeV1SqtHvxIqZZIeFwwxsY0Xq9awe2aZNpUNT6Cp8G9BgxAAoZmcpdhxXbXUrWw May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b607e36aa42545dfb715c629002236ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b607e36aa42545dfb715c629002236ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b607e36aa42545dfb715c629002236ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-421405011 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b607e36aa42545dfb715c629002236ed May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-421405011 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 59f3ba2c06c045d6afccb1639ed8d083 May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-421405011-project May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 could not be found. May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'c75d5c8f-8107-4a60-b50d-c1eacb348de5'} May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 could not be found. May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 could not be found. May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:21.666510 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 could not be found. May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Returning 404 to user: Instance c75d5c8f-8107-4a60-b50d-c1eacb348de5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39e9b34d-279b-4104-966b-66b1294285d5 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5" status: 404 len: 111 microversion: 2.1 time: 0.074324 May 19 08:33:21.672270 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2194/3519] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:21 2022] GET /compute/v2.1/servers/c75d5c8f-8107-4a60-b50d-c1eacb348de5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:21.682093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:21.687862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:21.701268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.701762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.702588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:21.703031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:21.848361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:33:21.853572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:33:21.854271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:33:21.854703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:33:21.855133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:33:21.884841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:22.010951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:22.028643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:22.030018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:22.031780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:22.035236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:22.111056 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d531dc6a-2d53-4005-8cc3-4e71752424ff tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "POST /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90/action" status: 202 len: 1079 microversion: 2.47 time: 0.436683 May 19 08:33:22.131191 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2195/3520] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:33:21 2022] POST /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90/action => generated 1079 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 08:33:22.134320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3e07c0e-93fb-4722-aa4b-6e8ea69ee4d6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] Calling method '.version_select at 0x7f3217ad2af0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:22.187290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3e07c0e-93fb-4722-aa4b-6e8ea69ee4d6 tempest-ServerActionsTestJSON-421405011 tempest-ServerActionsTestJSON-421405011-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384998341" status: 202 len: 0 microversion: 2.1 time: 0.061827 May 19 08:33:22.190860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2196/3521] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:33:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384998341 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:33:22.196036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:22.197292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:22.214904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:22.215585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:22.218421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:22.219176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:22.951345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:22.967653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:22.982274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:22.984273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e27e2d4f-6e39-4f23-aaf4-723874cfda45 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.794716 May 19 08:33:22.985695 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2197/3522] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:22 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:22.991143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:22.992018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:23.009924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:23.010400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:23.011194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:23.012361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:23.319866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:23.330942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:23.339215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:23.341254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59a9b7cf-9f57-4eb0-8588-add5d7d19999 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.353967 May 19 08:33:23.352948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2198/3523] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:22 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:23.369517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a53cfccc-c5cf-4448-b272-6eef0e8406b5 req-c411720f-da1d-4e2c-98e2-2d45347dbc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "23c51317-3b4b-4c46-8685-bf35bfb26d47"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:23.396214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a53cfccc-c5cf-4448-b272-6eef0e8406b5 req-c411720f-da1d-4e2c-98e2-2d45347dbc5d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:23.397171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a53cfccc-c5cf-4448-b272-6eef0e8406b5 req-c411720f-da1d-4e2c-98e2-2d45347dbc5d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:23.418188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a53cfccc-c5cf-4448-b272-6eef0e8406b5 req-c411720f-da1d-4e2c-98e2-2d45347dbc5d service nova] Creating event network-changed:23c51317-3b4b-4c46-8685-bf35bfb26d47 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:23.434298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a53cfccc-c5cf-4448-b272-6eef0e8406b5 req-c411720f-da1d-4e2c-98e2-2d45347dbc5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066155 May 19 08:33:23.437712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2199/3524] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:24.004386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:24.005006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:24.012233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:24.012882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:24.013644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:24.019346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:24.979380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:25.054059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:25.411368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:25.438337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:25.440711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:25.442670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86bd5c3b-8d0e-42a2-82f1-00f821cf15ab tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.442403 May 19 08:33:25.443479 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2200/3525] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:23 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:33:25.475021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:25.475672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:25.490766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:25.491609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:25.492619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:25.493252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:25.838333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:25.852890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:25.854566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:25.855946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c7e5da0-7c6f-4c48-82a6-8df805683835 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.411195 May 19 08:33:25.860594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2201/3526] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:25 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:26.466318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:26.467888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:26.484242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:26.486853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:26.488088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:26.490560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:27.194837 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:33:27.205781 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:33:27.573204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:27.594769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:27.602347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:27.605002 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab11d976-f9f1-4664-9fe6-78614b9090f6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.142744 May 19 08:33:27.624070 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2202/3527] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:26 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:33:27.647707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:27.648708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:27.657510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:27.658383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:27.660232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:27.660962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:27.810396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:27.830432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:27.832262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:27.838283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-224cbb67-c1b8-4ef5-a0d0-36c03c9878dc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.209397 May 19 08:33:27.844924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2203/3528] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:27 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:27.861678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2d2bdf08-2147-41db-91e3-7f423c1e6313 req-eaa344f1-da3d-43a5-81ea-c97e3c8061cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "ee4b12a5-239c-4c07-9dcb-7cd272e1df1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:27.895982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2d2bdf08-2147-41db-91e3-7f423c1e6313 req-eaa344f1-da3d-43a5-81ea-c97e3c8061cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:27.896427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2d2bdf08-2147-41db-91e3-7f423c1e6313 req-eaa344f1-da3d-43a5-81ea-c97e3c8061cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:27.928986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2d2bdf08-2147-41db-91e3-7f423c1e6313 req-eaa344f1-da3d-43a5-81ea-c97e3c8061cc service nova] Creating event network-changed:ee4b12a5-239c-4c07-9dcb-7cd272e1df1b for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:27.944165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2d2bdf08-2147-41db-91e3-7f423c1e6313 req-eaa344f1-da3d-43a5-81ea-c97e3c8061cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095662 May 19 08:33:27.950229 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2204/3529] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:28.627273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:28.629245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:28.649919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:28.655348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:28.656455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:28.657076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:30.380375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:30.394845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:30.397170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:30.399883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccf9ae9d-c402-4792-987a-1882a0bfe44f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.779706 May 19 08:33:30.418495 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2205/3530] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:28 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:30.429178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:30.432267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:30.445554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:30.446503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:30.448565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:30.450054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:30.633288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:30.645091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:30.655634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:30.657478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7494896d-7505-4f8a-aaae-481a42d7cc1a tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.237500 May 19 08:33:30.658329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2206/3531] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:30 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:31.420836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:31.421656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:31.435577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:31.436143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:31.437862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:31.438406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:32.475562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:32.492389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:32.498835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:32.500449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb729cc6-2fe8-4ad5-a471-8e114d84bf25 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.083798 May 19 08:33:32.514202 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2207/3532] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:31 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:33:32.530098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b5cfa785-a076-4204-853e-b7a738e4a513 req-111dc8a1-b2d7-4905-ba99-0e15da7a4de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "94babe40-01cf-4e4b-b343-36b1cd7d8aed"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:32.564235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b5cfa785-a076-4204-853e-b7a738e4a513 req-111dc8a1-b2d7-4905-ba99-0e15da7a4de6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:32.564394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b5cfa785-a076-4204-853e-b7a738e4a513 req-111dc8a1-b2d7-4905-ba99-0e15da7a4de6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:32.577765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b5cfa785-a076-4204-853e-b7a738e4a513 req-111dc8a1-b2d7-4905-ba99-0e15da7a4de6 service nova] Creating event network-changed:94babe40-01cf-4e4b-b343-36b1cd7d8aed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:33:32.582994 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b5cfa785-a076-4204-853e-b7a738e4a513 req-111dc8a1-b2d7-4905-ba99-0e15da7a4de6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067437 May 19 08:33:32.583619 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2208/3533] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:32.596775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:32.597515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:32.613170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:32.613908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:32.614949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:32.616696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:33.477409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:33.504794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:33.506608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:33.509035 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f896b5ae-521d-4240-8a8b-2f9df275ac4e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.924080 May 19 08:33:33.510404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2209/3534] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:32 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:33.769968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1828422847", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "cff545ba-e27d-4c74-8485-993b488e80c1"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:33.868257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] validate_networks() for [('cff545ba-e27d-4c74-8485-993b488e80c1', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:33:34.975258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:33:34.976861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:33:34.978991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:33:34.980343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:33:34.981138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:33:35.016892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:35.017755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:35.020394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:35.021670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:35.091949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Getting quotas for project 0dbc9255a3f54f229f48535b7d4230d1. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:33:35.100053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Getting quotas for user 9f7a1c23746f4972a5e2cd7403e9f0cb and project 0dbc9255a3f54f229f48535b7d4230d1. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:33:35.128703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:33:35.132373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:33:35.233239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-472a7996-cbe2-4563-97a3-dbdb53c04e5c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703354 May 19 08:33:35.237585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2210/3535] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:33:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:33:35.255241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:35.256050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:35.270796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:35.271264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:35.272078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:35.272524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.298422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.311857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.313408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.314594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0eb3181-f4d0-4bbc-a2b1-b77c11dd533c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.070873 May 19 08:33:36.315153 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2211/3536] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:35 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:36.333275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:36.333936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:36.360909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:36.361394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.362393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:36.362996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.624853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.636160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.638444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.641892 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12bbf98f-19ef-4fd3-90f8-7c77d2baa457 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.315532 May 19 08:33:36.643971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2212/3537] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:36 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:36.656848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:36.657950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:36.674546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:36.675698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.677909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:36.679317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.816400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:36.841907 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e0de231-34bc-4948-8900-be1b3f06a79c tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1277 microversion: 2.1 time: 0.196133 May 19 08:33:36.842521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2213/3538] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:36 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:36.857610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:36.858643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:36.869276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:36.872234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.874182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:36.875189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:36.922713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:36.927610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:37.085023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca79ac7f-044d-4991-9a62-2dcc9fe05d12 tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 204 len: 0 microversion: 2.1 time: 0.239029 May 19 08:33:37.086391 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2214/3539] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:33:36 2022] DELETE /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:37.096103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:37.099752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:37.112932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:37.114177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:37.115234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:37.116111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:37.728999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:37.752746 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3304922a-e8f7-49ac-ae16-959d050ec68c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1513 microversion: 2.1 time: 0.661329 May 19 08:33:37.753374 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2215/3540] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:37 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1513 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:37.758271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:37.759159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:37.775217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:37.776185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:37.776794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:37.781501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:39.106454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.122196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.132379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.133769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56daa1ea-38ac-476f-a522-12699de83649 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.379193 May 19 08:33:39.134598 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2216/3541] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:37 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:39.146403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:39.146403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:39.157223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:39.161726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:39.162824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:39.163468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:39.707043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.722620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.724957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.728229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ddee89e-b048-43be-88bd-1467d279fafa tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.592525 May 19 08:33:39.738198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2217/3542] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:39 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:39.744623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:39.745607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:39.764139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:39.765158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:39.766309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:39.767093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:39.969172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:39.980622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ab3be3b-d34b-4f57-9dc2-a46870c94261 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1283 microversion: 2.1 time: 0.240377 May 19 08:33:39.982003 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2218/3543] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:39 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1283 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:39.987680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:39.988516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:40.000056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:40.003228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:40.004279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:40.004913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:40.601714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73cd52377ce84c7ca8c254c0068a82b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ad1d482e3d447f9829945d5e09b32a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:40.611840 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-534226cf-4776-48b4-bc52-99ef7769ac5c tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 200 len: 1513 microversion: 2.1 time: 0.628449 May 19 08:33:40.618598 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2219/3544] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:39 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 1513 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:40.641373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:40.642454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:40.661830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:40.662289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:40.663088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:40.663562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:41.592815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:41.614777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:41.623302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:41.625038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac04dd98-0475-4720-b552-45e126530b86 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.997749 May 19 08:33:41.634744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2220/3545] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:40 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:41.928618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccd65666-877b-4283-9628-45df5d741a6e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'create', calling method: .version_select at 0x7f3210fb3310>, body: {"keypair": {"name": "tempest-keypair-815090382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABGYYCEyXc/ENaqutsUqUXsOs/DXhZr5LbbA/fMtN5FoG7eCBVdFuDyMFN2JtVQJZFL1blVucweQMFBbDkPOGJRT0v9l79Q/CMsIDg2pb9B81FbCwwN6qHo/hjVSTRdTQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:41.972932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ccd65666-877b-4283-9628-45df5d741a6e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:33:42.003164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ccd65666-877b-4283-9628-45df5d741a6e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for user 666f1bf89e4940a38d63dbe3a2380a1f and project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:33:42.011176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:42.073239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccd65666-877b-4283-9628-45df5d741a6e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.437051 May 19 08:33:42.074303 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2221/3546] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:33:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 08:33:42.085488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:42.086436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:42.100004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:42.102765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:42.105972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:42.107001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:42.303622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:42.312838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:42.319029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:42.325474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4363ce7-8d1c-4f51-acb8-c920a69a1f7e tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.249350 May 19 08:33:42.329001 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2222/3547] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:42 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:42.338464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ca479f24-66f8-4151-b6d8-13c733e733a3 req-d30844a4-8cc0-4e7e-92f3-216f89483b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f37cfb6-2e4b-42c9-b78d-69c4e18ed686", "name": "network-vif-deleted", "tag": "5126af38-3211-4235-b21e-dc6cb7088ab7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:42.364175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ca479f24-66f8-4151-b6d8-13c733e733a3 req-d30844a4-8cc0-4e7e-92f3-216f89483b22 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:42.365347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ca479f24-66f8-4151-b6d8-13c733e733a3 req-d30844a4-8cc0-4e7e-92f3-216f89483b22 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:42.390928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ca479f24-66f8-4151-b6d8-13c733e733a3 req-d30844a4-8cc0-4e7e-92f3-216f89483b22 service nova] Creating event network-vif-deleted:5126af38-3211-4235-b21e-dc6cb7088ab7 for instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 on chh2-842464-2 May 19 08:33:42.406111 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ca479f24-66f8-4151-b6d8-13c733e733a3 req-d30844a4-8cc0-4e7e-92f3-216f89483b22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075640 May 19 08:33:42.407827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2223/3548] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:42.421884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:42.423414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:42.439820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:42.440924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:42.442168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:42.446160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:43.845322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:43.862073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17c2f7bd-75a0-48af-b366-6072d644274e tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1325 microversion: 2.1 time: 1.452574 May 19 08:33:43.862689 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2224/3549] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:42 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1325 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:43.872866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:43.872866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] [instance: 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:43.890194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:43.890647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:43.891441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:43.891882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:43.919739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] HTTP exception thrown: Instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 could not be found. May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Request method failure captured: May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 HTTP/1.1 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihf83FXIkb04zP0PjjgbkcJHRXSpeo41h6QKi_fTW8y23p-YAn5WTcYo5UthTrFE7QGCi8nqTf1WSItL0ixsIBHHp4qaENXgUDy0yIdqZ3ToviAa73BOwefWZ2SXXEasnVoJdETLVb5cHdDIb1Kk8adn81c-0VFGsf13istDWNYDOdcc May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9ad1d482e3d447f9829945d5e09b32a1 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesSnapshotTestJSON-737754770 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ad1d482e3d447f9829945d5e09b32a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesSnapshotTestJSON-737754770 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9ad1d482e3d447f9829945d5e09b32a1 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-737754770 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesSnapshotTestJSON-737754770-project May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 73cd52377ce84c7ca8c254c0068a82b7 May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesSnapshotTestJSON-737754770-project May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 could not be found. May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1f37cfb6-2e4b-42c9-b78d-69c4e18ed686'} May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 could not be found. May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 could not be found. May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:43.921474 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 could not be found. May 19 08:33:43.926747 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:43.931745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] Returning 404 to user: Instance 1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:43.932815 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a63fdb3-8a8f-496a-a4bd-e0ab2cae8c1d tempest-VolumesSnapshotTestJSON-737754770 tempest-VolumesSnapshotTestJSON-737754770-project] 10.222.0.78 "GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686" status: 404 len: 111 microversion: 2.1 time: 0.069168 May 19 08:33:43.936985 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2225/3550] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:43 2022] GET /compute/v2.1/servers/1f37cfb6-2e4b-42c9-b78d-69c4e18ed686 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:43.953210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:43.954156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:43.962968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:43.963427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:43.964207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:43.966867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:45.016795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:45.047096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:45.076215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:45.085679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:45.089244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93c479af-be5b-429e-b18a-302a08d9d050 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 1.141727 May 19 08:33:45.090946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2226/3551] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:43 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:45.120039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:45.120941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:45.146802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:45.150889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:45.158276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:45.159588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:45.342520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:45.361109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:45.371243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:45.376295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f877370-719e-430e-97ea-3348eaa75d85 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.266565 May 19 08:33:45.380924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2227/3552] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:45 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:45.535513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-774916974", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "5bef4643-7442-483f-9827-3364339037b8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:45.638454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] validate_networks() for [('5bef4643-7442-483f-9827-3364339037b8', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:33:46.133545 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:33:46.134050 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:33:46.634429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:33:46.634928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:33:46.635448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:33:46.636072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:33:46.636712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:33:46.662268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:46.664801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:46.666030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:46.670387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:46.719077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Getting quotas for project 83fe2059a8894fb6ae93e3688e0445d9. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:33:46.732652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Getting quotas for user 2bf53c64d32e4c03a9a5edebf23b30d2 and project 83fe2059a8894fb6ae93e3688e0445d9. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:33:46.766979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:33:46.773646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:33:46.879878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6187cc1a-1b02-4329-8e98-fdce1bc258d1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497075 May 19 08:33:46.885048 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2228/3553] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:33:46.891052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:46.899803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:46.914057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:46.914444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:46.915191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:46.915629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:47.176864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:47.188403 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0be432e2-61d1-47c2-b838-1f3cec3b5aa9 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1325 microversion: 2.1 time: 0.301810 May 19 08:33:47.197860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2229/3554] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:46 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:47.197860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aa8a07a2-9ec4-4d58-a29d-f63a025acf53 req-4004fd88-99fe-4453-b104-af1aa7657c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4478410b-c308-4c85-9ceb-2365869807e8", "tag": "146fc502-5cb1-4da2-a977-f1be7bf34f0e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:47.235959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aa8a07a2-9ec4-4d58-a29d-f63a025acf53 req-4004fd88-99fe-4453-b104-af1aa7657c22 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:47.249953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aa8a07a2-9ec4-4d58-a29d-f63a025acf53 req-4004fd88-99fe-4453-b104-af1aa7657c22 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:47.287485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aa8a07a2-9ec4-4d58-a29d-f63a025acf53 req-4004fd88-99fe-4453-b104-af1aa7657c22 service nova] Creating event network-changed:146fc502-5cb1-4da2-a977-f1be7bf34f0e for instance 4478410b-c308-4c85-9ceb-2365869807e8 on chh1-842464-2 May 19 08:33:47.296429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aa8a07a2-9ec4-4d58-a29d-f63a025acf53 req-4004fd88-99fe-4453-b104-af1aa7657c22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105131 May 19 08:33:47.302771 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2230/3555] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:47.310243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:47.311262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:47.320320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:47.321160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:47.323225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:47.324214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:47.832314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:47.858844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:47.866673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:47.872601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36d5a5fb-abc0-42f7-859f-9d60c3285977 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.565662 May 19 08:33:47.873491 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2231/3556] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:47 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:47.884434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:47.885062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:47.907318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:47.908288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:47.913936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:47.914275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:48.578852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:48.591402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:48.596052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:48.599435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-508d5c12-e2f1-48ec-86ae-59a6ccb2bd10 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1366 microversion: 2.47 time: 0.724030 May 19 08:33:48.601263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2232/3557] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:47 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:48.633659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:48.638275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:48.657790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:48.658935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:48.659904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:48.660582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:48.735367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:48.975885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:48.989573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8199f32b-56e7-4902-b2f8-a64439355772 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1220 microversion: 2.1 time: 0.384617 May 19 08:33:49.000808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2233/3558] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:48 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1220 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:49.005989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-907201739", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9640551a-4500-475a-a6df-3b35313f36d4"}], "security_groups": [{"name": "tempest-securitygroup--114497749"}], "key_name": "tempest-keypair-815090382", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:49.533139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] validate_networks() for [('9640551a-4500-475a-a6df-3b35313f36d4', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:33:50.522061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:33:50.522763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:33:50.523120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:33:50.523545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:33:50.524041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:33:50.540384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:50.540838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:50.541680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:50.544006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:50.612118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:33:50.627477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for user 666f1bf89e4940a38d63dbe3a2380a1f and project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:33:50.666828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:33:50.674838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:33:50.779978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23b8369c-d317-4609-beef-b8c09116bf3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.785644 May 19 08:33:50.785860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2234/3559] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:33:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:33:50.807621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:50.815268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:50.826370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:50.827694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:50.829097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:50.829743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:51.352994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:51.369231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db13fa6b-009a-43e0-96af-5bc7e4e0b664 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1325 microversion: 2.1 time: 0.580700 May 19 08:33:51.371767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2235/3560] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:50 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1325 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:51.392495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:51.394475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:51.415043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:51.416269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:51.418327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:51.418845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.003546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.017693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.019180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.024525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbc53685-988f-4bca-bb8f-dbe7f0eee099 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.651170 May 19 08:33:52.028938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2236/3561] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:51 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:52.034185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:52.037768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:52.056049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.056540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.057433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.057822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.208750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.221480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.223289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.227440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3bebf7f8-a8cf-4c29-b40e-f5709337a96d tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1372 microversion: 2.47 time: 0.197114 May 19 08:33:52.228272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2237/3562] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:52 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:52.255046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:52.256095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:52.264318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.265775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.266768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.267371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.525195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.538502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b278b9cf-2cda-4f3f-b93d-30fc40fa225f tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.296229 May 19 08:33:52.539677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2238/3563] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:52 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:52.552547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:52.553558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:52.572927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.575507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.579875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.580707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.707804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.730358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.732296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:52.733688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-638899af-a78a-4461-b3bd-c60c3e773624 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1340 microversion: 2.20 time: 0.192186 May 19 08:33:52.736547 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2239/3564] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:52 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:52.748061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdac424f-0b5f-463c-a8c3-38520a22c190"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:52.755624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:52.764134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.769127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:52.771628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:52.772482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:53.293594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-539751d2-a0d3-4d87-afc5-7befcc50acfd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "POST /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555373 May 19 08:33:53.297058 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2240/3565] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:33:52 2022] POST /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:53.305593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2fb08007-2474-406b-8418-bcca54f64189 req-ab445ccb-d391-4e09-826a-a2b96a75c3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4478410b-c308-4c85-9ceb-2365869807e8", "name": "network-vif-plugged", "status": "completed", "tag": "146fc502-5cb1-4da2-a977-f1be7bf34f0e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:53.323735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2fb08007-2474-406b-8418-bcca54f64189 req-ab445ccb-d391-4e09-826a-a2b96a75c3b8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:53.325068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2fb08007-2474-406b-8418-bcca54f64189 req-ab445ccb-d391-4e09-826a-a2b96a75c3b8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:53.341243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2fb08007-2474-406b-8418-bcca54f64189 req-ab445ccb-d391-4e09-826a-a2b96a75c3b8 service nova] Creating event network-vif-plugged:146fc502-5cb1-4da2-a977-f1be7bf34f0e for instance 4478410b-c308-4c85-9ceb-2365869807e8 on chh1-842464-2 May 19 08:33:53.349104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2fb08007-2474-406b-8418-bcca54f64189 req-ab445ccb-d391-4e09-826a-a2b96a75c3b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048521 May 19 08:33:53.349104 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2241/3566] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:53.378037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:53.378037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:53.392974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:53.393457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:53.394297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:53.394737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:53.818887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:53.829181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ab51eff-04ec-46ba-857d-f799b1d4b02d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1325 microversion: 2.1 time: 0.478902 May 19 08:33:53.832881 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2242/3567] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:53 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:53.838434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:53.839062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:53.858503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:53.858961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:53.860244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:53.860244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:54.234524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:54.249118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:54.255459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:54.256752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a2ed0a81-65e3-49ca-9d57-8bae15ffb184 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.422132 May 19 08:33:54.257597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2243/3568] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:53 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:54.268569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:54.269213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:54.276431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:54.277752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:54.278634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:54.279205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:54.411752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:54.445074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:54.447131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:54.449216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38574151-bd1e-402b-8ae0-e20f5bab6de0 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1357 microversion: 2.47 time: 0.190295 May 19 08:33:54.450507 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2244/3569] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:54 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:54.456739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:54.457597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:54.466065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:54.467574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:54.468565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:54.469939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:55.113289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:55.128216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd648793-a57f-460f-ba0a-1eb6cd16456a tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.676195 May 19 08:33:55.129193 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2245/3570] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:54 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:55.134238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:55.134424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:55.157201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:55.158278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:55.158536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:55.158986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:55.577603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:55.598324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:55.602010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:55.609554 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a36598b9-f8e8-4605-a144-341793c52250 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1405 microversion: 2.20 time: 0.472966 May 19 08:33:55.610259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2246/3571] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:55 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:55.616374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:55.631246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:55.632377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Searching by: {'deleted': False, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:33:55.644754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:55.645533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:55.648712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:55.649394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:55.821020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:33:55.947313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=23 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:55.966865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:55.984503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:55.986423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.017159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:56.019181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:56.107892 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d1880dc-992f-4e1c-b134-5b00137b4d38 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.496180 May 19 08:33:56.109119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2247/3572] 10.222.0.78 () {60 vars in 1186 bytes} [Thu May 19 08:33:55 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:56.115083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:56.115953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:56.130019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.138378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.145464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.147027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.430041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:56.441199 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51028fc2-1fe0-4633-b45b-7b5eeaed261b tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1521 microversion: 2.1 time: 0.330655 May 19 08:33:56.441828 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2248/3573] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:56 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:56.450798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4f00987f-efe2-4fbc-965a-686fc06d949f req-eab47e4f-9960-4486-8dd7-4f3f7639564c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2ed316-6918-400e-b4da-85b9f8a6c178", "tag": "73522996-f156-4095-ac64-27ececcd0247"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:56.461044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4f00987f-efe2-4fbc-965a-686fc06d949f req-eab47e4f-9960-4486-8dd7-4f3f7639564c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.461811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4f00987f-efe2-4fbc-965a-686fc06d949f req-eab47e4f-9960-4486-8dd7-4f3f7639564c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.465643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:56.480303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4f00987f-efe2-4fbc-965a-686fc06d949f req-eab47e4f-9960-4486-8dd7-4f3f7639564c service nova] Creating event network-changed:73522996-f156-4095-ac64-27ececcd0247 for instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 on chh2-842464-2 May 19 08:33:56.497167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4f00987f-efe2-4fbc-965a-686fc06d949f req-eab47e4f-9960-4486-8dd7-4f3f7639564c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050435 May 19 08:33:56.497829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2249/3574] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:56.514583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:56.515500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:56.527720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.528188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.531122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.531595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.841492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:56.853728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:56.857352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:56.858857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edfa9305-b66f-4090-a2e1-2959c970b2aa tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.355876 May 19 08:33:56.859961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2250/3575] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:56 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:56.864570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0f1dfc4a-b711-450d-8287-23e90d18c39f req-c0f71ea5-233a-481b-a9fb-a041cfd6d61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:33:56.875830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0f1dfc4a-b711-450d-8287-23e90d18c39f req-c0f71ea5-233a-481b-a9fb-a041cfd6d61c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.876321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0f1dfc4a-b711-450d-8287-23e90d18c39f req-c0f71ea5-233a-481b-a9fb-a041cfd6d61c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.890914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0f1dfc4a-b711-450d-8287-23e90d18c39f req-c0f71ea5-233a-481b-a9fb-a041cfd6d61c service nova] Creating event network-changed:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:33:56.896161 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0f1dfc4a-b711-450d-8287-23e90d18c39f req-c0f71ea5-233a-481b-a9fb-a041cfd6d61c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034915 May 19 08:33:56.896777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2251/3576] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:33:56.902571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:56.903161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:56.910467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.910923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.911706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:56.912147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:56.946200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:57.021662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:33:57.040714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48cf0418-0273-4e9e-a871-fa03092a8dfc tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 204 len: 0 microversion: 2.47 time: 0.142242 May 19 08:33:57.041522 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2252/3577] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:33:56 2022] DELETE /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:33:57.047060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:57.047772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:57.056544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.057009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.059305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.059758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.419542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:57.430416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a2fcc89-26b5-423a-a321-8a6f2533a90c tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.387639 May 19 08:33:57.442334 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2253/3578] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:57 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:57.448166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:57.449016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:57.456757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.457600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.458597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.459229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.491193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] HTTP exception thrown: Action 999 not found May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Request method failure captured: May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8/os-instance-actions/999 HTTP/1.1 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDcUA9TsayMWgdwT_WPmjhPPh1J1cDgQw5Hdeqf2xZTYdC7IkmwaeA_RCZsKpKdPKOmKin37HGUEc2nZIeh16wyPuDaU-OzlozXB2R2BQ071_xB4pUBzixc_LQlT_K29QFsQOHwpJPf8N1kNXoJrj6j1Wg1zU5m4UXX9SdHnBd4nKk May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0dbc9255a3f54f229f48535b7d4230d1 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0dbc9255a3f54f229f48535b7d4230d1 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsNegativeTestJSON-1493810982-project May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9f7a1c23746f4972a5e2cd7403e9f0cb May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1493810982-project May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: exception: Action 999 not found May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '4478410b-c308-4c85-9ceb-2365869807e8', 'id': '999'} May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 19 08:33:57.500491 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:57.507425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Returning 404 to user: Action 999 not found {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:57.508549 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2eb672d2-51ff-4f3a-8be4-904c0af1610d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.064783 May 19 08:33:57.514679 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2254/3579] 10.222.0.78 () {58 vars in 1307 bytes} [Thu May 19 08:33:57 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8/os-instance-actions/999 => generated 66 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:33:57.517484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:57.518174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:57.524949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.525515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.526375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.528109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.894010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:57.905445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:57.908000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:57.909172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c960709-d803-4c2c-a1c2-df43930da19a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1405 microversion: 2.20 time: 0.398995 May 19 08:33:57.909979 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2255/3580] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:57 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:57.915693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:57.916682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:57.924140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.924584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:57.925393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:57.926229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:58.029066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:58.038533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:58.040145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:58.041370 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64ebf11b-0b58-4592-a525-4f574771d8c4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1363 microversion: 2.47 time: 0.130354 May 19 08:33:58.041950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2256/3581] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:57 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1363 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:58.046941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-371dbaa4-d539-459f-ac81-55ab75c05463 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '.version_select at 0x7f3210f7ad30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:58.047513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-371dbaa4-d539-459f-ac81-55ab75c05463 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 926d9d50-78ee-40f2-9487-dc4a6a1589b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:58.061578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-371dbaa4-d539-459f-ac81-55ab75c05463 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] HTTP exception thrown: Instance 926d9d50-78ee-40f2-9487-dc4a6a1589b7 could not be found. May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-371dbaa4-d539-459f-ac81-55ab75c05463 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Request method failure captured: May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/926d9d50-78ee-40f2-9487-dc4a6a1589b7/os-instance-actions HTTP/1.1 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDcUA9TsayMWgdwT_WPmjhPPh1J1cDgQw5Hdeqf2xZTYdC7IkmwaeA_RCZsKpKdPKOmKin37HGUEc2nZIeh16wyPuDaU-OzlozXB2R2BQ071_xB4pUBzixc_LQlT_K29QFsQOHwpJPf8N1kNXoJrj6j1Wg1zU5m4UXX9SdHnBd4nKk May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0dbc9255a3f54f229f48535b7d4230d1 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0dbc9255a3f54f229f48535b7d4230d1 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsNegativeTestJSON-1493810982-project May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9f7a1c23746f4972a5e2cd7403e9f0cb May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1493810982-project May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 926d9d50-78ee-40f2-9487-dc4a6a1589b7 could not be found. May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '926d9d50-78ee-40f2-9487-dc4a6a1589b7'} May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 926d9d50-78ee-40f2-9487-dc4a6a1589b7 could not be found. May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:33:58.063212 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 926d9d50-78ee-40f2-9487-dc4a6a1589b7 could not be found. May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 926d9d50-78ee-40f2-9487-dc4a6a1589b7 could not be found. May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-371dbaa4-d539-459f-ac81-55ab75c05463 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Returning 404 to user: Instance 926d9d50-78ee-40f2-9487-dc4a6a1589b7 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-371dbaa4-d539-459f-ac81-55ab75c05463 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/926d9d50-78ee-40f2-9487-dc4a6a1589b7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.021727 May 19 08:33:58.068103 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2257/3582] 10.222.0.78 () {58 vars in 1295 bytes} [Thu May 19 08:33:58 2022] GET /compute/v2.1/servers/926d9d50-78ee-40f2-9487-dc4a6a1589b7/os-instance-actions => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:33:58.072011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:58.072636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:58.081374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:58.081833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:58.082630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:58.083076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:58.757426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:58.776017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:58.779695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:58.782832 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aef9be95-ad06-491b-8e4f-851328127811 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.715683 May 19 08:33:58.783931 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2258/3583] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:58 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:58.790324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:58.791849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:58.800713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:58.801624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:58.804205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:58.804906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:58.839977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:33:58.958501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0eb34035-ffba-4ac3-900b-780457118921 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 204 len: 0 microversion: 2.1 time: 0.172400 May 19 08:33:58.961745 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2259/3584] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:33:58 2022] DELETE /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:33:58.969669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:58.971591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:58.998086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:58.998763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:58.999972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.000653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.211772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.221657 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-292b675e-efcd-4d35-abfc-cc438b956949 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.257426 May 19 08:33:59.222684 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2260/3585] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:58 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:59.227729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:59.228491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:59.236456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.237046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.238544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.239191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.412782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.421865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.423327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.424437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8981e7ee-999e-45de-9de0-fff8c6ee7f5f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1405 microversion: 2.20 time: 0.200709 May 19 08:33:59.436650 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2261/3586] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:59 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:59.436650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:59.436650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:59.442230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.442805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.443447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.443890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.628174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.646435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e64b9242-8bb2-4420-a4ba-e247fed2391f tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1527 microversion: 2.1 time: 0.220347 May 19 08:33:59.647342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2262/3587] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:33:59 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1527 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:33:59.654424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:59.657408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:59.672175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.672509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.677114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.679843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.760114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.760798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.761562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lazy-loading 'fault' on Instance uuid 3d794fa0-f204-49b8-8935-14fb87794d90 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:33:59.829119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.843026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.844677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:33:59.846788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e30ef30-15b1-4c4b-a94b-6e9f8f0249b4 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 200 len: 1368 microversion: 2.47 time: 0.197607 May 19 08:33:59.846788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2263/3588] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:59 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:33:59.856667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:33:59.856667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:33:59.862306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.862755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.864023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:33:59.864023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:33:59.900388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:00.216394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:00.227165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:00.231302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:00.236299 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5cd632b7-4021-4d0d-9f03-f948b874abba tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.387338 May 19 08:34:00.247772 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2264/3589] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:33:59 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:00.254169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:00.254667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:00.264427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:00.265611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:00.270425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:00.271579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:00.671644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:00.692935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d36e86a6-d9c1-431a-a83e-9609f64458bd tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.442722 May 19 08:34:00.695598 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2265/3590] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:00 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:00.705844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:00.721647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:00.737183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:00.737752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:00.738596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:00.739173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:00.987335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:00.998086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:01.001619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:01.003385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ad8c4e2-1c86-43c4-a6c7-454bd3b640af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1405 microversion: 2.20 time: 0.306424 May 19 08:34:01.004594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2266/3591] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:00 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:01.012213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:01.013510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:01.021226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.021897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.022855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.023488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.144503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7a1c23746f4972a5e2cd7403e9f0cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dbc9255a3f54f229f48535b7d4230d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:01.162908 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90426ed8-fc98-4303-8ce8-e1287124fc8d tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 200 len: 1485 microversion: 2.1 time: 0.157039 May 19 08:34:01.163524 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2267/3592] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:01 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 1485 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:01.178397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:01.179275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 3d794fa0-f204-49b8-8935-14fb87794d90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:01.188044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.189014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.190059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.190667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.221783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] HTTP exception thrown: Instance 3d794fa0-f204-49b8-8935-14fb87794d90 could not be found. May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Request method failure captured: May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 HTTP/1.1 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDGiWx2easG5kAUsJ0nvD8NDane6D3Xr2ONsgwgzwaxcovC_q5sskSGccBkEnKYFZ0Fe3T6qTpv1LUtNecOAdzvCu1cXCf-m-F8XH5fGR0fnnDXVGL3EsewSdwyZuR7GumcMf2lmV1DjxARIpiJIP9qIToLqssRp1vflzml3rr936c May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.47 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8e60a6c58f514d8d88d1fcecd08a8621 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerShowV247Test-1211194510 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerShowV247Test-1211194510 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8e60a6c58f514d8d88d1fcecd08a8621 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerShowV247Test-1211194510 May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerShowV247Test-1211194510-project May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 66ecf6d3ad2747a0a399cdba5b61648e May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerShowV247Test-1211194510-project May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3d794fa0-f204-49b8-8935-14fb87794d90 could not be found. May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3d794fa0-f204-49b8-8935-14fb87794d90'} May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d794fa0-f204-49b8-8935-14fb87794d90 could not be found. May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d794fa0-f204-49b8-8935-14fb87794d90 could not be found. May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:01.223629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d794fa0-f204-49b8-8935-14fb87794d90 could not be found. May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Returning 404 to user: Instance 3d794fa0-f204-49b8-8935-14fb87794d90 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9326da8d-c3ec-49a7-8251-5d4917b3bfe6 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90" status: 404 len: 111 microversion: 2.47 time: 0.050534 May 19 08:34:01.232956 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2268/3593] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:01 2022] GET /compute/v2.1/servers/3d794fa0-f204-49b8-8935-14fb87794d90 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:34:01.244202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:01.244704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:01.262750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.263206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.264155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.264734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.306207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:34:01.406899 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77dae0b4-9c31-4959-b02f-439a64f63d76 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14" status: 204 len: 0 microversion: 2.47 time: 0.173654 May 19 08:34:01.409295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2269/3594] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:34:01 2022] DELETE /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:34:01.421089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:01.422041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:01.430786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.432782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:01.434613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:01.435140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.013455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.027584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.029083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.039012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be74e35c-0544-4e9a-8587-a0521d34d5e3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.627312 May 19 08:34:02.042202 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2270/3595] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:01 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:02.047180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-39683ee7-b1bd-44b3-b987-76c3fe02c71b req-1cc2a9cf-8543-4d43-883b-9906bc58d627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4478410b-c308-4c85-9ceb-2365869807e8", "name": "network-vif-deleted", "tag": "146fc502-5cb1-4da2-a977-f1be7bf34f0e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:02.064667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-39683ee7-b1bd-44b3-b987-76c3fe02c71b req-1cc2a9cf-8543-4d43-883b-9906bc58d627 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.070993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-39683ee7-b1bd-44b3-b987-76c3fe02c71b req-1cc2a9cf-8543-4d43-883b-9906bc58d627 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.087051 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-39683ee7-b1bd-44b3-b987-76c3fe02c71b req-1cc2a9cf-8543-4d43-883b-9906bc58d627 service nova] Creating event network-vif-deleted:146fc502-5cb1-4da2-a977-f1be7bf34f0e for instance 4478410b-c308-4c85-9ceb-2365869807e8 on chh1-842464-2 May 19 08:34:02.099828 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-39683ee7-b1bd-44b3-b987-76c3fe02c71b req-1cc2a9cf-8543-4d43-883b-9906bc58d627 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056097 May 19 08:34:02.102557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2271/3596] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:02.116124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:02.116925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:02.137979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.139726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.142491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.143839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.255604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.271158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.272754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.278820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0bade3b-c72c-41f6-a78d-a4776d0220c9 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14" status: 200 len: 1362 microversion: 2.47 time: 0.170228 May 19 08:34:02.279498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2272/3597] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:02 2022] GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:02.294446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:02.295162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:02.318166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.318817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.319664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.320102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.546821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.556659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03a5b3f3-3f64-4683-a2b2-6774e21480ed tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.267221 May 19 08:34:02.566830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2273/3598] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:02 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:02.566830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:02.566830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:02.574026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.574640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.575752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.576290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.878923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.889041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.892401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:02.893673 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d4a4825-6807-4b17-a69d-e09a9d792902 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1405 microversion: 2.20 time: 0.334530 May 19 08:34:02.894980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2274/3599] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:02 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:02.900920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a55035e7-49e6-49b6-9c49-498d730c2800 req-2d57780a-28f5-4d0a-9006-26f1bd1dec18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "name": "network-vif-plugged", "status": "completed", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:02.914752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a55035e7-49e6-49b6-9c49-498d730c2800 req-2d57780a-28f5-4d0a-9006-26f1bd1dec18 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.921880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a55035e7-49e6-49b6-9c49-498d730c2800 req-2d57780a-28f5-4d0a-9006-26f1bd1dec18 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.940961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a55035e7-49e6-49b6-9c49-498d730c2800 req-2d57780a-28f5-4d0a-9006-26f1bd1dec18 service nova] Creating event network-vif-plugged:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:34:02.947191 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a55035e7-49e6-49b6-9c49-498d730c2800 req-2d57780a-28f5-4d0a-9006-26f1bd1dec18 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050536 May 19 08:34:02.948781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2275/3600] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:02.955499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:02.956964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] [instance: 4478410b-c308-4c85-9ceb-2365869807e8] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:02.964022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.965185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.966225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:02.967281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:02.985036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] HTTP exception thrown: Instance 4478410b-c308-4c85-9ceb-2365869807e8 could not be found. May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Request method failure captured: May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 HTTP/1.1 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDcUA9TsayMWgdwT_WPmjhPPh1J1cDgQw5Hdeqf2xZTYdC7IkmwaeA_RCZsKpKdPKOmKin37HGUEc2nZIeh16wyPuDaU-OzlozXB2R2BQ071_xB4pUBzixc_LQlT_K29QFsQOHwpJPf8N1kNXoJrj6j1Wg1zU5m4UXX9SdHnBd4nKk May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0dbc9255a3f54f229f48535b7d4230d1 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dbc9255a3f54f229f48535b7d4230d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0dbc9255a3f54f229f48535b7d4230d1 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1493810982 May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsNegativeTestJSON-1493810982-project May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9f7a1c23746f4972a5e2cd7403e9f0cb May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1493810982-project May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4478410b-c308-4c85-9ceb-2365869807e8 could not be found. May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4478410b-c308-4c85-9ceb-2365869807e8'} May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4478410b-c308-4c85-9ceb-2365869807e8 could not be found. May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4478410b-c308-4c85-9ceb-2365869807e8 could not be found. May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:02.986970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4478410b-c308-4c85-9ceb-2365869807e8 could not be found. May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:02.992291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] Returning 404 to user: Instance 4478410b-c308-4c85-9ceb-2365869807e8 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:34:02.993191 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d53ddc37-cdf5-4817-97ac-82ff69f224a4 tempest-InstanceActionsNegativeTestJSON-1493810982 tempest-InstanceActionsNegativeTestJSON-1493810982-project] 10.222.0.78 "GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8" status: 404 len: 111 microversion: 2.1 time: 0.042268 May 19 08:34:03.006845 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2276/3601] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:02 2022] GET /compute/v2.1/servers/4478410b-c308-4c85-9ceb-2365869807e8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:34:03.061898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:03.062824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:03.081334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.082115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:03.083087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.083719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:03.562771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:03.573926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:03.582763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:03.584273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b8cabe7-af68-4733-93a0-2ae11fa754d7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.527906 May 19 08:34:03.586696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2277/3602] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:03 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:03.595691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:03.598540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:03.611176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.611899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:03.612890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.613544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:03.702477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.702939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:03.703414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lazy-loading 'fault' on Instance uuid 710c5789-71ba-46e3-8932-af08674f5b14 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:34:03.826109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:03.851297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:03.857053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '66ecf6d3ad2747a0a399cdba5b61648e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e60a6c58f514d8d88d1fcecd08a8621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:03.859032 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6f18c42-8030-4d33-ac3f-aaf62bf316bb tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14" status: 200 len: 1367 microversion: 2.47 time: 0.271090 May 19 08:34:03.861349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2278/3603] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:03 2022] GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:03.870165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:03.871933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:03.882793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.883565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:03.884709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:03.885380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:04.157719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:04.170239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a3c3d11-6c8a-4042-bbf6-844e181186cf tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.306375 May 19 08:34:04.171627 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2279/3604] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:03 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:04.187487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:04.194562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:04.213079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:04.213875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:04.215716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:04.218578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:04.619706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:04.632980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:04.634578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:04.635884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f62fc0eb-50b5-4152-98dc-64630e46da94 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1405 microversion: 2.20 time: 0.452266 May 19 08:34:04.636666 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2280/3605] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:04 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:04.676250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:04.680858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:04.708041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:04.708495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:04.709294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:04.710282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:05.201708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:05.204418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:05.226606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:05.229594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:05.232040 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25096ec6-6781-4451-b801-8e6e713f08cc tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.576453 May 19 08:34:05.232815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2281/3606] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:04 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:05.240015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:05.241103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] [instance: 710c5789-71ba-46e3-8932-af08674f5b14] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:05.254370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:05.256920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:05.257926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:05.258574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:05.286641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] HTTP exception thrown: Instance 710c5789-71ba-46e3-8932-af08674f5b14 could not be found. May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Request method failure captured: May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14 HTTP/1.1 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDGiWx2easG5kAUsJ0nvD8NDane6D3Xr2ONsgwgzwaxcovC_q5sskSGccBkEnKYFZ0Fe3T6qTpv1LUtNecOAdzvCu1cXCf-m-F8XH5fGR0fnnDXVGL3EsewSdwyZuR7GumcMf2lmV1DjxARIpiJIP9qIToLqssRp1vflzml3rr936c May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.47 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8e60a6c58f514d8d88d1fcecd08a8621 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerShowV247Test-1211194510 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e60a6c58f514d8d88d1fcecd08a8621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerShowV247Test-1211194510 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8e60a6c58f514d8d88d1fcecd08a8621 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerShowV247Test-1211194510 May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerShowV247Test-1211194510-project May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 66ecf6d3ad2747a0a399cdba5b61648e May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerShowV247Test-1211194510-project May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 710c5789-71ba-46e3-8932-af08674f5b14 could not be found. May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '710c5789-71ba-46e3-8932-af08674f5b14'} May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710c5789-71ba-46e3-8932-af08674f5b14 could not be found. May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710c5789-71ba-46e3-8932-af08674f5b14 could not be found. May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:05.288540 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710c5789-71ba-46e3-8932-af08674f5b14 could not be found. May 19 08:34:05.294050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:05.297868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] Returning 404 to user: Instance 710c5789-71ba-46e3-8932-af08674f5b14 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:34:05.299371 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f001499-13b3-4911-b61e-dd4296515ec1 tempest-ServerShowV247Test-1211194510 tempest-ServerShowV247Test-1211194510-project] 10.222.0.78 "GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14" status: 404 len: 111 microversion: 2.47 time: 0.063384 May 19 08:34:05.300518 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2282/3607] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:05 2022] GET /compute/v2.1/servers/710c5789-71ba-46e3-8932-af08674f5b14 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:34:05.308726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-15cf5a25-5b5a-460c-a722-13e8bc53730f req-04063aa2-e073-4ce9-885d-0ebe5546f47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2ed316-6918-400e-b4da-85b9f8a6c178", "name": "network-vif-plugged", "status": "completed", "tag": "73522996-f156-4095-ac64-27ececcd0247"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:05.322783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-15cf5a25-5b5a-460c-a722-13e8bc53730f req-04063aa2-e073-4ce9-885d-0ebe5546f47e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:05.323526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-15cf5a25-5b5a-460c-a722-13e8bc53730f req-04063aa2-e073-4ce9-885d-0ebe5546f47e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:05.344115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-15cf5a25-5b5a-460c-a722-13e8bc53730f req-04063aa2-e073-4ce9-885d-0ebe5546f47e service nova] Creating event network-vif-plugged:73522996-f156-4095-ac64-27ececcd0247 for instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 on chh2-842464-2 May 19 08:34:05.363373 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-15cf5a25-5b5a-460c-a722-13e8bc53730f req-04063aa2-e073-4ce9-885d-0ebe5546f47e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060901 May 19 08:34:05.364041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2283/3608] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:05.399558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:05.403863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:05.447643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:05.448164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:05.449649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:05.450238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:05.744211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:05.982631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:06.012480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.030705 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-583cc489-aef3-4106-a0b1-371d7d1267ef tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1316 microversion: 2.1 time: 0.653507 May 19 08:34:06.033681 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2284/3609] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:05 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:06.045627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:06.048557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:06.064988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:06.069946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:06.071291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:06.071931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:06.295074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.307306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.311341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.313074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3969190-50ff-4ebb-a097-024e91d541a9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1597 microversion: 2.20 time: 0.277352 May 19 08:34:06.314429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2285/3610] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:06 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1597 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:06.320892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:06.322091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:06.330766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:06.331624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:06.332623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:06.333136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:06.587119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.598614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.600459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:06.601925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2187d583-4b9d-44f4-a969-3f7117c22cff tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.286264 May 19 08:34:06.603036 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2286/3611] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:06 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:06.608447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:06.609255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:06.616734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:06.617614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:06.618724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:06.619409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:06.732011 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e15ee94e-d5e6-45c4-bbac-186211a54154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127331 May 19 08:34:06.734822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2287/3612] 10.222.0.78 () {60 vars in 1315 bytes} [Thu May 19 08:34:06 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:34:07.049030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:07.049717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:07.056276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.056726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.057535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.058287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.329369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:07.341424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d1688ce-b95a-4a87-806f-f88a4095a28e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1505 microversion: 2.1 time: 0.296191 May 19 08:34:07.346482 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2288/3613] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:07 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:07.362233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:07.362837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:07.371142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.372207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.373209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.373996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.412423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bd28976-2998-408b-b815-25d4e67174a9 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178/ips" status: 200 len: 109 microversion: 2.1 time: 0.056805 May 19 08:34:07.422736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2289/3614] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:34:07 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178/ips => generated 109 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:07.430956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:07.431668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:07.439772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.440248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.441084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.441559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.475288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50b53916-56e9-4f30-9b6a-f82179011a2e tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178/ips" status: 200 len: 109 microversion: 2.1 time: 0.050431 May 19 08:34:07.477339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2290/3615] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:34:07 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:07.488978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:07.489748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:07.499974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.500551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.501790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.502364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.532265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8e61084-35e8-4813-9581-5c4aea66e499 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178/ips/tempest-ServerAddressesTestJSON-795526785-network" status: 200 len: 94 microversion: 2.1 time: 0.048087 May 19 08:34:07.533238 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2291/3616] 10.222.0.78 () {58 vars in 1397 bytes} [Thu May 19 08:34:07 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178/ips/tempest-ServerAddressesTestJSON-795526785-network => generated 94 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 08:34:07.551353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:07.552495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:07.560465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:07.563406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.564086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.565536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.566213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.601541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:34:07.724343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1aa289b7-5b07-45e2-a90a-e9df547db216 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 204 len: 0 microversion: 2.1 time: 0.176586 May 19 08:34:07.728185 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2292/3617] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:34:07 2022] DELETE /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:34:07.735302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:07.736023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:07.743156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.743750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:07.744709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:07.745197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:08.006457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:08.016903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:08.018524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:08.020953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d75724f9-79bc-4536-9b0e-93184502a73b tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1886 microversion: 2.42 time: 0.291429 May 19 08:34:08.021992 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2293/3618] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:07 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1886 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:08.027921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:08.028502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:08.034994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:08.035448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:08.036222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:08.036659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:08.257392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:08.268004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd004c79-7d6f-4b2c-bde9-7e4a03c578d7 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1511 microversion: 2.1 time: 0.245186 May 19 08:34:08.268860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2294/3619] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:08 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:09.043112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:09.043982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:09.067242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:09.069386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:09.070436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:09.070867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:09.746115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:09.768537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:09.771183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:09.772397 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d6ee970-1d86-4b6b-b014-240311cc99db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.736074 May 19 08:34:09.779698 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2295/3620] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:09 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:09.785833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:09.794251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:09.806874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:09.810247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:09.813045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:09.813727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:10.092244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bf53c64d32e4c03a9a5edebf23b30d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83fe2059a8894fb6ae93e3688e0445d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:10.101569 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93bafa99-bcbf-4d93-bca7-17c2f3978bd1 tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 200 len: 1511 microversion: 2.1 time: 0.320060 May 19 08:34:10.114076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2296/3621] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:09 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:10.460976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1536047079", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "302299e6-c209-490d-a401-78afbdeb8727"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:10.579845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] validate_networks() for [('302299e6-c209-490d-a401-78afbdeb8727', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:34:12.358239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:34:12.358941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:34:12.359120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:34:12.359535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:34:12.359942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:34:12.375146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:12.381001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:12.386578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:12.387469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:12.441772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Getting quotas for project 36560e910bfe4df291ec1c6533ddecc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:12.461859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Getting quotas for user 0a4cf9029e4242b794a6b3eaef958dc5 and project 36560e910bfe4df291ec1c6533ddecc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:12.494958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:34:12.498969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:34:12.615406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b80966f-a785-47a1-8b22-41388e1b7b4e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.499962 May 19 08:34:12.616072 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2297/3622] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:34:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:34:12.641354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-befaa05f-e157-4664-8bf6-035f11c3254d req-e1f9fc09-0123-474e-a012-8b0437a8e9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:12.671915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-befaa05f-e157-4664-8bf6-035f11c3254d req-e1f9fc09-0123-474e-a012-8b0437a8e9d7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:12.672906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-befaa05f-e157-4664-8bf6-035f11c3254d req-e1f9fc09-0123-474e-a012-8b0437a8e9d7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:12.686910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-befaa05f-e157-4664-8bf6-035f11c3254d req-e1f9fc09-0123-474e-a012-8b0437a8e9d7 service nova] Creating event network-changed:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:34:12.693805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-befaa05f-e157-4664-8bf6-035f11c3254d req-e1f9fc09-0123-474e-a012-8b0437a8e9d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063560 May 19 08:34:12.695650 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2298/3623] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:12.702362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:12.703524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:12.715787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:12.720464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:12.726707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:12.727622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:13.537800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:13.572836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:13.577904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:13.605479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66fb797c-0789-4410-8c67-3b7d7f4fb271 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.881467 May 19 08:34:13.606190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2299/3624] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:12 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:13.628194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:13.628850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] [instance: 0b2ed316-6918-400e-b4da-85b9f8a6c178] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:13.672069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:13.672565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:13.673478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:13.673931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:13.734155 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] HTTP exception thrown: Instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 could not be found. May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Request method failure captured: May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 HTTP/1.1 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDnaJoZzhPAhL4OLIqlF2-kpQ9UfT8qk6kWTPrCBR397Rc1Rj8UDLb27lbkXIbrVjW_TTralepAk7ckMgFDIzmGRpCqeOJ3ZozbCHeE0OImjD6SoNKVq6ILu5N_Ea59VTtvp1blRTW5MNesOSc-S2A_Bqy22tDIl7oYvhAcIeXaRIg May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 83fe2059a8894fb6ae93e3688e0445d9 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerAddressesTestJSON-1419939133 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/83fe2059a8894fb6ae93e3688e0445d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83fe2059a8894fb6ae93e3688e0445d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_83fe2059a8894fb6ae93e3688e0445d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/83fe2059a8894fb6ae93e3688e0445d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerAddressesTestJSON-1419939133 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 83fe2059a8894fb6ae93e3688e0445d9 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1419939133 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerAddressesTestJSON-1419939133-project May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2bf53c64d32e4c03a9a5edebf23b30d2 May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerAddressesTestJSON-1419939133-project May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 could not be found. May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0b2ed316-6918-400e-b4da-85b9f8a6c178'} May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 could not be found. May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 could not be found. May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:13.736426 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 could not be found. May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] Returning 404 to user: Instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3da3160e-016d-47e6-b594-265f534eb42b tempest-ServerAddressesTestJSON-1419939133 tempest-ServerAddressesTestJSON-1419939133-project] 10.222.0.78 "GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178" status: 404 len: 111 microversion: 2.1 time: 0.130759 May 19 08:34:13.745671 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2300/3625] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:13 2022] GET /compute/v2.1/servers/0b2ed316-6918-400e-b4da-85b9f8a6c178 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:34:13.831265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-318447905", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:13.938713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] validate_networks() for [('d7981aac-fa9b-4c71-bcbe-06980e089b70', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:34:15.089125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:34:15.090837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:34:15.091735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:34:15.092253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:34:15.092772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:34:15.117921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:15.118984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:15.122536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:15.124574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:15.192280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Getting quotas for project 144d9ead33364453bd7e349add7a8284. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:15.212768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Getting quotas for user 5cedbe79cf76418d815e2608f5f480ed and project 144d9ead33364453bd7e349add7a8284. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:15.237393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:34:15.239929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:34:15.382055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3492fe88-b15e-4951-bd1f-cd613226f29c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.636228 May 19 08:34:15.385587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2301/3626] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:34:15.407376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1226964102", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "302299e6-c209-490d-a401-78afbdeb8727"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:15.553421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] validate_networks() for [('302299e6-c209-490d-a401-78afbdeb8727', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:34:16.334293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:34:16.334834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:34:16.335810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:34:16.336294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:34:16.336787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:34:16.355300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:16.357336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:16.358748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:16.359427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:16.368801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:16.384166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Getting quotas for project 36560e910bfe4df291ec1c6533ddecc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:16.391784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Getting quotas for user 0a4cf9029e4242b794a6b3eaef958dc5 and project 36560e910bfe4df291ec1c6533ddecc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:16.419806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:34:16.422974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:34:16.511999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33535769-575f-4aa6-a9a5-1c01dfd06267 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118295 May 19 08:34:16.511999 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2302/3627] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:34:16.520907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:16.521577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:16.544469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:16.545417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:16.565607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:16.565726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:17.101673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:17.115809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:17.118042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:17.128858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c1a1007e-202c-4be7-8aeb-07f2b8a5079a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.616388 May 19 08:34:17.131400 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2303/3628] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:16 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:17.140205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-60ff2e62-b305-4501-ad2a-f4f5ec15c4fa req-0bd8b046-9629-49a7-9676-0e9e107d53c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2ed316-6918-400e-b4da-85b9f8a6c178", "name": "network-vif-deleted", "tag": "73522996-f156-4095-ac64-27ececcd0247"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:17.179721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-60ff2e62-b305-4501-ad2a-f4f5ec15c4fa req-0bd8b046-9629-49a7-9676-0e9e107d53c6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:17.181802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-60ff2e62-b305-4501-ad2a-f4f5ec15c4fa req-0bd8b046-9629-49a7-9676-0e9e107d53c6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:17.226115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-60ff2e62-b305-4501-ad2a-f4f5ec15c4fa req-0bd8b046-9629-49a7-9676-0e9e107d53c6 service nova] Creating event network-vif-deleted:73522996-f156-4095-ac64-27ececcd0247 for instance 0b2ed316-6918-400e-b4da-85b9f8a6c178 on chh2-842464-2 May 19 08:34:17.243591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-60ff2e62-b305-4501-ad2a-f4f5ec15c4fa req-0bd8b046-9629-49a7-9676-0e9e107d53c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108299 May 19 08:34:17.244620 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2304/3629] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:17.254767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:17.255953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:17.276106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:17.277560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:17.278826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:17.280587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:17.481187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:17.488944 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-42755e22-f31b-4670-ac6f-31fb6e5df6d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1286 microversion: 2.1 time: 0.242059 May 19 08:34:17.489560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2305/3630] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:17 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1286 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:17.504185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2068301653", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "451", "networks": [{"uuid": "302299e6-c209-490d-a401-78afbdeb8727"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:17.604125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] validate_networks() for [('302299e6-c209-490d-a401-78afbdeb8727', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:34:20.577915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:34:20.578660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:34:20.578786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:34:20.579437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:34:20.580183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:34:20.599244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:20.599972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:20.605533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:20.606538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:20.688389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Getting quotas for project 36560e910bfe4df291ec1c6533ddecc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:20.740474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Getting quotas for user 0a4cf9029e4242b794a6b3eaef958dc5 and project 36560e910bfe4df291ec1c6533ddecc7. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:20.810666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:34:20.832529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:34:20.954466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e55a4c8-0a5c-44e2-a4f6-e9af9c842ba4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.454181 May 19 08:34:20.955356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2306/3631] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:34:20.970859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:20.971489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:20.995140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:20.995767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:20.996598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:20.997044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:21.454911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:21.466596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:21.486519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:21.488247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f08e0d56-53d5-4454-873b-98b3a984349a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.531938 May 19 08:34:21.489456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2307/3632] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:20 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:21.509274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:21.512431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:21.527875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:21.528782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:21.530044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:21.532431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:22.299069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:22.316028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7215559d-4bbb-482d-bf63-74e1c2baba7c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.825081 May 19 08:34:22.316961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2308/3633] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:21 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:22.321591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f9e2861d-2dbb-43af-bc03-b88b111d8285 req-441f8f6e-2b3b-4d08-9658-30c8656ab966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8102b0fc-8627-4b8f-8d40-a07ec797ea8a", "tag": "b3e36e73-ab8a-424c-9428-5965d12b709d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:22.356570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f9e2861d-2dbb-43af-bc03-b88b111d8285 req-441f8f6e-2b3b-4d08-9658-30c8656ab966 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:22.360180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f9e2861d-2dbb-43af-bc03-b88b111d8285 req-441f8f6e-2b3b-4d08-9658-30c8656ab966 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:22.388163 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f9e2861d-2dbb-43af-bc03-b88b111d8285 req-441f8f6e-2b3b-4d08-9658-30c8656ab966 service nova] Creating event network-changed:b3e36e73-ab8a-424c-9428-5965d12b709d for instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a on chh2-842464-2 May 19 08:34:22.407086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f9e2861d-2dbb-43af-bc03-b88b111d8285 req-441f8f6e-2b3b-4d08-9658-30c8656ab966 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088655 May 19 08:34:22.407913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2309/3634] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:22.751784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39981285-4e8f-4c41-9fcb-75c410c20d87 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Action: 'create', calling method: .version_select at 0x7f3210e1f310>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:22.773278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:22.795626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-39981285-4e8f-4c41-9fcb-75c410c20d87 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Getting quotas for project 4254032cd7824814be688b9e85cb0088. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:22.804419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-39981285-4e8f-4c41-9fcb-75c410c20d87 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Getting quotas for user b11f135f449f44658617863b2558ded0 and project 4254032cd7824814be688b9e85cb0088. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:22.907357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-39981285-4e8f-4c41-9fcb-75c410c20d87 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Getting quotas for project 4254032cd7824814be688b9e85cb0088. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:22.938625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-39981285-4e8f-4c41-9fcb-75c410c20d87 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Getting quotas for user b11f135f449f44658617863b2558ded0 and project 4254032cd7824814be688b9e85cb0088. Resources: {'server_groups'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:22.977490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39981285-4e8f-4c41-9fcb-75c410c20d87 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.567823 May 19 08:34:22.979056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2310/3635] 10.222.0.78 () {62 vars in 1213 bytes} [Thu May 19 08:34:22 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:34:22.985104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:23.006520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:23.029482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:23.030524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:23.031604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:23.032273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:23.439576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:23.452457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f601157-3585-492d-bcd8-c7fe03276b92 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1281 microversion: 2.1 time: 0.471448 May 19 08:34:23.453064 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2311/3636] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:22 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:23.457970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:23.458916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:23.465467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:23.466165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:23.467092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:23.467682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:23.533811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7e8cc55-d4a4-484c-8c06-651a1c51584a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076090 May 19 08:34:23.538151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2312/3637] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:34:23 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:23.548410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:23.549026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:23.574471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:23.578269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:23.583866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:23.584778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:24.258063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:24.268780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:24.271111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:24.272805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74abfd31-0776-4b2a-95a4-ef1fb1999d1f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.733326 May 19 08:34:24.285336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2313/3638] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:23 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:24.290051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52ec0f1d-be4d-4ef2-8634-9f6702b41e40 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:24.302358 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52ec0f1d-be4d-4ef2-8634-9f6702b41e40 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.015854 May 19 08:34:24.302948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2314/3639] 10.222.0.78 () {60 vars in 1192 bytes} [Thu May 19 08:34:24 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:34:24.310312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:24.311008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:24.318187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:24.318647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:24.319700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:24.320161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:24.937768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:24.947383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1085d766-514f-42a2-8a3a-d6bc33b5a63a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.643122 May 19 08:34:24.950802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2315/3640] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:24 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:24.959134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:24.963313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:24.976189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:24.987067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:24.988305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:24.988859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:25.703030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lazy-loading 'services' on Instance uuid 64a56363-0605-49d5-8019-3537b2318fda {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:34:25.854046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea304273-1292-4daf-a734-794e91778778 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments/cdac424f-0b5f-463c-a8c3-38520a22c190" status: 202 len: 0 microversion: 2.1 time: 0.898881 May 19 08:34:25.855618 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2316/3641] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:34:24 2022] DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments/cdac424f-0b5f-463c-a8c3-38520a22c190 => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:34:25.888626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8616a53b-6599-48a9-a6fa-40573e0e9d44 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:25.955868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8616a53b-6599-48a9-a6fa-40573e0e9d44 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb" status: 200 len: 235 microversion: 2.64 time: 0.092894 May 19 08:34:25.965664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2317/3642] 10.222.0.78 () {60 vars in 1303 bytes} [Thu May 19 08:34:25 2022] GET /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb => generated 235 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:34:25.984536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:25.984536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:26.028947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:26.034398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:26.035372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:26.035844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:27.257123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:27.266813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2b9b440-d46b-42af-bafa-931cfc22faa0 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 1.298923 May 19 08:34:27.278353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2318/3643] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:25 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:27.284882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:27.285961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:27.294543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:27.295373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:27.296492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:27.297256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:27.926334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:27.955433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:27.957122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:27.958413 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1be56930-9985-4c01-b3d7-368e2993bc35 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.678580 May 19 08:34:27.958992 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2319/3644] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:27 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:27.975784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-58dea47d-c180-4e5a-a371-c3c2c4d10f02 req-9de274dd-604a-4b8a-8dde-127a09e0ee2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c62db77-f940-41b1-bf60-d5a9a4d00162", "tag": "5a66e7db-ad93-447b-bb87-de432e7ed34d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:28.014150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-58dea47d-c180-4e5a-a371-c3c2c4d10f02 req-9de274dd-604a-4b8a-8dde-127a09e0ee2e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.018416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-58dea47d-c180-4e5a-a371-c3c2c4d10f02 req-9de274dd-604a-4b8a-8dde-127a09e0ee2e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.060414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-58dea47d-c180-4e5a-a371-c3c2c4d10f02 req-9de274dd-604a-4b8a-8dde-127a09e0ee2e service nova] Creating event network-changed:5a66e7db-ad93-447b-bb87-de432e7ed34d for instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 on chh1-842464-2 May 19 08:34:28.083706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-58dea47d-c180-4e5a-a371-c3c2c4d10f02 req-9de274dd-604a-4b8a-8dde-127a09e0ee2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111703 May 19 08:34:28.084329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2320/3645] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:28.101167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:28.101936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:28.113143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.114290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.115722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.117000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.353725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:28.366658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1441eacf-5c58-4c58-b46b-7b216d5dea50 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.281018 May 19 08:34:28.367848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2321/3646] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:28 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:28.374548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-57fa138e-6b5f-4d56-9b87-395f428fdd23 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:28.422914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-57fa138e-6b5f-4d56-9b87-395f428fdd23 tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb" status: 204 len: 0 microversion: 2.64 time: 0.053090 May 19 08:34:28.424300 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2322/3647] 10.222.0.78 () {60 vars in 1306 bytes} [Thu May 19 08:34:28 2022] DELETE /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:34:28.431884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9c9b5daa-e23b-40ce-b5be-a032c8b7c511 req-9bbd3655-18a9-404d-9124-d46a2b69816d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "573df54d-b347-40b7-90ca-62d58676ce17", "tag": "66a1b5ac-fcaa-49de-9075-dacde1035a57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:28.446631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9c9b5daa-e23b-40ce-b5be-a032c8b7c511 req-9bbd3655-18a9-404d-9124-d46a2b69816d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.447335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9c9b5daa-e23b-40ce-b5be-a032c8b7c511 req-9bbd3655-18a9-404d-9124-d46a2b69816d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.461416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9c9b5daa-e23b-40ce-b5be-a032c8b7c511 req-9bbd3655-18a9-404d-9124-d46a2b69816d service nova] Creating event network-changed:66a1b5ac-fcaa-49de-9075-dacde1035a57 for instance 573df54d-b347-40b7-90ca-62d58676ce17 on chh2-842464-2 May 19 08:34:28.479128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9c9b5daa-e23b-40ce-b5be-a032c8b7c511 req-9bbd3655-18a9-404d-9124-d46a2b69816d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053581 May 19 08:34:28.481042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2323/3648] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:28.488631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8c8b00ab-4ca7-4639-98de-f83384b946e7 req-244532aa-a166-44b6-b487-5bfff42fce86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8102b0fc-8627-4b8f-8d40-a07ec797ea8a", "name": "network-vif-plugged", "status": "completed", "tag": "b3e36e73-ab8a-424c-9428-5965d12b709d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:28.500419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8c8b00ab-4ca7-4639-98de-f83384b946e7 req-244532aa-a166-44b6-b487-5bfff42fce86 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.501161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8c8b00ab-4ca7-4639-98de-f83384b946e7 req-244532aa-a166-44b6-b487-5bfff42fce86 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.517093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8c8b00ab-4ca7-4639-98de-f83384b946e7 req-244532aa-a166-44b6-b487-5bfff42fce86 service nova] Creating event network-vif-plugged:b3e36e73-ab8a-424c-9428-5965d12b709d for instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a on chh2-842464-2 May 19 08:34:28.522422 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8c8b00ab-4ca7-4639-98de-f83384b946e7 req-244532aa-a166-44b6-b487-5bfff42fce86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039706 May 19 08:34:28.523257 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2324/3649] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:28.530146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:28.540153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:28.549206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.550127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.551131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:28.551791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:28.862850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:28.892250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe7f9db1-7179-4634-ab84-997c0e5afa13 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.363677 May 19 08:34:28.893467 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2325/3650] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:28 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:28.915787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9b25b3e-5189-403f-9c83-ddc7549b294a tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:28.936564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a9b25b3e-5189-403f-9c83-ddc7549b294a tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] HTTP exception thrown: Instance group 29830764-fcde-48d7-9820-365c937bb1bb could not be found. May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9b25b3e-5189-403f-9c83-ddc7549b294a tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Request method failure captured: May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb HTTP/1.1 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEM_aEByixFixhrd38JaT-cb8MqWHrAmq7TzoveRDIuti1KbsQzkRdJS46AXnC4mozqaSw2spbeXk7AysqhfvT0QYZUjUTnoP-4keXn-O5n62pEKb4a5gvdeuAO70503wtn3azdnLMA56ydL_bckZKfR8nuaPpsqksFY0FkJvvuvc4 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.64 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 4254032cd7824814be688b9e85cb0088 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerGroup264TestJSON-398255570 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4254032cd7824814be688b9e85cb0088"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4254032cd7824814be688b9e85cb0088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4254032cd7824814be688b9e85cb0088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4254032cd7824814be688b9e85cb0088"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerGroup264TestJSON-398255570 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 4254032cd7824814be688b9e85cb0088 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerGroup264TestJSON-398255570 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerGroup264TestJSON-398255570-project May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b11f135f449f44658617863b2558ded0 May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerGroup264TestJSON-398255570-project May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance group 29830764-fcde-48d7-9820-365c937bb1bb could not be found. May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '29830764-fcde-48d7-9820-365c937bb1bb'} May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29830764-fcde-48d7-9820-365c937bb1bb could not be found. May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29830764-fcde-48d7-9820-365c937bb1bb could not be found. May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:28.949539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29830764-fcde-48d7-9820-365c937bb1bb could not be found. May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9b25b3e-5189-403f-9c83-ddc7549b294a tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] Returning 404 to user: Instance group 29830764-fcde-48d7-9820-365c937bb1bb could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9b25b3e-5189-403f-9c83-ddc7549b294a tempest-ServerGroup264TestJSON-398255570 tempest-ServerGroup264TestJSON-398255570-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb" status: 404 len: 117 microversion: 2.64 time: 0.066018 May 19 08:34:28.967072 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2326/3651] 10.222.0.78 () {60 vars in 1306 bytes} [Thu May 19 08:34:28 2022] DELETE /compute/v2.1/os-server-groups/29830764-fcde-48d7-9820-365c937bb1bb => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:34:29.013957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:29.019848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:29.094707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:29.096036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:29.098697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:29.099858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:29.822172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:29.825830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:29.839663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:29.844894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:29.850083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15f98a2f-3b39-4711-b2fe-3f766c745c39 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.859917 May 19 08:34:29.863441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2327/3652] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:28 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:29.868563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:29.869476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:29.884813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:29.885808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:29.886856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:29.887531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:30.272677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:30.282303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5777f7b5-d3e8-4165-a565-54289f212c38 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.417382 May 19 08:34:30.287764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2328/3653] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:29 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:30.295589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:30.299220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:30.314756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:30.326830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:30.326830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:30.326830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:30.650422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:30.772729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:30.789510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5eb6676f-22fb-4b79-8281-d3cc4d606a25 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.499901 May 19 08:34:30.813372 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2329/3654] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:30 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:30.819645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b7a11ff5-38e6-46ff-9c52-d1541e312854 req-4101393b-bab2-4550-9566-0b44f743e66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:30.847749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b7a11ff5-38e6-46ff-9c52-d1541e312854 req-4101393b-bab2-4550-9566-0b44f743e66d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:30.848606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b7a11ff5-38e6-46ff-9c52-d1541e312854 req-4101393b-bab2-4550-9566-0b44f743e66d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:30.915611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b7a11ff5-38e6-46ff-9c52-d1541e312854 req-4101393b-bab2-4550-9566-0b44f743e66d service nova] Creating event network-changed:dd872ee5-3152-4351-a644-7f3684672d4b for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d on chh2-842464-2 May 19 08:34:30.929485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b7a11ff5-38e6-46ff-9c52-d1541e312854 req-4101393b-bab2-4550-9566-0b44f743e66d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121850 May 19 08:34:30.930507 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2330/3655] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:30.943315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:30.944003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:30.966374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:30.973681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:30.975869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:30.976453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:31.487439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:31.506497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:31.507982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:31.509210 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6c91c51-4500-42ab-95ff-1707fb1d6d1c tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.577525 May 19 08:34:31.513819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2331/3656] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:30 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:31.534559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:31.536077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:31.544994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:31.556654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:31.558575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:31.559262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:32.076367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:32.098047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f569e037-1e78-48bb-8fa2-b423ccb58d99 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.577424 May 19 08:34:32.099214 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2332/3657] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:31 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:32.114578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:32.122712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:32.135149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:32.137133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:32.137133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:32.137610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:32.954292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=32 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:33.024863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:33.044683 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-948eca1a-4982-4504-915f-a36c60c49562 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.943516 May 19 08:34:33.045640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2333/3658] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:32 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:33.090172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:33.091801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:33.116597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:33.117066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:33.117922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:33.126854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:33.754422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:33.792989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:33.799066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:33.800224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11d0196f-3cd0-44f5-b6e4-0dc37b09add2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.743160 May 19 08:34:33.818405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2334/3659] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:33 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:33.828678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:33.832388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:33.844278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:33.847390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:33.850294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:33.850941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:34.239272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:34.248620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99eb1724-5e02-4c8a-9254-c742c44a0b2a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.434884 May 19 08:34:34.252817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2335/3660] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:33 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:34.269572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:34.274278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:34.304211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:34.307106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:34.310785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:34.313037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:34.680897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:34.701642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9bff0a1-728e-4d00-a414-d47e64d0ea70 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.446344 May 19 08:34:34.702863 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2336/3661] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:34 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:34.832037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:34.832664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:34.855472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:34.856826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:34.857872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:34.859421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:35.490076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:35.504992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:35.506567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:35.507826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e109ff62-19e7-4c8d-8116-8423e52bf521 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.682319 May 19 08:34:35.508406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2337/3662] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:34 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:35.529561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:35.532520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:35.549194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:35.552011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:35.553179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:35.555708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:36.067725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:36.080471 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2aa47906-39fd-4110-b070-45d9a472accb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.570938 May 19 08:34:36.092725 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2338/3663] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:35 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:36.103719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:36.106339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:36.122410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:36.126329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:36.127451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:36.128108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:36.958070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:36.977717 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff178042-02b0-4072-8f8e-d6849571f79e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.883287 May 19 08:34:36.991441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2339/3664] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:36 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:37.003013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:37.004291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:37.029404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:37.035472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:37.038930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:37.042319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:37.706249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:37.716884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:37.723575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:37.726372 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6dd3c994-2d93-4807-a93b-7bace8e33b56 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.735729 May 19 08:34:37.731018 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2340/3665] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:36 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:37.743818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:37.754237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:37.783347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:37.784576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:37.790967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:37.793969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:38.296536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:38.305693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55ef1d47-8de4-4cb3-8e27-2c2ba77bf3de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.573158 May 19 08:34:38.310244 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2341/3666] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:37 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:38.583085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1282999333", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:38.691786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:34:40.780670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:34:40.782042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:34:40.782759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:34:40.783540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:34:40.784263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:34:40.806339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:40.813242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:40.814500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:40.815120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:40.855320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:34:40.869410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:34:40.882207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:40.914610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:34:40.917739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:34:41.031964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6de102e9-94c4-4386-88ea-65707bf3ef82 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.713653 May 19 08:34:41.042791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2342/3667] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:34:41.048644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:41.054326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:41.068013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:41.071177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:41.072531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:41.073744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:41.663879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:41.672985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e065651d-037c-40da-9546-240bb8c8955d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.628579 May 19 08:34:41.679249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2343/3668] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:41 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:41.693685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:41.696053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:41.712827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:41.714116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:41.720578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:41.721531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:42.482314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:42.498411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:42.509125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:42.521606 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-daba8397-f1ef-41b0-ad77-69e4fca55668 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.841120 May 19 08:34:42.524144 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2344/3669] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:41 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:42.538524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:42.546428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:42.561698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:42.578391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:42.580215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:42.581847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.128346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:43.136513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:43.150616 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab1a7d61-e935-46ca-904c-b359323e9f7e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.624418 May 19 08:34:43.152752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2345/3670] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:42 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:43.158516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:43.160776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:43.173814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.174592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.177246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.178008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.372334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:43.385158 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b550482-b4ed-464c-a6f6-9fd77d17214c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1251 microversion: 2.1 time: 0.230992 May 19 08:34:43.403565 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2346/3671] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:43 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1251 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:43.412437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-deb0fbcd-8676-4bc8-84c5-8d590a30c2f2 req-1717d04b-6bac-4682-a9da-d976731dd896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "54802d14-fe37-40ec-9d4e-45c5506a6a30"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:43.431949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-deb0fbcd-8676-4bc8-84c5-8d590a30c2f2 req-1717d04b-6bac-4682-a9da-d976731dd896 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.441987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-deb0fbcd-8676-4bc8-84c5-8d590a30c2f2 req-1717d04b-6bac-4682-a9da-d976731dd896 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.484614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-deb0fbcd-8676-4bc8-84c5-8d590a30c2f2 req-1717d04b-6bac-4682-a9da-d976731dd896 service nova] Creating event network-vif-plugged:54802d14-fe37-40ec-9d4e-45c5506a6a30 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:43.504311 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-deb0fbcd-8676-4bc8-84c5-8d590a30c2f2 req-1717d04b-6bac-4682-a9da-d976731dd896 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097860 May 19 08:34:43.507951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2347/3672] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:43.542977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:43.546196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:43.573612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.574448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.575311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.575759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.648200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1bb13b4e-1e1d-4fb0-8ec9-142fdfe926c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/ips" status: 200 len: 152 microversion: 2.20 time: 0.138477 May 19 08:34:43.649195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2348/3673] 10.222.0.78 () {60 vars in 1288 bytes} [Thu May 19 08:34:43 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/ips => generated 152 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:34:43.664665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:43.665335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:43.696687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.697363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:43.705193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:43.705734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:44.326472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:44.347420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-97721475-49bc-4508-88a7-f6dcf9bda789 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 0.696913 May 19 08:34:44.362008 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2349/3674] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:43 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:44.369199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:44.371939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:44.387888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:44.389721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:44.395812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:44.398120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:45.306356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:45.331067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:45.343033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:45.350805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed2368ac-61f4-419f-ba96-3bd8987257cb tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.986885 May 19 08:34:45.362248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2350/3675] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:44 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:45.369647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:45.374222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:45.397201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:45.401110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:45.404387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:45.405773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:46.128142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:46.143396 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cafd9bb-b5f6-4473-b434-52a860f22c9c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.790322 May 19 08:34:46.148366 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2351/3676] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:45 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:46.169686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:46.170633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:46.193898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:46.210938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:46.212667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:46.216594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:46.722930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:46.753766 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ed6e83d-aa19-4729-aa8b-84aa1aa0d2df tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.597729 May 19 08:34:46.754760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2352/3677] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:46 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:46.766789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:46.782934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:46.799165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:46.801088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:46.801088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:46.801088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:47.843205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:47.853245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8658cdb4-4d2d-4f97-ae93-42bfed08d474 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1321 microversion: 2.1 time: 1.096994 May 19 08:34:47.863696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2353/3678] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:46 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1321 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:47.869104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-00b5a494-ef4f-4092-95de-e80bb703dd4e req-ea68fdcf-b0cf-4dd8-b9ae-438a342dd4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "b0bc770d-5102-4981-80bd-f484c3748df7"}, {"server_uuid": "573df54d-b347-40b7-90ca-62d58676ce17", "name": "network-vif-plugged", "status": "completed", "tag": "66a1b5ac-fcaa-49de-9075-dacde1035a57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:47.880944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00b5a494-ef4f-4092-95de-e80bb703dd4e req-ea68fdcf-b0cf-4dd8-b9ae-438a342dd4e9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:47.881730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00b5a494-ef4f-4092-95de-e80bb703dd4e req-ea68fdcf-b0cf-4dd8-b9ae-438a342dd4e9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:47.898414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-00b5a494-ef4f-4092-95de-e80bb703dd4e req-ea68fdcf-b0cf-4dd8-b9ae-438a342dd4e9 service nova] Creating event network-vif-plugged:b0bc770d-5102-4981-80bd-f484c3748df7 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:47.899208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-00b5a494-ef4f-4092-95de-e80bb703dd4e req-ea68fdcf-b0cf-4dd8-b9ae-438a342dd4e9 service nova] Creating event network-vif-plugged:66a1b5ac-fcaa-49de-9075-dacde1035a57 for instance 573df54d-b347-40b7-90ca-62d58676ce17 on chh2-842464-2 May 19 08:34:47.911114 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-00b5a494-ef4f-4092-95de-e80bb703dd4e req-ea68fdcf-b0cf-4dd8-b9ae-438a342dd4e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045809 May 19 08:34:47.912560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2354/3679] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:47.920170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:47.921759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:47.931503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:47.933100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:47.934588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:47.935562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:48.344620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:48.355783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:48.357763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:48.360538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31ef862d-e685-43f2-b910-57369d67382a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.445333 May 19 08:34:48.375597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2355/3680] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:47 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:48.381106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:48.382076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:48.392396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:48.393833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:48.395543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:48.396976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:48.792628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:48.806093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d749d8b-759b-4dd4-9c2c-069b3b794559 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.428901 May 19 08:34:48.819006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2356/3681] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:48 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:48.824731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:48.825472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:48.834251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:48.834776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:48.835635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:48.838857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.255732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:49.264826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c64ebe1-4111-4456-9691-bb54e8cb3d32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.444412 May 19 08:34:49.272820 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2357/3682] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:48 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:49.283561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:49.284693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:49.304869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.308792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.309982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.312500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.387798 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-824db16a-d2e5-4369-a1a7-23284b16c2c1 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113527 May 19 08:34:49.414865 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2358/3683] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:34:49 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:34:49.431211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6eafff4b-be2b-4b17-b29d-8607e1302060 req-b574d19e-d31a-44fa-aa64-9da9aed28dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae64075-10a6-4385-a09b-f3d64eb71c45", "tag": "edeb457c-a4b7-4082-8653-451d613bc77e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:49.451332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6eafff4b-be2b-4b17-b29d-8607e1302060 req-b574d19e-d31a-44fa-aa64-9da9aed28dd1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.458033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6eafff4b-be2b-4b17-b29d-8607e1302060 req-b574d19e-d31a-44fa-aa64-9da9aed28dd1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.494018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6eafff4b-be2b-4b17-b29d-8607e1302060 req-b574d19e-d31a-44fa-aa64-9da9aed28dd1 service nova] Creating event network-changed:edeb457c-a4b7-4082-8653-451d613bc77e for instance aae64075-10a6-4385-a09b-f3d64eb71c45 on chh1-842464-2 May 19 08:34:49.518950 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6eafff4b-be2b-4b17-b29d-8607e1302060 req-b574d19e-d31a-44fa-aa64-9da9aed28dd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099492 May 19 08:34:49.521353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2359/3684] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:49.536719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:49.537597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:49.554228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.554679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.555465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.555905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.868480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:49.883095 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67d4cd81-90b4-4ae8-b5f9-04f140911684 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1511 microversion: 2.1 time: 0.356898 May 19 08:34:49.886872 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2360/3685] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:49 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:49.898757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:49.899445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:49.912270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.912893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.913839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:49.914393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:49.946915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lazy-loading 'flavor' on Instance uuid 64fedff0-296a-4a9a-9743-30c679548b9b {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:34:50.476931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aed3103f-d806-4166-aede-481b0f366bdb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/action" status: 202 len: 0 microversion: 2.20 time: 0.588691 May 19 08:34:50.481796 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2361/3686] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:34:49 2022] POST /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:34:50.487773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:50.493422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:50.503091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:50.517159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:50.525393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:50.529477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:50.837392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:50.896465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:51.208560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:51.219970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:51.226359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:51.238056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:51.240228 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e7698ee-ea4e-46fa-8fdc-6669bc8dfb52 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.756944 May 19 08:34:51.241164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2362/3687] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:50 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:51.259690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:51.262344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:51.292191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:51.304288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:51.305970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:51.306783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:51.369150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69cc2943-8974-419f-a839-6fb08e743d4b tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126247 May 19 08:34:51.387356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2363/3688] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:34:51 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:34:51.407235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:51.412262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:51.423416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:51.427040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:51.428292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:51.432665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:51.920217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:51.935780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d24bf8da-a6b3-4789-a902-f521c2fb8be0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.544618 May 19 08:34:51.948349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2364/3689] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:51 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:51.956044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:51.967172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:51.976319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:51.981399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:51.983057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:51.985715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:53.228381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:53.241246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc8d6e3f-c914-4693-a9f9-164a82a7ec3b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1511 microversion: 2.1 time: 1.291485 May 19 08:34:53.242541 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2365/3690] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:51 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1511 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:53.249383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "35b433fc-d79e-466a-bec4-224d739093ed"}, {"server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "name": "network-vif-plugged", "status": "completed", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "ee4b12a5-239c-4c07-9dcb-7cd272e1df1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:53.266483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:53.267233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:53.293082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] Creating event network-vif-plugged:35b433fc-d79e-466a-bec4-224d739093ed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:53.294024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] Creating event network-vif-plugged:dd872ee5-3152-4351-a644-7f3684672d4b for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d on chh2-842464-2 May 19 08:34:53.294895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] Creating event network-vif-plugged:ee4b12a5-239c-4c07-9dcb-7cd272e1df1b for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:53.321810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c16f1374-ad0f-4ae5-82a2-9d689fdf575f req-130df658-2768-431f-a9e8-be5eb4346656 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074305 May 19 08:34:53.323456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2366/3691] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:53.345289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:53.346118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:53.370975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:53.378450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:53.379364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:53.379834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:53.726824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:53.736833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d45819a0-be3b-4c5d-a697-f4f708b66b1e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.409889 May 19 08:34:53.737865 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2367/3692] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:53 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:53.743309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:53.744279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:53.752572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:53.752572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:53.753749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:53.755290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:53.979893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:53.990818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:53.992721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:53.994228 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c73e09d1-d7df-443c-8f2a-08326556439e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1722 microversion: 2.20 time: 0.255163 May 19 08:34:53.996521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2368/3693] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:53 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:54.002197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:54.002922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:54.013079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.013872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.014901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.015849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.052068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:34:54.182571 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9580bb0-9bff-494d-bb73-607c592e0e1f tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 204 len: 0 microversion: 2.1 time: 0.183957 May 19 08:34:54.183595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2369/3694] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:34:53 2022] DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:34:54.190390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:54.191508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:54.206490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.207445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.208616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.209243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.518395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:54.531065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:54.533749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:54.535255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46a115b7-4f89-4506-b5ba-c62a5e5bf705 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.350147 May 19 08:34:54.546626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2370/3695] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:54 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:54.546626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:54.546626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:54.549395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.551011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.551011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.551258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.876399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:54.885278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ef66709-67fa-414c-96a5-981ff66fed26 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1316 microversion: 2.1 time: 0.348287 May 19 08:34:54.888698 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2371/3696] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:54 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:54.894626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:54.895268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:54.912976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.913513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:54.914631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:54.915640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:55.234563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:55.242613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dcaff6bb-43dc-41e6-ae0f-d2e3ae632bd6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 200 len: 1321 microversion: 2.1 time: 0.352640 May 19 08:34:55.253440 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2372/3697] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:54 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:55.258961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:55.259877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:55.268287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:55.269073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:55.270163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:55.270767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:55.556279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:55.579235 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c91d12f1-9a4f-4b06-8fe1-9c7609bb84a5 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1683 microversion: 2.1 time: 0.322675 May 19 08:34:55.580155 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2373/3698] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:55 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1683 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:55.598543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:55.605735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:55.617452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:55.617942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:55.618958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:55.638080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:56.122984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:56.136931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99cea5a3-235c-4390-83af-dacc579c8c97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.555255 May 19 08:34:56.138426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2374/3699] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:55 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:56.155808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:56.156645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:56.194113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:56.194962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:56.201856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:56.202706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:56.647744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:56.661668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:56.667539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:56.669761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9f52ccb-a6f8-43e7-9f3d-d833527f43ab tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1722 microversion: 2.20 time: 0.530271 May 19 08:34:56.674384 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2375/3700] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:56 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1722 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:56.679448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "c906b65b-8f2b-4c8c-b6a4-072396e4a00d"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "94babe40-01cf-4e4b-b343-36b1cd7d8aed"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-plugged", "status": "completed", "tag": "23c51317-3b4b-4c46-8685-bf35bfb26d47"}, {"server_uuid": "6c62db77-f940-41b1-bf60-d5a9a4d00162", "name": "network-vif-plugged", "status": "completed", "tag": "5a66e7db-ad93-447b-bb87-de432e7ed34d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:56.692670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:56.693018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:56.732406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Creating event network-vif-plugged:c906b65b-8f2b-4c8c-b6a4-072396e4a00d for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:56.732936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Creating event network-vif-plugged:94babe40-01cf-4e4b-b343-36b1cd7d8aed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:56.733552 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Creating event network-vif-plugged:23c51317-3b4b-4c46-8685-bf35bfb26d47 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:34:56.734062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] Creating event network-vif-plugged:5a66e7db-ad93-447b-bb87-de432e7ed34d for instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 on chh1-842464-2 May 19 08:34:56.755272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8f66569e-6aaf-4974-8b3f-de3b6a218722 req-259e360f-c26f-43c9-88f8-71314d01e181 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.079340 May 19 08:34:56.756237 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2376/3701] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:56.775514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:56.777497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:56.803792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:56.804312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:56.810567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:56.818139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:57.624569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:57.642910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:57.645017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:57.646618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c86b53bc-1a4d-4fb9-b7e6-eedaaa610560 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1874 microversion: 2.42 time: 0.889250 May 19 08:34:57.648697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2377/3702] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:56 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1874 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:57.654935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:57.655570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:57.700392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:57.701366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:57.702682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:57.703989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.258715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:58.272869 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4da8faa-654a-45b8-a39c-c7e9bb44f5e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.618933 May 19 08:34:58.273744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2378/3703] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:57 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:58.293945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:58.295225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:58.326508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.327109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.333342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.333822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.360429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:34:58.558891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:58.575686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1eec96d-a971-4cf0-b70f-8721f3237d9b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 200 len: 1321 microversion: 2.1 time: 0.299799 May 19 08:34:58.576422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2379/3704] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:58 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:58.582149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:58.582988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:58.591686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.592443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.593487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.594106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.650280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.651831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.654791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lazy-loading 'fault' on Instance uuid 64a56363-0605-49d5-8019-3537b2318fda {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:34:58.716526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8c7190576064231b0370b6e1e592ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216a7075606b4df0b6bb7c1d9d0e1250', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:58.734017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1435558-2054-4ce6-b55f-20d86be76d71 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 200 len: 1331 microversion: 2.1 time: 0.154026 May 19 08:34:58.736558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2380/3705] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:58 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:58.745505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:58.774479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:58.793960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.794846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:58.796051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:58.796685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:59.170723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:59.188381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ddd89007-d455-46c3-82b8-f64b91571e6b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.450375 May 19 08:34:59.189324 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2381/3706] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:34:58 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:34:59.204917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:34:59.206062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:34:59.218826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:59.220098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:59.222710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:59.223375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:59.491884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:59.506900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:59.517023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:34:59.519028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d722251e-5f57-4320-a6aa-d00b1ae6c6d7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1722 microversion: 2.20 time: 0.328466 May 19 08:34:59.522973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2382/3707] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:34:59 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:34:59.535899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-72bfeee7-23d0-4bf9-99fa-ff32a68c44d8 req-90992ae6-8803-40c6-8279-1d7b07920332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a56363-0605-49d5-8019-3537b2318fda", "name": "network-vif-deleted", "tag": "5c6ca18d-4831-4118-a223-7504d55f04a0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:59.571634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-72bfeee7-23d0-4bf9-99fa-ff32a68c44d8 req-90992ae6-8803-40c6-8279-1d7b07920332 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:34:59.576588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-72bfeee7-23d0-4bf9-99fa-ff32a68c44d8 req-90992ae6-8803-40c6-8279-1d7b07920332 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:34:59.606729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-72bfeee7-23d0-4bf9-99fa-ff32a68c44d8 req-90992ae6-8803-40c6-8279-1d7b07920332 service nova] Creating event network-vif-deleted:5c6ca18d-4831-4118-a223-7504d55f04a0 for instance 64a56363-0605-49d5-8019-3537b2318fda on chh2-842464-2 May 19 08:34:59.627606 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-72bfeee7-23d0-4bf9-99fa-ff32a68c44d8 req-90992ae6-8803-40c6-8279-1d7b07920332 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099763 May 19 08:34:59.629266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2383/3708] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:34:59.650031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-731654958", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:34:59.754786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] validate_networks() for [('d7981aac-fa9b-4c71-bcbe-06980e089b70', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:35:00.712722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:35:00.713961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:35:00.714721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:35:00.715371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:35:00.716053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:35:00.718425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:00.742460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:00.743292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:00.749660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:00.750360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:00.782198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Getting quotas for project 144d9ead33364453bd7e349add7a8284. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:35:00.790643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Getting quotas for user 5cedbe79cf76418d815e2608f5f480ed and project 144d9ead33364453bd7e349add7a8284. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:35:00.825933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:35:00.829726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:35:00.896943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3ed712a-4024-4732-81ee-990858fc6024 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260834 May 19 08:35:00.905098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2384/3709] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:34:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:35:00.913031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:00.913966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:00.924816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:00.925629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:00.926947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:00.927763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.364322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:01.382857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:01.384749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:01.395591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96a2d9b2-c30a-4d13-9449-c3515cd86164 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2831 microversion: 2.42 time: 0.488554 May 19 08:35:01.399755 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2385/3710] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:00 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2831 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:01.405666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0b96adf2-8fbd-4770-80c7-682121a50095 req-a81903ad-db1c-4149-ae60-8a08d98c81a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae64075-10a6-4385-a09b-f3d64eb71c45", "name": "network-vif-plugged", "status": "completed", "tag": "edeb457c-a4b7-4082-8653-451d613bc77e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:01.428555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0b96adf2-8fbd-4770-80c7-682121a50095 req-a81903ad-db1c-4149-ae60-8a08d98c81a7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.431675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0b96adf2-8fbd-4770-80c7-682121a50095 req-a81903ad-db1c-4149-ae60-8a08d98c81a7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.456794 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0b96adf2-8fbd-4770-80c7-682121a50095 req-a81903ad-db1c-4149-ae60-8a08d98c81a7 service nova] Creating event network-vif-plugged:edeb457c-a4b7-4082-8653-451d613bc77e for instance aae64075-10a6-4385-a09b-f3d64eb71c45 on chh1-842464-2 May 19 08:35:01.464238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0b96adf2-8fbd-4770-80c7-682121a50095 req-a81903ad-db1c-4149-ae60-8a08d98c81a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062138 May 19 08:35:01.464894 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2386/3711] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:01.473553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:01.473675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:01.483293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.483923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.484722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.485424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.699022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:01.709609 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-271543ba-c509-455e-a4ed-50a7d42cd78f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 200 len: 1511 microversion: 2.1 time: 0.243031 May 19 08:35:01.715347 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2387/3712] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:01 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:01.720338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:01.722537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:01.737102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.737577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.738635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.739080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.789106 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] HTTP exception thrown: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Request method failure captured: May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda HTTP/1.1 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBn2OFQRf1ExAilndKJ4evRMiCFUL0rhR-dAerCWyZzGdTQzZv3WJLDXQO5Eg7KHujDu_gVvHgM8Yf5Z-V7Cvr4rm4rJg5o_HBds10as9iA8qFE3ZqiNH0J2i0YUH-78zTaEgrOopgZZuBYok_lCeHHjTnnaULhIM_zTOV-zP0tabs May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 216a7075606b4df0b6bb7c1d9d0e1250 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 216a7075606b4df0b6bb7c1d9d0e1250 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachSCSIVolumeTestJSON-392382622-project May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d8c7190576064231b0370b6e1e592ea7 May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-392382622-project May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64a56363-0605-49d5-8019-3537b2318fda'} May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:01.794461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:01.801908 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:01.829336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Returning 404 to user: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:01.833959 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8058c284-e62d-4d04-b459-058ad3bcc8cd tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 404 len: 111 microversion: 2.1 time: 0.117608 May 19 08:35:01.835152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2388/3713] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:01 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:35:01.849921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:01.850843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:01.875741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.876442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:01.877468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:01.877908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.062629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:02.075072 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c39044b0-a06d-4410-9c71-1b6e39367389 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.238635 May 19 08:35:02.085075 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2389/3714] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:01 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:02.086666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:02.088597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:02.107107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.107894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.108254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.112031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.378679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:02.391330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:02.396250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:02.397545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5460e51d-eb57-4d0b-951b-1ef14403981d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1743 microversion: 2.20 time: 0.318514 May 19 08:35:02.413270 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2390/3715] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:02 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1743 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:02.415075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:02.415075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:02.424734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.425732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.426580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.427030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.498922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:02.510537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9c81bdc-b654-4874-a063-8b18021895d4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1268 microversion: 2.1 time: 0.098479 May 19 08:35:02.526536 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2391/3716] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:02 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:02.526536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:02.526536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:02.526536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.526536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.526536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.527221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.718509 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5be50ad-6c6d-40d4-952f-f4a8ff88bfec tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.205264 May 19 08:35:02.719466 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2392/3717] 10.222.0.78 () {60 vars in 1315 bytes} [Thu May 19 08:35:02 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6/os-interface => generated 1830 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:02.727614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:02.731537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:02.732473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:02.745869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.749142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.749142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:02.749142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:02.872526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:03.021644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:03.046660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:03.047850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:03.433409 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6786c2c-af44-4c1c-8c8c-8ebf0ff031fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.711680 May 19 08:35:03.434341 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2393/3718] 10.222.0.78 () {58 vars in 1166 bytes} [Thu May 19 08:35:02 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:03.439339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb2454d8-d821-447b-b2ce-59d979dbaad7 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '.version_select at 0x7f3210e77b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:03.491454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb2454d8-d821-447b-b2ce-59d979dbaad7 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329882362" status: 202 len: 0 microversion: 2.1 time: 0.055642 May 19 08:35:03.496539 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2394/3719] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:35:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329882362 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:35:03.503878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:03.516865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:03.549004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:03.554793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:03.555897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:03.559544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:04.067420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:04.078933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53907137-770a-4c8c-88dd-58c296f7389a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1293 microversion: 2.1 time: 0.580777 May 19 08:35:04.086320 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2395/3720] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:03 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1293 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:04.092531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:04.098697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:04.113441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:04.114582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:04.115584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:04.118636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:04.447482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:04.471922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:04.474735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:04.478194 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1249433-87dd-4eec-bfa9-f69d4b654fa5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.390356 May 19 08:35:04.481123 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2396/3721] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:04 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:04.502375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:04.506421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:04.507200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1536047079', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:04.516847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:04.518585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:04.519628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:04.530500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:04.687979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:04.825791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:04.832664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:04.833124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:06.049101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-041ea076-760d-41f1-ab50-19c67ec0232d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1536047079" status: 200 len: 1514 microversion: 2.1 time: 1.561878 May 19 08:35:06.061339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2397/3722] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:35:04 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1536047079 => generated 1514 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:06.066508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:06.067909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:06.078693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:06.080767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:06.084063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:06.084896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:06.098232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:06.555073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:06.567055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f12233b1-34a0-4e66-a79a-001c553a3901 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1316 microversion: 2.1 time: 0.512188 May 19 08:35:06.567880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2398/3723] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:06 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:06.586180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:06.590381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:06.606640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:06.609505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:06.610655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:06.611276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:06.948531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:06.974087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bf9c4fe-5f16-498b-b746-9ca9e19bf5fa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1475 microversion: 2.1 time: 0.404418 May 19 08:35:06.974785 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2399/3724] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:06 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1475 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:07.017510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:07.018136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:07.043470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:07.043928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:07.044725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:07.045169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:07.320590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:07.334176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:07.337603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:07.341460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a37f20e7-5ea2-48af-b392-d105eb5a9671 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.329672 May 19 08:35:07.346383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2400/3725] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:06 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:07.356934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:07.368112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:07.371132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:07.390349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:07.394882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:07.395993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:07.399547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:07.593349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:07.833966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:07.858617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:07.859079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:08.163128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d26d668c-75dc-418e-b952-5b64670ec16f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.813119 May 19 08:35:08.164561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2401/3726] 10.222.0.78 () {58 vars in 1172 bytes} [Thu May 19 08:35:07 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:08.171951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1242535473", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:08.533613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:35:09.357261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:35:09.357820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:35:09.358411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:35:09.358925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:35:09.359444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:35:09.375371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:09.378195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:09.379061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:09.379867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:09.414208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:35:09.430160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:35:09.446839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:35:09.450755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:35:09.505704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b016eb6-082f-4fff-a751-ea0f27be59dd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339768 May 19 08:35:09.507100 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2402/3727] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:35:09.512886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-208a2b11-f11d-4468-b156-27b23cfa3f3e req-d6acf710-1e92-47b4-8677-6025e0d8c47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "tag": "b0bc770d-5102-4981-80bd-f484c3748df7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:09.526629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-208a2b11-f11d-4468-b156-27b23cfa3f3e req-d6acf710-1e92-47b4-8677-6025e0d8c47a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:09.527491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-208a2b11-f11d-4468-b156-27b23cfa3f3e req-d6acf710-1e92-47b4-8677-6025e0d8c47a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:09.561416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-208a2b11-f11d-4468-b156-27b23cfa3f3e req-d6acf710-1e92-47b4-8677-6025e0d8c47a service nova] Creating event network-changed:b0bc770d-5102-4981-80bd-f484c3748df7 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:35:09.571139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-208a2b11-f11d-4468-b156-27b23cfa3f3e req-d6acf710-1e92-47b4-8677-6025e0d8c47a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062299 May 19 08:35:09.576332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2403/3728] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:09.582449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:09.605475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:09.621816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:09.625909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:09.627635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:09.628323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:10.357292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:10.367383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5027bafd-7745-45a8-9cbb-021fcf091c89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1316 microversion: 2.1 time: 0.789234 May 19 08:35:10.371460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2404/3729] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:09 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:10.393024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:10.402563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:10.412572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.servers [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Removing options 'limit' from query {{(pid=119072) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 19 08:35:10.416154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:10.435240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:10.438299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:10.439859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:10.440595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:10.555092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:10.571682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:10.572458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:11.074694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-504e2530-42ed-461c-ba03-4742637406bc tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.699150 May 19 08:35:11.076717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2405/3730] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:35:10 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:11.083090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-156d7afa-030f-4430-83b7-aaad187cfba4 req-0c8a09c6-7203-4d66-9b3f-87d47e4b199f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "name": "network-vif-plugged", "status": "completed", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:11.122887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-156d7afa-030f-4430-83b7-aaad187cfba4 req-0c8a09c6-7203-4d66-9b3f-87d47e4b199f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:11.126245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-156d7afa-030f-4430-83b7-aaad187cfba4 req-0c8a09c6-7203-4d66-9b3f-87d47e4b199f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:11.182260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-156d7afa-030f-4430-83b7-aaad187cfba4 req-0c8a09c6-7203-4d66-9b3f-87d47e4b199f service nova] Creating event network-vif-plugged:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:35:11.198502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-156d7afa-030f-4430-83b7-aaad187cfba4 req-0c8a09c6-7203-4d66-9b3f-87d47e4b199f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120088 May 19 08:35:11.199580 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2406/3731] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:11.207527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:11.208839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:11.218470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:11.219228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:11.220178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:11.220999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:11.730196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:11.754173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:11.760632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:11.762231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3068a604-316e-485d-88a5-22f2ea79f530 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.561058 May 19 08:35:11.764656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2407/3732] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:11 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:11.779244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:11.780463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:11.804830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:11.806574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:11.809749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:11.810276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:11.889165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:35:12.174079 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10a66db0-9fd2-4fa7-a5d3-c8ef6bcd8553 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 204 len: 0 microversion: 2.1 time: 0.405343 May 19 08:35:12.180053 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2408/3733] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:35:11 2022] DELETE /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:35:12.188983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:12.194863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:12.195974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:12.213124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:12.213124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:12.213124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:12.213124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:12.518823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:12.614001 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eeb31295-8711-42dd-b460-d085cd20b482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.432158 May 19 08:35:12.615211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2409/3734] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:35:12 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:12.626482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:12.627320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:12.637828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:12.638297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:12.639236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:12.639791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:13.271549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:13.284663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-babf53fc-84c0-4915-9f9f-2836ef06ee79 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1316 microversion: 2.1 time: 0.664937 May 19 08:35:13.294263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2410/3735] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:12 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:13.295059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-24db6274-cf1b-426e-bb97-b8087bbead91 req-e06a1d6f-286b-49a5-9ebe-e7cec1c2dfed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee93b28-80ce-457d-93fe-0fba061d0f07", "tag": "cb20904a-83a4-4961-be95-c4308bf02462"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:13.318052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-24db6274-cf1b-426e-bb97-b8087bbead91 req-e06a1d6f-286b-49a5-9ebe-e7cec1c2dfed service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:13.318501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-24db6274-cf1b-426e-bb97-b8087bbead91 req-e06a1d6f-286b-49a5-9ebe-e7cec1c2dfed service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:13.344762 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-24db6274-cf1b-426e-bb97-b8087bbead91 req-e06a1d6f-286b-49a5-9ebe-e7cec1c2dfed service nova] Creating event network-changed:cb20904a-83a4-4961-be95-c4308bf02462 for instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 on chh2-842464-2 May 19 08:35:13.358336 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-24db6274-cf1b-426e-bb97-b8087bbead91 req-e06a1d6f-286b-49a5-9ebe-e7cec1c2dfed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070432 May 19 08:35:13.359316 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2411/3736] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:13.372955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:13.374336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:13.384792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:13.388567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:13.389047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:13.396161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:13.396750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:14.099049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:14.118245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2541bcaa-4e64-4064-9908-920ad79f4d7b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.755018 May 19 08:35:14.129011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2412/3737] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:13 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:14.144663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:14.152308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:14.152538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.servers [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Removing options 'limit' from query {{(pid=119072) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 19 08:35:14.162242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:14.219634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:14.220405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:14.221585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:14.222268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:14.264897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:14.324209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a98d08d-8a9a-4f49-ae61-c8c8979456b4 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.193255 May 19 08:35:14.324864 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2413/3738] 10.222.0.78 () {58 vars in 1149 bytes} [Thu May 19 08:35:14 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:14.330015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:14.330458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:14.360393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:14.361470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:14.366939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:14.367408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:14.479631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:15.396805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:15.424426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:15.426037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:15.430302 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62e8a10d-0e32-42f3-95af-e373e6201b45 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 1.104411 May 19 08:35:15.438553 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2414/3739] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:14 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:15.457656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:15.458311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:15.499301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:15.499765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:15.500572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:15.501012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:16.306451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:16.319708 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-486bc69c-eb98-4536-b140-6b19bc81d8e7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1316 microversion: 2.1 time: 0.879903 May 19 08:35:16.333713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2415/3740] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:15 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1316 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:16.339131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:16.343146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:16.344831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:16.357385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:16.358102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:16.359094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:16.359707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:16.423035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:16.480572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28fe87b8-f0fc-4ea0-949f-00481dcb7bbb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.145267 May 19 08:35:16.481193 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2416/3741] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:35:16 2022] GET /compute/v2.1/servers => generated 1012 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:16.493188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:16.498442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:16.515500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:16.516194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:16.517151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:16.534122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:17.246090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:17.258269 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53e724a8-ae81-4066-ad8a-9f7c5602663d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.768870 May 19 08:35:17.259048 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2417/3742] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:16 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:17.273675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:17.274300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:17.317748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:17.318237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:17.319384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:17.320036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:18.466995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:18.484023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:18.486524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:18.490875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7f71821-5c22-495f-a6e5-0d4c84ddf52f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 1.218899 May 19 08:35:18.493476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2418/3743] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:17 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:18.517688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:18.523049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:18.524592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:18.551088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:18.551713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:18.552809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:18.553543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:18.679510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:18.834427 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44269236-c8e8-4394-8435-8553003de4ee tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.338722 May 19 08:35:18.842968 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2419/3744] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:35:18 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:18.855869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:18.856501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:18.888733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:18.889193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:18.890009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:18.890453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:19.529925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:19.538264 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0f849c6-301f-45ac-9cb7-747f3cb7cd93 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1316 microversion: 2.1 time: 0.694002 May 19 08:35:19.553651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2420/3745] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:18 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:19.566061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-51d389dd-3546-4dc7-918b-564e990f9a9f req-d07e3c4e-3972-4cb0-b5af-8cbb91320b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee93b28-80ce-457d-93fe-0fba061d0f07", "name": "network-vif-plugged", "status": "completed", "tag": "cb20904a-83a4-4961-be95-c4308bf02462"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:19.575822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51d389dd-3546-4dc7-918b-564e990f9a9f req-d07e3c4e-3972-4cb0-b5af-8cbb91320b42 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:19.576544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51d389dd-3546-4dc7-918b-564e990f9a9f req-d07e3c4e-3972-4cb0-b5af-8cbb91320b42 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:19.591567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-51d389dd-3546-4dc7-918b-564e990f9a9f req-d07e3c4e-3972-4cb0-b5af-8cbb91320b42 service nova] Creating event network-vif-plugged:cb20904a-83a4-4961-be95-c4308bf02462 for instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 on chh2-842464-2 May 19 08:35:19.596901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-51d389dd-3546-4dc7-918b-564e990f9a9f req-d07e3c4e-3972-4cb0-b5af-8cbb91320b42 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041646 May 19 08:35:19.598157 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2421/3746] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:19.604232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:19.605400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:19.612551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:19.613274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:19.614602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:19.615218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:19.974977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:19.985169 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c80c6c03-2446-4182-91f3-184c2ef47ec1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.385578 May 19 08:35:19.985806 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2422/3747] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:19 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:19.991978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0c78688b-277d-43b5-98ef-a6d73cec3192 req-bcc1e7bd-467f-4898-b478-2475b2431e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1467cda6-8c56-4b17-aa71-9d445ac9b118", "tag": "4c858579-b7ed-413c-99ba-cc9c80526b95"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:20.026666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0c78688b-277d-43b5-98ef-a6d73cec3192 req-bcc1e7bd-467f-4898-b478-2475b2431e2e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.027122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0c78688b-277d-43b5-98ef-a6d73cec3192 req-bcc1e7bd-467f-4898-b478-2475b2431e2e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.053165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0c78688b-277d-43b5-98ef-a6d73cec3192 req-bcc1e7bd-467f-4898-b478-2475b2431e2e service nova] Creating event network-changed:4c858579-b7ed-413c-99ba-cc9c80526b95 for instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 on chh2-842464-2 May 19 08:35:20.086936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0c78688b-277d-43b5-98ef-a6d73cec3192 req-bcc1e7bd-467f-4898-b478-2475b2431e2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097333 May 19 08:35:20.089130 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2423/3748] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:20.102783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:20.117420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:20.118556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.servers [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Removing options 'limit' from query {{(pid=119072) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 19 08:35:20.120980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:20.148478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.148725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.149419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.149856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.211739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a66338ae-54e7-4ca5-b34f-c830c06c398e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.117523 May 19 08:35:20.214310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2424/3749] 10.222.0.78 () {58 vars in 1139 bytes} [Thu May 19 08:35:20 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:20.222600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:20.230013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:20.244039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.247521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.248713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.251124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.551359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=20 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:20.570046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:20.584290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:20.615429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:20.622517 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cffaa063-2b89-4a64-b629-44de0e1ae154 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.403290 May 19 08:35:20.624449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2425/3750] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:20 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:20.669544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:20.673749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:20.696553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.705009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.706336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.706962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.752135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] HTTP exception thrown: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Request method failure captured: May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda HTTP/1.1 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBn2OFQRf1ExAilndKJ4evRMiCFUL0rhR-dAerCWyZzGdTQzZv3WJLDXQO5Eg7KHujDu_gVvHgM8Yf5Z-V7Cvr4rm4rJg5o_HBds10as9iA8qFE3ZqiNH0J2i0YUH-78zTaEgrOopgZZuBYok_lCeHHjTnnaULhIM_zTOV-zP0tabs May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 216a7075606b4df0b6bb7c1d9d0e1250 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 216a7075606b4df0b6bb7c1d9d0e1250 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachSCSIVolumeTestJSON-392382622-project May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d8c7190576064231b0370b6e1e592ea7 May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-392382622-project May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64a56363-0605-49d5-8019-3537b2318fda'} May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:35:20.754392 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:20.761650 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:20.763936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Returning 404 to user: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:20.764991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b624679-8333-47b4-baa8-a84d79e76184 tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 404 len: 111 microversion: 2.1 time: 0.134052 May 19 08:35:20.765876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2426/3751] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:35:20 2022] DELETE /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:35:20.774524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:20.780267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:20.785221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1536047079', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:20.818656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.819215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.820046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:20.820513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:20.988798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=23 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:21.144892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:21.292112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-294a9b01-35b0-4e59-a07f-65e51c017746 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1536047079" status: 200 len: 346 microversion: 2.1 time: 0.524389 May 19 08:35:21.299407 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2427/3752] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:35:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1536047079 => generated 346 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:21.304209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:21.304957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:21.327097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:21.327582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:21.328437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:21.328878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:22.102656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:22.114385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c182482e-3c37-4cdd-939b-04e14cd10f80 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1316 microversion: 2.1 time: 0.813780 May 19 08:35:22.125340 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2428/3753] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:21 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:22.125340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:22.125340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] [instance: 64a56363-0605-49d5-8019-3537b2318fda] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:22.142737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:22.143200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:22.144005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:22.144452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:22.178870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] HTTP exception thrown: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Request method failure captured: May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda HTTP/1.1 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgBn2OFQRf1ExAilndKJ4evRMiCFUL0rhR-dAerCWyZzGdTQzZv3WJLDXQO5Eg7KHujDu_gVvHgM8Yf5Z-V7Cvr4rm4rJg5o_HBds10as9iA8qFE3ZqiNH0J2i0YUH-78zTaEgrOopgZZuBYok_lCeHHjTnnaULhIM_zTOV-zP0tabs May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 216a7075606b4df0b6bb7c1d9d0e1250 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/216a7075606b4df0b6bb7c1d9d0e1250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 216a7075606b4df0b6bb7c1d9d0e1250 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-392382622 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachSCSIVolumeTestJSON-392382622-project May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d8c7190576064231b0370b6e1e592ea7 May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-392382622-project May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64a56363-0605-49d5-8019-3537b2318fda'} May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:22.180573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] Returning 404 to user: Instance 64a56363-0605-49d5-8019-3537b2318fda could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec2cfa56-0e76-4149-b298-d53f7e4fbf9a tempest-AttachSCSIVolumeTestJSON-392382622 tempest-AttachSCSIVolumeTestJSON-392382622-project] 10.222.0.78 "GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda" status: 404 len: 111 microversion: 2.1 time: 0.066442 May 19 08:35:22.189014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2429/3754] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:22 2022] GET /compute/v2.1/servers/64a56363-0605-49d5-8019-3537b2318fda => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:35:22.200618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:22.201251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:22.223225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:22.223696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:22.224502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:22.224948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:22.918885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:22.976271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c7e4c07-3b53-4ee6-860e-a806f152ccf3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.786920 May 19 08:35:22.981147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2430/3755] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:22 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:22.988973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d1ee0fe-b768-440a-8221-f1e850bf92e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:23.010560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d1ee0fe-b768-440a-8221-f1e850bf92e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:23.011301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d1ee0fe-b768-440a-8221-f1e850bf92e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:23.065683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d1ee0fe-b768-440a-8221-f1e850bf92e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:35:23.173329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d1ee0fe-b768-440a-8221-f1e850bf92e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "POST /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a/action" status: 202 len: 0 microversion: 2.1 time: 0.190619 May 19 08:35:23.174666 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2431/3756] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:35:22 2022] POST /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:35:23.181380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:23.182874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:23.189794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:23.190638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:23.191676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:23.192401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:23.217915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:23.852017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:23.869080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:23.870729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:23.872216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1742f13f-6074-4ac6-bf1b-546dbacb1e62 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.695838 May 19 08:35:23.879756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2432/3757] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:23 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:23.887727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:23.888392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:23.905265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:23.905265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:23.906025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:23.906465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:24.470026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:24.484270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9076e9b-0f4f-4526-947d-3879357887cf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1506 microversion: 2.1 time: 0.602952 May 19 08:35:24.484876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2433/3758] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:23 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:24.504988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:24.508253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:24.523066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:24.523523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:24.524318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:24.524772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:25.044119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:25.062756 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9fd82993-8a6f-4642-8f99-c1b1a9fa2d3e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1521 microversion: 2.1 time: 0.564676 May 19 08:35:25.063361 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2434/3759] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:24 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:25.085600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:25.086488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:25.109974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:25.110271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:25.118933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:25.119698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:25.493150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:25.505535 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc31480a-5bef-4a7d-8721-c8b84043b24e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.441032 May 19 08:35:25.521490 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2435/3760] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:25 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:25.527641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:25.527905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:25.554500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:25.555969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:25.560375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:25.565345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:25.635028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:35:25.853500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-becddd46-8740-46e9-ac14-ca2e7c1319e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 204 len: 0 microversion: 2.1 time: 0.330432 May 19 08:35:25.854918 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2436/3761] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:35:25 2022] DELETE /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:35:25.863220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:25.863924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:25.879509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:25.889898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:25.895906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:25.896563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:26.201271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:26.210823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:26.223297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:26.224647 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27684073-902f-408b-ad0d-50e3c97d09f2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.367678 May 19 08:35:26.225230 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2437/3762] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:25 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:26.242920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-bbb4c5be-3a8e-4c75-a924-40c9b6486352 req-80b7fd08-5074-45dc-90e8-65c196626d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1467cda6-8c56-4b17-aa71-9d445ac9b118", "name": "network-vif-plugged", "status": "completed", "tag": "4c858579-b7ed-413c-99ba-cc9c80526b95"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:26.264630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bbb4c5be-3a8e-4c75-a924-40c9b6486352 req-80b7fd08-5074-45dc-90e8-65c196626d7a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:26.265075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-bbb4c5be-3a8e-4c75-a924-40c9b6486352 req-80b7fd08-5074-45dc-90e8-65c196626d7a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:26.288440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-bbb4c5be-3a8e-4c75-a924-40c9b6486352 req-80b7fd08-5074-45dc-90e8-65c196626d7a service nova] Creating event network-vif-plugged:4c858579-b7ed-413c-99ba-cc9c80526b95 for instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 on chh2-842464-2 May 19 08:35:26.300285 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-bbb4c5be-3a8e-4c75-a924-40c9b6486352 req-80b7fd08-5074-45dc-90e8-65c196626d7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060778 May 19 08:35:26.300913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2438/3763] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:26.308353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:26.309055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:26.333617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:26.334378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:26.335368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:26.335971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:27.082739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:27.094045 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27c2e6be-c32e-4eeb-ba38-a726e2ebcfa2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1512 microversion: 2.1 time: 0.791895 May 19 08:35:27.101545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2439/3764] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:26 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1512 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:27.114072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:27.118389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:27.133135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:27.133822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:27.135010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:27.136250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:27.609543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:27.625061 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb3d0f29-aa06-42d3-b0d9-abe29a896a02 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1521 microversion: 2.1 time: 0.519496 May 19 08:35:27.630142 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2440/3765] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:27 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:27.637216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:27.641736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:27.655440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:27.661949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:27.663081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:27.663701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:28.485276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:28.508693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4e6bfae-2db5-4b9d-8ba5-10418b89cb02 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.864503 May 19 08:35:28.515407 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2441/3766] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:27 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:28.542813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:28.546366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:28.577532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:28.587610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:28.589703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:28.590204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:29.363950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:29.393593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:29.406517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:29.412024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-166cdc99-926f-4678-8dca-41a9c78bc6c4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.892316 May 19 08:35:29.414365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2442/3767] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:28 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:29.431287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:29.437690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:29.481764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:29.487466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:29.492597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:29.492766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:29.953581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:29.969781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4292446a-be71-4169-9208-5f5cc622230e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 200 len: 1470 microversion: 2.1 time: 0.548853 May 19 08:35:29.971904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2443/3768] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:29 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 1470 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:29.991255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:29.998447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:30.033626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:30.038887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:30.042734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:30.045191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:30.998198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:31.031930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:31.063252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90a06f93-dae1-441d-bc3a-eda331b07fb7 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1521 microversion: 2.1 time: 1.089780 May 19 08:35:31.082462 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2444/3769] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:29 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1521 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:31.093839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:31.094453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:31.120150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:31.120592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:31.121414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:31.121855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:31.798403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:31.827176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-694ba85f-72c6-4b44-832b-0e38e0b82a00 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1309 microversion: 2.1 time: 0.742394 May 19 08:35:31.828175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2445/3770] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:31 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1309 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:31.833763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ac4dce88-1428-44dd-b5cc-027cd4a17095 req-4bf07c86-7f2a-414d-a0c0-9546d88033a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee93b28-80ce-457d-93fe-0fba061d0f07", "name": "network-vif-deleted", "tag": "cb20904a-83a4-4961-be95-c4308bf02462"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:31.874722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ac4dce88-1428-44dd-b5cc-027cd4a17095 req-4bf07c86-7f2a-414d-a0c0-9546d88033a9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:31.875235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ac4dce88-1428-44dd-b5cc-027cd4a17095 req-4bf07c86-7f2a-414d-a0c0-9546d88033a9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:31.979800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ac4dce88-1428-44dd-b5cc-027cd4a17095 req-4bf07c86-7f2a-414d-a0c0-9546d88033a9 service nova] Creating event network-vif-deleted:cb20904a-83a4-4961-be95-c4308bf02462 for instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 on chh2-842464-2 May 19 08:35:31.990393 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ac4dce88-1428-44dd-b5cc-027cd4a17095 req-4bf07c86-7f2a-414d-a0c0-9546d88033a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160672 May 19 08:35:31.992752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2446/3771] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:32.008714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:32.014635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:32.032155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:32.032905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:32.034007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:32.034712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:32.561397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:32.586391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:32.601100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:32.604270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91a9bdbd-a06e-48d9-83e2-24224306ecd7 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.599725 May 19 08:35:32.620091 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2447/3772] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:31 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:32.638392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:32.646456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:32.673892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:32.683007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:32.686798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:32.689666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:32.784120 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 HTTP/1.1 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3ee93b28-80ce-457d-93fe-0fba061d0f07'} May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:32.795579 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:32.802915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3bbde4f-0dae-4acf-912e-210505df4f42 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 404 len: 111 microversion: 2.1 time: 0.180005 May 19 08:35:32.809080 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2448/3773] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:32 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:35:32.813836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:32.824861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:32.861245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:32.861731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:32.863146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:32.863585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:32.905580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:33.490045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:33.500769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7766b56-8346-4f46-891a-61e5a45ca482 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1521 microversion: 2.1 time: 0.694414 May 19 08:35:33.514694 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2449/3774] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:32 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1521 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:33.530293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cfa00291-58f8-4b67-a2d4-b473cc066e10 req-a8eaea5d-fabc-4f10-a308-38b5e9ec639d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1467cda6-8c56-4b17-aa71-9d445ac9b118", "name": "network-vif-deleted", "tag": "4c858579-b7ed-413c-99ba-cc9c80526b95"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:33.557853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cfa00291-58f8-4b67-a2d4-b473cc066e10 req-a8eaea5d-fabc-4f10-a308-38b5e9ec639d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:33.558547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cfa00291-58f8-4b67-a2d4-b473cc066e10 req-a8eaea5d-fabc-4f10-a308-38b5e9ec639d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:33.575774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cfa00291-58f8-4b67-a2d4-b473cc066e10 req-a8eaea5d-fabc-4f10-a308-38b5e9ec639d service nova] Creating event network-vif-deleted:4c858579-b7ed-413c-99ba-cc9c80526b95 for instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 on chh2-842464-2 May 19 08:35:33.602511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cfa00291-58f8-4b67-a2d4-b473cc066e10 req-a8eaea5d-fabc-4f10-a308-38b5e9ec639d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080882 May 19 08:35:33.603314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2450/3775] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:33.624471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:33.628242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:33.641554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:33.647461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:33.651687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:33.654660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:33.916954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:33.931132 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e897f383-cfbd-46c4-8fef-5a4ad84eb2af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.323950 May 19 08:35:33.933360 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2451/3776] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:33 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:33.949852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:33.951051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:33.960888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:33.961394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:33.962373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:33.963978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:34.102517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:34.115191 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b546382-2765-4fcf-9640-e06ee1d90b22 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 200 len: 1288 microversion: 2.1 time: 0.180187 May 19 08:35:34.118268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2452/3777] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:33 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 1288 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:34.130389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:34.131295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:34.142077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:34.142973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:34.144075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:34.144749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:34.409793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:34.421947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:34.426074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:34.427781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ab803b1-f6fc-45d8-811e-8829b48a834a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1738 microversion: 2.20 time: 0.305571 May 19 08:35:34.429418 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2453/3778] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:34 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:34.438219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d0bbd72-26b9-4ef3-82a0-2b4ba5bb443e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d0bbd72-26b9-4ef3-82a0-2b4ba5bb443e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 163 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": 12345, "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 12345 May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:35:34.446218 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 19 08:35:34.459592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:34.464112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d0bbd72-26b9-4ef3-82a0-2b4ba5bb443e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:34.464990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d0bbd72-26b9-4ef3-82a0-2b4ba5bb443e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.034336 May 19 08:35:34.466066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2454/3779] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:34 2022] POST /compute/v2.1/servers => generated 127 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:35:34.483286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:34.484300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:34.494600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:34.496352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:34.497929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:34.498817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:34.748454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:34.766304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a5c84ad-e33d-42d8-853b-6dd39e2a8af7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.290891 May 19 08:35:34.767228 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2455/3780] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:34 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:34.772150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:34.772768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:34.788358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:34.788813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:34.793461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:34.793963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:35.135902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:35.150867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea4a9044-4d19-4274-9c96-d66c3f0d07a5 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1521 microversion: 2.1 time: 0.381935 May 19 08:35:35.152704 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2456/3781] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:34 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:35.158920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:35.159944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:35.169362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:35.170426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:35.171577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:35.172284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:36.066511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:36.080620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d23dee3a-1112-42ea-ba4b-53910524006b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.925772 May 19 08:35:36.081578 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2457/3782] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:35 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:36.086839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:36.088563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:36.122519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:36.124582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:36.126907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:36.127985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:36.171402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 HTTP/1.1 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1467cda6-8c56-4b17-aa71-9d445ac9b118'} May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:36.174690 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:36.180264 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:36.180264 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:36.180264 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:36.180264 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:36.180264 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:35:36.180264 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:36.184430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:36.185615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed50ecea-71ce-4876-a490-77e231ebed97 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 404 len: 111 microversion: 2.1 time: 0.102899 May 19 08:35:36.187730 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2458/3783] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:36 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:35:36.215333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:36.215958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:36.233949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:36.259430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:36.269363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:36.271669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:36.273609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:36.666873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:36.682667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:36.688334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:36.691297 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ea07354-0bd1-4d42-b202-64631b810b3d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1720 microversion: 2.20 time: 0.485299 May 19 08:35:36.692541 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2459/3784] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:36 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1720 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:36.705570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:36.705570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:36.722773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:36.724732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:36.731033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:36.731392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:37.170909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:37.179000 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85f38c71-261b-4e4a-9458-bda1ddcc6bca tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1521 microversion: 2.1 time: 0.483912 May 19 08:35:37.185227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2460/3785] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:36 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:37.190113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-574669646", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:37.291295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:35:38.445775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:35:38.447144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:35:38.448146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:35:38.448890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:35:38.449824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:35:38.470667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:38.473428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:38.476216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:38.476670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:38.539109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:35:38.554332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:35:38.595741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:35:38.601971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:35:38.705433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a184aaca-880b-46e0-808c-f5f674afcead tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.517607 May 19 08:35:38.711905 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2461/3786] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:35:38.739420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:38.741198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:38.757198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:38.758078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:38.759495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:38.761158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:39.230228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:39.263594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:39.265179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:39.279856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72344e31-a419-41de-94c7-bdc1c016a173 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1720 microversion: 2.20 time: 0.566579 May 19 08:35:39.282688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2462/3787] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:38 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1720 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:39.314275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:39.315897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:39.339985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:39.341652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:39.349417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:39.350649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:39.980790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:39.993287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-343fc164-a8e6-4806-b6a0-4572406e8f51 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1498 microversion: 2.1 time: 0.694014 May 19 08:35:39.997294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2463/3788] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:39 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1498 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:40.003922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-860ac971-79d1-47a8-abe6-cfb40d72f394 req-5f8e1094-b117-4b19-9098-be54b9b6e5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "name": "network-vif-unplugged", "status": "completed", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:40.035678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-860ac971-79d1-47a8-abe6-cfb40d72f394 req-5f8e1094-b117-4b19-9098-be54b9b6e5ed service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.054074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-860ac971-79d1-47a8-abe6-cfb40d72f394 req-5f8e1094-b117-4b19-9098-be54b9b6e5ed service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:40.067571 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-860ac971-79d1-47a8-abe6-cfb40d72f394 req-5f8e1094-b117-4b19-9098-be54b9b6e5ed service nova] Creating event network-vif-unplugged:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:35:40.077954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-860ac971-79d1-47a8-abe6-cfb40d72f394 req-5f8e1094-b117-4b19-9098-be54b9b6e5ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079072 May 19 08:35:40.078902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2464/3789] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:40.093334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:40.094374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:40.109326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.110166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:40.111123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.113858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:40.519096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:40.531564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af4447a0-7b01-4447-8dbc-718c4086c7ca tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1216 microversion: 2.1 time: 0.447535 May 19 08:35:40.533013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2465/3790] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:40 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1216 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:40.538976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:40.556990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:40.558934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:40.575076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.575833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:40.581058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.581775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:40.640656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:40.710945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0923b002-1531-499d-a4ec-ac82cda0270c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.175522 May 19 08:35:40.715668 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2466/3791] 10.222.0.78 () {58 vars in 1153 bytes} [Thu May 19 08:35:40 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:40.725192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:40.726354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:40.742107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.742832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:40.743809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:40.752954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:41.500972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:41.515808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:41.519576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:41.523545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c32e618-c3fc-4957-9cd4-a415c068a1ea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1663 microversion: 2.20 time: 0.806513 May 19 08:35:41.526120 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2467/3792] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:40 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1663 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:41.542921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe22e80d-7124-42b3-8d56-6e8f40851deb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732378548", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "37425875-dbfa-4f2a-b253-9140d6375ab9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:41.701671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-fe22e80d-7124-42b3-8d56-6e8f40851deb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Block Device 37425875-dbfa-4f2a-b253-9140d6375ab9 is not bootable. May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe22e80d-7124-42b3-8d56-6e8f40851deb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 357 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732378548", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "37425875-dbfa-4f2a-b253-9140d6375ab9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: exception: Block Device 37425875-dbfa-4f2a-b253-9140d6375ab9 is not bootable. May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-732378548', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '37425875-dbfa-4f2a-b253-9140d6375ab9'}], 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 37425875-dbfa-4f2a-b253-9140d6375ab9 is not bootable. May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:41.715407 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 37425875-dbfa-4f2a-b253-9140d6375ab9 is not bootable. May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 37425875-dbfa-4f2a-b253-9140d6375ab9 is not bootable. May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe22e80d-7124-42b3-8d56-6e8f40851deb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Block Device 37425875-dbfa-4f2a-b253-9140d6375ab9 is not bootable. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:41.720066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe22e80d-7124-42b3-8d56-6e8f40851deb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.190983 May 19 08:35:41.721483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2468/3793] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:41 2022] POST /compute/v2.1/servers => generated 110 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:35:41.729200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a65ae167-a08c-4c34-bde4-d2d5371728db tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:41.740829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a65ae167-a08c-4c34-bde4-d2d5371728db tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:41.741293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a65ae167-a08c-4c34-bde4-d2d5371728db tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:41.782241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a65ae167-a08c-4c34-bde4-d2d5371728db tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 08:35:41.832235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:41.870205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a65ae167-a08c-4c34-bde4-d2d5371728db tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "POST /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a/action" status: 202 len: 0 microversion: 2.1 time: 0.145751 May 19 08:35:41.871888 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2469/3794] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:35:41 2022] POST /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:35:41.882206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a543dd-6374-4cc6-ac42-fd39eb76e78a"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:41.884989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:41.897495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:41.898626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:41.900943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:41.901735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:42.674382 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28f284cc-2fdb-41b1-89e5-5f1f65a8f0ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.800153 May 19 08:35:42.677988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2470/3795] 10.222.0.78 () {62 vars in 1363 bytes} [Thu May 19 08:35:41 2022] POST /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 188 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:35:42.696169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:42.698821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:42.710186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:42.711295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:42.714854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:42.716638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:43.742385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:43.761171 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84009002-9f90-4b15-a550-873e9fca9a90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1278 microversion: 2.1 time: 1.072489 May 19 08:35:43.762307 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2471/3796] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:42 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1278 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:43.767508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:43.768416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:43.780101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:43.799578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:43.801512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:43.802186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:44.405329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:44.424854 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6c5ba61-2dad-4bdf-9773-eb5f5e62df36 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.661102 May 19 08:35:44.425715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2472/3797] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:43 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:44.449571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:44.450924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:44.458206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:44.458936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:44.461980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:44.464840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:44.911613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:44.927509 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffda6045-2903-40dd-a8a3-478c4ffac81d tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1507 microversion: 2.1 time: 0.499842 May 19 08:35:44.929531 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2473/3798] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:44 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:44.941158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:44.942168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:44.952239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:44.953443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:44.954726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:44.957411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:45.172437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1eb300a5-453c-41f3-8ea3-f1b1f2b6acd9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/action" status: 202 len: 0 microversion: 2.20 time: 0.240198 May 19 08:35:45.174383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2474/3799] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:35:44 2022] POST /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:35:45.184839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:45.185766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:45.194160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:45.194626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:45.195716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:45.196325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:45.544787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:45.559807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7286dc73-3584-4635-bf02-c67380cfd685 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.383075 May 19 08:35:45.560676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2475/3800] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:45 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:45.571481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:45.572682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:45.591070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:45.591725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:45.595696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:45.597415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:46.090453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:46.104699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e12f303d-4ae2-45e7-bd10-c9d5537d833e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1320 microversion: 2.1 time: 0.542844 May 19 08:35:46.119713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2476/3801] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:45 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:46.141397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:46.141946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:46.178711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:46.179379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:46.183063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:46.183705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:46.750225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:46.768147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:46.770368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:46.771929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-661333e7-76de-49a3-85c3-ddc48961a5d9 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1749 microversion: 2.20 time: 0.647518 May 19 08:35:46.784434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2477/3802] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:46 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1749 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:46.797480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:46.799094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:46.805754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:46.806868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:46.820498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:46.821389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:47.198047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:47.206226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04635f4c-9c13-4164-92e5-865d2b5f2d03 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1511 microversion: 2.1 time: 0.419608 May 19 08:35:47.210518 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2478/3803] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:46 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:47.348706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65c09f99-fa7e-450a-b82a-f0e7cc8f07b1 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:47.360161 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65c09f99-fa7e-450a-b82a-f0e7cc8f07b1 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.148263 May 19 08:35:47.373776 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2479/3804] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:47.382384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:47.387510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:47.402658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:47.403727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:47.406196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:47.407880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:47.785110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:47.807266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44c0dc4e-b34d-4f0d-ba8f-3e99202f422c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1320 microversion: 2.1 time: 0.430316 May 19 08:35:47.810047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2480/3805] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:47 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:48.088389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-90ab5565-51a8-45a2-b916-699aed2d2936 req-914a0966-d23c-487e-a1a8-600b17fca421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf1234a-053c-432d-b904-25e00946d453", "tag": "c85be009-766f-43db-aada-9e4113448422"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:48.105649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-90ab5565-51a8-45a2-b916-699aed2d2936 req-914a0966-d23c-487e-a1a8-600b17fca421 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.107741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-90ab5565-51a8-45a2-b916-699aed2d2936 req-914a0966-d23c-487e-a1a8-600b17fca421 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.141386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-90ab5565-51a8-45a2-b916-699aed2d2936 req-914a0966-d23c-487e-a1a8-600b17fca421 service nova] Creating event network-changed:c85be009-766f-43db-aada-9e4113448422 for instance ddf1234a-053c-432d-b904-25e00946d453 on chh1-842464-2 May 19 08:35:48.153469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-90ab5565-51a8-45a2-b916-699aed2d2936 req-914a0966-d23c-487e-a1a8-600b17fca421 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341275 May 19 08:35:48.158349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2481/3806] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:48.172934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:48.180407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:48.183321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.servers [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Removing options 'limit' from query {{(pid=119072) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 19 08:35:48.184398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:48.185864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.189034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.190123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.190745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.194475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b586c3ec-b2f9-404e-a99c-7b6468bb63df tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.034598 May 19 08:35:48.197982 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2482/3807] 10.222.0.78 () {58 vars in 1139 bytes} [Thu May 19 08:35:48 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:35:48.203180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f03266e-2abc-406f-8171-59fcba0f106e tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:48.234777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f03266e-2abc-406f-8171-59fcba0f106e tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.034571 May 19 08:35:48.235754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2483/3808] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:35:48 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:48.241297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:48.242238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:48.262884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.264837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.265986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.266887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.476452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:48.494532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:48.496135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:48.497383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed268191-a081-4bee-bd7c-6ddeec4e2188 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.260451 May 19 08:35:48.497959 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2484/3809] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:48 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:48.514193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:48.514814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:48.525802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.526623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.527593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.528204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.579325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:48.723183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:48.732339 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e268189-9053-4424-bc2c-d889ede45719 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1511 microversion: 2.1 time: 0.233242 May 19 08:35:48.733065 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2485/3810] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:48 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:48.742577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf18507d-8d68-4b8a-aa06-42a2e5670bc3 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:48.764614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf18507d-8d68-4b8a-aa06-42a2e5670bc3 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029981 May 19 08:35:48.765821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2486/3811] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:48.770882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:48.771715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:48.799650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.800737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.802662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:48.808607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:48.812862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:49.000764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:49.016328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23829616-40b3-45c6-a458-bb739a5d74e2 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 200 len: 1511 microversion: 2.1 time: 0.244622 May 19 08:35:49.016328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2487/3812] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:48 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:49.021983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7f79e88-a0ba-493d-8c4f-6108158c1c84 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:49.032083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7f79e88-a0ba-493d-8c4f-6108158c1c84 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018077 May 19 08:35:49.032856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2488/3813] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:49.041131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:49.041968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:49.053827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:49.054354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:49.055159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:49.055708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:49.390633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:49.400441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c57415c0-9b43-4666-a4ae-c8f9679bd718 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1320 microversion: 2.1 time: 0.366279 May 19 08:35:49.401051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2489/3814] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:49 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:49.418107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:49.419030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:49.436244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:49.436712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:49.437566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:49.438015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:49.781053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:49.794160 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a13d72bc-2069-4e13-ad1b-6ca823646d45 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1511 microversion: 2.1 time: 0.380532 May 19 08:35:49.796171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2490/3815] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:49 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:49.809958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06ca2b62-5dfc-402f-bd06-d8b6e3841f7d tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:49.876982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06ca2b62-5dfc-402f-bd06-d8b6e3841f7d tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.079175 May 19 08:35:49.880749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2491/3816] 10.222.0.78 () {58 vars in 1164 bytes} [Thu May 19 08:35:49 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:49.901803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:49.902425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:49.928063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:49.928714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:49.931103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:49.933208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:50.393553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:50.403229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:50.404998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:50.406304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b1b1b78-7c44-402a-a135-9b59775859da tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.514920 May 19 08:35:50.424490 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2492/3817] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:49 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:50.429332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:50.434078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:50.434754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:50.537699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:50.538146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:50.539138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:50.539765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:50.677000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:50.793935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f22253d9-bfc9-4123-bd0f-a6605e46902e tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.368158 May 19 08:35:50.799948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2493/3818] 10.222.0.78 () {58 vars in 1153 bytes} [Thu May 19 08:35:50 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:50.811968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4d885a2-d0f5-4de7-98d2-44765663b687 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-407674898", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "destination_type": "local"}, {"source_type": "volume", "uuid": "334a16aa-ecf9-455c-ae76-633f2c085e3a", "destination_type": "invalid"}], "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4d885a2-d0f5-4de7-98d2-44765663b687 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 494 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-407674898", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "destination_type": "local"}, {"source_type": "volume", "uuid": "334a16aa-ecf9-455c-ae76-633f2c085e3a", "destination_type": "invalid"}], "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-407674898', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '334a16aa-ecf9-455c-ae76-633f2c085e3a', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'invalid' May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:50.823691 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 19 08:35:50.828563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:50.836439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4d885a2-d0f5-4de7-98d2-44765663b687 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:50.838634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4d885a2-d0f5-4de7-98d2-44765663b687 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.036955 May 19 08:35:50.839896 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2494/3819] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:50 2022] POST /compute/v2.1/servers => generated 155 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:35:50.853969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adc555e2-816e-4c68-8dff-da57e2052069 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:50.880936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adc555e2-816e-4c68-8dff-da57e2052069 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033894 May 19 08:35:50.883830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2495/3820] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:50.897391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:50.900935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:50.920220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:50.920694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:50.925443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:50.926180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:51.146415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:51.165680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8059aa2-d35a-4e53-a472-a8ff7836a640 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1320 microversion: 2.1 time: 0.279879 May 19 08:35:51.167057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2496/3821] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:50 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:51.178020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:51.178650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:51.208055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:51.208440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:51.209245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:51.209717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:51.457550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:51.475233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51543d67-0bc2-4771-b91f-a375b8a3db29 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1511 microversion: 2.1 time: 0.306915 May 19 08:35:51.476056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2497/3822] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:51 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:51.486344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:51.487406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:51.499269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:51.501900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:51.504042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:51.505891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:51.770145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:51.781750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08397a55-72fb-4a68-8f3c-d2699fbe2c09 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.304226 May 19 08:35:51.797065 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2498/3823] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:51 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:51.805395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-14f1d370-806d-4e09-8ca3-7b566035d8c2 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:51.837984 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-14f1d370-806d-4e09-8ca3-7b566035d8c2 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039258 May 19 08:35:51.838880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2499/3824] 10.222.0.78 () {58 vars in 1168 bytes} [Thu May 19 08:35:51 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:51.843251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:51.843856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:51.857366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:51.858431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:51.859475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:51.859921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:52.207337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:52.227700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:52.232734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:52.240175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4688da73-e171-4dc8-bd2b-9c7f2ddc49e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.398464 May 19 08:35:52.242843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2500/3825] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:51 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:52.258153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:52.261912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:52.278515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:52.286793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:52.288405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:52.289049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:52.880796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:52.889583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f2021c9-167d-498d-a45b-2e087d699492 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 200 len: 1511 microversion: 2.1 time: 0.643621 May 19 08:35:52.892739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2501/3826] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:52 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 1511 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:52.915357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:52.916633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:52.931372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:52.931962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:52.932928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:52.937503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:53.247587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:53.262686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:53.269181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:53.270510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16c85ba1-ce74-4cd5-bbba-d902c258a8f3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2949 microversion: 2.42 time: 0.367485 May 19 08:35:53.286076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2502/3827] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:52 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2949 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:53.286076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:53.289990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:53.302063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:53.304043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:53.304844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:53.305298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:53.657664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:53.667197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef0e6e70-46e7-451d-ba8a-1f196d80ee66 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.389454 May 19 08:35:53.678185 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2503/3828] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:53 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:53.700971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20d3e7ee-a97a-44b5-abdc-8a41398ca969 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:53.709681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:53.723045 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20d3e7ee-a97a-44b5-abdc-8a41398ca969 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.043190 May 19 08:35:53.732388 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2504/3829] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 08:35:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:53.741437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:53.743429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:53.752873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:53.753674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:53.754640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:53.755280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.011890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:54.019819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cca829b5-5e7c-4034-8c3d-827142ecfd08 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1320 microversion: 2.1 time: 0.285731 May 19 08:35:54.020611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2505/3830] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:53 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:54.025765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a1798e5c-4a47-4a99-98e0-ca2636e0930e req-2d20d06e-fd59-4473-88cd-89824d2daae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf1234a-053c-432d-b904-25e00946d453", "name": "network-vif-plugged", "status": "completed", "tag": "c85be009-766f-43db-aada-9e4113448422"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:54.034440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a1798e5c-4a47-4a99-98e0-ca2636e0930e req-2d20d06e-fd59-4473-88cd-89824d2daae1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.035115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a1798e5c-4a47-4a99-98e0-ca2636e0930e req-2d20d06e-fd59-4473-88cd-89824d2daae1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.048347 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a1798e5c-4a47-4a99-98e0-ca2636e0930e req-2d20d06e-fd59-4473-88cd-89824d2daae1 service nova] Creating event network-vif-plugged:c85be009-766f-43db-aada-9e4113448422 for instance ddf1234a-053c-432d-b904-25e00946d453 on chh1-842464-2 May 19 08:35:54.061174 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a1798e5c-4a47-4a99-98e0-ca2636e0930e req-2d20d06e-fd59-4473-88cd-89824d2daae1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 May 19 08:35:54.065645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2506/3831] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:54.071107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:54.072720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:54.082892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.083618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.085187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.085904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.396991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:54.406947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eadda028-6b86-4412-b670-5b9b3a7354e8 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1511 microversion: 2.1 time: 0.340596 May 19 08:35:54.418697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2507/3832] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:54 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:54.429232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:54.430183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:54.438755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.439347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.440355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.440914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.699119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:54.711022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:54.715204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:54.717334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-660ec9ee-cb50-4d44-b815-b02af4b47550 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.303711 May 19 08:35:54.718535 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2508/3833] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:54 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:54.732008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:54.734778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:54.746592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.747100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.748149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.748766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.917716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ea76f12-b3ec-4692-8a7b-dc8ebe55080d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.197791 May 19 08:35:54.918696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2509/3834] 10.222.0.78 () {60 vars in 1315 bytes} [Thu May 19 08:35:54 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6/os-interface => generated 1830 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:54.923500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a7ec23a-38a9-4602-8c2a-aff4c283625b tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:54.942948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a7ec23a-38a9-4602-8c2a-aff4c283625b tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022784 May 19 08:35:54.944014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2510/3835] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:54.951483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9efb44e5-7576-4048-864b-98e0903effd7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-877360771", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9efb44e5-7576-4048-864b-98e0903effd7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 491 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-877360771", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-877360771', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 19 08:35:54.954498 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9efb44e5-7576-4048-864b-98e0903effd7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9efb44e5-7576-4048-864b-98e0903effd7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.013673 May 19 08:35:54.961105 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2511/3836] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:54 2022] POST /compute/v2.1/servers => generated 624 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:35:54.969503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:54.974056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:54.975055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:54.982275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.983854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:54.984964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:54.985447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:55.013792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:55.024758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:55.085651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:55.096170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:55.096913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:55.334335 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00fda5af-517f-4a4a-a4ab-7ff9c7f2cc10 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.369555 May 19 08:35:55.334983 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2512/3837] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:35:54 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:55.341367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3aca355-9db0-4ca2-9089-092d0c791f90 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:55.392240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3aca355-9db0-4ca2-9089-092d0c791f90 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.056003 May 19 08:35:55.392751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2513/3838] 10.222.0.78 () {58 vars in 1166 bytes} [Thu May 19 08:35:55 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:55.405255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:55.406696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:55.414758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:55.415212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:55.417052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:55.417523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:55.675086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:55.688525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e1d9cfe-cd5e-43f7-942b-f779cf8e2829 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.294511 May 19 08:35:55.707449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2514/3839] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:55 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:55.722529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:55.722529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:55.731593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:55.732816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:55.735380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:55.736652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:56.432104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:56.440356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6010dd66-ddf0-46bf-afc0-cdd4a81d1e60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1501 microversion: 2.1 time: 0.728920 May 19 08:35:56.445888 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2515/3840] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:55 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1501 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:56.459636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:56.473673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:56.474405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:56.626540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:56.626997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:56.628485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:56.629079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:56.685189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:56.752111 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-100f89f8-5915-45b6-9afa-0e0b019a044c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1012 microversion: 2.1 time: 0.305087 May 19 08:35:56.755847 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2516/3841] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:35:56 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1012 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:56.762861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e63f19b7-f5a1-4fd2-abbf-6b84949b1307 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:56.783251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e63f19b7-f5a1-4fd2-abbf-6b84949b1307 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025270 May 19 08:35:56.784460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2517/3842] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:56.789586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:56.790603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:56.805220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:56.806617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:56.807647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:56.808291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.029075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:57.040726 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-186d7357-999e-495c-802d-bdffa7f020da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.254933 May 19 08:35:57.062137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2518/3843] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:56 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:57.080804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:57.082114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:57.092213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.093114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.094290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.094927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.334357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:57.347097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:57.349175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:57.350980 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9852aad1-2c1f-49c3-ba5d-ab36cd0fe49c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.276120 May 19 08:35:57.352368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2519/3844] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:57 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:57.358296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:57.359419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:57.366907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.367500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.368577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.373283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.596769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:57.607631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-45a68e6a-8754-4406-80e8-2b13cbcdd7e1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1501 microversion: 2.1 time: 0.253293 May 19 08:35:57.608538 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2520/3845] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:57 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:57.624964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:57.628908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:57.629729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:57.636730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.637581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.638489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.639465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.778502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:57.891769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11cd128e-0f84-464c-aa18-7d2088da785f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.270423 May 19 08:35:57.893021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2521/3846] 10.222.0.78 () {58 vars in 1211 bytes} [Thu May 19 08:35:57 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:57.897685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bebe1e7a-f330-49bf-9e76-6d3e36d3a112 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:57.919179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bebe1e7a-f330-49bf-9e76-6d3e36d3a112 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024565 May 19 08:35:57.919774 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2522/3847] 10.222.0.78 () {58 vars in 1143 bytes} [Thu May 19 08:35:57 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:57.924931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ec755e7-8d3a-4370-8de7-95929cd12a48 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ec755e7-8d3a-4370-8de7-95929cd12a48 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 416 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:57.927853 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ec755e7-8d3a-4370-8de7-95929cd12a48 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:57.932536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ec755e7-8d3a-4370-8de7-95929cd12a48 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.008590 May 19 08:35:57.935305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2523/3848] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:57 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:35:57.938380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:57.938906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:57.945853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.946120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.947431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:57.948210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:57.983242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:35:58.103345 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b743ac5-920f-431e-b814-001100de437d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 204 len: 0 microversion: 2.1 time: 0.167634 May 19 08:35:58.105773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2524/3849] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:35:57 2022] DELETE /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:35:58.112776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.118291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:58.119951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:58.127049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.127667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.128576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.129473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.233613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:58.295403 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a2ef2e1-4eb3-4f8c-9643-6ba7ea2c7083 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.188109 May 19 08:35:58.302183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2525/3850] 10.222.0.78 () {58 vars in 1195 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:58.302183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c15c8a2f-d6b9-4410-a27c-e9145ae612f0 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.309460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c15c8a2f-d6b9-4410-a27c-e9145ae612f0 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012233 May 19 08:35:58.310201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2526/3851] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:58.318790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.319696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:58.328106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.328746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.329740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.330669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.473330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:58.481369 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c74a2570-4b25-414d-ba72-c16a51a2bf20 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.166511 May 19 08:35:58.494326 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2527/3852] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:58.494326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.494326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:58.494720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.495029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.495925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.496363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.649413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:58.658266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b08aef30-975a-4bd7-8d39-c259d09c4bb4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1507 microversion: 2.1 time: 0.175214 May 19 08:35:58.664353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2528/3853] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:58.664665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.669054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:58.669769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': '1536047079', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:58.675463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.675906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.676810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.677243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.763977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:58.827293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcdaf151-44ca-483e-b749-dd14090c5a7f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?name=1536047079" status: 200 len: 346 microversion: 2.1 time: 0.166481 May 19 08:35:58.828247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2529/3854] 10.222.0.78 () {58 vars in 1155 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/servers?name=1536047079 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:58.835636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-330933b2-1ff8-4b7e-96b2-7c7897a4d125 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.848706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-330933b2-1ff8-4b7e-96b2-7c7897a4d125 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.019029 May 19 08:35:58.856968 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2530/3855] 10.222.0.78 () {58 vars in 1147 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:58.861777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:58.862392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:58.868489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.869587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.870370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:58.870812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:58.889704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:35:59.038319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:59.047684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:59.049167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:59.050547 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55dc928c-b965-4f45-a902-0bfc6bf30412 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.192336 May 19 08:35:59.051147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2531/3856] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:35:58 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:35:59.063544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:59.064175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:59.072803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.073276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.074074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.074511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.230511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:59.253332 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3222666-4d5c-4953-9e47-4e7275e3dd13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.179774 May 19 08:35:59.253332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2532/3857] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:59 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:59.253332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:59.253332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:59.253332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:59.256740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.257180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.258006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.258492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.475780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:59.547254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e218af3-e269-475d-9df2-1c101f0649da tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.305642 May 19 08:35:59.548302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2533/3858] 10.222.0.78 () {58 vars in 1153 bytes} [Thu May 19 08:35:59 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:35:59.558507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07670b94-414e-45aa-ba41-e076ce2fe995 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:59.580993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07670b94-414e-45aa-ba41-e076ce2fe995 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.031249 May 19 08:35:59.588867 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2534/3859] 10.222.0.78 () {58 vars in 1139 bytes} [Thu May 19 08:35:59 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:59.595702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e64bc71-9622-4e37-a9e4-ecf5842a33b4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1540828690", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": -1, "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:35:59.612247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1e64bc71-9622-4e37-a9e4-ecf5842a33b4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Flavor -1 could not be found. May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e64bc71-9622-4e37-a9e4-ecf5842a33b4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 206 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1540828690", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": -1, "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: exception: Flavor -1 could not be found. May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1540828690', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': -1, 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:59.614684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e64bc71-9622-4e37-a9e4-ecf5842a33b4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:35:59.620845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e64bc71-9622-4e37-a9e4-ecf5842a33b4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.029705 May 19 08:35:59.627022 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2535/3860] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:35:59 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:35:59.629218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:59.633745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:35:59.634598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-153604707', 'deleted': False, 'project_id': '36560e910bfe4df291ec1c6533ddecc7'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:35:59.640658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.641244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.642167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.642696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.734075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:35:59.802449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ce3b012-5dca-49a2-b2a3-f7453911a08c tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-153604707" status: 200 len: 346 microversion: 2.1 time: 0.177400 May 19 08:35:59.809940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2536/3861] 10.222.0.78 () {58 vars in 1227 bytes} [Thu May 19 08:35:59 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-153604707 => generated 346 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:59.815360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e8702d0-d17c-4662-b072-8c0c6e43d22a tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:59.825347 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e8702d0-d17c-4662-b072-8c0c6e43d22a tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013824 May 19 08:35:59.826211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2537/3862] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:35:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:35:59.831952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:35:59.832848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:35:59.843168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.843655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:35:59.844447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:35:59.844897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:00.182252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:00.190537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e294eba8-5c54-4ecf-8e9b-8145c8cd8d85 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.363217 May 19 08:36:00.191437 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2538/3863] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:35:59 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:00.196026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:00.197142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:00.204917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:00.205633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:00.206421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:00.206869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:00.494989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:00.507807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5ec768f-7861-4546-ab98-f0c6f20963f2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 200 len: 1507 microversion: 2.1 time: 0.315233 May 19 08:36:00.517201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2539/3864] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:00 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 1507 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:00.528692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:00.534171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:00.545715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:00.547752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:00.551240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:00.556400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.065473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:36:01.204329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e134b134-093b-4fea-8d79-c861989a48fa tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "DELETE /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 204 len: 0 microversion: 2.1 time: 0.684247 May 19 08:36:01.209082 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2540/3865] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:36:00 2022] DELETE /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:36:01.216916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9e0d344-5f6d-4223-aad5-e3be87ba7d38 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:01.247060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9e0d344-5f6d-4223-aad5-e3be87ba7d38 tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.036091 May 19 08:36:01.247790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2541/3866] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:36:01 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:01.260902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:01.261782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:01.269272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.269864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.271130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.271677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.441666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:01.474104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:01.476230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:01.480122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b8b7050-5636-4333-8baf-cc9dc46cdb0d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.223391 May 19 08:36:01.489462 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2542/3867] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:01 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:01.489462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:01.489462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:01.506084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.506536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.507317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.507846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.684052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:01.693885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4dee04c1-c4af-4caa-b744-3680810e209a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.210845 May 19 08:36:01.694882 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2543/3868] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:01 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:01.700589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-47ec6115-993e-40c4-8d8b-f292438b9d3c req-ecb69acb-2fcb-430b-836b-211600d7f1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf1234a-053c-432d-b904-25e00946d453", "name": "network-vif-deleted", "tag": "c85be009-766f-43db-aada-9e4113448422"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:01.717200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-47ec6115-993e-40c4-8d8b-f292438b9d3c req-ecb69acb-2fcb-430b-836b-211600d7f1c6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.717787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-47ec6115-993e-40c4-8d8b-f292438b9d3c req-ecb69acb-2fcb-430b-836b-211600d7f1c6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.740711 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-47ec6115-993e-40c4-8d8b-f292438b9d3c req-ecb69acb-2fcb-430b-836b-211600d7f1c6 service nova] Creating event network-vif-deleted:c85be009-766f-43db-aada-9e4113448422 for instance ddf1234a-053c-432d-b904-25e00946d453 on chh1-842464-2 May 19 08:36:01.751822 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-47ec6115-993e-40c4-8d8b-f292438b9d3c req-ecb69acb-2fcb-430b-836b-211600d7f1c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055593 May 19 08:36:01.759646 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2544/3869] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:01.767523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:01.767523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:01.789272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.789895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.791368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:01.791909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:01.966003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:01.975706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-545ea400-bf3d-415b-b891-e735a5d2df48 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1517 microversion: 2.1 time: 0.214715 May 19 08:36:01.989714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2545/3870] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:01 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:01.998273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb27ac12-f2a1-4980-ab59-c0a5d5b7a6be tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:02.020818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb27ac12-f2a1-4980-ab59-c0a5d5b7a6be tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026901 May 19 08:36:02.022140 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2546/3871] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:02.028123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:02.028977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:02.038732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:02.039185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:02.039971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:02.040473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:02.058170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 HTTP/1.1 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ddf1234a-053c-432d-b904-25e00946d453'} May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.059834 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:02.065544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a236517-f936-41cf-b935-b1fca68e6159 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 404 len: 111 microversion: 2.1 time: 0.037622 May 19 08:36:02.073748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2547/3872] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:02 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:02.078907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-416eb524-21af-48e1-b199-515422667065 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2129689073", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-416eb524-21af-48e1-b199-515422667065 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 173 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2129689073", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2129689073', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi -1 May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:36:02.082081 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-416eb524-21af-48e1-b199-515422667065 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-416eb524-21af-48e1-b199-515422667065 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008668 May 19 08:36:02.087784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2548/3873] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:02 2022] POST /compute/v2.1/servers => generated 145 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:36:02.090382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4048285e-4133-43e6-8864-0bd3210d731e tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:02.099834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4048285e-4133-43e6-8864-0bd3210d731e tempest-FlavorsV2TestJSON-311692010 tempest-FlavorsV2TestJSON-311692010-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014313 May 19 08:36:02.100738 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2549/3874] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:36:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:02.115631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51c1a7c1-9ee3-4916-af40-ca07de0ea1d8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: .version_select at 0x7f3211188430>, body: {"keypair": {"name": "tempest-key-1372422045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDJByk3gq/ipEICzcA0ARnjh0ZsraBT28aQhQbFox2nI6tCpX7eyQPnay8tdhQT4wvl2jMV5AoHNR1lfhIfmO2e4CzFsnUkr5mPs0+bEHt6ZMLockVn9OXLQL9C7/vqgQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:02.122557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:02.134792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-51c1a7c1-9ee3-4916-af40-ca07de0ea1d8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:02.151181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-51c1a7c1-9ee3-4916-af40-ca07de0ea1d8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:02.248267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51c1a7c1-9ee3-4916-af40-ca07de0ea1d8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.108362 May 19 08:36:02.248267 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2550/3875] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:36:02 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:02.248267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:02.248267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:02.260247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:02.260727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:02.261640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:02.262089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:02.516681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:02.526260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19eedc43-02c3-4067-838e-d026cf7217f1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.314256 May 19 08:36:02.537345 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2551/3876] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:02 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:02.542568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5675c2e-8bd6-4f0e-98e0-094a91c9becc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '.version_select at 0x7f32111314c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:02.548541 chdv-842464-2 devstack@n-api.service[119072]: WARNING oslo_db.sqlalchemy.utils [None req-c5675c2e-8bd6-4f0e-98e0-094a91c9becc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Unique keys not in sort_keys. The sorting order may be unstable. May 19 08:36:02.568841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5675c2e-8bd6-4f0e-98e0-094a91c9becc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.040815 May 19 08:36:02.591421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2552/3877] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:36:02 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:02.608473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:02.609235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:02.617377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:02.617813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:02.618793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:02.619241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:02.985926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:02.997036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:03.004458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:03.005782 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec2414e4-66f1-40ec-a2d5-55b086ef931f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.413278 May 19 08:36:03.006402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2553/3878] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:02 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:03.019235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:03.020223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:03.041186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:03.041877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:03.042880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:03.043455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:03.468687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:03.483318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe652e0a-faf0-46f3-82da-59d6f81c5fe0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.474074 May 19 08:36:03.496152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2554/3879] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:03 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:03.500907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1442080366", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-key-1372422045", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:03.609635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:36:04.844784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:36:04.845427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:36:04.845726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:36:04.846311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:36:04.847451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:36:04.880659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:04.885260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:04.886695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:04.888970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:04.908002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=21 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:04.933243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:04.940321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:04.959113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:36:04.963041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:36:05.047885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84015bd0-dce2-4191-9a2d-600d1d86a80b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557709 May 19 08:36:05.049354 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2555/3880] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:36:05.059784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:05.062953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:05.109853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.114218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.115650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.116242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.228900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.229936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.231178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lazy-loading 'fault' on Instance uuid 573df54d-b347-40b7-90ca-62d58676ce17 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:36:05.240985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:05.301899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:05.312605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd628bce-20bc-48fd-842b-c76be16e2ebb tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 200 len: 1311 microversion: 2.1 time: 0.261193 May 19 08:36:05.313724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2556/3881] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:05 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:05.319153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-110340ec-6624-44c4-84c4-85e8f34484c5 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-759223563", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:05.324003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-110340ec-6624-44c4-84c4-85e8f34484c5 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-110340ec-6624-44c4-84c4-85e8f34484c5 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 215 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-759223563", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-759223563', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:05.326478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 19 08:36:05.330175 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:05.333665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-110340ec-6624-44c4-84c4-85e8f34484c5 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:05.334681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-110340ec-6624-44c4-84c4-85e8f34484c5 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.019848 May 19 08:36:05.341902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2557/3882] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:05 2022] POST /compute/v2.1/servers => generated 123 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:36:05.347193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:05.347805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:05.365631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.366092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.366908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.367353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.755187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:05.769103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:05.771804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:05.773281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c55f89a0-d9fb-4d5a-a745-629f8ed34a67 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1751 microversion: 2.20 time: 0.429809 May 19 08:36:05.774310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2558/3883] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:05 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1751 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:05.782152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3cbee865-64fb-42d4-863d-e3063ccbc399 req-4de481d1-f06a-4e21-8c3f-ceaf1a446b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "573df54d-b347-40b7-90ca-62d58676ce17", "name": "network-vif-deleted", "tag": "66a1b5ac-fcaa-49de-9075-dacde1035a57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:05.792407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3cbee865-64fb-42d4-863d-e3063ccbc399 req-4de481d1-f06a-4e21-8c3f-ceaf1a446b35 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.793157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3cbee865-64fb-42d4-863d-e3063ccbc399 req-4de481d1-f06a-4e21-8c3f-ceaf1a446b35 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.824324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3cbee865-64fb-42d4-863d-e3063ccbc399 req-4de481d1-f06a-4e21-8c3f-ceaf1a446b35 service nova] Creating event network-vif-deleted:66a1b5ac-fcaa-49de-9075-dacde1035a57 for instance 573df54d-b347-40b7-90ca-62d58676ce17 on chh2-842464-2 May 19 08:36:05.837988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3cbee865-64fb-42d4-863d-e3063ccbc399 req-4de481d1-f06a-4e21-8c3f-ceaf1a446b35 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061245 May 19 08:36:05.843299 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2559/3884] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:05.861044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:05.865765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:05.889781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.893909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:05.899522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:05.900275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:06.064954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:06.075637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7947b75-827a-4a1d-ab4d-c7bc17d2e136 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1233 microversion: 2.1 time: 0.230000 May 19 08:36:06.087194 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2560/3885] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:05 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1233 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:06.097217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:06.098532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:06.107607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:06.108293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:06.109287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:06.110063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:06.364293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:06.376722 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95a6036f-53d5-4606-843f-a9d64f0ea07a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.287242 May 19 08:36:06.382409 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2561/3886] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:06 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:06.399516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:06.407914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 573df54d-b347-40b7-90ca-62d58676ce17] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:06.443795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:06.444478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:06.453389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:06.454482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:06.507245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] HTTP exception thrown: Instance 573df54d-b347-40b7-90ca-62d58676ce17 could not be found. May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Request method failure captured: May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 HTTP/1.1 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEBt6CwBChGK5OCwasJlMXStTf_lZ-9aapapzghRAzkaywBbyIxnteJO6sndo-lHZtCNH8cghlFDe41r64zHxEb4DYChkWhu3GFxRbB3BdQ9-bcoG3LC48oiicfZlVy6uSy2LzMq0JfP2I3F01cziVNH_pi0baCDAOJ3nWE-_C4Ios May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 36560e910bfe4df291ec1c6533ddecc7 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 36560e910bfe4df291ec1c6533ddecc7 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServerFiltersTestJSON-1101156688-project May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0a4cf9029e4242b794a6b3eaef958dc5 May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServerFiltersTestJSON-1101156688-project May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 573df54d-b347-40b7-90ca-62d58676ce17 could not be found. May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '573df54d-b347-40b7-90ca-62d58676ce17'} May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 573df54d-b347-40b7-90ca-62d58676ce17 could not be found. May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 573df54d-b347-40b7-90ca-62d58676ce17 could not be found. May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:06.514596 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 573df54d-b347-40b7-90ca-62d58676ce17 could not be found. May 19 08:36:06.518299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:06.520801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Returning 404 to user: Instance 573df54d-b347-40b7-90ca-62d58676ce17 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:06.522781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92da081e-dc07-4f0d-8e76-34a0e7712d71 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17" status: 404 len: 111 microversion: 2.1 time: 0.137242 May 19 08:36:06.527270 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2562/3887] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:06 2022] GET /compute/v2.1/servers/573df54d-b347-40b7-90ca-62d58676ce17 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:06.539353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:06.540099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:06.560932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:06.562142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:06.563576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:06.564774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:07.194313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:07.210387 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f97ad8e-00b6-4fd3-9839-bfc164073bd9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.681619 May 19 08:36:07.211356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2563/3888] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:06 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:07.216788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:07.222112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:07.246606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:07.252232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:07.253974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:07.259878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:07.341469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:36:07.533256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0843eb1-7539-4181-aad8-84a7068978c6 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 204 len: 0 microversion: 2.1 time: 0.320349 May 19 08:36:07.534614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2564/3889] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:36:07 2022] DELETE /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:36:07.540786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:07.541919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:07.548963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:07.549995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:07.551197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:07.551848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:07.933458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:07.947615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:07.953567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:07.954958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfc5ff3d-dffb-4c6e-aeb7-30b8b7e6ad8b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.418904 May 19 08:36:07.955820 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2565/3890] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:07 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:07.978769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:07.979590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:08.005037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:08.006755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:08.007581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:08.008022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:08.186316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:08.204686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34242025-6e37-4c38-b6f9-61d321d94c9d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1287 microversion: 2.1 time: 0.247694 May 19 08:36:08.208713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2566/3891] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:07 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1287 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:08.223300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce50058-d30b-496e-8952-955f41715e54 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1815679816", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-key-1722342930", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:08.326482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-dce50058-d30b-496e-8952-955f41715e54 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] validate_networks() for [('d7981aac-fa9b-4c71-bcbe-06980e089b70', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:36:10.059939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-dce50058-d30b-496e-8952-955f41715e54 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Invalid key_name provided. May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce50058-d30b-496e-8952-955f41715e54 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 247 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1815679816", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-key-1722342930", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid key_name provided. May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1815679816', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'key_name': 'tempest-key-1722342930', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1722342930 not found for user 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:10.071041 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 19 08:36:10.075525 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:10.086490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dce50058-d30b-496e-8952-955f41715e54 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid key_name provided. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:10.105014 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dce50058-d30b-496e-8952-955f41715e54 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.887493 May 19 08:36:10.109761 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2567/3892] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:08 2022] POST /compute/v2.1/servers => generated 70 bytes in 1900 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 19 08:36:10.131942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:10.133701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:10.170014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:10.170471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:10.171591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:10.172177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:10.234805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:10.235289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:10.236499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lazy-loading 'fault' on Instance uuid 6c62db77-f940-41b1-bf60-d5a9a4d00162 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:36:10.378082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:10.391598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-632fe945-2475-4afb-a817-f0ff72bfef83 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 200 len: 1311 microversion: 2.1 time: 0.276890 May 19 08:36:10.394964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2568/3893] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:10 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 1311 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:10.407457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:10.408284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:10.441033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:10.441523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:10.450535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:10.457994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:11.221815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:11.241218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:11.247368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:11.252861 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e44c8d5-54dc-4533-a830-d3388d0b1d5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.854079 May 19 08:36:11.253933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2569/3894] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:10 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:11.290165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:11.296559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:11.314500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:11.317240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:11.318465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:11.319195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:12.910309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:12.925669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e83e6b8-23b5-490c-b10b-9c5713708956 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1329 microversion: 2.1 time: 1.668075 May 19 08:36:12.928560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2570/3895] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:11 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1329 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:12.936081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d47fdcde-cc47-4a37-a309-51c2c2e000e6 req-63ec4a02-e1f0-466c-ba27-87d63b1602c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c62db77-f940-41b1-bf60-d5a9a4d00162", "name": "network-vif-deleted", "tag": "5a66e7db-ad93-447b-bb87-de432e7ed34d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:12.950373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d47fdcde-cc47-4a37-a309-51c2c2e000e6 req-63ec4a02-e1f0-466c-ba27-87d63b1602c5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:12.958781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d47fdcde-cc47-4a37-a309-51c2c2e000e6 req-63ec4a02-e1f0-466c-ba27-87d63b1602c5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:12.999153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d47fdcde-cc47-4a37-a309-51c2c2e000e6 req-63ec4a02-e1f0-466c-ba27-87d63b1602c5 service nova] Creating event network-vif-deleted:5a66e7db-ad93-447b-bb87-de432e7ed34d for instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 on chh1-842464-2 May 19 08:36:13.022739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d47fdcde-cc47-4a37-a309-51c2c2e000e6 req-63ec4a02-e1f0-466c-ba27-87d63b1602c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092329 May 19 08:36:13.027784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2571/3896] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:13.040233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:13.047919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:13.096363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:13.097722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:13.109326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:13.113368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:13.703870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:13.719905 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f93d79e-5e9e-4b02-8d68-6792e01ca850 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.686191 May 19 08:36:13.735977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2572/3897] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:13 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:13.741155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:13.749655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 6c62db77-f940-41b1-bf60-d5a9a4d00162] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:13.767716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:13.768529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:13.772971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:13.773707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:13.815612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] HTTP exception thrown: Instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 could not be found. May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Request method failure captured: May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 HTTP/1.1 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEBt6CwBChGK5OCwasJlMXStTf_lZ-9aapapzghRAzkaywBbyIxnteJO6sndo-lHZtCNH8cghlFDe41r64zHxEb4DYChkWhu3GFxRbB3BdQ9-bcoG3LC48oiicfZlVy6uSy2LzMq0JfP2I3F01cziVNH_pi0baCDAOJ3nWE-_C4Ios May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 36560e910bfe4df291ec1c6533ddecc7 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 36560e910bfe4df291ec1c6533ddecc7 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServerFiltersTestJSON-1101156688-project May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0a4cf9029e4242b794a6b3eaef958dc5 May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServerFiltersTestJSON-1101156688-project May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 could not be found. May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6c62db77-f940-41b1-bf60-d5a9a4d00162'} May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 could not be found. May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 could not be found. May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:13.824931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 could not be found. May 19 08:36:13.828185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:13.836473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Returning 404 to user: Instance 6c62db77-f940-41b1-bf60-d5a9a4d00162 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:13.838415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ddeeac83-eb5c-4c6a-9a15-bbfc33d1a361 tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162" status: 404 len: 111 microversion: 2.1 time: 0.100714 May 19 08:36:13.843168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2573/3898] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:13 2022] GET /compute/v2.1/servers/6c62db77-f940-41b1-bf60-d5a9a4d00162 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:13.857380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:13.863806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:13.880227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:13.882839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:13.893916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:13.895035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:14.390867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:14.416830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:14.428737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:14.430146 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6acdb989-151a-4bca-8982-8d2618ad949a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.585407 May 19 08:36:14.436194 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2574/3899] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:13 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:14.456659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:14.457345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:14.488417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:14.489032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:14.490041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:14.490696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:14.855117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:14.860137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:14.878003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6df7f545-79f4-4a0d-9fec-bf6427d8f359 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.436033 May 19 08:36:14.892016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2575/3900] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:14 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:14.956337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:14.970280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:15.005515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:15.018124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:15.029069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:15.031652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:15.034357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:15.041665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:15.209571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:36:15.506865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b725816c-044e-4507-b794-fc4448b7b90b tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 204 len: 0 microversion: 2.1 time: 0.608120 May 19 08:36:15.508871 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2576/3901] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:36:14 2022] DELETE /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:36:15.519789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:15.522346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:15.537522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:15.538381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:15.539420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:15.540062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:15.934361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:15.946240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-241f9b60-8bfe-4440-9311-aeb408533e58 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1329 microversion: 2.1 time: 0.435507 May 19 08:36:15.947803 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2577/3902] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:15 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1329 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:15.965187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3a5131a5-968a-4c79-9ab0-4479246b2e83 req-8b92b4c5-8244-443a-8f22-a7635cec8c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5470bba9-72f6-47d6-a99f-d95406958a0c", "tag": "985186d9-6551-4620-93e7-b0c8caa6ed01"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:15.989487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a5131a5-968a-4c79-9ab0-4479246b2e83 req-8b92b4c5-8244-443a-8f22-a7635cec8c00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:15.989487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3a5131a5-968a-4c79-9ab0-4479246b2e83 req-8b92b4c5-8244-443a-8f22-a7635cec8c00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:16.030728 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3a5131a5-968a-4c79-9ab0-4479246b2e83 req-8b92b4c5-8244-443a-8f22-a7635cec8c00 service nova] Creating event network-changed:985186d9-6551-4620-93e7-b0c8caa6ed01 for instance 5470bba9-72f6-47d6-a99f-d95406958a0c on chh1-842464-2 May 19 08:36:16.036515 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3a5131a5-968a-4c79-9ab0-4479246b2e83 req-8b92b4c5-8244-443a-8f22-a7635cec8c00 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075123 May 19 08:36:16.042192 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2578/3903] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:16.068414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5ff4aa0-6e3f-40c8-acf2-52ab0fe427a7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1002172904", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:16.108690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:16.468321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.security_group_api [None req-f5ff4aa0-6e3f-40c8-acf2-52ab0fe427a7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Neutron security group does_not_exist not found {{(pid=119072) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 19 08:36:16.468918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f5ff4aa0-6e3f-40c8-acf2-52ab0fe427a7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5ff4aa0-6e3f-40c8-acf2-52ab0fe427a7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 258 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1002172904", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: exception: Unable to find security_group with name or id 'does_not_exist' May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1002172904', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 19 08:36:16.521985 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._create_instance( May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:16.526688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5ff4aa0-6e3f-40c8-acf2-52ab0fe427a7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:16.530331 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5ff4aa0-6e3f-40c8-acf2-52ab0fe427a7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.480029 May 19 08:36:16.530331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2579/3904] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:16 2022] POST /compute/v2.1/servers => generated 106 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:36:16.531924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:16.532056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:16.540763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:16.541236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:16.542986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:16.543445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:16.749571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:16.764111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:16.767584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:16.771307 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5eb916b-e8cb-4636-a81c-39f046924601 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.242948 May 19 08:36:16.773232 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2580/3905] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:16 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:16.780510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:16.781686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:16.789202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:16.797331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:16.797331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:16.797331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:16.993901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a4cf9029e4242b794a6b3eaef958dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36560e910bfe4df291ec1c6533ddecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:17.002336 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91386c48-cdfd-4ddf-8b7a-1aff88313ebd tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 200 len: 1517 microversion: 2.1 time: 0.227319 May 19 08:36:17.003135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2581/3906] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:16 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:17.018152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:17.018684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:17.033592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:17.034054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:17.034879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:17.035517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:17.392126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:17.407916 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34e756a8-621e-47d6-a125-856c2bace775 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.393592 May 19 08:36:17.432000 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2582/3907] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:17 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:17.441671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:17.448736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:17.494777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:17.507378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:17.511663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:17.513126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:18.894575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:18.907796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6cc7ba1e-a823-4da8-bc90-9f6e6235ce39 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1329 microversion: 2.1 time: 1.474169 May 19 08:36:18.914031 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2583/3908] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:17 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1329 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:18.920232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:18.926841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:18.951094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:18.951549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:18.952362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:18.952816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:19.643736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:19.657058 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19e762a2-b1c2-49c6-94c5-470798ce4fbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.741751 May 19 08:36:19.657893 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2584/3909] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:18 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:19.697059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:19.701460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:19.742884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:19.745865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:19.746785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:19.747284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:20.367116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:20.385538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:20.390986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:20.394012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69b69bf7-3c3a-4584-9305-85482b0132c8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.734956 May 19 08:36:20.394776 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2585/3910] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:19 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:20.403387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:20.410674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] [instance: 8102b0fc-8627-4b8f-8d40-a07ec797ea8a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:20.431952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:20.432422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:20.433211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:20.433678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:20.499544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] HTTP exception thrown: Instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a could not be found. May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Request method failure captured: May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a HTTP/1.1 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEBt6CwBChGK5OCwasJlMXStTf_lZ-9aapapzghRAzkaywBbyIxnteJO6sndo-lHZtCNH8cghlFDe41r64zHxEb4DYChkWhu3GFxRbB3BdQ9-bcoG3LC48oiicfZlVy6uSy2LzMq0JfP2I3F01cziVNH_pi0baCDAOJ3nWE-_C4Ios May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 36560e910bfe4df291ec1c6533ddecc7 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/36560e910bfe4df291ec1c6533ddecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 36560e910bfe4df291ec1c6533ddecc7 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1101156688 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ListServerFiltersTestJSON-1101156688-project May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0a4cf9029e4242b794a6b3eaef958dc5 May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ListServerFiltersTestJSON-1101156688-project May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a could not be found. May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8102b0fc-8627-4b8f-8d40-a07ec797ea8a'} May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a could not be found. May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a could not be found. May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:20.506140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a could not be found. May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] Returning 404 to user: Instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:20.509513 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4ade178-05ad-4b5e-b8ab-1aac54b6181f tempest-ListServerFiltersTestJSON-1101156688 tempest-ListServerFiltersTestJSON-1101156688-project] 10.222.0.78 "GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a" status: 404 len: 111 microversion: 2.1 time: 0.108757 May 19 08:36:20.521451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2586/3911] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:20 2022] GET /compute/v2.1/servers/8102b0fc-8627-4b8f-8d40-a07ec797ea8a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:20.922680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25b0c35c-e9d0-4f82-8472-33cce9f3c7ab tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Action: 'create', calling method: .version_select at 0x7f3212167ee0>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:28.141023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25b0c35c-e9d0-4f82-8472-33cce9f3c7ab tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.618345 May 19 08:36:28.142295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2587/3912] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:36:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:28.148976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-01a6728f-9e74-4523-a84f-0ed2421c2060 req-972880b1-ab33-4091-83b7-2e2b2ddc0e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8102b0fc-8627-4b8f-8d40-a07ec797ea8a", "name": "network-vif-deleted", "tag": "b3e36e73-ab8a-424c-9428-5965d12b709d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:28.157780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-01a6728f-9e74-4523-a84f-0ed2421c2060 req-972880b1-ab33-4091-83b7-2e2b2ddc0e64 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:28.158316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-01a6728f-9e74-4523-a84f-0ed2421c2060 req-972880b1-ab33-4091-83b7-2e2b2ddc0e64 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:28.175839 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-01a6728f-9e74-4523-a84f-0ed2421c2060 req-972880b1-ab33-4091-83b7-2e2b2ddc0e64 service nova] Creating event network-vif-deleted:b3e36e73-ab8a-424c-9428-5965d12b709d for instance 8102b0fc-8627-4b8f-8d40-a07ec797ea8a on chh2-842464-2 May 19 08:36:28.183181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-01a6728f-9e74-4523-a84f-0ed2421c2060 req-972880b1-ab33-4091-83b7-2e2b2ddc0e64 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039304 May 19 08:36:28.190719 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2588/3913] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:28.196410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c638139-2cd0-4390-81ee-8082be957f8c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:28.199665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c638139-2cd0-4390-81ee-8082be957f8c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 058184e6-5909-4f70-9eea-0ca772c98a3f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:28.212634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6c638139-2cd0-4390-81ee-8082be957f8c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 058184e6-5909-4f70-9eea-0ca772c98a3f could not be found. May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c638139-2cd0-4390-81ee-8082be957f8c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/058184e6-5909-4f70-9eea-0ca772c98a3f HTTP/1.1 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 058184e6-5909-4f70-9eea-0ca772c98a3f could not be found. May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '058184e6-5909-4f70-9eea-0ca772c98a3f'} May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 058184e6-5909-4f70-9eea-0ca772c98a3f could not be found. May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 058184e6-5909-4f70-9eea-0ca772c98a3f could not be found. May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:28.220455 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 058184e6-5909-4f70-9eea-0ca772c98a3f could not be found. May 19 08:36:28.223809 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:28.229572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c638139-2cd0-4390-81ee-8082be957f8c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 058184e6-5909-4f70-9eea-0ca772c98a3f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:28.230988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c638139-2cd0-4390-81ee-8082be957f8c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "DELETE /compute/v2.1/servers/058184e6-5909-4f70-9eea-0ca772c98a3f" status: 404 len: 111 microversion: 2.1 time: 0.038836 May 19 08:36:28.242856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2589/3914] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:36:28 2022] DELETE /compute/v2.1/servers/058184e6-5909-4f70-9eea-0ca772c98a3f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:28.248679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:28.250190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:28.257681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:28.258131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:28.258966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:28.259406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:28.540994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:28.550634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af15d2e9-634c-4311-84d7-a5657aaa01cd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1329 microversion: 2.1 time: 0.305718 May 19 08:36:28.551236 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2590/3915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:28 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1329 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:28.556911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:28.557954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:28.570273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:28.570649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:28.572946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:28.573807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:28.816510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:28.828395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:28.831438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:28.833963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8c1bb3e-a18d-4445-bde5-1601902093b8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.281567 May 19 08:36:28.846674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2591/3916] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:28 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:28.852648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f3e93cbd-8ec1-4e00-a945-5673596429bd req-07fe339c-affb-44cc-b025-a8bab6d6cc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5470bba9-72f6-47d6-a99f-d95406958a0c", "name": "network-vif-plugged", "status": "completed", "tag": "985186d9-6551-4620-93e7-b0c8caa6ed01"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:28.862749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f3e93cbd-8ec1-4e00-a945-5673596429bd req-07fe339c-affb-44cc-b025-a8bab6d6cc71 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:28.863449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f3e93cbd-8ec1-4e00-a945-5673596429bd req-07fe339c-affb-44cc-b025-a8bab6d6cc71 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:28.879263 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f3e93cbd-8ec1-4e00-a945-5673596429bd req-07fe339c-affb-44cc-b025-a8bab6d6cc71 service nova] Creating event network-vif-plugged:985186d9-6551-4620-93e7-b0c8caa6ed01 for instance 5470bba9-72f6-47d6-a99f-d95406958a0c on chh1-842464-2 May 19 08:36:28.888099 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f3e93cbd-8ec1-4e00-a945-5673596429bd req-07fe339c-affb-44cc-b025-a8bab6d6cc71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038316 May 19 08:36:28.889701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2592/3917] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:28.895824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2340a99-8436-4744-b246-a8d10ed0ad62 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Action: 'create', calling method: .version_select at 0x7f32119b8430>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:30.998080 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2340a99-8436-4744-b246-a8d10ed0ad62 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.104890 May 19 08:36:31.001749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2593/3918] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:36:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:31.379264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-816920519", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": "none"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:31.453559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:36:31.453559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:36:31.453559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:36:31.453559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:36:31.453559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:36:31.462517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:31.462981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:31.463942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:31.464391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:31.484600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Getting quotas for project 3fb2864bea63453580b34b04e4a765b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:31.490922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Getting quotas for user 4aaab5e1976c42d69e35106e35a97e4b and project 3fb2864bea63453580b34b04e4a765b5. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:31.506481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:36:31.509938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:36:31.572455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f32e46a4-8887-4935-ab8d-d397f469d036 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.569453 May 19 08:36:31.583976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2594/3919] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:36:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:36:31.596923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:31.601507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:31.614884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:31.616609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:31.617763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:31.618551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:31.877596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:31.895689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3e7d766-8b0a-4578-b9a9-6f2d6e3240e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.309865 May 19 08:36:31.896714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2595/3920] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:31 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:31.921240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:31.922235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:31.944433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:31.947452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:31.953229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:31.956187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:32.311450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:32.337783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce5e72da-52eb-446e-b584-b112d62524a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1510 microversion: 2.1 time: 0.438718 May 19 08:36:32.342554 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2596/3921] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:31 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:32.359962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:32.361195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:32.386641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:32.387462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:32.388500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:32.390643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:32.688333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:32.728776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:32.730544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:32.732293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffdcaef7-ef39-47b0-b381-04071fdfb309 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.387733 May 19 08:36:32.733699 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2597/3922] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:32 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:32.739097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b20653e-f040-44b3-90e1-ed9efbf5b644 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Action: 'create', calling method: .version_select at 0x7f3211d92f70>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:35.865551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b20653e-f040-44b3-90e1-ed9efbf5b644 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.130406 May 19 08:36:35.867346 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2598/3923] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:36:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:35.874092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:35.874906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:35.894952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:35.897870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:35.899052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:35.899963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:35.917905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:36.074332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:36.088992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:36.090761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:36.091996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab83b888-c33c-4bec-8840-c24796f0ef91 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b" status: 200 len: 1338 microversion: 2.47 time: 0.222855 May 19 08:36:36.096626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2599/3924] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:35 2022] GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b => generated 1338 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:36.101550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:36.102169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:36.126906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:36.129382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:36.130265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:36.130716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:36.379652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:36.390895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53dbc99e-90b1-48ca-a5d7-0c1e81f1a518 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.292751 May 19 08:36:36.392087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2600/3925] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:36 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:36.397190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:36.398235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:36.405976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:36.409863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:36.411133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:36.411768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:36.617764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:36.629153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf66401e-5d15-4b8f-b453-6da54e06ad9c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1510 microversion: 2.1 time: 0.235410 May 19 08:36:36.642574 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2601/3926] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:36 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:36.656306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:36.657410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:36.667725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:36.668550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:36.669636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:36.670225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:36.999063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:37.016223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:37.017891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:37.019142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd39dc8c-a766-4f21-81e3-b99f6fca3026 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.375270 May 19 08:36:37.020135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2602/3927] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:36 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:37.029475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0c7d28d-69c4-4b59-935e-4c53a3a7d3c3 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Action: 'create', calling method: .version_select at 0x7f321120d670>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:38.690644 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0c7d28d-69c4-4b59-935e-4c53a3a7d3c3 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.669277 May 19 08:36:38.691532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2603/3928] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:36:37 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:38.697396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a24181dc-9183-47e8-a51f-a9093073acbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:38.698043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a24181dc-9183-47e8-a51f-a9093073acbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:36:38.698785 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a24181dc-9183-47e8-a51f-a9093073acbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a24181dc-9183-47e8-a51f-a9093073acbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9223372036854775808 could not be found. May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9223372036854775808'} May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:38.700275 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a24181dc-9183-47e8-a51f-a9093073acbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a24181dc-9183-47e8-a51f-a9093073acbb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008218 May 19 08:36:38.708318 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2604/3929] 10.222.0.78 () {58 vars in 1187 bytes} [Thu May 19 08:36:38 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:36:38.708958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:38.709341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:38.716363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:38.716868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:38.717707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:38.718142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:38.748240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:36:38.856109 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4083d378-07d5-45bf-b9a9-6926bf75562d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 204 len: 0 microversion: 2.1 time: 0.152192 May 19 08:36:38.856718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2605/3930] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:36:38 2022] DELETE /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:36:38.863172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:38.863947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:38.871357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:38.871894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:38.872770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:38.873213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:38.958151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:38.967193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:38.968850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:38.970144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80613bb4-435d-4468-a030-027e3152310c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b" status: 200 len: 1359 microversion: 2.47 time: 0.111665 May 19 08:36:38.970718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2606/3931] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:38 2022] GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b => generated 1359 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:39.097499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c8afbdb-4293-4a54-9682-90c431ee269a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Action: 'create', calling method: .version_select at 0x7f32119b8ee0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-207141368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFftjapY0zBeYeO9Hg/VN3hdOl98mrLgwMjocy+Int4ntfAwiAVvGfdPoOWhyJYW3au5mRRxUVErWBru6lbE8PAzm9Zb7TLUaE4OlSsiq1eM8rdGqSes+Ql4JMQBhtEE2Q=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:39.112960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5c8afbdb-4293-4a54-9682-90c431ee269a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Getting quotas for project 9b787317040f45919dfe88c57a9c8c54. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:39.119806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5c8afbdb-4293-4a54-9682-90c431ee269a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Getting quotas for user 7109e0e5f69c431eaf502a01c0881319 and project 9b787317040f45919dfe88c57a9c8c54. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:39.147740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c8afbdb-4293-4a54-9682-90c431ee269a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.175959 May 19 08:36:39.148544 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2607/3932] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:36:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:39.162988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:39.163627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:39.178228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:39.182789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:39.183820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:39.184557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:39.389079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:39.402299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:39.406540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:39.407941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f4bd650-795f-4051-b674-c3ca8f5baf1a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.258445 May 19 08:36:39.408773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2608/3933] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:39 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:39.431055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8e3b00d-d300-4b46-b6ae-e7491e13f391 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f32119b8f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:39.659623 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8e3b00d-d300-4b46-b6ae-e7491e13f391 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/5e98287b-1f16-470c-8bc5-096b951dbefd" status: 200 len: 141 microversion: 2.1 time: 0.239612 May 19 08:36:39.660664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2609/3934] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:36:39 2022] GET /compute/v2.1/os-floating-ips/5e98287b-1f16-470c-8bc5-096b951dbefd => generated 141 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:39.667115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:39.668757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:39.676670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:39.677246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:39.678179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:39.678702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:39.897350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:39.909479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c95789c-9bd0-434a-9ac9-786a6b85b9c0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.246731 May 19 08:36:39.910245 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2610/3935] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:39 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:39.916080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:39.917110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:39.928953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:39.930394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:39.931417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:39.932248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:40.318564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:40.335339 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-021076ba-bdf7-4dcd-bfe7-ea79ee8bffdf tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 200 len: 1516 microversion: 2.1 time: 0.420610 May 19 08:36:40.335976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2611/3936] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:39 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 1516 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:40.356519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1670778417"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:40.356519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:40.377161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:40.378294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:40.381490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:40.382106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:40.986309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ba99262-5f14-4672-b382-4fae4578011e tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "POST /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b/action" status: 202 len: 52 microversion: 2.47 time: 0.649035 May 19 08:36:40.992706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2612/3937] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:36:40 2022] POST /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b/action => generated 52 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 19 08:36:40.998629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a0748251-df52-4cb5-86be-18deeb53466a req-1fbfd269-fa95-4ded-a00c-3b0f04a4a19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "name": "network-vif-plugged", "status": "completed", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:41.025771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a0748251-df52-4cb5-86be-18deeb53466a req-1fbfd269-fa95-4ded-a00c-3b0f04a4a19b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:41.026965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a0748251-df52-4cb5-86be-18deeb53466a req-1fbfd269-fa95-4ded-a00c-3b0f04a4a19b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:41.049976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a0748251-df52-4cb5-86be-18deeb53466a req-1fbfd269-fa95-4ded-a00c-3b0f04a4a19b service nova] Creating event network-vif-plugged:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:36:41.077771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a0748251-df52-4cb5-86be-18deeb53466a req-1fbfd269-fa95-4ded-a00c-3b0f04a4a19b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082934 May 19 08:36:41.085014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2613/3938] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:41.104437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ae52c85-c268-4fda-b2a8-27471387204b tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f32121f6040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:41.473726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:43.576864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ae52c85-c268-4fda-b2a8-27471387204b tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/5e98287b-1f16-470c-8bc5-096b951dbefd" status: 202 len: 0 microversion: 2.1 time: 2.490194 May 19 08:36:43.592177 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2614/3939] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:36:41 2022] DELETE /compute/v2.1/os-floating-ips/5e98287b-1f16-470c-8bc5-096b951dbefd => generated 0 bytes in 2506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:36:43.608944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:43.611306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:43.643925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:43.644488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:43.646645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:43.648233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:43.882457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:43.896942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-782a5acf-7491-45bc-ae4d-115dd55ea22f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.300469 May 19 08:36:43.908517 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2615/3940] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:43 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:43.913918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:43.920240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:43.986453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:43.986918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:43.987787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:43.989994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:44.295853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:44.307793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:44.310630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:44.312746 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da9e926d-fae4-4ca9-a0ee-b939416bdbb0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1807 microversion: 2.20 time: 0.402772 May 19 08:36:44.326761 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2616/3941] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:43 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1807 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:44.333732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:44.334344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:44.342129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:44.342691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:44.343557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:44.344006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:44.377262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:36:44.411755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:44.520310 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d4c23af-7ee2-4d8b-b5de-469ff40adf97 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b" status: 204 len: 0 microversion: 2.47 time: 0.189403 May 19 08:36:44.523367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2617/3942] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:36:44 2022] DELETE /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:36:44.531729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:44.532896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:44.536401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:44.547637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:44.548564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:44.549590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:44.550182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:44.572023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c HTTP/1.1 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5470bba9-72f6-47d6-a99f-d95406958a0c'} May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:44.574589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:44.578291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:44.578291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:44.578291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:44.578291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:44.578291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:36:44.578291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:44.580695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:44.582231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-002085a2-9855-476b-9af7-be1724cf91a1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 404 len: 111 microversion: 2.1 time: 0.056871 May 19 08:36:44.583489 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2618/3943] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:44 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:44.589069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-669faccc-87e7-4357-9d63-57702ab54274 req-872b5543-fcab-4c4f-9829-0250f01648f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5470bba9-72f6-47d6-a99f-d95406958a0c", "name": "network-vif-deleted", "tag": "985186d9-6551-4620-93e7-b0c8caa6ed01"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:44.599705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-669faccc-87e7-4357-9d63-57702ab54274 req-872b5543-fcab-4c4f-9829-0250f01648f7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:44.600410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-669faccc-87e7-4357-9d63-57702ab54274 req-872b5543-fcab-4c4f-9829-0250f01648f7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:44.615567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-669faccc-87e7-4357-9d63-57702ab54274 req-872b5543-fcab-4c4f-9829-0250f01648f7 service nova] Creating event network-vif-deleted:985186d9-6551-4620-93e7-b0c8caa6ed01 for instance 5470bba9-72f6-47d6-a99f-d95406958a0c on chh1-842464-2 May 19 08:36:44.629386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-669faccc-87e7-4357-9d63-57702ab54274 req-872b5543-fcab-4c4f-9829-0250f01648f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044040 May 19 08:36:44.630630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2619/3944] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:44.636715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1412802383", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-207141368", "security_groups": [{"name": "tempest-secgroup-smoke-1765559554"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a89c8585-76f6-4ec8-9abc-7e6bc543468b"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:44.857676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] validate_networks() for [('a89c8585-76f6-4ec8-9abc-7e6bc543468b', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:36:45.324640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Getting quotas for project 9b787317040f45919dfe88c57a9c8c54. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:45.330317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Getting quotas for user 7109e0e5f69c431eaf502a01c0881319 and project 9b787317040f45919dfe88c57a9c8c54. Resources: dict_keys(['metadata_items']) {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:45.344500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:36:45.344940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:36:45.345467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:36:45.345877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:36:45.346288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:36:45.357064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:45.357541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:45.358341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:45.358778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:45.379585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Getting quotas for project 9b787317040f45919dfe88c57a9c8c54. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:45.385392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Getting quotas for user 7109e0e5f69c431eaf502a01c0881319 and project 9b787317040f45919dfe88c57a9c8c54. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:45.399598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:36:45.402426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:36:45.451814 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dca0c288-081e-408a-b0b8-4466778038fd tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.819710 May 19 08:36:45.452798 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2620/3945] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:36:45.462773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e08a7365-fa94-4278-bcc0-1d4d767d5022 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f32121f68b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:45.762181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e08a7365-fa94-4278-bcc0-1d4d767d5022 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.307205 May 19 08:36:45.763665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2621/3946] 10.222.0.78 () {58 vars in 1163 bytes} [Thu May 19 08:36:45 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:36:45.772627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-076565f8-99a6-4c28-8841-40cbeb0c41f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:45.773630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-076565f8-99a6-4c28-8841-40cbeb0c41f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Failed to fetch instance by id -1 {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2926}} May 19 08:36:45.777806 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-076565f8-99a6-4c28-8841-40cbeb0c41f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance -1 could not be found. May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-076565f8-99a6-4c28-8841-40cbeb0c41f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance -1 could not be found. May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '-1'} May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:45.779917 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:45.783349 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:45.783349 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:45.783349 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 19 08:36:45.783349 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:45.783349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-076565f8-99a6-4c28-8841-40cbeb0c41f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:45.783349 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-076565f8-99a6-4c28-8841-40cbeb0c41f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017533 May 19 08:36:45.783685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2622/3947] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:36:45 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:36:45.793236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:45.794243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:45.802572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:45.803020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:45.803800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:45.804236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:45.897272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:45.911831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:45.914148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4aaab5e1976c42d69e35106e35a97e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb2864bea63453580b34b04e4a765b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:45.917033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3508cc6-3383-4782-898a-407693d275b7 tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b" status: 200 len: 1365 microversion: 2.47 time: 0.128781 May 19 08:36:45.918038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2623/3948] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:45 2022] GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:45.934359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0ad51fc-73c8-49b0-85ba-384ef5cabb3a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '.version_select at 0x7f321120d4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:45.960836 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0ad51fc-73c8-49b0-85ba-384ef5cabb3a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-key-1372422045" status: 202 len: 0 microversion: 2.1 time: 0.040413 May 19 08:36:45.972201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2624/3949] 10.222.0.78 () {58 vars in 1208 bytes} [Thu May 19 08:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1372422045 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:36:45.983233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:45.983666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:45.991266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:45.991726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:45.992517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:45.992992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:46.269917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:46.284175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:46.286509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:46.290684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0159da6-63b3-46de-970b-c574221f229e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1794 microversion: 2.20 time: 0.325334 May 19 08:36:46.313293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2625/3950] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:45 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1794 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:36:46.322288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:46.323695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:46.333165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:46.334306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:46.335379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:46.335902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:46.449060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:46.458137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afb739ad-2333-4422-a423-913959e4474a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1306 microversion: 2.1 time: 0.142350 May 19 08:36:46.459764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2626/3951] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:46 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:46.466243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2503e806-d2f4-4487-a64d-c754e95c1f8e tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f321120d430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:46.738023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2503e806-d2f4-4487-a64d-c754e95c1f8e tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.276997 May 19 08:36:46.738626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2627/3952] 10.222.0.78 () {58 vars in 1148 bytes} [Thu May 19 08:36:46 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:46.743753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:46.744845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:46.752827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:46.753294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:46.754131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:46.754577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:46.907793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:46.916190 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-09142470-4372-402f-a060-08fac3e977d9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.176460 May 19 08:36:46.917019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2628/3953] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:46 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:46.933430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-412024215", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:47.012386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:36:47.220417 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:36:47.220988 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:36:47.602876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:36:47.603319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:36:47.603893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:36:47.604306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:36:47.604721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:36:47.613779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:47.614449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:47.615256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:47.615697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:47.633087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:47.639413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:47.653168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:36:47.655405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:36:47.702960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfcee49a-7b0b-412c-bc2f-8992280fb5d7 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774358 May 19 08:36:47.704235 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2629/3954] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:36:47.872145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1961098030", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "02407c28-0f26-4d88-8a2d-c868eaba6b29"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:47.937198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] validate_networks() for [('02407c28-0f26-4d88-8a2d-c868eaba6b29', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:36:48.552355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:36:48.552789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:36:48.553272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:36:48.553718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:36:48.554141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:36:48.564322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:48.564784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:48.565644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:48.566087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:48.585726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Getting quotas for project 5703a409e8724b779bc091f2063b817e. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:48.591791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Getting quotas for user 0f34dfe6e96443c496218b2944fdf38b and project 5703a409e8724b779bc091f2063b817e. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:48.605195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:36:48.607398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:36:48.678651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c265e13-9245-456f-a7f7-aeae5bb33968 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955461 May 19 08:36:48.680962 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2630/3955] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:36:48.688521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-797004ea-06c3-41d3-837f-d175138d2296 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f3211ef6ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:51.030875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-797004ea-06c3-41d3-837f-d175138d2296 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/7d8a5478-d661-4460-bec9-0a274f54c94f" status: 202 len: 0 microversion: 2.1 time: 2.347015 May 19 08:36:51.032917 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2631/3956] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:36:48 2022] DELETE /compute/v2.1/os-floating-ips/7d8a5478-d661-4460-bec9-0a274f54c94f => generated 0 bytes in 2351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:36:51.040482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:51.042246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:51.062003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:51.074967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:51.076125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:51.076737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:51.448261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:51.464841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49f1d6e6-ccec-4643-806b-bcadf5875981 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.430559 May 19 08:36:51.465477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2632/3957] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:51 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:51.471289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:51.472207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] [instance: 95623417-cc7b-4925-b1b3-78760c2feb7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:51.480818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:51.481587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:51.482539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:51.483238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:51.513559 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] HTTP exception thrown: Instance 95623417-cc7b-4925-b1b3-78760c2feb7b could not be found. May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Request method failure captured: May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b HTTP/1.1 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGMhG3FCHAyf1bLf-p5_SO3dhan2fyEvkQvn5OsAIVFLzUlQ_AIF4pdCzQo1qVqXOBUxDqXVYoVVnhcvfflJiV50PkQZk0Jaz6CCm2ystlkuHlvAdUWiUFoJRY4Am9HxAwWxOp9D6Vcr-Yisf3UiI0Wp8E_MGme4_ZJDwEggiWNvNI May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.47 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 3fb2864bea63453580b34b04e4a765b5 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAaction247Test-1482030164 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3fb2864bea63453580b34b04e4a765b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3fb2864bea63453580b34b04e4a765b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3fb2864bea63453580b34b04e4a765b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3fb2864bea63453580b34b04e4a765b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAaction247Test-1482030164 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 3fb2864bea63453580b34b04e4a765b5 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAaction247Test-1482030164 May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAaction247Test-1482030164-project May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 4aaab5e1976c42d69e35106e35a97e4b May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAaction247Test-1482030164-project May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 95623417-cc7b-4925-b1b3-78760c2feb7b could not be found. May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '95623417-cc7b-4925-b1b3-78760c2feb7b'} May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95623417-cc7b-4925-b1b3-78760c2feb7b could not be found. May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95623417-cc7b-4925-b1b3-78760c2feb7b could not be found. May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:51.515688 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95623417-cc7b-4925-b1b3-78760c2feb7b could not be found. May 19 08:36:51.519186 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:51.523885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] Returning 404 to user: Instance 95623417-cc7b-4925-b1b3-78760c2feb7b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:51.525916 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53c41d4f-5d7c-4e49-9efa-7a15f44d955c tempest-ServersAaction247Test-1482030164 tempest-ServersAaction247Test-1482030164-project] 10.222.0.78 "GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b" status: 404 len: 111 microversion: 2.47 time: 0.059086 May 19 08:36:51.529493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2633/3958] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:36:51 2022] GET /compute/v2.1/servers/95623417-cc7b-4925-b1b3-78760c2feb7b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:36:51.533155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:51.533830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:51.548350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:51.550274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:51.551986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:51.552924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:52.038138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:52.055179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e486aef0-fe63-4ffc-b483-210fa14ea355 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1428 microversion: 2.1 time: 0.526806 May 19 08:36:52.056260 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2634/3959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:51 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1428 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:52.061620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:52.062520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:52.070513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:52.071219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:52.073831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:52.074596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:52.374647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:52.382667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-29adf856-1c0d-4244-8dd0-ed413ed69667 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1308 microversion: 2.1 time: 0.325157 May 19 08:36:52.384092 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2635/3960] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:52 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:52.390907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:52.391621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:52.398454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:52.399028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:52.399885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:52.400394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:52.668408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:52.677694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc30054d-d954-4116-82c6-2bf30fd241e7 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1314 microversion: 2.1 time: 0.292066 May 19 08:36:52.689497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2636/3961] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:52 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:52.693913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-900e763f-b435-47f7-9828-786da53b2a40 req-2943176c-85eb-461d-8c11-798b8ae1f6ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06abe74-2b86-4b72-986c-63ff3e4f7960", "tag": "4bae762b-ae85-4613-bd9a-b5116343346b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:52.707313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-900e763f-b435-47f7-9828-786da53b2a40 req-2943176c-85eb-461d-8c11-798b8ae1f6ce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:52.707954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-900e763f-b435-47f7-9828-786da53b2a40 req-2943176c-85eb-461d-8c11-798b8ae1f6ce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:52.723507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-900e763f-b435-47f7-9828-786da53b2a40 req-2943176c-85eb-461d-8c11-798b8ae1f6ce service nova] Creating event network-changed:4bae762b-ae85-4613-bd9a-b5116343346b for instance d06abe74-2b86-4b72-986c-63ff3e4f7960 on chh1-842464-2 May 19 08:36:52.731507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-900e763f-b435-47f7-9828-786da53b2a40 req-2943176c-85eb-461d-8c11-798b8ae1f6ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051352 May 19 08:36:52.732210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2637/3962] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:52.737466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-119be0d0-e701-491e-a6b3-b3df3a0d3bfb tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f32119b84c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:53.589723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-119be0d0-e701-491e-a6b3-b3df3a0d3bfb tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/1b9cf04f-6b62-4337-9208-11346902c96c" status: 202 len: 0 microversion: 2.1 time: 0.856199 May 19 08:36:53.594157 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2638/3963] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:36:52 2022] DELETE /compute/v2.1/os-floating-ips/1b9cf04f-6b62-4337-9208-11346902c96c => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:36:53.597111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4c3bcfa-7608-49f6-bbc6-8ee453f4f29e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:53.597941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4c3bcfa-7608-49f6-bbc6-8ee453f4f29e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 121a3949-3128-4200-90df-e1cff452cf7b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:53.604489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d4c3bcfa-7608-49f6-bbc6-8ee453f4f29e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 121a3949-3128-4200-90df-e1cff452cf7b could not be found. May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4c3bcfa-7608-49f6-bbc6-8ee453f4f29e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/121a3949-3128-4200-90df-e1cff452cf7b/action HTTP/1.1 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 19 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: {"forceDelete": {}} May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 121a3949-3128-4200-90df-e1cff452cf7b could not be found. May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '121a3949-3128-4200-90df-e1cff452cf7b', 'body': {'forceDelete': {}}} May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121a3949-3128-4200-90df-e1cff452cf7b could not be found. May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121a3949-3128-4200-90df-e1cff452cf7b could not be found. May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:53.609287 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121a3949-3128-4200-90df-e1cff452cf7b could not be found. May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4c3bcfa-7608-49f6-bbc6-8ee453f4f29e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 121a3949-3128-4200-90df-e1cff452cf7b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4c3bcfa-7608-49f6-bbc6-8ee453f4f29e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/121a3949-3128-4200-90df-e1cff452cf7b/action" status: 404 len: 111 microversion: 2.1 time: 0.018361 May 19 08:36:53.617252 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2639/3964] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:36:53 2022] POST /compute/v2.1/servers/121a3949-3128-4200-90df-e1cff452cf7b/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:53.621543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f72c6886-73ca-430b-954f-e1782ca59841 req-6f42f68e-32b9-4851-bad9-ac770b5894a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc874094-e6ed-4357-818b-7dfac14af413", "tag": "d27f112d-1226-4f7e-81a8-67d4b2926f3d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:53.630268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f72c6886-73ca-430b-954f-e1782ca59841 req-6f42f68e-32b9-4851-bad9-ac770b5894a7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:53.630863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f72c6886-73ca-430b-954f-e1782ca59841 req-6f42f68e-32b9-4851-bad9-ac770b5894a7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:53.645685 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f72c6886-73ca-430b-954f-e1782ca59841 req-6f42f68e-32b9-4851-bad9-ac770b5894a7 service nova] Creating event network-changed:d27f112d-1226-4f7e-81a8-67d4b2926f3d for instance cc874094-e6ed-4357-818b-7dfac14af413 on chh1-842464-2 May 19 08:36:53.651292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f72c6886-73ca-430b-954f-e1782ca59841 req-6f42f68e-32b9-4851-bad9-ac770b5894a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038770 May 19 08:36:53.651944 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2640/3965] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:53.657043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:53.657780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:53.664280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:53.664907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:53.665754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:53.666192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:53.843698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:53.858101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a4d7709-80f8-4891-ad46-2034e21627e9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1428 microversion: 2.1 time: 0.204940 May 19 08:36:53.858716 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2641/3966] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:53 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1428 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:53.864878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:53.865870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:53.878439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:53.879094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:53.880148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:53.880574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:54.178778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:54.187902 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c2e3e6d-af13-47e4-9e3f-d17f12878097 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1308 microversion: 2.1 time: 0.327826 May 19 08:36:54.189599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2642/3967] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:53 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:54.195223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60668dec-7d10-479e-9d6e-c6ae7aad9729 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] Calling method '.version_select at 0x7f3211ce08b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:55.548075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60668dec-7d10-479e-9d6e-c6ae7aad9729 tempest-FloatingIPDetailsTestJSON-528282020 tempest-FloatingIPDetailsTestJSON-528282020-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/45c651c1-71c1-4b9e-bd77-963340a5d44d" status: 202 len: 0 microversion: 2.1 time: 1.356847 May 19 08:36:55.548950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2643/3968] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:36:54 2022] DELETE /compute/v2.1/os-floating-ips/45c651c1-71c1-4b9e-bd77-963340a5d44d => generated 0 bytes in 1359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:36:55.554431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:55.555165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:55.565219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:55.566062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:55.567095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:55.567659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:55.939406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:55.978340 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71c8981b-e0c8-4017-9983-32c66312d923 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.424533 May 19 08:36:55.993925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2644/3969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:55 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:56.001756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:56.004633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:56.014584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:56.015506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:56.016940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:56.018578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:56.300747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:56.315807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-395e55df-178a-4746-8bfa-374fcd0e83f2 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1314 microversion: 2.1 time: 0.320359 May 19 08:36:56.316417 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2645/3970] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:55 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:56.330423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ccec0d60-e2d7-42c2-9604-8387624cfcdf req-91b4798b-90df-44de-aec5-97d320a74461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8105472-c446-4604-9a41-b4a40bdcc14f", "tag": "6d52f1fc-a0bc-48a6-b739-b4b7f9c01d84"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:56.349469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ccec0d60-e2d7-42c2-9604-8387624cfcdf req-91b4798b-90df-44de-aec5-97d320a74461 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:56.349937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ccec0d60-e2d7-42c2-9604-8387624cfcdf req-91b4798b-90df-44de-aec5-97d320a74461 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:56.386142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ccec0d60-e2d7-42c2-9604-8387624cfcdf req-91b4798b-90df-44de-aec5-97d320a74461 service nova] Creating event network-changed:6d52f1fc-a0bc-48a6-b739-b4b7f9c01d84 for instance b8105472-c446-4604-9a41-b4a40bdcc14f on chh1-842464-2 May 19 08:36:56.394455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ccec0d60-e2d7-42c2-9604-8387624cfcdf req-91b4798b-90df-44de-aec5-97d320a74461 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067093 May 19 08:36:56.396164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2646/3971] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:56.422560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:56.423588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:56.434240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:56.437678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:56.438180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:56.439219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:56.439679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:56.547690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:56.971293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:56.982029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b2a41d5-7095-4dd6-81ce-8dff1029da56 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1428 microversion: 2.1 time: 0.583741 May 19 08:36:56.982777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2647/3972] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:56 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1428 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:56.997195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:56.998246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:57.005280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:57.005851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:57.007533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:57.008503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:57.579689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:57.590829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d86022c4-d588-4cfc-a115-3f48ab1dbdfa tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1308 microversion: 2.1 time: 0.606714 May 19 08:36:57.591443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2648/3973] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:56 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:57.598314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:57.599221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:57.611157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:57.611623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:57.612637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:57.613238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:57.882881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:57.893359 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-528137e4-36c9-4ecc-b61a-eb5d11406445 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.300003 May 19 08:36:57.894189 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2649/3974] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:57 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:58.074154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-628572847", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "7d665246-6193-4cba-8247-b1af995eac62"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:58.151326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] validate_networks() for [('7d665246-6193-4cba-8247-b1af995eac62', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:36:58.575191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:58.599965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=32 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:36:58.817234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:36:58.817980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:36:58.818566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:36:58.819053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:36:58.819545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:36:58.832202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:58.832890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:58.834878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:58.835724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:58.859402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Getting quotas for project 8ca1fe796a8d444088345ee1fceaf525. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:36:58.865706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Getting quotas for user b5281a62235c407baefe87936dd6283a and project 8ca1fe796a8d444088345ee1fceaf525. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:36:58.881413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:36:58.884643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:36:58.934197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f680dd7-5224-40aa-ab6d-911d2fddf936 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035320 May 19 08:36:58.935150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2650/3975] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:36:58.941976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:58.942848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:58.951912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:58.952649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:58.953793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:58.954396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:59.195492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:59.204829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-421e4be9-c133-4c43-923f-e06243ae5b6f tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1314 microversion: 2.1 time: 0.268470 May 19 08:36:59.205822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2651/3976] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:58 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:59.335473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-faa26e57-27c0-42a0-8aed-2cdf951d4fec req-1c2b493f-bea7-459b-b49e-d1ad44faa6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06abe74-2b86-4b72-986c-63ff3e4f7960", "name": "network-vif-plugged", "status": "completed", "tag": "4bae762b-ae85-4613-bd9a-b5116343346b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:59.344758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-faa26e57-27c0-42a0-8aed-2cdf951d4fec req-1c2b493f-bea7-459b-b49e-d1ad44faa6aa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:59.345216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-faa26e57-27c0-42a0-8aed-2cdf951d4fec req-1c2b493f-bea7-459b-b49e-d1ad44faa6aa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:59.360048 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-faa26e57-27c0-42a0-8aed-2cdf951d4fec req-1c2b493f-bea7-459b-b49e-d1ad44faa6aa service nova] Creating event network-vif-plugged:4bae762b-ae85-4613-bd9a-b5116343346b for instance d06abe74-2b86-4b72-986c-63ff3e4f7960 on chh1-842464-2 May 19 08:36:59.368582 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-faa26e57-27c0-42a0-8aed-2cdf951d4fec req-1c2b493f-bea7-459b-b49e-d1ad44faa6aa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149324 May 19 08:36:59.373667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2652/3977] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:36:59.380655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19df3919-6c4c-4dae-a637-476d6d97b427 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:36:59.382053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19df3919-6c4c-4dae-a637-476d6d97b427 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: d3ee93de-1282-4c6a-ba14-e617cd482b3d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:59.388139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-19df3919-6c4c-4dae-a637-476d6d97b427 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance d3ee93de-1282-4c6a-ba14-e617cd482b3d could not be found. May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19df3919-6c4c-4dae-a637-476d6d97b427 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/d3ee93de-1282-4c6a-ba14-e617cd482b3d/action HTTP/1.1 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 39 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: {"os-getConsoleOutput": {"length": 10}} May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d3ee93de-1282-4c6a-ba14-e617cd482b3d could not be found. May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd3ee93de-1282-4c6a-ba14-e617cd482b3d', 'body': {'os-getConsoleOutput': {'length': 10}}} May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3ee93de-1282-4c6a-ba14-e617cd482b3d could not be found. May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3ee93de-1282-4c6a-ba14-e617cd482b3d could not be found. May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:59.398382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:36:59.403973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:36:59.403973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:36:59.403973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:36:59.403973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:36:59.403973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3ee93de-1282-4c6a-ba14-e617cd482b3d could not be found. May 19 08:36:59.403973 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:36:59.405487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19df3919-6c4c-4dae-a637-476d6d97b427 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance d3ee93de-1282-4c6a-ba14-e617cd482b3d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:36:59.406664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19df3919-6c4c-4dae-a637-476d6d97b427 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/d3ee93de-1282-4c6a-ba14-e617cd482b3d/action" status: 404 len: 111 microversion: 2.1 time: 0.031578 May 19 08:36:59.410577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2653/3978] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:36:59 2022] POST /compute/v2.1/servers/d3ee93de-1282-4c6a-ba14-e617cd482b3d/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:36:59.421988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:59.424349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:59.442128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:59.442787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:59.443735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:59.444171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:59.767994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:36:59.778093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-655d3df1-4e1b-4dfa-95cb-7cc2d6449da7 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1428 microversion: 2.1 time: 0.366216 May 19 08:36:59.778693 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2654/3979] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:59 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1428 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:36:59.783643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:36:59.784319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:36:59.792710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:59.793407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:36:59.794327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:36:59.794894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:00.363283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:00.373182 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3fa5125-7775-40a1-a7ac-abfe1daf862d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1308 microversion: 2.1 time: 0.593215 May 19 08:37:00.382964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2655/3980] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:36:59 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:00.388856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:00.389507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:00.396101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:00.396557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:00.397385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:00.397828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:00.504119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:00.529626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f4d5383-140d-4f13-b545-979abb35a119 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1279 microversion: 2.1 time: 0.144873 May 19 08:37:00.530225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2656/3981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:00 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:00.536675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:00.537657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:00.544315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:00.545061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:00.545880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:00.546491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:00.815443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:00.828046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-161bd3fa-64b2-48b7-a340-e57e9cf15b13 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.292285 May 19 08:37:00.836313 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2657/3982] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:00 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:00.843726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:00.844366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:00.852795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:00.853249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:00.854131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:00.854718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:01.159327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:01.172778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc953767-411c-4817-beaf-2e3c01e5aeac tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1314 microversion: 2.1 time: 0.333207 May 19 08:37:01.178035 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2658/3983] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:00 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:01.198096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:01.202257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:01.220225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:01.221093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:01.225785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:01.228183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:01.532130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:01.544863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11c3aee1-ff61-4f90-82f4-21985ba107ad tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1607 microversion: 2.1 time: 0.365042 May 19 08:37:01.545810 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2659/3984] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:01 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1607 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:01.564753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:01.565398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:01.572997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:01.573637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:01.574630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:01.575197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:01.828545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:01.838837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b54dd4f-f3dd-4f56-b25e-4a370650d224 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.279066 May 19 08:37:01.840247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2660/3985] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:01 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:01.845164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:01.845800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:01.853122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:01.853423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:01.854272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:01.854705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.103821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:02.112144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d09b301-daf5-404c-82d5-329cd9e0f3cc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1308 microversion: 2.1 time: 0.270632 May 19 08:37:02.113042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2661/3986] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:01 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:02.131412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d0b3e48d-8474-49ff-9267-06b714fc10e4 req-93be97e3-4a03-48e1-b93e-b8da4bc26255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc874094-e6ed-4357-818b-7dfac14af413", "name": "network-vif-plugged", "status": "completed", "tag": "d27f112d-1226-4f7e-81a8-67d4b2926f3d"}, {"server_uuid": "b8105472-c446-4604-9a41-b4a40bdcc14f", "name": "network-vif-plugged", "status": "completed", "tag": "6d52f1fc-a0bc-48a6-b739-b4b7f9c01d84"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:02.141128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0b3e48d-8474-49ff-9267-06b714fc10e4 req-93be97e3-4a03-48e1-b93e-b8da4bc26255 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.141611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0b3e48d-8474-49ff-9267-06b714fc10e4 req-93be97e3-4a03-48e1-b93e-b8da4bc26255 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.155492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d0b3e48d-8474-49ff-9267-06b714fc10e4 req-93be97e3-4a03-48e1-b93e-b8da4bc26255 service nova] Creating event network-vif-plugged:d27f112d-1226-4f7e-81a8-67d4b2926f3d for instance cc874094-e6ed-4357-818b-7dfac14af413 on chh1-842464-2 May 19 08:37:02.156037 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d0b3e48d-8474-49ff-9267-06b714fc10e4 req-93be97e3-4a03-48e1-b93e-b8da4bc26255 service nova] Creating event network-vif-plugged:6d52f1fc-a0bc-48a6-b739-b4b7f9c01d84 for instance b8105472-c446-4604-9a41-b4a40bdcc14f on chh1-842464-2 May 19 08:37:02.162826 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d0b3e48d-8474-49ff-9267-06b714fc10e4 req-93be97e3-4a03-48e1-b93e-b8da4bc26255 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048506 May 19 08:37:02.163451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2662/3987] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:02.169105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:02.169849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:02.177101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.189666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.190873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.193338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.566121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:02.575861 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1289946b-32c6-497e-a6da-f7d0bbc508b1 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.410954 May 19 08:37:02.591083 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2663/3988] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:02 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:02.598930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:02.600121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:02.608568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.609010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.609866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.610331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.854213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:02.863760 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-29992a5b-a4a0-4994-880a-7e872f042bdc tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1607 microversion: 2.1 time: 0.271437 May 19 08:37:02.864640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2664/3989] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:02 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1607 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:02.874787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67a6f8a1-6c30-418a-9abf-433e47672bbc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:02.875478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67a6f8a1-6c30-418a-9abf-433e47672bbc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: e518a878-75c4-432f-b227-105fad135e20] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:02.882318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-67a6f8a1-6c30-418a-9abf-433e47672bbc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance e518a878-75c4-432f-b227-105fad135e20 could not be found. May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67a6f8a1-6c30-418a-9abf-433e47672bbc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e518a878-75c4-432f-b227-105fad135e20 HTTP/1.1 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e518a878-75c4-432f-b227-105fad135e20 could not be found. May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e518a878-75c4-432f-b227-105fad135e20'} May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e518a878-75c4-432f-b227-105fad135e20 could not be found. May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e518a878-75c4-432f-b227-105fad135e20 could not be found. May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:02.884211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:02.888368 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:02.888368 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:02.888368 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:02.888368 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e518a878-75c4-432f-b227-105fad135e20 could not be found. May 19 08:37:02.888368 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:02.889593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67a6f8a1-6c30-418a-9abf-433e47672bbc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance e518a878-75c4-432f-b227-105fad135e20 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:02.893670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67a6f8a1-6c30-418a-9abf-433e47672bbc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/e518a878-75c4-432f-b227-105fad135e20" status: 404 len: 111 microversion: 2.1 time: 0.024732 May 19 08:37:02.893670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2665/3990] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:02 2022] GET /compute/v2.1/servers/e518a878-75c4-432f-b227-105fad135e20 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:02.895879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:02.896653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:02.904134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.904589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:02.905512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:02.906177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.135630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:03.143568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9d38b2c-769e-46b9-a01f-4874409d1914 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1314 microversion: 2.1 time: 0.251143 May 19 08:37:03.144427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2666/3991] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:02 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:03.149948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:03.150851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:03.159514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.159966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.161014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.161578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.333577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:03.342778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64a21c2f-33f6-46df-877e-fd33ba0d5810 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1607 microversion: 2.1 time: 0.196898 May 19 08:37:03.351396 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2667/3992] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:03 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1607 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:03.357414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:03.358034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:03.365399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.365851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.366628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.367063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.389592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:03.536656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:03.547350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8099228-a6b3-4183-8070-7bde8c7efe40 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.194016 May 19 08:37:03.548171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2668/3993] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:03 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:03.560110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:03.560110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:03.560523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.560619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.563434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.563904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.842339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:03.854700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24c79e6b-9ede-477d-8193-d974a97f7502 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1308 microversion: 2.1 time: 0.305344 May 19 08:37:03.855577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2669/3994] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:03 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:03.861338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a9a5dd14-69a3-4745-9b64-6528e2e0d198 req-ec44d076-bcea-494b-a8d9-8d76086125d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6", "tag": "a23345cb-357a-4091-854d-bd319accc6a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:03.870617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a9a5dd14-69a3-4745-9b64-6528e2e0d198 req-ec44d076-bcea-494b-a8d9-8d76086125d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.871306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a9a5dd14-69a3-4745-9b64-6528e2e0d198 req-ec44d076-bcea-494b-a8d9-8d76086125d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.886039 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a9a5dd14-69a3-4745-9b64-6528e2e0d198 req-ec44d076-bcea-494b-a8d9-8d76086125d3 service nova] Creating event network-changed:a23345cb-357a-4091-854d-bd319accc6a7 for instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 on chh1-842464-2 May 19 08:37:03.907093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a9a5dd14-69a3-4745-9b64-6528e2e0d198 req-ec44d076-bcea-494b-a8d9-8d76086125d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049949 May 19 08:37:03.908497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2670/3995] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:03.916704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:03.917798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:03.925243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.925951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:03.926892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:03.927481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:04.261801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:04.270487 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b2e6a85-bb89-4435-8963-c02484d6183f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.360498 May 19 08:37:04.271788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2671/3996] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:03 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:04.278271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:04.279222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:04.288760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:04.289220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:04.290771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:04.291388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:04.617352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:04.630687 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c3be7a5-8bab-4df3-9962-164baded6e34 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.357427 May 19 08:37:04.631667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2672/3997] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:04 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:04.641811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:04.642476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:04.654118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:04.654495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:04.657553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:04.658146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:05.014748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:05.026652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8dfb7dd5-f672-4fb4-a3e3-fd443df2f399 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1498 microversion: 2.1 time: 0.393023 May 19 08:37:05.038769 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2673/3998] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:04 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:05.045985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64258d01-ec36-4310-abf3-7896dec2478f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-479478820", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64258d01-ec36-4310-abf3-7896dec2478f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 237 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-479478820", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-479478820', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:37:05.048823 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 19 08:37:05.052236 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:05.054048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64258d01-ec36-4310-abf3-7896dec2478f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:05.055113 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64258d01-ec36-4310-abf3-7896dec2478f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014915 May 19 08:37:05.056413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2674/3999] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:37:05 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:37:05.061591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:05.062419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:05.069931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:05.070386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:05.071250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:05.071839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:05.888176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:05.898376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71307a26-e979-477b-9063-9fb0ec7264f0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1489 microversion: 2.1 time: 0.840696 May 19 08:37:05.906492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2675/4000] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:05 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1489 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:05.913275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:05.914661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:05.926823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:05.927282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:05.928209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:05.933362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:06.144957 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:37:06.145527 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:37:06.422779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:06.431572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb9dd1c3-4cd6-4e00-b4ae-8e8eb59297b7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.523017 May 19 08:37:06.442449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2676/4001] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:05 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:06.449033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:06.458069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:06.472967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:06.473592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:06.474542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:06.474999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:06.965328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:06.983537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6fbc8563-d4a8-4348-bf21-51311b61af0b tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.539718 May 19 08:37:06.984473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2677/4002] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:06 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:06.997882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-412024215", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:07.076887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:37:08.760723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:37:08.761273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:37:08.762105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:37:08.762702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:37:08.763129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:37:08.789421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:08.789652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:08.801131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:08.801858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:08.860531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:37:08.876807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:37:08.924056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:37:08.935112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:37:09.072217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9744a391-59b8-4411-9640-30857b629829 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086488 May 19 08:37:09.073548 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2678/4003] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:37:09.090612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:09.092768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:09.142695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:09.145677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:09.151819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:09.154466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:09.531545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:09.549933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3969ecbc-d417-4635-991e-b6fdae97a3a6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.471328 May 19 08:37:09.552021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2679/4004] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:09 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:09.581806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:09.582694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:09.590970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:09.591716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:09.592694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:09.593551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:09.807516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:09.818266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4132a94-4a2f-4f22-b03c-6bc4744534c5 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.248297 May 19 08:37:09.819548 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2680/4005] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:09 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:09.826134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bdce301-2b6c-49ce-90a5-ed41241dc3a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:09.826900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8bdce301-2b6c-49ce-90a5-ed41241dc3a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:09.925323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bdce301-2b6c-49ce-90a5-ed41241dc3a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:09.933167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bdce301-2b6c-49ce-90a5-ed41241dc3a3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1208 microversion: 2.1 time: 0.112368 May 19 08:37:09.933801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2681/4006] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:09 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:09.955283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b75ec420-3904-4bd8-9bda-a4a7e90452ac req-2703c5b7-4c27-40b5-865e-86ee719997c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06abe74-2b86-4b72-986c-63ff3e4f7960", "tag": "4bae762b-ae85-4613-bd9a-b5116343346b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:09.966282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b75ec420-3904-4bd8-9bda-a4a7e90452ac req-2703c5b7-4c27-40b5-865e-86ee719997c4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:09.967010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b75ec420-3904-4bd8-9bda-a4a7e90452ac req-2703c5b7-4c27-40b5-865e-86ee719997c4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:10.002528 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b75ec420-3904-4bd8-9bda-a4a7e90452ac req-2703c5b7-4c27-40b5-865e-86ee719997c4 service nova] Creating event network-changed:4bae762b-ae85-4613-bd9a-b5116343346b for instance d06abe74-2b86-4b72-986c-63ff3e4f7960 on chh1-842464-2 May 19 08:37:10.019335 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b75ec420-3904-4bd8-9bda-a4a7e90452ac req-2703c5b7-4c27-40b5-865e-86ee719997c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069223 May 19 08:37:10.022939 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2682/4007] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:10.039482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:10.040806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:10.055183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:10.060883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:10.062297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:10.067937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:10.071161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:10.134923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:37:10.333392 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab46e733-9358-4135-80c6-a4a4e034d141 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 204 len: 0 microversion: 2.1 time: 0.308631 May 19 08:37:10.334002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2683/4008] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:37:10 2022] DELETE /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:37:10.346655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d000585d-63be-4a94-b27f-c81315f6f9a9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-131826641", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d000585d-63be-4a94-b27f-c81315f6f9a9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 234 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-131826641", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-131826641', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = func(instance) May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'notvalid' May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:10.363634 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d000585d-63be-4a94-b27f-c81315f6f9a9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:10.367301 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d000585d-63be-4a94-b27f-c81315f6f9a9 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.030574 May 19 08:37:10.370853 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2684/4009] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:37:10 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:37:10.532546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b260cac-3c13-4985-8d35-032c65f6b4eb tempest-FloatingIPDetailsNegativeTestJSON-878937880 tempest-FloatingIPDetailsNegativeTestJSON-878937880-project] Calling method '.version_select at 0x7f3211ebca60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:10.590560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG neutronclient.v2_0.client [None req-6b260cac-3c13-4985-8d35-032c65f6b4eb tempest-FloatingIPDetailsNegativeTestJSON-878937880 tempest-FloatingIPDetailsNegativeTestJSON-878937880-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0d8c3708-1834-4d21-a737-5b4e98b3eb92 could not be found", "detail": ""}} {{(pid=119072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 19 08:37:10.591269 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6b260cac-3c13-4985-8d35-032c65f6b4eb tempest-FloatingIPDetailsNegativeTestJSON-878937880 tempest-FloatingIPDetailsNegativeTestJSON-878937880-project] HTTP exception thrown: Floating IP not found for ID 0d8c3708-1834-4d21-a737-5b4e98b3eb92 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b260cac-3c13-4985-8d35-032c65f6b4eb tempest-FloatingIPDetailsNegativeTestJSON-878937880 tempest-FloatingIPDetailsNegativeTestJSON-878937880-project] Request method failure captured: May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-floating-ips/0d8c3708-1834-4d21-a737-5b4e98b3eb92 HTTP/1.1 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG1hjZt0J6NEs3NrmMYKM_43WgKae1pgiDmdFuJp9BhuYg8RORGVxTDwIp88xPTI2SojeBS1wiO7ZKpXlCucxIre4C6GMBcnu3IeWrakX4dyl6ut_sJID1JgMHtvlUVLcMgh4DLFwk_vQK8_GHLnLi39DH1LvH6MpwTYYOTd0-smhg May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: c26f562273ec482b9aaf8b98358871d8 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-878937880 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c26f562273ec482b9aaf8b98358871d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c26f562273ec482b9aaf8b98358871d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c26f562273ec482b9aaf8b98358871d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c26f562273ec482b9aaf8b98358871d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-878937880 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: c26f562273ec482b9aaf8b98358871d8 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-878937880 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-878937880-project May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b3a4a1dcaba94e9a9b3654a3744a37d1 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-878937880-project May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: exception: Floating IP not found for ID 0d8c3708-1834-4d21-a737-5b4e98b3eb92 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0d8c3708-1834-4d21-a737-5b4e98b3eb92'} May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0d8c3708-1834-4d21-a737-5b4e98b3eb92 could not be found May 19 08:37:10.593109 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-738781d9-318d-4154-b773-bb6786747d9a'] May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0d8c3708-1834-4d21-a737-5b4e98b3eb92. May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0d8c3708-1834-4d21-a737-5b4e98b3eb92 May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0d8c3708-1834-4d21-a737-5b4e98b3eb92 May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b260cac-3c13-4985-8d35-032c65f6b4eb tempest-FloatingIPDetailsNegativeTestJSON-878937880 tempest-FloatingIPDetailsNegativeTestJSON-878937880-project] Returning 404 to user: Floating IP not found for ID 0d8c3708-1834-4d21-a737-5b4e98b3eb92 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b260cac-3c13-4985-8d35-032c65f6b4eb tempest-FloatingIPDetailsNegativeTestJSON-878937880 tempest-FloatingIPDetailsNegativeTestJSON-878937880-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/0d8c3708-1834-4d21-a737-5b4e98b3eb92" status: 404 len: 111 microversion: 2.1 time: 0.221989 May 19 08:37:10.597163 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2685/4010] 10.222.0.78 () {58 vars in 1259 bytes} [Thu May 19 08:37:10 2022] GET /compute/v2.1/os-floating-ips/0d8c3708-1834-4d21-a737-5b4e98b3eb92 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:10.604707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:10.605660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:10.612376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:10.612834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:10.613759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:10.614148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:10.822600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:10.836165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9659308-392d-4a0b-adac-352f143f9a3d tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1504 microversion: 2.1 time: 0.239919 May 19 08:37:10.846697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2686/4011] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:10 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:10.846697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:10.846697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:10.853612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:10.854262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:10.855916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:10.856574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.025167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:11.034341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44bc09f9-ae4e-4345-9f48-bd3e62f7102a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.195371 May 19 08:37:11.035170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2687/4012] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:10 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:11.048339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:11.049561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:11.056892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.057384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.058185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.058628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.213402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:11.222119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0c1e75b-9d5a-4bdc-baf6-018ab7066169 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.177758 May 19 08:37:11.222721 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2688/4013] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:11 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:11.228500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:11.229480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:11.238439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.238893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.239692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.240124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.244303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:11.316786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:11.325810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87a399d5-12f6-4721-bc4b-905f3d632cbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1260 microversion: 2.1 time: 0.101514 May 19 08:37:11.326773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2689/4014] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:11 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1260 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:11.332101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:11.332947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:11.341068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.341571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.342579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.343027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.505082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:11.515176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4921f387-931e-40e8-bfc2-e1aa1e31ba21 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.187054 May 19 08:37:11.516286 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2690/4015] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:11 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:11.533106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec3f18d2-44eb-4b9a-8122-ec3afac3fa4c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:11.533714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec3f18d2-44eb-4b9a-8122-ec3afac3fa4c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: b47f6383-da76-4d30-a41e-9ace9083eb56] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:11.539737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ec3f18d2-44eb-4b9a-8122-ec3afac3fa4c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance b47f6383-da76-4d30-a41e-9ace9083eb56 could not be found. May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec3f18d2-44eb-4b9a-8122-ec3afac3fa4c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/b47f6383-da76-4d30-a41e-9ace9083eb56/action HTTP/1.1 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 13 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: {"pause": {}} May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b47f6383-da76-4d30-a41e-9ace9083eb56 could not be found. May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b47f6383-da76-4d30-a41e-9ace9083eb56', 'body': {'pause': {}}} May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47f6383-da76-4d30-a41e-9ace9083eb56 could not be found. May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47f6383-da76-4d30-a41e-9ace9083eb56 could not be found. May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:11.544234 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47f6383-da76-4d30-a41e-9ace9083eb56 could not be found. May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec3f18d2-44eb-4b9a-8122-ec3afac3fa4c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance b47f6383-da76-4d30-a41e-9ace9083eb56 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec3f18d2-44eb-4b9a-8122-ec3afac3fa4c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/b47f6383-da76-4d30-a41e-9ace9083eb56/action" status: 404 len: 111 microversion: 2.1 time: 0.016936 May 19 08:37:11.550261 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2691/4016] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:11 2022] POST /compute/v2.1/servers/b47f6383-da76-4d30-a41e-9ace9083eb56/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:37:11.557333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:11.558582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:11.567096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.567522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.568562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.569884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.729515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:11.744971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2608e0a3-f899-4617-8ec5-eb83bc2354e2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.192984 May 19 08:37:11.746263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2692/4017] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:11 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:11.765960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:11.767001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:11.778258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.778993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:11.780151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:11.780744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:12.223302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:12.233686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e56b3fb4-4b4b-4a7d-a1fe-211c17520e2b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.472073 May 19 08:37:12.246219 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2693/4018] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:11 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:12.252584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:12.254052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:12.262305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:12.263178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:12.264448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:12.265091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:12.642251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:12.654529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02a4467e-00c1-4084-b13d-fc33dc8dc7eb tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1504 microversion: 2.1 time: 0.405997 May 19 08:37:12.655364 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2694/4019] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:12 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:12.672407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0712cd7b-143f-47e5-af48-c6219be0d27a req-32e51bd5-0a5f-4cfe-8201-fb0ec78a4cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6", "name": "network-vif-plugged", "status": "completed", "tag": "a23345cb-357a-4091-854d-bd319accc6a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:12.692209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0712cd7b-143f-47e5-af48-c6219be0d27a req-32e51bd5-0a5f-4cfe-8201-fb0ec78a4cfe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:12.692676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0712cd7b-143f-47e5-af48-c6219be0d27a req-32e51bd5-0a5f-4cfe-8201-fb0ec78a4cfe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:12.723433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0712cd7b-143f-47e5-af48-c6219be0d27a req-32e51bd5-0a5f-4cfe-8201-fb0ec78a4cfe service nova] Creating event network-vif-plugged:a23345cb-357a-4091-854d-bd319accc6a7 for instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 on chh1-842464-2 May 19 08:37:12.753196 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0712cd7b-143f-47e5-af48-c6219be0d27a req-32e51bd5-0a5f-4cfe-8201-fb0ec78a4cfe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085425 May 19 08:37:12.760645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2695/4020] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:12.787370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:12.794349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:12.808168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:12.810802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:12.811735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:12.812197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.226455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:13.238199 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc70acb9-28e7-4c9b-83ec-eff3af916457 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.472625 May 19 08:37:13.239012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2696/4021] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:12 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:13.245928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:13.246958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:13.253485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.254128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.255138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.255774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.338351 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd448403-090d-4fd1-8b54-603de56e06f3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 202 len: 0 microversion: 2.1 time: 0.097607 May 19 08:37:13.342244 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2697/4022] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:13 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:37:13.348558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:13.349406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:13.359450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.359904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.360909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.361561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.632824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:13.643295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcb91458-52d7-4622-b243-a05525e69c29 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.302494 May 19 08:37:13.644233 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2698/4023] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:13 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:13.649856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-98f3fdbe-b38d-4796-a3bc-0ae59e6938c4 req-30b38904-b99d-4c96-9752-d1c0d59c4332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc874094-e6ed-4357-818b-7dfac14af413", "name": "network-vif-deleted", "tag": "d27f112d-1226-4f7e-81a8-67d4b2926f3d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:13.661255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-98f3fdbe-b38d-4796-a3bc-0ae59e6938c4 req-30b38904-b99d-4c96-9752-d1c0d59c4332 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.661883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-98f3fdbe-b38d-4796-a3bc-0ae59e6938c4 req-30b38904-b99d-4c96-9752-d1c0d59c4332 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.676651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-98f3fdbe-b38d-4796-a3bc-0ae59e6938c4 req-30b38904-b99d-4c96-9752-d1c0d59c4332 service nova] Creating event network-vif-deleted:d27f112d-1226-4f7e-81a8-67d4b2926f3d for instance cc874094-e6ed-4357-818b-7dfac14af413 on chh1-842464-2 May 19 08:37:13.682937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-98f3fdbe-b38d-4796-a3bc-0ae59e6938c4 req-30b38904-b99d-4c96-9752-d1c0d59c4332 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037113 May 19 08:37:13.687972 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2699/4024] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:13.696450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:13.697776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:13.710527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.711328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.712280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.712752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.880040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:13.888022 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20a57e66-c79d-48cf-b001-e3a7f9bbef98 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1491 microversion: 2.1 time: 0.198484 May 19 08:37:13.888630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2700/4025] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:13 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1491 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:13.893216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:13.893870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:13.900559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.901029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.901924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.902365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.939115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:13.939577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:13.940037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lazy-loading 'fault' on Instance uuid cc874094-e6ed-4357-818b-7dfac14af413 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:37:13.987143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f34dfe6e96443c496218b2944fdf38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5703a409e8724b779bc091f2063b817e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:14.001626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f8ca7ac-5e01-449f-aac9-fc50809a8c57 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 200 len: 1304 microversion: 2.1 time: 0.111747 May 19 08:37:14.002227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2701/4026] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:13 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:14.007334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:14.007945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:14.016341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.016804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.017694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.018084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.049485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'pause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state paused May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 13 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: {"pause": {}} May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'pause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state paused May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'pause': {}}} May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state paused. Cannot pause while the instance is in this state. May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state paused May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:14.051142 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state paused May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'pause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state paused {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7718687-aa55-4577-b0fd-8dd29e32709d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 143 microversion: 2.1 time: 0.049428 May 19 08:37:14.054575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2702/4027] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:14 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 143 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:37:14.079254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:14.079800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:14.087938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.088206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.088984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.089450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.162281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-232553f3-057d-4c4e-a8f0-dce465032501 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 202 len: 0 microversion: 2.1 time: 0.086895 May 19 08:37:14.167264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2703/4028] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:14 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:37:14.176282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:14.177515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:14.185811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.186267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.187059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.187534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.345505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:14.353853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5b63c24-f9e3-4d5d-aca3-fcfda404ae1a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1498 microversion: 2.1 time: 0.182942 May 19 08:37:14.354587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2704/4029] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:14 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:14.359197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:14.359949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:14.366272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.366991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.368686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.369265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.533332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:14.542983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9e7cc56-e998-486c-991b-d07ef0fe2d37 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1327 microversion: 2.1 time: 0.187124 May 19 08:37:14.552391 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2705/4030] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:14 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1327 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:14.662708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:14.663337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:14.671610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.672118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.673075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:14.673580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:14.678998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:14.869773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:14.878232 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50acec3d-d6ef-4748-adc7-7dcf865fe6b8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.220134 May 19 08:37:14.878810 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2706/4031] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:14 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:15.026535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:15.027458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] [instance: cc874094-e6ed-4357-818b-7dfac14af413] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:15.034643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.035432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:15.036414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.037041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] HTTP exception thrown: Instance cc874094-e6ed-4357-818b-7dfac14af413 could not be found. May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Request method failure captured: May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 HTTP/1.1 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGcOUvHxta1TGNkRha0Fs-VyNz1ZOo3kntq13egQVIB6RD2FybEF2Khhfx_OL8h5iTSDRSHCwKSfAS9yxXFEFQuH6O-p3zWa81EH5snckIyX7T1jE8xIBnx884VVgFWS11Mx7h6AJB700_UtCbeHNlG_8xLpUPJPNM3UjxSAjq7RH4 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 5703a409e8724b779bc091f2063b817e May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesActionsTest-474068043 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5703a409e8724b779bc091f2063b817e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5703a409e8724b779bc091f2063b817e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5703a409e8724b779bc091f2063b817e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5703a409e8724b779bc091f2063b817e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesActionsTest-474068043 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 5703a409e8724b779bc091f2063b817e May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesActionsTest-474068043 May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesActionsTest-474068043-project May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0f34dfe6e96443c496218b2944fdf38b May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesActionsTest-474068043-project May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance cc874094-e6ed-4357-818b-7dfac14af413 could not be found. May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'cc874094-e6ed-4357-818b-7dfac14af413'} May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc874094-e6ed-4357-818b-7dfac14af413 could not be found. May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:15.060753 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc874094-e6ed-4357-818b-7dfac14af413 could not be found. May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc874094-e6ed-4357-818b-7dfac14af413 could not be found. May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] Returning 404 to user: Instance cc874094-e6ed-4357-818b-7dfac14af413 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86fd47b7-e1bc-451a-8ea4-0e45b4a01c22 tempest-VolumesActionsTest-474068043 tempest-VolumesActionsTest-474068043-project] 10.222.0.78 "GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413" status: 404 len: 111 microversion: 2.1 time: 0.036170 May 19 08:37:15.066585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2707/4032] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:15 2022] GET /compute/v2.1/servers/cc874094-e6ed-4357-818b-7dfac14af413 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:15.374620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:15.376426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:15.385954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.386654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:15.387538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.388171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:15.770109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:15.783298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fdfceff-c61c-4756-88d7-ef93b4c84816 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1498 microversion: 2.1 time: 0.414983 May 19 08:37:15.785710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2708/4033] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:15 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1498 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:15.901698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-501f942b-4cf6-4c83-a268-fc49e4bce176 req-83c5f534-bbc0-430e-9793-9c5b8a5234cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0779eef3-859e-45b7-a4e2-0cdf527d358e", "tag": "da7a50ff-f156-4aac-9a55-6c8b1449a401"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:15.911849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-501f942b-4cf6-4c83-a268-fc49e4bce176 req-83c5f534-bbc0-430e-9793-9c5b8a5234cb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.912486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-501f942b-4cf6-4c83-a268-fc49e4bce176 req-83c5f534-bbc0-430e-9793-9c5b8a5234cb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:15.928499 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-501f942b-4cf6-4c83-a268-fc49e4bce176 req-83c5f534-bbc0-430e-9793-9c5b8a5234cb service nova] Creating event network-changed:da7a50ff-f156-4aac-9a55-6c8b1449a401 for instance 0779eef3-859e-45b7-a4e2-0cdf527d358e on chh1-842464-2 May 19 08:37:15.941214 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-501f942b-4cf6-4c83-a268-fc49e4bce176 req-83c5f534-bbc0-430e-9793-9c5b8a5234cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152979 May 19 08:37:15.942155 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2709/4034] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:15.949905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:15.950627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:15.957517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.957983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:15.958779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:15.959221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.222316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:16.231926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b95dfb8b-6def-4a6b-b258-500ccd0a8bad tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1526 microversion: 2.1 time: 0.287810 May 19 08:37:16.232510 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2710/4035] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:15 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:16.239007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:16.239621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:16.248263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.248726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.249594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.250036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.424381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:16.433378 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e051f17-dfa2-4db3-963f-2d18deeb83b5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.199251 May 19 08:37:16.434265 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2711/4036] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:16 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:16.438888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:16.439580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:16.447561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.448017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.448824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.449273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.654600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:16.662496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e5938b0-01ed-45e2-a0a6-5f6e37778731 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1526 microversion: 2.1 time: 0.227181 May 19 08:37:16.667021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2712/4037] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:16 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1526 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:16.911639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:16.912249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:16.919291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.919812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.920729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.921233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.938694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] HTTP exception thrown: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Request method failure captured: May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 HTTP/1.1 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGon7TyVZQT4_Gm9cdfjBnBlaz3UZBks7WfOmDM_nQrtSdeA_jQ0UTYE9mpvKS6UifdoERQsNIV6IyNF9zh5Ke-YD_GJ1XdjGD-mzcteqdV4qIQcVhGRqqLgfjxSkfKFI9txtnJdho5cvZw6qnK835NI33SUQ58Uqw0ijW5eAr0zCg May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: dd79bffd41b34b28abbfbda2718dee43 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1022094110 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1022094110 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: dd79bffd41b34b28abbfbda2718dee43 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1022094110 May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1022094110-project May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 42cdbda4da914106b08f2280fd9e278e May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1022094110-project May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6'} May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:16.940400 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Returning 404 to user: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ab88904-aa20-4f25-967f-87cee487ce57 tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 404 len: 111 microversion: 2.1 time: 0.266487 May 19 08:37:16.948180 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2713/4038] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:37:16 2022] DELETE /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:37:16.958061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:16.959015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:16.966465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.966465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:16.967141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:16.967225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.151552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:17.161929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5640d275-a7be-4f68-8b6a-57b28f8965c3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1498 microversion: 2.1 time: 0.217605 May 19 08:37:17.162534 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2714/4039] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:16 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:17.169789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:17.170652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:17.178727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.179390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.181133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.181879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.333369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:17.341228 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-985cf41b-f5c3-44d0-a7de-cdca9fb3871a tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1526 microversion: 2.1 time: 0.177470 May 19 08:37:17.341841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2715/4040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:17 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1526 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:17.366366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Action: 'update', calling method: >, body: {"server": {"name": "9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6_new"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:17.368208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:17.374818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.375274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.376049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.376493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.392053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] HTTP exception thrown: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Request method failure captured: May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 HTTP/1.1 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 64 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGon7TyVZQT4_Gm9cdfjBnBlaz3UZBks7WfOmDM_nQrtSdeA_jQ0UTYE9mpvKS6UifdoERQsNIV6IyNF9zh5Ke-YD_GJ1XdjGD-mzcteqdV4qIQcVhGRqqLgfjxSkfKFI9txtnJdho5cvZw6qnK835NI33SUQ58Uqw0ijW5eAr0zCg May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: dd79bffd41b34b28abbfbda2718dee43 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1022094110 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd79bffd41b34b28abbfbda2718dee43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1022094110 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: dd79bffd41b34b28abbfbda2718dee43 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1022094110 May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1022094110-project May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 42cdbda4da914106b08f2280fd9e278e May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1022094110-project May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6_new"}} May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6', 'body': {'server': {'name': '9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6_new'}}} May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:37:17.393845 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] Returning 404 to user: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9edd503-07d8-44f9-ba80-1071fb21378d tempest-ServersNegativeTestMultiTenantJSON-1022094110 tempest-ServersNegativeTestMultiTenantJSON-1022094110-project] 10.222.0.78 "PUT /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 404 len: 111 microversion: 2.1 time: 0.032810 May 19 08:37:17.397282 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2716/4041] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:37:17 2022] PUT /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:37:17.405402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:17.405956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:17.413441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.414025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.415171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.415956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.446901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:37:17.550644 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-45533924-a9af-4eab-9c10-3096d4a20058 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 204 len: 0 microversion: 2.1 time: 0.148638 May 19 08:37:17.551587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2717/4042] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:37:17 2022] DELETE /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:37:17.560402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:17.561467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:17.567696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.568136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.569029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.569510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.750406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:17.759222 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ea43ee9-30fe-4c7a-87e7-a29a06172ae8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.204363 May 19 08:37:17.760312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2718/4043] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:17 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:17.766309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:17.767186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:17.774873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.775981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:17.776802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:17.777488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:18.279930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:18.288453 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55a811cd-edaa-4893-b15a-b03e3c118750 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1532 microversion: 2.1 time: 0.526760 May 19 08:37:18.289171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2719/4044] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:17 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1532 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:18.294127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:18.294748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:18.301022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:18.301583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:18.302369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:18.302818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:18.546646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:18.556293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d475f8be-622b-4e19-9f79-b915c6e751ea tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1498 microversion: 2.1 time: 0.265750 May 19 08:37:18.557571 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2720/4045] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:18 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1498 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:18.787490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:18.788123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:18.795868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:18.796244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:18.797028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:18.797669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:18.833502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:18.980779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:18.989131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f65cbe6d-bcae-46d6-99f9-85d7e9e547c0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.206149 May 19 08:37:18.989773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2721/4046] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:18 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:19.163820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1518630444", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "1a050905-faf4-46cc-bb59-12e712335300"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:19.264951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] validate_networks() for [('1a050905-faf4-46cc-bb59-12e712335300', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:37:19.929180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:37:19.933010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:37:19.933772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:37:19.934537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:37:19.935182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:37:19.939720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:19.955311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:19.956148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:19.958026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:19.958481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:19.984304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:37:19.991312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for user f59b91044370427fa198cff1a2c604e9 and project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:37:20.019491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:37:20.023214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:37:20.040838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:20.115029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4556d1fd-acc6-4d19-ad0a-0c0c67f170ae tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113931 May 19 08:37:20.115767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2722/4047] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:37:20.126835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:20.129615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:20.137060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.138021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.139598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.140208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.234508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5281a62235c407baefe87936dd6283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca1fe796a8d444088345ee1fceaf525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:20.245541 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-606162ee-55f1-468c-b5e6-80f00d0015d2 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 200 len: 1312 microversion: 2.1 time: 0.128512 May 19 08:37:20.246140 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2723/4048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:20 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:20.251454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:20.252063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:20.285690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.286665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.287829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.289781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.307540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:20.450903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:20.464191 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95b42a81-5603-414f-ab2a-be58ca836a4e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.214491 May 19 08:37:20.489907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2724/4049] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:20 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:20.489907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:20.489907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:20.501333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.501939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.502817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.503268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.724193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:20.734642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a5d14ab-dd80-4678-a409-9cd43a76dab2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.256357 May 19 08:37:20.735570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2725/4050] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:20 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:20.742523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c98f5c82-dc0b-4409-ac46-e7ace3b8a041 req-0ae0c075-c8ac-4f58-9704-bf6139659489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6", "name": "network-vif-deleted", "tag": "a23345cb-357a-4091-854d-bd319accc6a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:20.760936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c98f5c82-dc0b-4409-ac46-e7ace3b8a041 req-0ae0c075-c8ac-4f58-9704-bf6139659489 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.761418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c98f5c82-dc0b-4409-ac46-e7ace3b8a041 req-0ae0c075-c8ac-4f58-9704-bf6139659489 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.774405 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c98f5c82-dc0b-4409-ac46-e7ace3b8a041 req-0ae0c075-c8ac-4f58-9704-bf6139659489 service nova] Creating event network-vif-deleted:a23345cb-357a-4091-854d-bd319accc6a7 for instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 on chh1-842464-2 May 19 08:37:20.780764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c98f5c82-dc0b-4409-ac46-e7ace3b8a041 req-0ae0c075-c8ac-4f58-9704-bf6139659489 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043902 May 19 08:37:20.781758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2726/4051] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:20.790016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:20.791690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:20.800558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.801140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.802093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.802531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.874522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:20.885138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4871a54f-c7cf-4a53-89d2-a934a20bdad5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1212 microversion: 2.1 time: 0.101441 May 19 08:37:20.885803 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2727/4052] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:20 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:20.891672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:20.892303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:20.900467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.900813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:20.901647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:20.902094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.054773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:21.062757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11649302-9b85-4760-bd2c-0475a6965810 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.175954 May 19 08:37:21.063351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2728/4053] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:20 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:21.079938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:21.080948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:21.088267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.088577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.089447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.089889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.105920 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07/action HTTP/1.1 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 28 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: {"reboot": {"type": "SOFT"}} May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3ee93b28-80ce-457d-93fe-0fba061d0f07', 'body': {'reboot': {'type': 'SOFT'}}} May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:21.107638 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:21.111284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adf9fc51-30e0-48ba-839e-655d9c1e4450 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07/action" status: 404 len: 111 microversion: 2.1 time: 0.033053 May 19 08:37:21.112040 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2729/4054] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:21 2022] POST /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:37:21.117821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:21.118439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:21.124698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.125159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.125961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.126410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.282380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:21.290652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84e6d4e3-f937-405a-adb5-35031dabda68 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.176555 May 19 08:37:21.291232 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2730/4055] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:21 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:21.295775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:21.299746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] [instance: 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:21.307195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.307646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.308435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.308857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.324187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] HTTP exception thrown: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Request method failure captured: May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 HTTP/1.1 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGnHe3z4aAr-GstBB7YPMFZuDB4pEOpGk2enz1cw48zdiM3MjmC9TS5p8XdHNnhf0J1dQf9c1CiO1L_hc1uNQ9gry_SYMKHyoL67aS_wsuvf8TCLEKwTsBiIGhBgNG1h6g_7RgiFPHDehwHbmINZNMAysiHAZb9wLme0r25xFjW53Q May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8ca1fe796a8d444088345ee1fceaf525 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-561385208 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ca1fe796a8d444088345ee1fceaf525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ca1fe796a8d444088345ee1fceaf525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ca1fe796a8d444088345ee1fceaf525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ca1fe796a8d444088345ee1fceaf525"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-561385208 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8ca1fe796a8d444088345ee1fceaf525 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-561385208 May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestMultiTenantJSON-561385208-project May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b5281a62235c407baefe87936dd6283a May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-561385208-project May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6'} May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.325770 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] Returning 404 to user: Instance 9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:21.329972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7af5ce4-8630-4b0d-8f0f-bab062e03446 tempest-ServersNegativeTestMultiTenantJSON-561385208 tempest-ServersNegativeTestMultiTenantJSON-561385208-project] 10.222.0.78 "GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6" status: 404 len: 111 microversion: 2.1 time: 0.035015 May 19 08:37:21.333599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2731/4056] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:21 2022] GET /compute/v2.1/servers/9d18c0ff-e0b0-4055-893e-cfb15cf7eaa6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:21.339835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:21.340761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:21.348541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.349455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.350500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.351171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.676667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:21.684701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51ce0a98-b3ad-413d-b142-c780651754f6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.349482 May 19 08:37:21.695183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2732/4057] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:21 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:21.706195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4fbaddd-c324-4e2f-91ff-a7aac30f30e4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:21.707235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4fbaddd-c324-4e2f-91ff-a7aac30f30e4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: f3cce19a-4fdd-434e-99fa-78d322312914] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:21.714096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a4fbaddd-c324-4e2f-91ff-a7aac30f30e4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance f3cce19a-4fdd-434e-99fa-78d322312914 could not be found. May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4fbaddd-c324-4e2f-91ff-a7aac30f30e4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/f3cce19a-4fdd-434e-99fa-78d322312914/action HTTP/1.1 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 28 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: {"reboot": {"type": "SOFT"}} May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f3cce19a-4fdd-434e-99fa-78d322312914 could not be found. May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f3cce19a-4fdd-434e-99fa-78d322312914', 'body': {'reboot': {'type': 'SOFT'}}} May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3cce19a-4fdd-434e-99fa-78d322312914 could not be found. May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3cce19a-4fdd-434e-99fa-78d322312914 could not be found. May 19 08:37:21.715877 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3cce19a-4fdd-434e-99fa-78d322312914 could not be found. May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4fbaddd-c324-4e2f-91ff-a7aac30f30e4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance f3cce19a-4fdd-434e-99fa-78d322312914 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:21.720615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4fbaddd-c324-4e2f-91ff-a7aac30f30e4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/f3cce19a-4fdd-434e-99fa-78d322312914/action" status: 404 len: 111 microversion: 2.1 time: 0.017839 May 19 08:37:21.722530 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2733/4058] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:21 2022] POST /compute/v2.1/servers/f3cce19a-4fdd-434e-99fa-78d322312914/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:21.729241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:21.729908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:21.737129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.738863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.740643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:21.741294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:21.954941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:21.967936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8f4aa33-3981-4d27-babc-4480847cfa57 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.244515 May 19 08:37:21.981787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2734/4059] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:21 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:21.995053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:21.996092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:22.004277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:22.005068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:22.006116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:22.006807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:22.389711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:22.403205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55164f04-c1f7-438a-a9f9-a29ac746e6eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.416498 May 19 08:37:22.404411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2735/4060] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:21 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:22.412593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:22.413275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:22.433036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:22.434086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:22.443321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:22.444705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:22.631544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:22.643716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b86abd4-077e-40a3-a014-a9ae973ad444 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1266 microversion: 2.1 time: 0.235856 May 19 08:37:22.653700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2736/4061] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:22 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:22.654679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:22.657724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:22.673086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:22.673632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:22.674532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:22.675059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:22.972666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:22.986805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-702b72da-b212-4575-9901-487e156d0390 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.340139 May 19 08:37:22.988441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2737/4062] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:22 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:22.996645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f1c48180-4491-40f1-b0a6-6e5a413dd715 req-380bb7c2-e9d6-4f30-bb7e-3f7bec9902f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eef3-859e-45b7-a4e2-0cdf527d358e", "name": "network-vif-plugged", "status": "completed", "tag": "da7a50ff-f156-4aac-9a55-6c8b1449a401"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:23.020205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1c48180-4491-40f1-b0a6-6e5a413dd715 req-380bb7c2-e9d6-4f30-bb7e-3f7bec9902f7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.024209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1c48180-4491-40f1-b0a6-6e5a413dd715 req-380bb7c2-e9d6-4f30-bb7e-3f7bec9902f7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.052187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f1c48180-4491-40f1-b0a6-6e5a413dd715 req-380bb7c2-e9d6-4f30-bb7e-3f7bec9902f7 service nova] Creating event network-vif-plugged:da7a50ff-f156-4aac-9a55-6c8b1449a401 for instance 0779eef3-859e-45b7-a4e2-0cdf527d358e on chh1-842464-2 May 19 08:37:23.065404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f1c48180-4491-40f1-b0a6-6e5a413dd715 req-380bb7c2-e9d6-4f30-bb7e-3f7bec9902f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070400 May 19 08:37:23.066782 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2738/4063] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:23.089297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:23.091224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:23.115859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.119219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.120640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.121519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.142028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07/action HTTP/1.1 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 65 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3ee93b28-80ce-457d-93fe-0fba061d0f07', 'body': {'rebuild': {'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff'}}} May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 19 08:37:23.144168 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:37:23.149171 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:23.152105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:23.153183 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d7e227d-56cb-4dfc-b6dd-6c78e2474b95 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07/action" status: 404 len: 111 microversion: 2.1 time: 0.082854 May 19 08:37:23.154345 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2739/4064] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:23 2022] POST /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:23.162150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:23.163085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:23.173015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.173934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.175038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.175723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.428961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:23.441774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a80ce16-ca15-4d00-ae16-ff8655132a64 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.283369 May 19 08:37:23.442717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2740/4065] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:23 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:23.450647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:23.451340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:23.460256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.460722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.461681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.462206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.826458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:23.836291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e85c95a-c21c-4245-8276-f6fc4be241cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1308 microversion: 2.1 time: 0.390473 May 19 08:37:23.839961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2741/4066] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:23 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:23.852562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:23.856829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:23.877619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.878142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:23.879001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:23.879501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:24.439175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:24.449052 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9b6e258-b13a-4b24-95f7-ca51c1c174ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.600926 May 19 08:37:24.452576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2742/4067] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:23 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:24.458254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:24.462300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:24.499515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:24.499978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:24.500958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:24.501218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:24.823417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:24.853239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30fd7b97-2841-44e9-8fd5-2fcca2ac7d80 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.389532 May 19 08:37:24.863827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2743/4068] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:24 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:24.872701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d7cfcb1-4464-44ed-9a63-852057b16db3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:24.874695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d7cfcb1-4464-44ed-9a63-852057b16db3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 4de747f2-103f-45d5-b33d-3ca70c1ebcd9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:24.886865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0d7cfcb1-4464-44ed-9a63-852057b16db3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 4de747f2-103f-45d5-b33d-3ca70c1ebcd9 could not be found. May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d7cfcb1-4464-44ed-9a63-852057b16db3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/4de747f2-103f-45d5-b33d-3ca70c1ebcd9/action HTTP/1.1 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 65 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4de747f2-103f-45d5-b33d-3ca70c1ebcd9 could not be found. May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4de747f2-103f-45d5-b33d-3ca70c1ebcd9', 'body': {'rebuild': {'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff'}}} May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de747f2-103f-45d5-b33d-3ca70c1ebcd9 could not be found. May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 19 08:37:24.888885 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de747f2-103f-45d5-b33d-3ca70c1ebcd9 could not be found. May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de747f2-103f-45d5-b33d-3ca70c1ebcd9 could not be found. May 19 08:37:24.892713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:24.897770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d7cfcb1-4464-44ed-9a63-852057b16db3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 4de747f2-103f-45d5-b33d-3ca70c1ebcd9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:24.899460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d7cfcb1-4464-44ed-9a63-852057b16db3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/4de747f2-103f-45d5-b33d-3ca70c1ebcd9/action" status: 404 len: 111 microversion: 2.1 time: 0.034146 May 19 08:37:24.900708 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2744/4069] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:24 2022] POST /compute/v2.1/servers/4de747f2-103f-45d5-b33d-3ca70c1ebcd9/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:24.909491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:24.910415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:24.923857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:24.924685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:24.925616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:24.926270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.230941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:25.241138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75f50e82-f562-4d1d-9a92-242421f4d72c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1489 microversion: 2.1 time: 0.339056 May 19 08:37:25.241783 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2745/4070] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:24 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1489 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:25.253734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:25.264691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:25.273454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.274750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.275659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.276257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.326376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:25.594730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:25.613490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a1f56f1-3c50-4feb-bd95-1971d6339738 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.366810 May 19 08:37:25.614651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2746/4071] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:25 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:25.628872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:25.630301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:25.639910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.640722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.641803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.642790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.687322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38d3427a-94eb-489c-923c-ee359d8ffa39 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments/e4a543dd-6374-4cc6-ac42-fd39eb76e78a" status: 200 len: 194 microversion: 2.20 time: 0.071270 May 19 08:37:25.693045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2747/4072] 10.222.0.78 () {60 vars in 1453 bytes} [Thu May 19 08:37:25 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments/e4a543dd-6374-4cc6-ac42-fd39eb76e78a => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:25.702626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3f14979a-c0d3-4e06-875c-b0fd2ca6326d req-5205e504-9413-433a-86ce-bbc9cab0d91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a7feae-e67f-46d7-be63-e50adf2c1a49", "tag": "979663c4-bdcd-46ad-86db-6591d1acd7cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:25.721723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3f14979a-c0d3-4e06-875c-b0fd2ca6326d req-5205e504-9413-433a-86ce-bbc9cab0d91c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.722316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3f14979a-c0d3-4e06-875c-b0fd2ca6326d req-5205e504-9413-433a-86ce-bbc9cab0d91c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.743395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3f14979a-c0d3-4e06-875c-b0fd2ca6326d req-5205e504-9413-433a-86ce-bbc9cab0d91c service nova] Creating event network-changed:979663c4-bdcd-46ad-86db-6591d1acd7cb for instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 on chh1-842464-2 May 19 08:37:25.754187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3f14979a-c0d3-4e06-875c-b0fd2ca6326d req-5205e504-9413-433a-86ce-bbc9cab0d91c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061964 May 19 08:37:25.755156 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2748/4073] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:25.763200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:25.764229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:25.779242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.780579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.781844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.782517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.963861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:25.974175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa28b96b-ddb1-47e2-81f5-ed1a010f3f35 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1489 microversion: 2.1 time: 0.217168 May 19 08:37:25.974876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2749/4074] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:25 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1489 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:25.982266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:25.983227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:25.990988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.991532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:25.993072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:25.993610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.137917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:26.146770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5dbb35e-320d-4a70-b367-cf0d5c1fa9c8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.170513 May 19 08:37:26.147736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2750/4075] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:25 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:26.159237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.160011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.167053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.167626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.168485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.169026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.264167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lazy-loading 'services' on Instance uuid 64fedff0-296a-4a9a-9743-30c679548b9b {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:37:26.341931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-991ae1cb-3564-4bf3-9fd7-c87ac962255a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments/e4a543dd-6374-4cc6-ac42-fd39eb76e78a" status: 202 len: 0 microversion: 2.20 time: 0.186993 May 19 08:37:26.342928 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2751/4076] 10.222.0.78 () {60 vars in 1456 bytes} [Thu May 19 08:37:26 2022] DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments/e4a543dd-6374-4cc6-ac42-fd39eb76e78a => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:37:26.349210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.350000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.357185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.357671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.358456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.358897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.506991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:26.516386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba72fd5c-738c-492c-b3f7-40d49f23d47a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.171914 May 19 08:37:26.516988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2752/4077] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:26 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:26.521767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.522381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.529815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.530270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.531040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.531478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.669377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:26.677492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1489 microversion: 2.1 time: 0.159271 May 19 08:37:26.678168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2753/4078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:26 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1489 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:26.679303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.681078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ecbc8023-1f0d-46b4-bd7e-9a5cd02db557 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001287 May 19 08:37:26.681933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2754/4079] 10.222.0.78 () {56 vars in 885 bytes} [Thu May 19 08:37:26 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 08:37:26.686511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-650b472d-1754-4eee-b46f-f97860ec4ec2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:26.687159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-650b472d-1754-4eee-b46f-f97860ec4ec2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: bb8b0347-97bb-435a-96f2-2e8d24cbf25d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.692905 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-650b472d-1754-4eee-b46f-f97860ec4ec2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance bb8b0347-97bb-435a-96f2-2e8d24cbf25d could not be found. May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-650b472d-1754-4eee-b46f-f97860ec4ec2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/bb8b0347-97bb-435a-96f2-2e8d24cbf25d/action HTTP/1.1 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: {"restore": {}} May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance bb8b0347-97bb-435a-96f2-2e8d24cbf25d could not be found. May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'bb8b0347-97bb-435a-96f2-2e8d24cbf25d', 'body': {'restore': {}}} May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8b0347-97bb-435a-96f2-2e8d24cbf25d could not be found. May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8b0347-97bb-435a-96f2-2e8d24cbf25d could not be found. May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:26.694706 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8b0347-97bb-435a-96f2-2e8d24cbf25d could not be found. May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-650b472d-1754-4eee-b46f-f97860ec4ec2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance bb8b0347-97bb-435a-96f2-2e8d24cbf25d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-650b472d-1754-4eee-b46f-f97860ec4ec2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/bb8b0347-97bb-435a-96f2-2e8d24cbf25d/action" status: 404 len: 111 microversion: 2.1 time: 0.013974 May 19 08:37:26.699701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2755/4080] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:26 2022] POST /compute/v2.1/servers/bb8b0347-97bb-435a-96f2-2e8d24cbf25d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:26.702651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.703635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.719263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.719714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.720558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.721215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.754223 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055124 May 19 08:37:26.754712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2756/4081] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:26 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:26.755864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.756879 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b93371b-b3ec-4a9b-bece-82724d0bb0e1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001342 May 19 08:37:26.762799 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2757/4082] 10.222.0.78 () {54 vars in 1034 bytes} [Thu May 19 08:37:26 2022] GET /compute/v2/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 19 08:37:26.762799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.763101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.769516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.769969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.770759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.771196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.798181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:37:26.879733 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca4e0c61-4434-4a73-bbf9-d65aa7c2d22b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 204 len: 0 microversion: 2.1 time: 0.121245 May 19 08:37:26.880330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2758/4083] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:37:26 2022] DELETE /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:37:26.885910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:26.886647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:26.892672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.893115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:26.893907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:26.894341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.044314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:27.052247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.170788 May 19 08:37:27.052829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2759/4084] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:26 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:27.053958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.054998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-748a9a09-46c3-4c25-9202-9520ab0d7620 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001241 May 19 08:37:27.058609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2760/4085] 10.222.0.78 () {54 vars in 1040 bytes} [Thu May 19 08:37:27 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:27.065663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.066534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:27.073442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.073916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.074722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.075166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.217058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:27.224971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1495 microversion: 2.1 time: 0.168542 May 19 08:37:27.225603 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2761/4086] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:27 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1495 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:27.226625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.227717 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af9c4dbd-1540-4764-90bd-e24eb7be620c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001180 May 19 08:37:27.233763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2762/4087] 10.222.0.78 () {56 vars in 885 bytes} [Thu May 19 08:37:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 08:37:27.239789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.240424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:27.248136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.248580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.249385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.249833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.408727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:27.416832 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74537798-b6ea-4387-9ef6-02953f66705c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.187822 May 19 08:37:27.417630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2763/4088] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:27 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:27.433188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:27.433774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:27.440390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.440847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.441704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.442175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.468087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'restore' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: {"restore": {}} May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'restore' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'restore': {}}} May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state active. Cannot restore while the instance is in this state. May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:27.469814 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'restore' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3bfbba47-771d-46f9-9dd5-bcaf124b9fcc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 145 microversion: 2.1 time: 0.042362 May 19 08:37:27.474925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2764/4089] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:27 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 145 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 19 08:37:27.480379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.481253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:27.491635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.491635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.491635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.491635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.647391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:27.658334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e52a24d-0f44-4778-8875-3b984ca947d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.181505 May 19 08:37:27.664534 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2765/4090] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:27 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:27.668800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.671197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:27.676762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.677287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.678085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.678517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.851301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:27.854447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:27.864738 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-618a7a63-35ca-4b8c-8ecc-7017a7206e71 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.203868 May 19 08:37:27.865515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2766/4091] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:27 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:27.873192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:27.874122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:27.881532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.882233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:27.883332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:27.883975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.048142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:28.059579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1f5fcf6-2aa5-4e76-a63a-d3249bfb5a0f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.192557 May 19 08:37:28.071869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2767/4092] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:27 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:28.077783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:28.078854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:28.089987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.090548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.091402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.091915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.145683 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffce51be-fa57-46ab-9210-2fe7c5a88176 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072310 May 19 08:37:28.146290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2768/4093] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:28 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:28.154937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7086edda-e642-47de-a175-8695ce2043bf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:28.155576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7086edda-e642-47de-a175-8695ce2043bf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: b4686a88-ff0b-4f68-870c-80248dddeff0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:28.161423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7086edda-e642-47de-a175-8695ce2043bf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance b4686a88-ff0b-4f68-870c-80248dddeff0 could not be found. May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7086edda-e642-47de-a175-8695ce2043bf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/b4686a88-ff0b-4f68-870c-80248dddeff0/action HTTP/1.1 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 14 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: {"resume": {}} May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b4686a88-ff0b-4f68-870c-80248dddeff0 could not be found. May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b4686a88-ff0b-4f68-870c-80248dddeff0', 'body': {'resume': {}}} May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4686a88-ff0b-4f68-870c-80248dddeff0 could not be found. May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4686a88-ff0b-4f68-870c-80248dddeff0 could not be found. May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:28.168051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:28.172220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:28.172220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:28.172220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4686a88-ff0b-4f68-870c-80248dddeff0 could not be found. May 19 08:37:28.172220 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:28.172220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7086edda-e642-47de-a175-8695ce2043bf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance b4686a88-ff0b-4f68-870c-80248dddeff0 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:28.172220 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7086edda-e642-47de-a175-8695ce2043bf tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/b4686a88-ff0b-4f68-870c-80248dddeff0/action" status: 404 len: 111 microversion: 2.1 time: 0.024361 May 19 08:37:28.173264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2769/4094] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:28 2022] POST /compute/v2.1/servers/b4686a88-ff0b-4f68-870c-80248dddeff0/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:28.187357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:28.188262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:28.199548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.200171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.201098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.201500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.472236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:28.480333 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b1f0f19-0ca8-4fae-88b3-6f29b04d8005 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.301818 May 19 08:37:28.481394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2770/4095] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:28 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:28.496551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:28.497190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:28.504018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.504474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.505264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.505739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.674750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:28.684816 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e80f46cb-229a-41ba-9b0e-a38bb983452a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1495 microversion: 2.1 time: 0.202251 May 19 08:37:28.685738 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2771/4096] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:28 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1495 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:28.690200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:28.690839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:28.692863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:28.699452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.699908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:28.700706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:28.701160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.000458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:29.010224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9fa4c306-22ce-41b1-a403-fdd2ae3b54da tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.323605 May 19 08:37:29.011459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2772/4097] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:28 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:29.025060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:29.028666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:29.038274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.039031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.040057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.040727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.265160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:29.276472 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a504fb33-afbf-4f00-9bee-e3bb42b15255 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.263530 May 19 08:37:29.278991 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2773/4098] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:29 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:29.473926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03502316-6490-4e1a-a15b-6e817c992034 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Action: 'create', calling method: .version_select at 0x7f3217a59280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1795562009", "metadata": {"Type": "work"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03502316-6490-4e1a-a15b-6e817c992034 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Request method failure captured: May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 122 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgHIAq2-7Eqv3n-wPIL7Qt7p67Al93OUL1wlmPqTbq7SR4hsezGILk44JZli2Rw8jRf39wP-ARZcksaxbMXDk90KMby2fGnSo4S0jAtw0805RUhB25bygT1QS1QCDtcpLftzTPrDpjrtx4CLpv3YEzmDpXLOlJJDYxKhLyc-mkHb8FE May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1045728462 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 77f5f31fd68746d08bcfc94a5131b4c9 May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1795562009", "metadata": {"Type": "work"}}} May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1795562009', 'metadata': {'Type': 'work'}}}} May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '#$%' May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:37:29.477755 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 08:37:29.481600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.484915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03502316-6490-4e1a-a15b-6e817c992034 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:29.491093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03502316-6490-4e1a-a15b-6e817c992034 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.206501 May 19 08:37:29.491808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2774/4099] 10.222.0.78 () {60 vars in 1155 bytes} [Thu May 19 08:37:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:37:29.500731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:29.502424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:29.520879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.521470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.524518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.526242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.586736 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'resume' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 14 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: {"resume": {}} May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'resume' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'resume': {}}} May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state active. Cannot resume while the instance is in this state. May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.588488 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:29.592822 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:29.592822 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:29.592822 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:29.592822 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:37:29.592822 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.593176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'resume' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:29.594381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5f9118d-0675-4684-ac7b-f266a04e29ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 144 microversion: 2.1 time: 0.101250 May 19 08:37:29.595237 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2775/4100] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:29 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 144 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:37:29.606872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:29.610110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:29.629105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.629795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.631009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.631562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.697479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbcd2559-d313-4197-82b3-400ae4337237 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086884 May 19 08:37:29.700654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2776/4101] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:29 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:29.715778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-624e6036-503d-444a-8edf-409b964b8b75 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Action: 'create', calling method: .version_select at 0x7f3210f6cb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-315131303", "metadata": {"Type": "work"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-624e6036-503d-444a-8edf-409b964b8b75 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Request method failure captured: May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 119 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgHIAq2-7Eqv3n-wPIL7Qt7p67Al93OUL1wlmPqTbq7SR4hsezGILk44JZli2Rw8jRf39wP-ARZcksaxbMXDk90KMby2fGnSo4S0jAtw0805RUhB25bygT1QS1QCDtcpLftzTPrDpjrtx4CLpv3YEzmDpXLOlJJDYxKhLyc-mkHb8FE May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1045728462 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 77f5f31fd68746d08bcfc94a5131b4c9 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-315131303", "metadata": {"Type": "work"}}} May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-315131303', 'metadata': {'Type': 'work'}}}} May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '0' May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:37:29.721709 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:29.727514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-624e6036-503d-444a-8edf-409b964b8b75 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:29.737500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-624e6036-503d-444a-8edf-409b964b8b75 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022257 May 19 08:37:29.738854 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2777/4102] 10.222.0.78 () {60 vars in 1155 bytes} [Thu May 19 08:37:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:37:29.756471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:29.757100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:29.779789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.780120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.780932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:29.781420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:29.972845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:30.017582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:30.090411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:30.108990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-641b16d4-e654-4df3-94d7-c2e084dd1f1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.366636 May 19 08:37:30.109539 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2778/4103] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:29 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:30.117480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-30411481-beb1-4f0c-97ca-953feb30a7f3 req-3963facd-3cb6-40b0-a07e-0c4cc3f70467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0779eef3-859e-45b7-a4e2-0cdf527d358e", "name": "network-vif-deleted", "tag": "da7a50ff-f156-4aac-9a55-6c8b1449a401"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:30.134912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-30411481-beb1-4f0c-97ca-953feb30a7f3 req-3963facd-3cb6-40b0-a07e-0c4cc3f70467 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.139423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-30411481-beb1-4f0c-97ca-953feb30a7f3 req-3963facd-3cb6-40b0-a07e-0c4cc3f70467 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.161026 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-30411481-beb1-4f0c-97ca-953feb30a7f3 req-3963facd-3cb6-40b0-a07e-0c4cc3f70467 service nova] Creating event network-vif-deleted:da7a50ff-f156-4aac-9a55-6c8b1449a401 for instance 0779eef3-859e-45b7-a4e2-0cdf527d358e on chh1-842464-2 May 19 08:37:30.174971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-30411481-beb1-4f0c-97ca-953feb30a7f3 req-3963facd-3cb6-40b0-a07e-0c4cc3f70467 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063230 May 19 08:37:30.175912 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2779/4104] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:30.183175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:30.184641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:30.192887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.193575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.195059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.196642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.269389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.271487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.274866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lazy-loading 'fault' on Instance uuid 0779eef3-859e-45b7-a4e2-0cdf527d358e {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:37:30.351519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:30.369901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21993db0-ed3c-4e2b-84cd-bb740ef85c18 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 200 len: 1298 microversion: 2.1 time: 0.189676 May 19 08:37:30.372513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2780/4105] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:30 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 1298 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:30.384084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa286a65-aad3-47a7-bda9-8deee19b1a1d tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Action: 'create', calling method: .version_select at 0x7f3210fc0700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2019654378", "metadata": {"Type": "work"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa286a65-aad3-47a7-bda9-8deee19b1a1d tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Request method failure captured: May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 119 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgHIAq2-7Eqv3n-wPIL7Qt7p67Al93OUL1wlmPqTbq7SR4hsezGILk44JZli2Rw8jRf39wP-ARZcksaxbMXDk90KMby2fGnSo4S0jAtw0805RUhB25bygT1QS1QCDtcpLftzTPrDpjrtx4CLpv3YEzmDpXLOlJJDYxKhLyc-mkHb8FE May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1045728462 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 77f5f31fd68746d08bcfc94a5131b4c9 May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2019654378", "metadata": {"Type": "work"}}} May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2019654378', 'metadata': {'Type': 'work'}}}} May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '' May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:37:30.388722 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 08:37:30.393232 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.394442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa286a65-aad3-47a7-bda9-8deee19b1a1d tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:30.401701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa286a65-aad3-47a7-bda9-8deee19b1a1d tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027934 May 19 08:37:30.402497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2781/4106] 10.222.0.78 () {60 vars in 1155 bytes} [Thu May 19 08:37:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:37:30.410736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:30.411615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:30.422774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.423576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.424642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.425582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.608250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:30.625196 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac41d4eb-068b-4a19-8044-879090d99d89 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.221440 May 19 08:37:30.626355 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2782/4107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:30 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:30.632405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:30.636070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:30.645447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.645926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.646928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.647356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.879440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:30.891480 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c39f5cf0-4153-4245-b9ac-896cd5c6f023 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.263185 May 19 08:37:30.892589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2783/4108] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:30 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:30.899109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf122928-9c12-4d2c-8e9d-1c8da40b308a tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Calling method '.version_select at 0x7f3210e23c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:30.941976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-cf122928-9c12-4d2c-8e9d-1c8da40b308a tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] HTTP exception thrown: Volume tempest-invalid-1134011476 could not be found. May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf122928-9c12-4d2c-8e9d-1c8da40b308a tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Request method failure captured: May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1134011476 HTTP/1.1 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgHIAq2-7Eqv3n-wPIL7Qt7p67Al93OUL1wlmPqTbq7SR4hsezGILk44JZli2Rw8jRf39wP-ARZcksaxbMXDk90KMby2fGnSo4S0jAtw0805RUhB25bygT1QS1QCDtcpLftzTPrDpjrtx4CLpv3YEzmDpXLOlJJDYxKhLyc-mkHb8FE May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1045728462 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 77f5f31fd68746d08bcfc94a5131b4c9 May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: exception: Volume tempest-invalid-1134011476 could not be found. May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'tempest-invalid-1134011476'} May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1134011476 could not be found. (HTTP 404) (Request-ID: req-cfc394fd-2022-49dd-817a-54397bd9d963) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:37:30.948938 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1134011476 could not be found. May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1134011476 could not be found. May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1134011476 could not be found. May 19 08:37:30.953435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:30.957695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf122928-9c12-4d2c-8e9d-1c8da40b308a tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Returning 404 to user: Volume tempest-invalid-1134011476 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:30.958731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf122928-9c12-4d2c-8e9d-1c8da40b308a tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1134011476" status: 404 len: 99 microversion: 2.1 time: 0.064714 May 19 08:37:30.959474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2784/4109] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:37:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1134011476 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:37:30.965094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:30.967005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:30.974925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.975584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:30.978198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:30.978862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.013136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6ccb7cb-1613-4ae2-8654-d7a1ed6d942a tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052401 May 19 08:37:31.014073 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2785/4110] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:30 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:31.020863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25414b0c-be52-4747-b2b3-f0ef3e0884ec tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25414b0c-be52-4747-b2b3-f0ef3e0884ec tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 160 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d7981aac-fa9b-4c71-bcbe-06980e089b70"}]}} May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': '', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'networks': [{'uuid': 'd7981aac-fa9b-4c71-bcbe-06980e089b70'}]}}} May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '' May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:37:31.027470 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 08:37:31.034820 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.038242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25414b0c-be52-4747-b2b3-f0ef3e0884ec tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:31.040190 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25414b0c-be52-4747-b2b3-f0ef3e0884ec tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.025033 May 19 08:37:31.041552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2786/4111] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:37:31 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:37:31.048243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c9af923-98f9-422c-90df-60bdd847ad73 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005473 May 19 08:37:31.049275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2787/4112] 10.222.0.78 () {58 vars in 1139 bytes} [Thu May 19 08:37:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 08:37:31.054032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.055083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:31.063347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.064058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.065059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.065853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.268167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:31.284590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-742a9667-bcce-4864-9749-eb61d3f02d0a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.233950 May 19 08:37:31.300757 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2788/4113] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:31 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:31.306900 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f48ab42-0839-4d39-bbb8-1b3977a13a5e tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004637 May 19 08:37:31.313602 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2789/4114] 10.222.0.78 () {58 vars in 1136 bytes} [Thu May 19 08:37:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 08:37:31.323866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.327759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:31.342916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.343658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.345273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.346009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.505898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:31.522873 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66a7e7ab-926e-4e2a-85c1-beef78c5f51a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.205326 May 19 08:37:31.535604 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2790/4115] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:31 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:31.541755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8b0eaef-c087-4fc4-b72c-64241fce5613 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Calling method '.version_select at 0x7f3217ad21f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.581727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f8b0eaef-c087-4fc4-b72c-64241fce5613 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] HTTP exception thrown: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8b0eaef-c087-4fc4-b72c-64241fce5613 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Request method failure captured: May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/os-volumes/6afcadff-c1ff-4257-adf1-88865650c879 HTTP/1.1 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgHIAq2-7Eqv3n-wPIL7Qt7p67Al93OUL1wlmPqTbq7SR4hsezGILk44JZli2Rw8jRf39wP-ARZcksaxbMXDk90KMby2fGnSo4S0jAtw0805RUhB25bygT1QS1QCDtcpLftzTPrDpjrtx4CLpv3YEzmDpXLOlJJDYxKhLyc-mkHb8FE May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1045728462 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 77f5f31fd68746d08bcfc94a5131b4c9 May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: exception: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6afcadff-c1ff-4257-adf1-88865650c879'} May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. (HTTP 404) (Request-ID: req-e370cfb0-689d-4e93-bff2-6199262914e5) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:37:31.584217 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8b0eaef-c087-4fc4-b72c-64241fce5613 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Returning 404 to user: Volume 6afcadff-c1ff-4257-adf1-88865650c879 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:31.588477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8b0eaef-c087-4fc4-b72c-64241fce5613 tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6afcadff-c1ff-4257-adf1-88865650c879" status: 404 len: 109 microversion: 2.1 time: 0.048753 May 19 08:37:31.594016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2791/4116] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:37:31 2022] DELETE /compute/v2.1/os-volumes/6afcadff-c1ff-4257-adf1-88865650c879 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:31.598132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.598773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:31.607329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.607796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.608820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.609299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.627740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e HTTP/1.1 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0779eef3-859e-45b7-a4e2-0cdf527d358e'} May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.629398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:31.633015 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94fbf854-b39c-43ed-ac70-25c985ece2c1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 404 len: 111 microversion: 2.1 time: 0.038686 May 19 08:37:31.637733 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2792/4117] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:31 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:31.641791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de0b4353-ac69-482e-8cc3-a136f508c023 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:31.642502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de0b4353-ac69-482e-8cc3-a136f508c023 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 2e679e8a-d90c-4358-b65f-b1bedc25ec37] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:31.650467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-de0b4353-ac69-482e-8cc3-a136f508c023 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 2e679e8a-d90c-4358-b65f-b1bedc25ec37 could not be found. May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de0b4353-ac69-482e-8cc3-a136f508c023 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/2e679e8a-d90c-4358-b65f-b1bedc25ec37/action HTTP/1.1 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 14 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: {"shelve": {}} May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2e679e8a-d90c-4358-b65f-b1bedc25ec37 could not be found. May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2e679e8a-d90c-4358-b65f-b1bedc25ec37', 'body': {'shelve': {}}} May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e679e8a-d90c-4358-b65f-b1bedc25ec37 could not be found. May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e679e8a-d90c-4358-b65f-b1bedc25ec37 could not be found. May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.653000 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.656668 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:31.656668 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:31.656668 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e679e8a-d90c-4358-b65f-b1bedc25ec37 could not be found. May 19 08:37:31.656668 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.656668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de0b4353-ac69-482e-8cc3-a136f508c023 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 2e679e8a-d90c-4358-b65f-b1bedc25ec37 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:31.656668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de0b4353-ac69-482e-8cc3-a136f508c023 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/2e679e8a-d90c-4358-b65f-b1bedc25ec37/action" status: 404 len: 111 microversion: 2.1 time: 0.016968 May 19 08:37:31.660284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2793/4118] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:31 2022] POST /compute/v2.1/servers/2e679e8a-d90c-4358-b65f-b1bedc25ec37/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:31.666780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef21bf7e-4c25-426d-b619-75b7471cd78b tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Calling method '.version_select at 0x7f3210fc08b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.699551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ef21bf7e-4c25-426d-b619-75b7471cd78b tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] HTTP exception thrown: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef21bf7e-4c25-426d-b619-75b7471cd78b tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Request method failure captured: May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/os-volumes/36b6baf1-d34b-405a-aa26-c2cff6195e44 HTTP/1.1 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgHIAq2-7Eqv3n-wPIL7Qt7p67Al93OUL1wlmPqTbq7SR4hsezGILk44JZli2Rw8jRf39wP-ARZcksaxbMXDk90KMby2fGnSo4S0jAtw0805RUhB25bygT1QS1QCDtcpLftzTPrDpjrtx4CLpv3YEzmDpXLOlJJDYxKhLyc-mkHb8FE May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e448a3608de46d5a0970f00e751cd5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1045728462 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0e448a3608de46d5a0970f00e751cd5e May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1045728462 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 77f5f31fd68746d08bcfc94a5131b4c9 May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1045728462-project May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: exception: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '36b6baf1-d34b-405a-aa26-c2cff6195e44'} May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. (HTTP 404) (Request-ID: req-0032667e-b002-4d6c-ba53-4e519d1f3346) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 08:37:31.702161 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef21bf7e-4c25-426d-b619-75b7471cd78b tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] Returning 404 to user: Volume 36b6baf1-d34b-405a-aa26-c2cff6195e44 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef21bf7e-4c25-426d-b619-75b7471cd78b tempest-VolumesNegativeTest-1045728462 tempest-VolumesNegativeTest-1045728462-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/36b6baf1-d34b-405a-aa26-c2cff6195e44" status: 404 len: 109 microversion: 2.1 time: 0.042301 May 19 08:37:31.705791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2794/4119] 10.222.0.78 () {58 vars in 1244 bytes} [Thu May 19 08:37:31 2022] GET /compute/v2.1/os-volumes/36b6baf1-d34b-405a-aa26-c2cff6195e44 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:31.724020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.730613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:31.745878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.746847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.748159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.749969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.785755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:37:31.789120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:31.914914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b616ca5a-5a9a-47f5-b86d-543ea0ff1547 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 204 len: 0 microversion: 2.1 time: 0.208592 May 19 08:37:31.920885 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2795/4120] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:37:31 2022] DELETE /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:37:31.927517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:31.929330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:31.938776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.938776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:31.938776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:31.939676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.148738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:32.159641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-37cabe3e-6fb6-4239-b1fb-81330144a551 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.236872 May 19 08:37:32.161081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2796/4121] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:31 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:32.166484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:32.167324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:32.175930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.177609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.179363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.180796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.457721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:32.466319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d47fea4-537f-4cca-a1f2-56ef11ed7d3e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.303822 May 19 08:37:32.470667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2797/4122] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:32 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:32.475458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:32.496733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:32.507547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.509496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.510920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.511808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.736543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:32.746117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a887c630-19be-4c8b-86ac-cb26c85e1ac6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1495 microversion: 2.1 time: 0.274294 May 19 08:37:32.770377 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2798/4123] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:32 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1495 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:32.778093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:32.779954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:32.786881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.787598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.788397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.789148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.844692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e06c4309-0c6f-4b4b-ae3a-aa5cee54621b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072646 May 19 08:37:32.845599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2799/4124] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:32 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:32.852697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:32.854055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:32.861833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.863124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:32.864205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:32.864735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.053176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:33.062789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e664498f-abe4-4698-8999-140ba5b19482 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.216020 May 19 08:37:33.063889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2800/4125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:32 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:33.071319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-10d75bbd-ce0d-44e1-93ab-f7f6b16ee7e9 req-16d1eb59-d6c4-432b-a6b5-233b3733b4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a7feae-e67f-46d7-be63-e50adf2c1a49", "name": "network-vif-plugged", "status": "completed", "tag": "979663c4-bdcd-46ad-86db-6591d1acd7cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:33.081229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-10d75bbd-ce0d-44e1-93ab-f7f6b16ee7e9 req-16d1eb59-d6c4-432b-a6b5-233b3733b4b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.082356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-10d75bbd-ce0d-44e1-93ab-f7f6b16ee7e9 req-16d1eb59-d6c4-432b-a6b5-233b3733b4b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.095054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-10d75bbd-ce0d-44e1-93ab-f7f6b16ee7e9 req-16d1eb59-d6c4-432b-a6b5-233b3733b4b4 service nova] Creating event network-vif-plugged:979663c4-bdcd-46ad-86db-6591d1acd7cb for instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 on chh1-842464-2 May 19 08:37:33.100967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-10d75bbd-ce0d-44e1-93ab-f7f6b16ee7e9 req-16d1eb59-d6c4-432b-a6b5-233b3733b4b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 May 19 08:37:33.102302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2801/4126] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:33.119458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:33.120554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:33.135485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.135940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.141841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.142312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.190298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lazy-loading 'flavor' on Instance uuid 83bf71d1-ffb2-4636-ad87-2a206d45851d {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:37:33.644069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-32b94289-9fc8-413d-afe5-d48ca119f550 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 202 len: 0 microversion: 2.1 time: 0.539706 May 19 08:37:33.648933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2802/4127] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:33 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:37:33.658802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:33.664131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:33.679164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.679164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.684269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.684834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.901008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:33.911272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca8b5e34-9627-4998-be1b-c81656a79e78 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1308 microversion: 2.1 time: 0.260625 May 19 08:37:33.921764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2803/4128] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:33 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:33.927216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:33.928004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:33.935342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.936082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:33.937000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:33.937588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.112351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:34.127924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6abb8440-789d-4bfe-817d-1c334c2fcfe8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.204136 May 19 08:37:34.132149 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2804/4129] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:33 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:34.139001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:34.144000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:34.157243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.158198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.159364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.160209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.408688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:34.419594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31cfa532-aab4-4a46-8bd6-ae28929ae617 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 200 len: 1495 microversion: 2.1 time: 0.285068 May 19 08:37:34.423033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2805/4130] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:34 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 1495 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:34.445092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:34.447887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:34.464360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.464580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.467939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.477386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.548423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6a60a41-8c2e-4876-9f96-be52e00366a0 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123498 May 19 08:37:34.562975 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2806/4131] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:34 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:34.576672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-702a2c7b-1b0b-425e-a9ba-59a12191247b req-96815f83-004a-4100-a77c-379b10ced5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8105472-c446-4604-9a41-b4a40bdcc14f", "name": "network-vif-deleted", "tag": "6d52f1fc-a0bc-48a6-b739-b4b7f9c01d84"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:34.597839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-702a2c7b-1b0b-425e-a9ba-59a12191247b req-96815f83-004a-4100-a77c-379b10ced5f1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.598535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-702a2c7b-1b0b-425e-a9ba-59a12191247b req-96815f83-004a-4100-a77c-379b10ced5f1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.630156 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-702a2c7b-1b0b-425e-a9ba-59a12191247b req-96815f83-004a-4100-a77c-379b10ced5f1 service nova] Creating event network-vif-deleted:6d52f1fc-a0bc-48a6-b739-b4b7f9c01d84 for instance b8105472-c446-4604-9a41-b4a40bdcc14f on chh1-842464-2 May 19 08:37:34.648811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-702a2c7b-1b0b-425e-a9ba-59a12191247b req-96815f83-004a-4100-a77c-379b10ced5f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081502 May 19 08:37:34.649492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2807/4132] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:37:34.933159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:34.934281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:34.953648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.954278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:34.960296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:34.967380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.174187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:35.184462 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d509fa46-8c76-4b8e-a6e1-b6fb0c19e3f0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1488 microversion: 2.1 time: 0.258772 May 19 08:37:35.185824 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2808/4133] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:34 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1488 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:35.190754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:35.191651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:35.201723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.203204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.204187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.205343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.413289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:35.427630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b574ee8f-6ca1-47ca-bfab-4d1da59f54e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.240267 May 19 08:37:35.428897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2809/4134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:35 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:35.436434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:35.438141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:35.447879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.448592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.449696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.450331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.454790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:35.543863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8b896ee-80cb-4813-9f79-86ae837e8d66 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49/action" status: 202 len: 0 microversion: 2.1 time: 0.112800 May 19 08:37:35.544546 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2810/4135] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:35 2022] POST /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:37:35.551585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:35.552624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:35.565049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.566035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.568496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.569541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.592042 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f HTTP/1.1 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b8105472-c446-4604-9a41-b4a40bdcc14f'} May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:35.593791 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6c06dfd-ac70-4d6c-93c9-a43eaaae5ffc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 404 len: 111 microversion: 2.1 time: 0.049132 May 19 08:37:35.597738 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2811/4136] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:35 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:37:35.607098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:35.608300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:35.630466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.647448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.649833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.651737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.892617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:35.904421 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df3b33b0-ebb9-4f86-95c5-81710964058a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1493 microversion: 2.1 time: 0.306450 May 19 08:37:35.905164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2812/4137] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:35 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1493 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:35.910919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:35.912016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:35.920109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.920809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.921775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:35.922366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:35.966420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64f23705-f4ba-484c-a445-8143b72e3751 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060029 May 19 08:37:35.967580 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2813/4138] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:35 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:35.974197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1959370743", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:36.046060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:37:36.800801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:37:36.802109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:37:36.802762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:37:36.803321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:37:36.803884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:37:36.829537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:36.830000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:36.830811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:36.831258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:36.851676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:37:36.857857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:37:36.874584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:37:36.878353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:37:36.937134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8b67786-9102-4a75-bbd0-fdee9eb4e351 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968256 May 19 08:37:36.938502 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2814/4139] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:37:36.948722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:36.949483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:36.960926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:36.962160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:36.964092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:36.964615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:37.186267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:37.199893 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-847b73ba-d1f0-4431-96ba-1eadb818f95d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.255479 May 19 08:37:37.201916 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2815/4140] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:36 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:37.215074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:37.215704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:37.229707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:37.230794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:37.232444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:37.234392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:37.424546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:37.434299 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-372ffd3f-8214-490b-a287-7884dbcab9f6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 200 len: 1473 microversion: 2.1 time: 0.231337 May 19 08:37:37.435475 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2816/4141] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:37 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:37.440851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dcd713a-147c-438d-9bce-9831dfee78f9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:37.441727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8dcd713a-147c-438d-9bce-9831dfee78f9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:37.541916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8dcd713a-147c-438d-9bce-9831dfee78f9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:37.562194 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8dcd713a-147c-438d-9bce-9831dfee78f9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1209 microversion: 2.1 time: 0.125461 May 19 08:37:37.563589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2817/4142] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:37 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:37.569893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:37.572041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:37.587551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:37.588308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:37.598752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:37.599726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:37.641770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07df5e5b-6f36-414c-acc7-c397dd55357f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076602 May 19 08:37:37.642812 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2818/4143] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:37 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:37.647592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-108827567"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:37:37.649266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:37.653198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:37.667336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:37.667789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:37.671708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:37.672226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.116031 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ecc5997-1a8e-4a90-8341-c4600e6c4097 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49/action" status: 202 len: 0 microversion: 2.1 time: 0.471869 May 19 08:37:38.120850 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2819/4144] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:37:37 2022] POST /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:37:38.139557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0db8980-1012-4e42-bf3d-febc46ef4f62 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3217ab31f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:38.219154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0db8980-1012-4e42-bf3d-febc46ef4f62 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 200 len: 1411 microversion: 2.1 time: 0.091542 May 19 08:37:38.220010 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2820/4145] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:37:38 2022] GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:38.242065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:38.251206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:38.277747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:38.278450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.279563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:38.280169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.575525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:38.584938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-986ff501-0e2c-40b0-97b4-17eaee872fb0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.355780 May 19 08:37:38.587448 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2821/4146] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:38 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:38.592538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:38.593525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:38.601210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:38.602644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.603829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:38.604472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.683421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:38.692590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a5e3c67-73d4-48e7-bf3d-d25cb3e6a794 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1261 microversion: 2.1 time: 0.103874 May 19 08:37:38.693225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2822/4147] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:38 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:38.699428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:38.700480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:38.708317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:38.708902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.709743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:38.710318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:38.749442 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a75c17a8-863c-44f1-a4f7-14b5586f7746 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054878 May 19 08:37:38.754404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2823/4148] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:38 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:39.236247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d3c4fbb-1fc9-4e13-8053-0d09733a45a9 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3211e88f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:39.319104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d3c4fbb-1fc9-4e13-8053-0d09733a45a9 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 200 len: 1411 microversion: 2.1 time: 0.088214 May 19 08:37:39.320006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2824/4149] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:37:39 2022] GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:39.608588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:39.609220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:39.624364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:39.624835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:39.625680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:39.626130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:39.977093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:39.986269 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b67c2b41-8597-4c05-b2c3-e55c66e65d6e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1533 microversion: 2.1 time: 0.385953 May 19 08:37:40.001441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2825/4150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:39 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1533 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:40.016036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:40.016666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:40.032272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:40.032732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:40.033554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:40.033991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:40.353476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:40.362755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce6c2190-7d9e-4312-b4e0-0a9df96cfc64 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1309 microversion: 2.1 time: 0.359777 May 19 08:37:40.363677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2826/4151] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:40 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:40.369836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:40.371261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:40.378548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:40.379393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:40.380519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:40.381279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:40.417791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78712292-cfee-47d9-bde2-43748a7ae8bf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052704 May 19 08:37:40.418738 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2827/4152] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:40 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:40.432571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-270117f3-fc9c-49ef-874e-e0d561237d5f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210f7aee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:40.546380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-270117f3-fc9c-49ef-874e-e0d561237d5f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 200 len: 1411 microversion: 2.1 time: 0.122838 May 19 08:37:40.551109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2828/4153] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:37:40 2022] GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:41.007008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:41.007771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:41.026560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:41.028821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:41.029763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:41.032567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:41.336951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:41.344084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:41.347993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-908df570-8643-44cf-9f86-a570db14066b tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1533 microversion: 2.1 time: 0.345991 May 19 08:37:41.359011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2829/4154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:40 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1533 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:37:41.381024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:41.386256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:41.412611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:41.413061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:41.416357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:41.418947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:41.867659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:37:41.884966 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0e5d40d-9c06-4c65-aa0c-f4a75d7f0dce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1309 microversion: 2.1 time: 0.508538 May 19 08:37:41.894412 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2830/4155] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:37:41 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1309 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:37:41.894412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:41.895268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:37:41.912715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:41.913204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:41.914341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:37:41.920073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:37:42.022868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50fdd9ed-3c5e-47eb-b498-ab260975e0cd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135610 May 19 08:37:42.031262 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2831/4156] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:37:41 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:37:42.045977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6879e337-767a-4898-baba-d7ad2836a954 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321206d430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:37:46.842017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:47.561867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:51.906221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=19 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:37:52.007150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:00.491478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6879e337-767a-4898-baba-d7ad2836a954 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 200 len: 1411 microversion: 2.1 time: 18.457347 May 19 08:38:00.497745 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2832/4157] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:37:42 2022] GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 1411 bytes in 18461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:00.512493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-045ac514-966a-465f-90d5-7053de82f22a req-11297017-623c-42c9-8ca1-6e8a15e9550a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1eafe1-5443-4f50-b3c1-73582eef2478", "tag": "f5eeb00f-9eba-4433-ae2e-202f89759c4c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:00.524819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-045ac514-966a-465f-90d5-7053de82f22a req-11297017-623c-42c9-8ca1-6e8a15e9550a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:00.525274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-045ac514-966a-465f-90d5-7053de82f22a req-11297017-623c-42c9-8ca1-6e8a15e9550a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:00.548939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-045ac514-966a-465f-90d5-7053de82f22a req-11297017-623c-42c9-8ca1-6e8a15e9550a service nova] Creating event network-changed:f5eeb00f-9eba-4433-ae2e-202f89759c4c for instance da1eafe1-5443-4f50-b3c1-73582eef2478 on chh1-842464-2 May 19 08:38:00.571588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-045ac514-966a-465f-90d5-7053de82f22a req-11297017-623c-42c9-8ca1-6e8a15e9550a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077178 May 19 08:38:00.572535 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2833/4158] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:00.577612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:00.578515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:00.598918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:00.599516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:00.609722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:00.609722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:00.870079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:00.878359 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25d06201-9083-4497-8cbf-2309b596f1b0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1528 microversion: 2.1 time: 0.304609 May 19 08:38:00.878971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2834/4159] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:00 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1528 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:00.884828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:00.885638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:00.892001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:00.892843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:00.893856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:00.894288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.113204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:01.123735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec46f368-1d88-4ffd-b6ea-734faecc0ea9 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1309 microversion: 2.1 time: 0.242702 May 19 08:38:01.125849 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2835/4160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:00 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1309 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:01.147465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:01.151534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:01.164702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.165563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.166369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.166959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.234017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05d77184-7f79-4eb7-baba-04c34e10ba75 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.097977 May 19 08:38:01.234642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2836/4161] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:38:01 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:01.253753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-01447f40-8efa-44d1-a611-b894e281f231 req-36244b93-ee7b-490b-b804-311c3b405393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a7feae-e67f-46d7-be63-e50adf2c1a49", "name": "network-vif-plugged", "status": "completed", "tag": "979663c4-bdcd-46ad-86db-6591d1acd7cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:01.265398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-01447f40-8efa-44d1-a611-b894e281f231 req-36244b93-ee7b-490b-b804-311c3b405393 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.266244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-01447f40-8efa-44d1-a611-b894e281f231 req-36244b93-ee7b-490b-b804-311c3b405393 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.284420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-01447f40-8efa-44d1-a611-b894e281f231 req-36244b93-ee7b-490b-b804-311c3b405393 service nova] Creating event network-vif-plugged:979663c4-bdcd-46ad-86db-6591d1acd7cb for instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 on chh1-842464-2 May 19 08:38:01.291978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-01447f40-8efa-44d1-a611-b894e281f231 req-36244b93-ee7b-490b-b804-311c3b405393 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056031 May 19 08:38:01.294379 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2837/4162] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:01.305709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:01.307079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:01.320981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.321772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.322681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.323288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.372112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfd20a91-bb86-4ac5-afd4-de130fd453b8 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.075983 May 19 08:38:01.373716 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2838/4163] 10.222.0.78 () {58 vars in 1292 bytes} [Thu May 19 08:38:01 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960/os-server-password => generated 116 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:01.667751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:01.668446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:01.680869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.682881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.684000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.684661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.723975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:38:01.868581 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5068e8ab-1e85-4f1c-9d67-c5c5d105ad61 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 204 len: 0 microversion: 2.42 time: 0.493070 May 19 08:38:01.869933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2839/4164] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:38:01 2022] DELETE /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:38:01.879629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:01.902676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:01.926020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.926020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.926020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:01.926020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:01.986009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:38:02.120107 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3a0679d-f062-4161-8012-e340e61fbc4b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 204 len: 0 microversion: 2.20 time: 0.245009 May 19 08:38:02.121089 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2840/4165] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:38:01 2022] DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:38:02.129408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-877248ad-8877-41ad-bae8-82cbf0ad4826 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32121670d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:02.202043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-877248ad-8877-41ad-bae8-82cbf0ad4826 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 200 len: 1420 microversion: 2.1 time: 0.077355 May 19 08:38:02.202926 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2841/4166] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:38:02 2022] GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:02.208947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:02.210148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:02.219918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:02.220664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:02.221782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:02.223012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:02.920695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:02.940339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:02.941945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:02.943243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b948feaf-72f0-43c3-9e8b-e091c21380c6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2955 microversion: 2.42 time: 0.738936 May 19 08:38:02.943814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2842/4167] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:02 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2955 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:02.949145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:02.953765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:02.973181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:02.974333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:02.976157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:02.981484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:03.197146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:03.210051 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7517df6b-570a-41ab-931f-d0de9e487424 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1510 microversion: 2.1 time: 0.265140 May 19 08:38:03.221887 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2843/4168] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:02 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:03.228259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:03.229556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:03.236147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:03.236799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:03.237772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:03.238552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:03.436714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:03.463903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:03.466227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:03.467777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbc1a434-6493-4e65-a4c3-4f0f8789274e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1722 microversion: 2.20 time: 0.244426 May 19 08:38:03.468654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2844/4169] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:03 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:03.474684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:03.475925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:03.483856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:03.484619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:03.485790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:03.486840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:03.643397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:03.655560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf2a4108-1551-4dd5-8a5e-6115ec046727 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1309 microversion: 2.1 time: 0.185435 May 19 08:38:03.656346 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2845/4170] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:03 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:03.662194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3dd38ac9-4e27-40f5-b646-85ab91da1e58 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321235f820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:03.728692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3dd38ac9-4e27-40f5-b646-85ab91da1e58 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 200 len: 1420 microversion: 2.1 time: 0.071423 May 19 08:38:03.736047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2846/4171] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:38:03 2022] GET /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:03.736839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f3bfaefb-0cf9-4d4f-9e98-969031726932 req-aa98c031-0ad6-42c3-aeaa-e1b470a88e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "name": "network-vif-plugged", "status": "completed", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}, {"server_uuid": "da1eafe1-5443-4f50-b3c1-73582eef2478", "name": "network-vif-plugged", "status": "completed", "tag": "f5eeb00f-9eba-4433-ae2e-202f89759c4c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:03.748539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f3bfaefb-0cf9-4d4f-9e98-969031726932 req-aa98c031-0ad6-42c3-aeaa-e1b470a88e65 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:03.748998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f3bfaefb-0cf9-4d4f-9e98-969031726932 req-aa98c031-0ad6-42c3-aeaa-e1b470a88e65 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:03.764433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f3bfaefb-0cf9-4d4f-9e98-969031726932 req-aa98c031-0ad6-42c3-aeaa-e1b470a88e65 service nova] Creating event network-vif-plugged:dd872ee5-3152-4351-a644-7f3684672d4b for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d on chh2-842464-2 May 19 08:38:03.765133 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f3bfaefb-0cf9-4d4f-9e98-969031726932 req-aa98c031-0ad6-42c3-aeaa-e1b470a88e65 service nova] Creating event network-vif-plugged:f5eeb00f-9eba-4433-ae2e-202f89759c4c for instance da1eafe1-5443-4f50-b3c1-73582eef2478 on chh1-842464-2 May 19 08:38:03.775796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f3bfaefb-0cf9-4d4f-9e98-969031726932 req-aa98c031-0ad6-42c3-aeaa-e1b470a88e65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044925 May 19 08:38:03.776773 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2847/4172] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:03.784912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbf8877e-af19-47e5-840a-3c5de53fc59e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210f7ad30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:04.551693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbf8877e-af19-47e5-840a-3c5de53fc59e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 204 len: 0 microversion: 2.1 time: 0.773442 May 19 08:38:04.552361 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2848/4173] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:03 2022] DELETE /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:38:04.558272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:04.559021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:04.577348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:04.577989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:04.579544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:04.580072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:04.833228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:04.856933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:04.860290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:04.862817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7336051-5de1-4d8e-a23b-61ad24e1687a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2955 microversion: 2.42 time: 0.309482 May 19 08:38:04.878350 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2849/4174] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:04 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2955 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:04.885858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:04.886517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:04.893466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:04.894179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:04.895159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:04.895782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.103056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:05.111870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9ea3e84-7710-4c65-bb4b-8a982e1a47c7 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1513 microversion: 2.1 time: 0.232084 May 19 08:38:05.113065 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2850/4175] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:04 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:05.118775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:05.119398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:05.126425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.126950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.127835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.128343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.160501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:05.364273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:05.373705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:05.375646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:05.376862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51f1cd72-883f-409e-80dd-f6590d027ca2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1722 microversion: 2.20 time: 0.262186 May 19 08:38:05.377678 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2851/4176] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:05 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:05.383073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:05.383818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:05.391198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.391839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.392800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.394027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.432423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:38:05.533591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-323c606d-5487-4bec-978b-c1f3a6b6f18d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 204 len: 0 microversion: 2.1 time: 0.154027 May 19 08:38:05.537706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2852/4177] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:38:05 2022] DELETE /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:38:05.546240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:05.547474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:05.586544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.589643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.590872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.592043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.834728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:05.848365 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-563170bd-ea73-40f9-9234-a25a1da64b90 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1309 microversion: 2.1 time: 0.305465 May 19 08:38:05.849291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2853/4178] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:05 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:05.862416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:05.863055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:05.872867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.873605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:05.874186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:05.874622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:06.053684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:06.064161 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a30c8a8a-bd19-45b3-adb8-d6a2dfac4b39 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1453 microversion: 2.1 time: 0.213016 May 19 08:38:06.065076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2854/4179] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:05 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:06.083239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1551500999", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "1a050905-faf4-46cc-bb59-12e712335300"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:06.169126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] validate_networks() for [('1a050905-faf4-46cc-bb59-12e712335300', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:38:06.634188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:38:06.635098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:38:06.635590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:38:06.636011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:38:06.636435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:38:06.647304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:06.648944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:06.649954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:06.650896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:06.672459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:38:06.680017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for user f59b91044370427fa198cff1a2c604e9 and project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:38:06.694619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:38:06.697242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:38:06.761495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bcdef0d-8dfb-42d7-a930-f805b92abf11 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695106 May 19 08:38:06.762559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2855/4180] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:38:06.768909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dd4c90f2-dbfb-4612-8fe0-c6886efb504f req-38fc05d0-b465-4b87-8860-dc0ed210a2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a7feae-e67f-46d7-be63-e50adf2c1a49", "name": "network-vif-unplugged", "status": "completed", "tag": "979663c4-bdcd-46ad-86db-6591d1acd7cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:06.782694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dd4c90f2-dbfb-4612-8fe0-c6886efb504f req-38fc05d0-b465-4b87-8860-dc0ed210a2ca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:06.783155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dd4c90f2-dbfb-4612-8fe0-c6886efb504f req-38fc05d0-b465-4b87-8860-dc0ed210a2ca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:06.823238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dd4c90f2-dbfb-4612-8fe0-c6886efb504f req-38fc05d0-b465-4b87-8860-dc0ed210a2ca service nova] Creating event network-vif-unplugged:979663c4-bdcd-46ad-86db-6591d1acd7cb for instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 on chh1-842464-2 May 19 08:38:06.830149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dd4c90f2-dbfb-4612-8fe0-c6886efb504f req-38fc05d0-b465-4b87-8860-dc0ed210a2ca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065928 May 19 08:38:06.831127 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2856/4181] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:06.838299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:06.839300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:06.849572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:06.850109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:06.850983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:06.852317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:07.276743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:07.292060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:07.293710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:07.295086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6a8e4d8-145c-49ef-8d8e-d42e65babf65 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2955 microversion: 2.42 time: 0.462919 May 19 08:38:07.304902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2857/4182] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:06 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2955 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:07.313073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:07.313472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:07.327099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:07.327567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:07.328410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:07.328862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:07.379523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lazy-loading 'flavor' on Instance uuid 83bf71d1-ffb2-4636-ad87-2a206d45851d {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:38:07.412138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'shelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state shelved_offloaded May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 14 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: {"shelve": {}} May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'shelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state shelved_offloaded May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'shelve': {}}} May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 19 08:38:07.416703 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state shelved_offloaded May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state shelved_offloaded May 19 08:38:07.421008 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:07.423961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'shelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state shelved_offloaded {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:07.425482 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4e4adf9-3644-4636-87f6-adbcc8c9377f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 155 microversion: 2.1 time: 0.120740 May 19 08:38:07.426450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2858/4183] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:07 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 155 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:38:07.436243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:07.437736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:07.445795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:07.446541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:07.448166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:07.448614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:07.989291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:08.014722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:08.016449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:08.017647 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c80d8249-5ce8-4462-aeee-48931ebd7857 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1722 microversion: 2.20 time: 0.589933 May 19 08:38:08.018552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2859/4184] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:07 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1722 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:08.036137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:08.037531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:08.047312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:08.048261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:08.049688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:08.052467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:08.171988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:08.182186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbcb0ff7-6b21-44f8-b877-e5cf43ea3502 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1204 microversion: 2.1 time: 0.162469 May 19 08:38:08.182984 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2860/4185] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:08 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1204 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:08.207075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:08.210014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:08.230125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:08.230621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:08.232414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:08.234612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:08.819031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:08.833186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e64b0fa-c3f6-4341-a389-44706cec7fce tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1309 microversion: 2.1 time: 0.637529 May 19 08:38:08.834337 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2861/4186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:08 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1309 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:08.839952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:08.849383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:08.869888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:08.870872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:08.871998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:08.872708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:09.061072 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5cb02666-fcfd-4dac-aac0-62d8690d3d75 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 202 len: 0 microversion: 2.1 time: 0.225450 May 19 08:38:09.062801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2862/4187] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:08 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:38:09.068333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:09.070840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:09.092756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:09.093573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:09.094741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:09.095440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:09.776996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:09.797777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:09.803229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:09.810399 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e8be14c-fe4f-4ad7-b97f-72a264dee6f8 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2955 microversion: 2.42 time: 0.744315 May 19 08:38:09.814954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2863/4188] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:09 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2955 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:09.831042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3445caca-2d2d-4365-98aa-fa503983a052 req-213a8588-5e96-488c-9387-d9506166c593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "name": "network-vif-unplugged", "status": "completed", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:09.851986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3445caca-2d2d-4365-98aa-fa503983a052 req-213a8588-5e96-488c-9387-d9506166c593 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:09.852690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3445caca-2d2d-4365-98aa-fa503983a052 req-213a8588-5e96-488c-9387-d9506166c593 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:09.866010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_external_events [req-3445caca-2d2d-4365-98aa-fa503983a052 req-213a8588-5e96-488c-9387-d9506166c593 service nova] Unable to find a host for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d. Dropping event network-vif-unplugged {{(pid=119072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 08:38:09.870807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3445caca-2d2d-4365-98aa-fa503983a052 req-213a8588-5e96-488c-9387-d9506166c593 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054154 May 19 08:38:09.872151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2864/4189] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 08:38:09.877609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:09.878589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:09.885604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:09.886388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:09.887439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:09.888138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:10.055621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:10.076347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:10.079816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:10.087944 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ebb9d38b-4174-4969-ace3-2e91db2d59bb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 200 len: 1655 microversion: 2.20 time: 0.209327 May 19 08:38:10.105606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2865/4190] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:09 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 1655 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:10.141605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:10.154000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:10.186186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:10.186807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:10.192307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:10.192795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:11.090268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:11.103415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d2b59f5-bb37-44b8-89ea-5328ed76ca62 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1461 microversion: 2.1 time: 0.994587 May 19 08:38:11.105184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2866/4191] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:10 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1461 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:11.136223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:11.141483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:11.154856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:11.157174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:11.159833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:11.160869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:11.274912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:11.471710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:11.500043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-131f8382-0903-4f29-b974-73e2a80e823e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1266 microversion: 2.1 time: 0.393665 May 19 08:38:11.500671 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2867/4192] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:11 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:11.536187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:11.536954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:11.548146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:11.567908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:11.568362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:11.569230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:11.569661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.074293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:12.082394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6cd65720-60ed-4162-baab-2883cd4156e8 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1490 microversion: 2.1 time: 0.560668 May 19 08:38:12.083457 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2868/4193] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:11 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1490 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:12.094227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0fa3a069-2a1a-497d-991e-aede72ef8153 req-94390838-2877-42d7-a7b6-bbbd7c60bda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fedff0-296a-4a9a-9743-30c679548b9b", "name": "network-vif-deleted", "tag": "f69074b5-29b6-44ce-a093-01ed4c5f5b42"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:12.106291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0fa3a069-2a1a-497d-991e-aede72ef8153 req-94390838-2877-42d7-a7b6-bbbd7c60bda6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.107237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0fa3a069-2a1a-497d-991e-aede72ef8153 req-94390838-2877-42d7-a7b6-bbbd7c60bda6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.123120 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0fa3a069-2a1a-497d-991e-aede72ef8153 req-94390838-2877-42d7-a7b6-bbbd7c60bda6 service nova] Creating event network-vif-deleted:f69074b5-29b6-44ce-a093-01ed4c5f5b42 for instance 64fedff0-296a-4a9a-9743-30c679548b9b on chh1-842464-2 May 19 08:38:12.128383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0fa3a069-2a1a-497d-991e-aede72ef8153 req-94390838-2877-42d7-a7b6-bbbd7c60bda6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043261 May 19 08:38:12.129276 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2869/4194] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:12.135514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:12.136324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:12.143162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.143646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.144723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.145174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.587242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:12.602439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:12.610707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:12.612459 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2326684d-e761-4f11-8c6a-acbdef6cfae1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2934 microversion: 2.42 time: 0.481479 May 19 08:38:12.613045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2870/4195] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:12 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2934 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:12.638653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:12.642836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:12.656019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.657536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.658330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.658773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.689367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] HTTP exception thrown: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Request method failure captured: May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b HTTP/1.1 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDkGRaHAytumnh5B6BiCrOD4rpSHaXHYu8f3EoON-tDdgZ9nSjsFBk5lkNrbIldF66YdNp6Ga_eV4fsbBaYQVxkB17gqTaYo_iuICdY6OKIlVvEeRMx8NRV899PsImFpFZCB7637AzyhVnOHfDkHlWDefMxhWaj8_nz7mZ54jXZAo4 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.20 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 666f1bf89e4940a38d63dbe3a2380a1f May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64fedff0-296a-4a9a-9743-30c679548b9b'} May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:12.691091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Returning 404 to user: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:12.694717 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce03af3f-cedf-4285-a25f-7d12356244d5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 404 len: 111 microversion: 2.20 time: 0.065878 May 19 08:38:12.700959 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2871/4196] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:12 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:38:12.707116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-unplugged", "status": "completed", "tag": "54802d14-fe37-40ec-9d4e-45c5506a6a30"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-unplugged", "status": "completed", "tag": "94babe40-01cf-4e4b-b343-36b1cd7d8aed"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-unplugged", "status": "completed", "tag": "ee4b12a5-239c-4c07-9dcb-7cd272e1df1b"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-unplugged", "status": "completed", "tag": "35b433fc-d79e-466a-bec4-224d739093ed"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-unplugged", "status": "completed", "tag": "23c51317-3b4b-4c46-8685-bf35bfb26d47"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-unplugged", "status": "completed", "tag": "b0bc770d-5102-4981-80bd-f484c3748df7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:12.729630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.732516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.758043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Creating event network-vif-unplugged:54802d14-fe37-40ec-9d4e-45c5506a6a30 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:12.758929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Creating event network-vif-unplugged:94babe40-01cf-4e4b-b343-36b1cd7d8aed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:12.759792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Creating event network-vif-unplugged:ee4b12a5-239c-4c07-9dcb-7cd272e1df1b for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:12.760482 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Creating event network-vif-unplugged:35b433fc-d79e-466a-bec4-224d739093ed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:12.761591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Creating event network-vif-unplugged:23c51317-3b4b-4c46-8685-bf35bfb26d47 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:12.762282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] Creating event network-vif-unplugged:b0bc770d-5102-4981-80bd-f484c3748df7 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:12.780520 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2c9d4643-c07f-4a99-8698-3909a7af8a1e req-8c0bbc1e-9339-4a9d-acd7-9e649729a05b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.076787 May 19 08:38:12.785098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2872/4197] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:12.798221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:12.801412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:12.819567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.823086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.824470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:12.827156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:12.988382 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac89f14c-50aa-44fb-bd8c-76118ff03895 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "PUT /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1085 microversion: 2.1 time: 0.200766 May 19 08:38:12.992628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2873/4198] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:38:12 2022] PUT /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1085 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:13.025879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:13.027162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:13.046483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:13.047433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:13.053716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:13.056785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:13.329871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:13.343182 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4df3acb1-465c-4793-b393-daa2fa863f3f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.348554 May 19 08:38:13.353454 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2874/4199] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:12 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:13.358580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:13.359208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:13.366122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:13.366584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:13.367863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:13.368473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:13.799916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:13.808564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34495ec2-6d1b-4c23-87cd-3d57d8b3d31e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1308 microversion: 2.1 time: 0.453852 May 19 08:38:13.818987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2875/4200] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:13 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:13.834469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd84660d-5a52-46f9-a46e-92f9e5dab4ca tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '.version_select at 0x7f3211a011f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:13.871162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd84660d-5a52-46f9-a46e-92f9e5dab4ca tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815090382" status: 204 len: 0 microversion: 2.20 time: 0.050013 May 19 08:38:13.875419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2876/4201] 10.222.0.78 () {60 vars in 1258 bytes} [Thu May 19 08:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815090382 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:38:13.885008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:13.898654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:13.905485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:13.906198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:13.907148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:13.907743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:14.284354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:14.294357 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-794a4efa-ccd3-4490-b45b-076d336c46a2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1511 microversion: 2.1 time: 0.417902 May 19 08:38:14.295017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2877/4202] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:13 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1511 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:14.306618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:14.310048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:14.323431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:14.323886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:14.324680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:14.325127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:15.008019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:15.024881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:15.027618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:15.029546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae9376d1-396c-4242-8815-b608bfc96fc7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2867 microversion: 2.42 time: 0.733522 May 19 08:38:15.031847 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2878/4203] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:14 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2867 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:15.046359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7465cfaf-3673-4261-b8f6-3ad7b5eb4124 req-8ed889e2-dd5c-4af0-a6b1-3caa48d34826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8500c9aa-dd15-47c0-9906-9d73f704fca0", "tag": "24685e5f-7060-411b-a9ed-5b4052fe1e17"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:15.055902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7465cfaf-3673-4261-b8f6-3ad7b5eb4124 req-8ed889e2-dd5c-4af0-a6b1-3caa48d34826 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:15.056603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7465cfaf-3673-4261-b8f6-3ad7b5eb4124 req-8ed889e2-dd5c-4af0-a6b1-3caa48d34826 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:15.071353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7465cfaf-3673-4261-b8f6-3ad7b5eb4124 req-8ed889e2-dd5c-4af0-a6b1-3caa48d34826 service nova] Creating event network-changed:24685e5f-7060-411b-a9ed-5b4052fe1e17 for instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 on chh1-842464-2 May 19 08:38:15.076970 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7465cfaf-3673-4261-b8f6-3ad7b5eb4124 req-8ed889e2-dd5c-4af0-a6b1-3caa48d34826 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043545 May 19 08:38:15.078002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2879/4204] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:15.085114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5d44b56e-f04d-4422-a752-f2022b464b66 req-db3587a4-4815-4624-98b6-a4928e2708dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a7feae-e67f-46d7-be63-e50adf2c1a49", "name": "network-vif-deleted", "tag": "979663c4-bdcd-46ad-86db-6591d1acd7cb"}, {"name": "network-changed", "server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:15.132753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5d44b56e-f04d-4422-a752-f2022b464b66 req-db3587a4-4815-4624-98b6-a4928e2708dd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:15.142955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5d44b56e-f04d-4422-a752-f2022b464b66 req-db3587a4-4815-4624-98b6-a4928e2708dd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:15.177671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5d44b56e-f04d-4422-a752-f2022b464b66 req-db3587a4-4815-4624-98b6-a4928e2708dd service nova] Creating event network-vif-deleted:979663c4-bdcd-46ad-86db-6591d1acd7cb for instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 on chh1-842464-2 May 19 08:38:15.179842 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5d44b56e-f04d-4422-a752-f2022b464b66 req-db3587a4-4815-4624-98b6-a4928e2708dd service nova] Creating event network-changed:dd872ee5-3152-4351-a644-7f3684672d4b for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d on chh1-842464-2 May 19 08:38:15.202656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5d44b56e-f04d-4422-a752-f2022b464b66 req-db3587a4-4815-4624-98b6-a4928e2708dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122076 May 19 08:38:15.205266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2880/4205] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:15.222080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:15.227011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:15.240412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:15.242311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:15.246495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:15.247083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:15.685641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:15.703681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6d3f878-4b34-4414-aec4-847f003b6d51 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1511 microversion: 2.1 time: 0.493096 May 19 08:38:15.709119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2881/4206] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:15 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:15.731490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:15.733467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:15.751455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:15.751905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:15.755795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:15.758476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:16.485135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:16.495100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40927d08-04c1-4eb7-8035-5d2645bcce1d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.781795 May 19 08:38:16.495706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2882/4207] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:15 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:16.513482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:16.514351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:16.561241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:16.563623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:16.567213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:16.567907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:16.662085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:16.688673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:17.161668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:17.194988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7538e584-2955-423d-9253-6513e2b2a2ce tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1308 microversion: 2.1 time: 0.670379 May 19 08:38:17.196384 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2883/4208] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:16 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1308 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:17.209835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:17.211023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:17.224521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:17.224980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:17.225791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:17.230018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:17.307634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:38:17.573049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aebb31f0-3566-46ae-b7d8-673e63d6aa32 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 204 len: 0 microversion: 2.1 time: 0.375165 May 19 08:38:17.573715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2884/4209] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:38:17 2022] DELETE /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:38:17.599029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:17.601969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:17.635272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:17.635735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:17.636565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:17.645162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.063505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:18.084940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:18.089658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:18.092012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8021038-36dd-4b71-bc33-46e04811503d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2821 microversion: 2.42 time: 0.513216 May 19 08:38:18.093476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2885/4210] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:17 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2821 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:18.118602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd566411-772a-4695-9b1e-9bddf2795f5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'create', calling method: .version_select at 0x7f32105a9820>, body: {"keypair": {"name": "tempest-keypair-393739733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfZorzpzE0r9Zr7T0KnQSuW8tGLrgbrExegMvMJaIm3JEK7NfX5jWj/4qbDbNjskrWJBGiBaQpc4PCC2GwV+MOJzpZdR9f0pleyiT/KG7ECh1LPIHfFSFYT5AljJQ+Pjw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:18.153987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-bd566411-772a-4695-9b1e-9bddf2795f5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:38:18.169148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-bd566411-772a-4695-9b1e-9bddf2795f5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for user 666f1bf89e4940a38d63dbe3a2380a1f and project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:38:18.220177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd566411-772a-4695-9b1e-9bddf2795f5d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.121482 May 19 08:38:18.221911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2886/4211] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:38:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 08:38:18.230354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-212cc02f-bdd8-453e-a410-e2b16e2d5942 req-3446dfc2-e48c-48b9-b621-4581cabc3840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-deleted", "tag": "b0bc770d-5102-4981-80bd-f484c3748df7"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-deleted", "tag": "23c51317-3b4b-4c46-8685-bf35bfb26d47"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:18.249606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-212cc02f-bdd8-453e-a410-e2b16e2d5942 req-3446dfc2-e48c-48b9-b621-4581cabc3840 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.250795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-212cc02f-bdd8-453e-a410-e2b16e2d5942 req-3446dfc2-e48c-48b9-b621-4581cabc3840 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.259055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:18.270368 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-212cc02f-bdd8-453e-a410-e2b16e2d5942 req-3446dfc2-e48c-48b9-b621-4581cabc3840 service nova] Creating event network-vif-deleted:b0bc770d-5102-4981-80bd-f484c3748df7 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:18.271170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-212cc02f-bdd8-453e-a410-e2b16e2d5942 req-3446dfc2-e48c-48b9-b621-4581cabc3840 service nova] Creating event network-vif-deleted:23c51317-3b4b-4c46-8685-bf35bfb26d47 for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:18.280550 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-212cc02f-bdd8-453e-a410-e2b16e2d5942 req-3446dfc2-e48c-48b9-b621-4581cabc3840 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056426 May 19 08:38:18.283972 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2887/4212] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:18.302022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:18.305742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:18.323694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.324386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.325630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.326299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.566703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:18.583410 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58902ba2-e1da-4a11-9ece-7d40adcf1ba6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.293229 May 19 08:38:18.593776 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2888/4213] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:18 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:18.593776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:18.594318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:18.611225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.611225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.613511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.614027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.855416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:18.866437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de59ce7a-9073-4e76-9b75-01b79b8f99bb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1517 microversion: 2.1 time: 0.277962 May 19 08:38:18.867208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2889/4214] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:18 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1517 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:18.894312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:18.894945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:18.916145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.916607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:18.924243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:18.925160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:19.221982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:19.232671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-798b6ed0-3d58-413c-90d5-3b9f7bd73307 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1308 microversion: 2.1 time: 0.354099 May 19 08:38:19.238066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2890/4215] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:18 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:19.258834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:19.262171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:19.281897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:19.287266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:19.297168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:19.297958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:19.817281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:19.829810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:19.829810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:19.830930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9fd57824-d259-4603-bf54-cdbeb7d6a079 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2775 microversion: 2.42 time: 0.590959 May 19 08:38:19.831525 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2891/4216] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:19 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2775 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:19.849980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:19.850849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:19.891068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:19.891528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:19.892333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:19.892809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:21.065100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:21.109066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9ba8926-1c44-4045-a22c-5b9ec0eb9805 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 1.273946 May 19 08:38:21.113755 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2892/4217] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:19 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:21.139455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9424d124-1dae-4150-8c64-b8f7466aea08 req-db35c44e-546a-4286-a2e6-f3734a77959d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8500c9aa-dd15-47c0-9906-9d73f704fca0", "name": "network-vif-plugged", "status": "completed", "tag": "24685e5f-7060-411b-a9ed-5b4052fe1e17"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:21.178280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9424d124-1dae-4150-8c64-b8f7466aea08 req-db35c44e-546a-4286-a2e6-f3734a77959d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:21.182122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9424d124-1dae-4150-8c64-b8f7466aea08 req-db35c44e-546a-4286-a2e6-f3734a77959d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:21.238289 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9424d124-1dae-4150-8c64-b8f7466aea08 req-db35c44e-546a-4286-a2e6-f3734a77959d service nova] Creating event network-vif-plugged:24685e5f-7060-411b-a9ed-5b4052fe1e17 for instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 on chh1-842464-2 May 19 08:38:21.255553 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9424d124-1dae-4150-8c64-b8f7466aea08 req-db35c44e-546a-4286-a2e6-f3734a77959d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140352 May 19 08:38:21.261371 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2893/4218] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:21.267915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:21.268958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:21.288163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:21.289428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:21.290436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:21.291205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:21.976825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:22.000205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63c79756-4736-42a5-bfbc-abe2facefbc6 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1517 microversion: 2.1 time: 0.737270 May 19 08:38:22.000989 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2894/4219] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:21 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1517 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:22.019672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:22.025625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:22.038978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:22.042166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:22.043294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:22.048315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:22.442362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:22.459460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-894c7618-acbd-498e-8120-635040b71133 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1308 microversion: 2.1 time: 0.446282 May 19 08:38:22.461041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2895/4220] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:22 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:22.470489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-087c41c1-8264-46af-8794-999a41cf89c5 req-b343ac76-4914-4f9a-906e-8705cb7cb62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-deleted", "tag": "ee4b12a5-239c-4c07-9dcb-7cd272e1df1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:22.489273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-087c41c1-8264-46af-8794-999a41cf89c5 req-b343ac76-4914-4f9a-906e-8705cb7cb62d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:22.489996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-087c41c1-8264-46af-8794-999a41cf89c5 req-b343ac76-4914-4f9a-906e-8705cb7cb62d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:22.510462 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-087c41c1-8264-46af-8794-999a41cf89c5 req-b343ac76-4914-4f9a-906e-8705cb7cb62d service nova] Creating event network-vif-deleted:ee4b12a5-239c-4c07-9dcb-7cd272e1df1b for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:22.531911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-087c41c1-8264-46af-8794-999a41cf89c5 req-b343ac76-4914-4f9a-906e-8705cb7cb62d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066234 May 19 08:38:22.533987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2896/4221] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:22.549792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:22.551547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:22.567044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:22.567628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:22.568544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:22.569156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:22.956800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:22.968521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:22.975571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:22.977792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3edb7a26-ac16-4e99-9f60-03e857ef7d4f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 2325 microversion: 2.42 time: 0.441348 May 19 08:38:22.978388 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2897/4222] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:22 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 2325 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:23.011053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ecf0caaf-9891-41c5-bdaa-8cbe30983a7f req-ad825e1b-454c-4c9d-b2ac-c68cd37e76e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1eafe1-5443-4f50-b3c1-73582eef2478", "name": "network-vif-deleted", "tag": "f5eeb00f-9eba-4433-ae2e-202f89759c4c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:23.039490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ecf0caaf-9891-41c5-bdaa-8cbe30983a7f req-ad825e1b-454c-4c9d-b2ac-c68cd37e76e3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.042670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ecf0caaf-9891-41c5-bdaa-8cbe30983a7f req-ad825e1b-454c-4c9d-b2ac-c68cd37e76e3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:23.088729 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ecf0caaf-9891-41c5-bdaa-8cbe30983a7f req-ad825e1b-454c-4c9d-b2ac-c68cd37e76e3 service nova] Creating event network-vif-deleted:f5eeb00f-9eba-4433-ae2e-202f89759c4c for instance da1eafe1-5443-4f50-b3c1-73582eef2478 on chh1-842464-2 May 19 08:38:23.117549 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ecf0caaf-9891-41c5-bdaa-8cbe30983a7f req-ad825e1b-454c-4c9d-b2ac-c68cd37e76e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105986 May 19 08:38:23.118445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2898/4223] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:23.140233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:23.140975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:23.192566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.193027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:23.193857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.194295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:23.635862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:23.648263 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c419f77-e8b8-4c36-9585-bde25acb06de tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.525876 May 19 08:38:23.659696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2899/4224] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:23 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:23.666891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:23.667515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:23.674545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.675219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:23.677068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.682266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:23.825383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:23.837722 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6564dd0-e992-44a1-893b-33df87ef1dd0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 200 len: 1315 microversion: 2.1 time: 0.173838 May 19 08:38:23.839260 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2900/4225] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:23 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:23.852478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:23.853105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:23.870614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.871205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:23.873870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:23.874310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:24.254119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:24.259391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f131a47-78be-49ed-96d1-0fe20c552ee5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1308 microversion: 2.1 time: 0.417112 May 19 08:38:24.261511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2901/4226] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:23 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:24.284373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-833884392", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9640551a-4500-475a-a6df-3b35313f36d4"}], "security_groups": [{"name": "tempest-securitygroup--1877680084"}], "key_name": "tempest-keypair-393739733", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:24.520974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] validate_networks() for [('9640551a-4500-475a-a6df-3b35313f36d4', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:38:25.409103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:38:25.410811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:38:25.411548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:38:25.412188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:38:25.412857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:38:25.425022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:25.425882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:25.426972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:25.427655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:25.450433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:38:25.458129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Getting quotas for user 666f1bf89e4940a38d63dbe3a2380a1f and project b207c0cef1024b6294e3b8c482ca8deb. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:38:25.474437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:38:25.485405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:38:25.612520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:25.646859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-847cbc83-8e00-4b95-83d6-e3d500aa2f3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.373162 May 19 08:38:25.648688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2902/4227] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:38:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:38:25.654534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:25.655720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:25.666462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:25.667093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:25.668090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:25.668739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:25.842062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:25.865509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:25.886852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:25.895460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aaf62084-6782-45df-a4d0-296af44830bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.238371 May 19 08:38:25.896453 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2903/4228] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:25 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:25.930373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-93160d38-688b-43de-8058-63c572e80ee8 req-06456600-7158-439b-a516-f2fcf9199030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-deleted", "tag": "94babe40-01cf-4e4b-b343-36b1cd7d8aed"}, {"server_uuid": "79f8801e-9604-49c1-9aca-12652b7a90e6", "name": "network-vif-deleted", "tag": "35b433fc-d79e-466a-bec4-224d739093ed"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:25.952576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-93160d38-688b-43de-8058-63c572e80ee8 req-06456600-7158-439b-a516-f2fcf9199030 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:25.953274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-93160d38-688b-43de-8058-63c572e80ee8 req-06456600-7158-439b-a516-f2fcf9199030 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:25.968810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-93160d38-688b-43de-8058-63c572e80ee8 req-06456600-7158-439b-a516-f2fcf9199030 service nova] Creating event network-vif-deleted:94babe40-01cf-4e4b-b343-36b1cd7d8aed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:25.969398 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-93160d38-688b-43de-8058-63c572e80ee8 req-06456600-7158-439b-a516-f2fcf9199030 service nova] Creating event network-vif-deleted:35b433fc-d79e-466a-bec4-224d739093ed for instance 79f8801e-9604-49c1-9aca-12652b7a90e6 on chh1-842464-2 May 19 08:38:26.004351 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-93160d38-688b-43de-8058-63c572e80ee8 req-06456600-7158-439b-a516-f2fcf9199030 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.105606 May 19 08:38:26.015839 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2904/4229] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:26.055956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:26.056822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:26.103232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:26.103910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:26.104736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:26.105179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:26.522004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:26.565044 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec003025-6bc2-4a1c-ab23-21869ea90da2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.537756 May 19 08:38:26.567456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2905/4230] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:26 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:26.587686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:26.590271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:26.618066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:26.619597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:26.622242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:26.624578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:26.685986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 HTTP/1.1 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'da1eafe1-5443-4f50-b3c1-73582eef2478'} May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:26.691921 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:26.698511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:26.698511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:26.698511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:26.698511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:26.698511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:38:26.698511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:26.701418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:26.704489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ae502a6-cedd-4084-bb19-d618416ef66b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 404 len: 111 microversion: 2.1 time: 0.134303 May 19 08:38:26.706864 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2906/4231] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:26 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:38:26.720966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:26.726390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:26.745896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:26.748145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:26.750361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:26.752233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:26.980474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:26.989521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff39c864-b095-4f3f-9aae-242584b8d245 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1487 microversion: 2.1 time: 0.280383 May 19 08:38:26.994391 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2907/4232] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:26 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1487 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:26.999411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:27.000039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:27.019415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:27.019993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:27.020922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:27.021429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:27.112760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:27.234940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:27.246315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:27.247978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:27.249227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aaa5e2f7-420b-473b-9353-09f2ad4bb4b4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1284 microversion: 2.20 time: 0.253767 May 19 08:38:27.250426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2908/4233] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:26 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:27.255444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:27.256209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:27.263767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:27.264375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:27.265294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:27.265866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:27.394954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:27.412112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:27.416294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:27.418116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e216a809-963b-4da1-a752-d2c73e684c47 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.166444 May 19 08:38:27.418951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2909/4234] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:27 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:27.425795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d575e69-0d08-410a-a51f-3679ff04a800 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:27.438575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d575e69-0d08-410a-a51f-3679ff04a800 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:27.440109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d575e69-0d08-410a-a51f-3679ff04a800 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:27.476499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d575e69-0d08-410a-a51f-3679ff04a800 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:38:27.552137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d575e69-0d08-410a-a51f-3679ff04a800 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0/action" status: 202 len: 0 microversion: 2.1 time: 0.130442 May 19 08:38:27.555466 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2910/4235] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:27 2022] POST /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:38:27.573573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-56270728", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "064874e4-a477-4636-aaf3-b675b1210ad0"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:27.691019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] validate_networks() for [('064874e4-a477-4636-aaf3-b675b1210ad0', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:38:28.490656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:38:28.492209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:38:28.492864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:38:28.493489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:38:28.494073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:38:28.513170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:28.514610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:28.519950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:28.520697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:28.580046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:38:28.589168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Getting quotas for user d72580bf62b6451ab10b45bc77c1f899 and project 6b526d88e8814c29b0c49b8c3dcd4c8d. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:38:28.625212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:38:28.629179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:38:28.710999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba33f0de-9e2e-4865-a9e2-4dc2865d895c tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150989 May 19 08:38:28.714154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2911/4236] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:38:28.745378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:28.748577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:28.762134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:28.763020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:28.764030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:28.764705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.088332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.105954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05658db3-da21-45f3-b2b9-356acd896b19 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.389434 May 19 08:38:29.106597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2912/4237] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:28 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:29.112669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:29.113340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:29.131785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.132909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.134533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.135344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.372645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.383880 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f68b345-d2cd-4458-8a86-83dd9cb919d3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.276181 May 19 08:38:29.397143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2913/4238] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:29 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:29.412174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:29.414880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:29.422083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.422540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.423468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.423919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.499938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.515222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.517707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.518890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28f35e2a-467b-4e37-ba3a-76a31ec3f2ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1350 microversion: 2.20 time: 0.129627 May 19 08:38:29.519587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2914/4239] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:29 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:29.525386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:29.526019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:29.533016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.533979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.534964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.535677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.615698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.626809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.628398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.633179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48d50da8-63fc-45b6-a765-d566ac96e8d4 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.109479 May 19 08:38:29.634432 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2915/4240] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:29 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:29.640344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:29.641133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:29.650216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.650572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.651413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:29.651859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:29.727627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:29.736437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67facad9-32c3-49b2-b0db-05bd5897c501 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1211 microversion: 2.1 time: 0.100791 May 19 08:38:29.737419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2916/4241] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:29 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:30.124982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:30.126015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:30.140452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.141278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.142624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.145047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.376139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:30.406062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64e041cc-332f-4f86-ad6e-14362df925ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.284028 May 19 08:38:30.407477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2917/4242] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:30 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:30.424245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:30.426921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:30.437069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.437593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.438665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.439250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.680746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:30.690829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c383d13-7ba0-4168-9751-3d9bf12f1d46 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.279498 May 19 08:38:30.691630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2918/4243] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:30 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:30.699334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:30.701141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:30.710000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.710735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.711798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.712385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.852950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:30.867960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:30.872903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:30.877258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f5a6814-6897-4ed5-82b6-fc8fd9a53a68 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1338 microversion: 2.20 time: 0.184256 May 19 08:38:30.892483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2919/4244] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:30 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1338 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:30.898970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:30.900039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:30.908578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.909422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:30.910608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:30.911351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:31.064261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:31.085808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:31.097168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:31.099759 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7192c819-6a13-4bfa-90d8-bfc4b27fc05d tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.205907 May 19 08:38:31.100364 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2920/4245] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:30 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:31.128973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:31.129851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:31.154429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:31.155200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:31.156006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:31.156465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:31.329291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:31.339948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64fa397a-1d43-414c-b92b-6421867edf63 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1265 microversion: 2.1 time: 0.223082 May 19 08:38:31.356191 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2921/4246] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:31 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:31.424354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:31.425204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:31.455683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:31.456143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:31.456950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:31.478730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:31.869765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:31.877696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbde8fce-d12f-46f4-a02c-0b752a1bf9a7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.457433 May 19 08:38:31.883259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2922/4247] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:31 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:38:31.890393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:31.894571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:31.906884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:31.908076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:31.911019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:31.913986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:32.312535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:32.325375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f5266a1-ed1a-481b-8d28-4dfb4c996fe4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.440891 May 19 08:38:32.326794 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2923/4248] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:31 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:32.344068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:32.344706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:32.360437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:32.360898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:32.361744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:32.364837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:32.761044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:32.765454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:32.779213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:32.782770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:32.785911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-024a4cc2-f209-4425-b150-02b7f8dd4703 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1406 microversion: 2.20 time: 0.446359 May 19 08:38:32.787355 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2924/4249] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:32 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:32.814504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:32.815977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:32.838674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:32.839368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:32.840989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:32.844374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:33.166397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:33.198685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:33.205133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:33.209189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1dd75828-af2c-464e-8c51-3cac767c5d17 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.407753 May 19 08:38:33.213128 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2925/4250] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:32 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:33.233598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:33.234667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:33.248936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:33.250142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:33.251493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:33.252090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:33.750727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:33.764416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-721b3b09-304e-4a09-aab5-7aba25952862 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1307 microversion: 2.1 time: 0.548431 May 19 08:38:33.766848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2926/4251] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:33 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1307 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:33.773385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c9ad1f64-7d20-4b21-93cb-f118095c88d7 req-9c277e50-6f59-45ee-9d41-e446a1b609c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:33.785422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c9ad1f64-7d20-4b21-93cb-f118095c88d7 req-9c277e50-6f59-45ee-9d41-e446a1b609c3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:33.787529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c9ad1f64-7d20-4b21-93cb-f118095c88d7 req-9c277e50-6f59-45ee-9d41-e446a1b609c3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:33.836287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c9ad1f64-7d20-4b21-93cb-f118095c88d7 req-9c277e50-6f59-45ee-9d41-e446a1b609c3 service nova] Creating event network-changed:e821d61e-ed3c-4c43-b51a-a5ae486dc9d3 for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce on chh1-842464-2 May 19 08:38:33.842707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c9ad1f64-7d20-4b21-93cb-f118095c88d7 req-9c277e50-6f59-45ee-9d41-e446a1b609c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074111 May 19 08:38:33.843308 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2927/4252] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:33.854251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:33.861105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:33.875632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:33.876200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:33.876871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:33.877334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:34.176009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:34.186036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0209cb0c-2ed9-4f97-a1cf-2768ab08311b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.341559 May 19 08:38:34.191886 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2928/4253] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:33 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:34.203972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:34.204852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:34.229432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:34.230082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:34.231035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:34.231627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:34.518274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:34.530845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b65ddc1b-7abf-48e7-8f5d-ce0933247666 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.337476 May 19 08:38:34.537281 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2929/4254] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:34 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:34.543067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2a6ea089-f56a-43f4-94ef-1a36ce8565c4 req-ff07953d-258b-41cb-98e0-169e8170795f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "name": "network-vif-plugged", "status": "completed", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:34.568126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2a6ea089-f56a-43f4-94ef-1a36ce8565c4 req-ff07953d-258b-41cb-98e0-169e8170795f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:34.569985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2a6ea089-f56a-43f4-94ef-1a36ce8565c4 req-ff07953d-258b-41cb-98e0-169e8170795f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:34.604801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2a6ea089-f56a-43f4-94ef-1a36ce8565c4 req-ff07953d-258b-41cb-98e0-169e8170795f service nova] Creating event network-vif-plugged:dd872ee5-3152-4351-a644-7f3684672d4b for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d on chh1-842464-2 May 19 08:38:34.609890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2a6ea089-f56a-43f4-94ef-1a36ce8565c4 req-ff07953d-258b-41cb-98e0-169e8170795f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071293 May 19 08:38:34.610595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2930/4255] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:34.615649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:34.616374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:34.636355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:34.637057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:34.638044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:34.638637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.043033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.057068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.061919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.066751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5e5ced9-9079-431e-b58a-5bdd845a5cf8 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1406 microversion: 2.20 time: 0.452518 May 19 08:38:35.067527 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2931/4256] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:34 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:35.109361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:35.110496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:35.127037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.127762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.131401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.132197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.294047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.305971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.309904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.311716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-927e5ea6-3bae-4755-a64e-6e2cdc851b46 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.217168 May 19 08:38:35.312657 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2932/4257] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:35 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:35.319031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:35.333839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:35.343965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.345129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.346532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.347295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.706685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:35.716491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b64a9e12-b28f-4170-b369-1d6bbec25b96 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1307 microversion: 2.1 time: 0.402458 May 19 08:38:35.717732 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2933/4258] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:35 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1307 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:35.722806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dc4613c2-d9b5-451e-9c01-7495504acc0f req-02e44934-99a4-4251-8f9f-30d69c336e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8657e95-60cb-4754-a3ed-e57983d41079", "tag": "85c236aa-9f2f-4be7-a589-2efda0925871"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:35.741140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc4613c2-d9b5-451e-9c01-7495504acc0f req-02e44934-99a4-4251-8f9f-30d69c336e52 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.749382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc4613c2-d9b5-451e-9c01-7495504acc0f req-02e44934-99a4-4251-8f9f-30d69c336e52 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.770060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dc4613c2-d9b5-451e-9c01-7495504acc0f req-02e44934-99a4-4251-8f9f-30d69c336e52 service nova] Creating event network-changed:85c236aa-9f2f-4be7-a589-2efda0925871 for instance f8657e95-60cb-4754-a3ed-e57983d41079 on chh1-842464-2 May 19 08:38:35.778394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dc4613c2-d9b5-451e-9c01-7495504acc0f req-02e44934-99a4-4251-8f9f-30d69c336e52 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059256 May 19 08:38:35.779353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2934/4259] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:35.785687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:35.786707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:35.822281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.825166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:35.830671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:35.831650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:36.258595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:36.269872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f90402a-fd68-4314-a6f5-21c96d9d4eb2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.488653 May 19 08:38:36.271394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2935/4260] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:35 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:36.280537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:36.281877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:36.290331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:36.291415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:36.292389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:36.292990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:36.623387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:36.646621 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-972e3a27-cc8b-414e-975f-e155f5505103 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1519 microversion: 2.1 time: 0.373769 May 19 08:38:36.648199 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2936/4261] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:36 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1519 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:36.657868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:36.658510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:36.673804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:36.676647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:36.680062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:36.685267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:36.905511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:36.918927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:36.921884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:36.923706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0a97214-2906-4f3e-8bac-99c0f06883ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1406 microversion: 2.20 time: 0.274379 May 19 08:38:36.925111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2937/4262] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:36 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:36.932956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:36.933788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:36.943971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:36.950740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:36.950740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:36.950740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.083948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:37.101690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:37.103217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:37.110437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-502be4ef-8952-40e4-a9aa-7b85339f8236 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.178119 May 19 08:38:37.111579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2938/4263] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:36 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:37.123777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:37.128205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:37.148567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.149429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.150964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.152191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.466978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:37.483675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a1e8273-6ea1-4b1c-bc30-8642bb2c72a5 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1307 microversion: 2.1 time: 0.370041 May 19 08:38:37.484484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2939/4264] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:37 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:37.491838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-88deefb5-5571-4df4-af8a-d41c4ca4199c req-0d9af448-ad69-42f9-a9ec-35587d56c05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "name": "network-vif-plugged", "status": "completed", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:37.502364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-88deefb5-5571-4df4-af8a-d41c4ca4199c req-0d9af448-ad69-42f9-a9ec-35587d56c05d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.503111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-88deefb5-5571-4df4-af8a-d41c4ca4199c req-0d9af448-ad69-42f9-a9ec-35587d56c05d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.519501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-88deefb5-5571-4df4-af8a-d41c4ca4199c req-0d9af448-ad69-42f9-a9ec-35587d56c05d service nova] Creating event network-vif-plugged:e821d61e-ed3c-4c43-b51a-a5ae486dc9d3 for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce on chh1-842464-2 May 19 08:38:37.525854 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-88deefb5-5571-4df4-af8a-d41c4ca4199c req-0d9af448-ad69-42f9-a9ec-35587d56c05d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 May 19 08:38:37.527294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2940/4265] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:37.533944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:37.535007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:37.545495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.546303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.547517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.548187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.922774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:37.931009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02829957-8f45-40fa-941a-7f5e2e238832 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.402231 May 19 08:38:37.931614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2941/4266] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:37 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:37.946761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:37.947860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:37.955614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.956463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:37.957614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:37.958660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:38.248490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:38.257038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efcb522b-9dd8-472e-99dc-79aa6b632609 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.324308 May 19 08:38:38.261034 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2942/4267] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:37 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:38.275867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:38.277341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:38.295747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:38.296215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:38.297655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:38.297655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:38.547427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:38.610920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=16 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:38.973938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.003406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.013199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.016444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d60b0c20-ef8d-42fd-a6e3-821ebd0ee210 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1406 microversion: 2.20 time: 0.754329 May 19 08:38:39.018090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2943/4268] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:38 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1406 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:39.035223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:39.036261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:39.044035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:39.057027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.058852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.065775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.067169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.080813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:39.233517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.246095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.251337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.252613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f233adbd-4a8f-45f5-a069-81d1460df823 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.233162 May 19 08:38:39.253184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2944/4269] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:39 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:39.282814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:39.284651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:39.308390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.309206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.310310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.310905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.507524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.516862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7033671-5060-48a9-ae07-400b37928082 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.256488 May 19 08:38:39.518932 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2945/4270] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:39 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:39.524909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:39.525973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:39.540869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.542711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.543669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.544112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.765643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:39.776674 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95679876-e16d-454b-9008-b06664646474 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1307 microversion: 2.1 time: 0.256383 May 19 08:38:39.777820 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2946/4271] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:39 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:39.785501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:39.787113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:39.804547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.805619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:39.806655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:39.807306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:40.072982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:40.082514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0026f96-fac7-4c5d-8795-95b19cf646bf tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.303406 May 19 08:38:40.091377 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2947/4272] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:39 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:40.105955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:40.106788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:40.118953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:40.119601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:40.121032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:40.121689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:40.547970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:40.560694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb5b2234-683c-48b5-b328-3502146ed733 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.460879 May 19 08:38:40.590360 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2948/4273] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:40 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:40.604896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:40.607773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:40.614164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:40.614748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:40.616966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:40.617726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:40.877882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:40.887811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:40.892314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:40.896883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9995b619-7cb7-45b9-91b0-b3d17fee0f0b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1597 microversion: 2.20 time: 0.304212 May 19 08:38:40.899845 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2949/4274] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:40 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1597 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:40.920718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:40.936831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:40.953965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:40.960071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:40.963027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:40.965232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:41.130778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:41.148648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:41.154595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:41.158753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9af3952b-0d17-4b0f-82f1-d9886eb2f9b2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.255503 May 19 08:38:41.159784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2950/4275] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:40 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:41.178587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dd1cb04-710e-408d-9a8d-cc4dc0cafccd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:41.196889 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1dd1cb04-710e-408d-9a8d-cc4dc0cafccd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 0c2c94bf-934c-4662-8d5f-88f8fe6d9785 has no mapping to a cell. May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dd1cb04-710e-408d-9a8d-cc4dc0cafccd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/0c2c94bf-934c-4662-8d5f-88f8fe6d9785/action HTTP/1.1 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: {"os-stop": {}} May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 0c2c94bf-934c-4662-8d5f-88f8fe6d9785 has no mapping to a cell. May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0c2c94bf-934c-4662-8d5f-88f8fe6d9785', 'body': {'os-stop': {}}} May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 0c2c94bf-934c-4662-8d5f-88f8fe6d9785 has no mapping to a cell. May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 08:38:41.205014 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2c94bf-934c-4662-8d5f-88f8fe6d9785 has no mapping to a cell. May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2c94bf-934c-4662-8d5f-88f8fe6d9785 has no mapping to a cell. May 19 08:38:41.209221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:41.213284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dd1cb04-710e-408d-9a8d-cc4dc0cafccd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 0c2c94bf-934c-4662-8d5f-88f8fe6d9785 has no mapping to a cell. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:41.214471 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1dd1cb04-710e-408d-9a8d-cc4dc0cafccd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/0c2c94bf-934c-4662-8d5f-88f8fe6d9785/action" status: 404 len: 117 microversion: 2.1 time: 0.053024 May 19 08:38:41.215710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2951/4276] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:41 2022] POST /compute/v2.1/servers/0c2c94bf-934c-4662-8d5f-88f8fe6d9785/action => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:38:41.221213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:41.222757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:41.237287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:41.238114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:41.239113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:41.239781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:41.564321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:41.575956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3182efd-16e2-43ad-b16c-1c1f9ccf3b4d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1307 microversion: 2.1 time: 0.358944 May 19 08:38:41.576629 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2952/4277] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:41 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:41.949503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:41.950127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:41.957458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:41.958736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:41.959065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:41.959507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.143946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a094cb1e-1e3d-4c01-84d2-08a75fc91cc6 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.556739 May 19 08:38:42.144581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2953/4278] 10.222.0.78 () {60 vars in 1315 bytes} [Thu May 19 08:38:41 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-interface => generated 284 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:38:42.154885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:42.155534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:42.164716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.165169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.165985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.166422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.453053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:42.465482 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-288ab93a-f15b-4980-999e-c2c0a5159af6 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.319839 May 19 08:38:42.466297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2954/4279] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:42 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:42.503098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:42.505320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:42.517366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.517809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.521466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.521961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.764018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:42.782240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf60f279-83d5-4eda-ab0f-ec0639a22ac4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.300624 May 19 08:38:42.782845 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2955/4280] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:42 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:42.787435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7cd53148-02c3-4d90-965b-b5f824da7f3a req-c9cb6a00-d2de-4e13-90c0-6e01c9d334c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8657e95-60cb-4754-a3ed-e57983d41079", "name": "network-vif-plugged", "status": "completed", "tag": "85c236aa-9f2f-4be7-a589-2efda0925871"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:42.821153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7cd53148-02c3-4d90-965b-b5f824da7f3a req-c9cb6a00-d2de-4e13-90c0-6e01c9d334c1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.821865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7cd53148-02c3-4d90-965b-b5f824da7f3a req-c9cb6a00-d2de-4e13-90c0-6e01c9d334c1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.850491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7cd53148-02c3-4d90-965b-b5f824da7f3a req-c9cb6a00-d2de-4e13-90c0-6e01c9d334c1 service nova] Creating event network-vif-plugged:85c236aa-9f2f-4be7-a589-2efda0925871 for instance f8657e95-60cb-4754-a3ed-e57983d41079 on chh1-842464-2 May 19 08:38:42.860610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7cd53148-02c3-4d90-965b-b5f824da7f3a req-c9cb6a00-d2de-4e13-90c0-6e01c9d334c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074321 May 19 08:38:42.862448 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2956/4281] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:42.873353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:42.874443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:42.885008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.885713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:42.886799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:42.887576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.116503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:43.148814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:43.155266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:43.161791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75b17685-5359-4e50-9709-4ac6ebc8d9a2 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.295160 May 19 08:38:43.164491 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2957/4282] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:42 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:43.185222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:43.188731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:43.204788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.210594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.211860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.212476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.440027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:43.451204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07684897-7f14-422c-b8d4-581180941e83 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1307 microversion: 2.1 time: 0.284480 May 19 08:38:43.452516 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2958/4283] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:43 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1307 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:43.459543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:43.460543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:43.469093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.472317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.473580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.474500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.703594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:43.714045 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a282f5f2-d1a9-49b4-a491-0eac117780eb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.259306 May 19 08:38:43.714771 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2959/4284] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:43 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:43.720090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:43.720877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:43.728123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.728723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.729799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.730467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.916812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:43.927957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5f0f62b-2807-480c-bf8a-95d6be0581ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.211964 May 19 08:38:43.928727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2960/4285] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:43 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:43.935118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea3bd6e5-01eb-4637-a5f9-8620f149c2ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:43.935976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea3bd6e5-01eb-4637-a5f9-8620f149c2ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:43.942177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ea3bd6e5-01eb-4637-a5f9-8620f149c2ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70 could not be found. May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea3bd6e5-01eb-4637-a5f9-8620f149c2ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70/action HTTP/1.1 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: {"suspend": {}} May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70 could not be found. May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70', 'body': {'suspend': {}}} May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70 could not be found. May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70 could not be found. May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:43.944205 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:43.948964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:43.948964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:43.948964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70 could not be found. May 19 08:38:43.948964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:43.950235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea3bd6e5-01eb-4637-a5f9-8620f149c2ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:43.951293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea3bd6e5-01eb-4637-a5f9-8620f149c2ff tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70/action" status: 404 len: 111 microversion: 2.1 time: 0.020928 May 19 08:38:43.952095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2961/4286] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:43 2022] POST /compute/v2.1/servers/0ae8bbc6-751b-4e9a-9e28-a13fe9a25a70/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:38:43.961813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:43.962549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:43.970202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.970880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:43.971840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:43.972425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.165290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:44.177170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b51e943c-671f-4baa-a14f-53e185c58384 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.220380 May 19 08:38:44.179272 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2962/4287] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:43 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:38:44.185173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:44.186015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:44.212989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.213766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.214855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.215553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.309011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:44.322045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:44.322725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:44.325576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:44.328088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d20f646c-e314-455c-8366-b81774fc1529 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.147346 May 19 08:38:44.342352 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2963/4288] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:44 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:44.353127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:44.354068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:44.361342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.361802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.363455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.363977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.573477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:44.586154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55dfd364-5697-488f-a0ec-743b795f116e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.241589 May 19 08:38:44.587275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2964/4289] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:44 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:44.593554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:44.594186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:44.605358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.606358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.607185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.607637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.807396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:44.818709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-268e7152-cfda-4ba5-8f27-53dcec2f9bf1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1488 microversion: 2.1 time: 0.230211 May 19 08:38:44.832532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2965/4290] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:44 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1488 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:44.832532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:44.834573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:44.847621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.848081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.848889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:44.851532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:44.899722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lazy-loading 'flavor' on Instance uuid 83bf71d1-ffb2-4636-ad87-2a206d45851d {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:38:45.037423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f66409c-4397-47e9-8be1-6fab1730c9af tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 202 len: 0 microversion: 2.1 time: 0.214164 May 19 08:38:45.041452 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2966/4291] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:44 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:38:45.061132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-593515617"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:45.062859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:45.090572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:45.091677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:45.104788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:45.105887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:45.262149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c6f0bbe-87a3-4caf-ba9f-7a519b3ff632 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "PUT /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1074 microversion: 2.1 time: 0.214014 May 19 08:38:45.262149 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2967/4292] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:38:45 2022] PUT /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1074 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:45.290543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:45.291027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:45.312380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:45.312986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:45.314650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:45.314789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:45.939684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:45.952791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49b25343-5f80-4f49-aa1d-acaf8591e2b1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.685184 May 19 08:38:45.955529 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2968/4293] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:45 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:45.973585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:45.982795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:45.996017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:45.996391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:45.998711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:45.999172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:46.389799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:46.399750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-784c6f81-a792-4685-b595-6bc7e9026d03 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1497 microversion: 2.1 time: 0.428216 May 19 08:38:46.400411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2969/4294] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:45 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1497 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:46.407654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-54181922-2adf-4eb1-b5a9-a309c1e72864 req-4b923d85-3bbd-4f24-8776-72278eb5c269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:46.419585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-54181922-2adf-4eb1-b5a9-a309c1e72864 req-4b923d85-3bbd-4f24-8776-72278eb5c269 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:46.420038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-54181922-2adf-4eb1-b5a9-a309c1e72864 req-4b923d85-3bbd-4f24-8776-72278eb5c269 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:46.459324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-54181922-2adf-4eb1-b5a9-a309c1e72864 req-4b923d85-3bbd-4f24-8776-72278eb5c269 service nova] Creating event network-changed:e821d61e-ed3c-4c43-b51a-a5ae486dc9d3 for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce on chh1-842464-2 May 19 08:38:46.466111 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-54181922-2adf-4eb1-b5a9-a309c1e72864 req-4b923d85-3bbd-4f24-8776-72278eb5c269 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062169 May 19 08:38:46.467165 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2970/4295] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:38:46.475288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:46.476629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:46.512035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:46.512543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:46.513402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:46.513902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:46.893635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:46.901692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f28c21f-5123-4de2-81b0-1e592070cfe2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1500 microversion: 2.1 time: 0.433221 May 19 08:38:46.914348 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2971/4296] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:46 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1500 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:46.933742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:46.934375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:46.957069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:46.957822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:46.959027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:46.959621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:47.231339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:47.245595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:47.256175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:47.260341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-726a70fd-fa0f-4f39-a223-1b948664222a tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.340831 May 19 08:38:47.261585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2972/4297] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:46 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:47.280364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:47.282702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:47.306703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:47.311012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:47.314922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:47.315979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:47.376694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lazy-loading 'flavor' on Instance uuid 83bf71d1-ffb2-4636-ad87-2a206d45851d {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:38:47.401611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'suspend' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state suspended May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: {"suspend": {}} May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'suspend' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state suspended May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'suspend': {}}} May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state suspended. Cannot suspend while the instance is in this state. May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 19 08:38:47.417299 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state suspended May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state suspended May 19 08:38:47.421715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:47.428527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'suspend' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state suspended {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:47.430277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9383b548-2086-4f60-960c-2fc9d09cb416 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 148 microversion: 2.1 time: 0.166922 May 19 08:38:47.431281 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2973/4298] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:47 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 148 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:38:47.452388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:47.468059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:47.490452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:47.492823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:47.497279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:47.498866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:48.272190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:48.300624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c89516e3-2ca5-49c9-809d-e4f1588281b3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1500 microversion: 2.1 time: 0.864774 May 19 08:38:48.302618 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2974/4299] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:47 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1500 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:48.328718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:48.343986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:48.363538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:48.364205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:48.365215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:48.365960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:48.899484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:48.916173 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-97400968-bbfe-46db-8cd4-45650bbb54aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.601659 May 19 08:38:48.927050 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2975/4300] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:48 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:48.939206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:48.940214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:48.954662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:48.958670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:48.963987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:48.964953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:49.178376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7fb5e41-a0f1-46a9-bb8c-4e56beebc53d tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 202 len: 0 microversion: 2.1 time: 0.244393 May 19 08:38:49.183386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2976/4301] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:48 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:38:49.195581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:49.198259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:49.240470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:49.248088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:49.249217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:49.252567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:49.525020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:49.535640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:49.544827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:49.547495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:49.551100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b051d48c-ff75-4674-944f-fcea040d81a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.365706 May 19 08:38:49.565433 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2977/4302] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:49 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:49.565433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec925756-1b10-495c-906e-ada918757833 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:49.571447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec925756-1b10-495c-906e-ada918757833 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:49.572210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec925756-1b10-495c-906e-ada918757833 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:49.610394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec925756-1b10-495c-906e-ada918757833 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:38:49.697607 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec925756-1b10-495c-906e-ada918757833 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "POST /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079/action" status: 202 len: 0 microversion: 2.1 time: 0.139829 May 19 08:38:49.714988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2978/4303] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:49 2022] POST /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:38:49.734851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:49.736087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:49.746205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:49.747145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:49.748784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:49.749807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:50.199811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:50.220489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5344c6cc-493f-448c-b85f-58b7a4915614 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1503 microversion: 2.1 time: 0.503430 May 19 08:38:50.222321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2979/4304] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:49 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1503 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:50.257904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:50.260150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:50.295908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:50.300756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:50.301890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:50.305042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.017985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:51.028107 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36c9c6ed-0201-4db9-8b56-0dd13d50f975 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.786437 May 19 08:38:51.029216 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2980/4305] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:50 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:51.034064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:51.035463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:51.043380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:51.044099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.045247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:51.046011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.238053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:51.250580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3d4ed73-9e57-4fbc-a79e-9025bf8ffcdb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.220035 May 19 08:38:51.251904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2981/4306] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:51 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:51.259455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:51.260466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:51.270187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:51.270993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.272322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:51.273296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.376321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:51.392386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:51.394839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:51.396545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-826d2db2-eb67-429e-8779-83e582aa4d5f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.143314 May 19 08:38:51.397479 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2982/4307] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:51 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:51.404409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:51.405296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:51.415816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:51.416590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.417822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:51.418627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:51.696583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:51.718443 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02682296-f35f-4189-be9c-ffa1a9c59cbe tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1503 microversion: 2.1 time: 0.319521 May 19 08:38:51.719716 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2983/4308] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:51 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:52.047612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:52.048478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:52.062376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.063190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.064430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.065221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.373369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:52.397209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f74a894-7296-4a62-9e9b-d9ec5b397efd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.353942 May 19 08:38:52.399234 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2984/4309] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:52 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:52.406083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:52.407137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:52.416250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.417081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.418992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.419562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.688847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:52.701764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0aa44272-4250-41b8-8641-e7c04909de51 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.300969 May 19 08:38:52.703043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2985/4310] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:52 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:52.709480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:52.711053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:52.720569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.721402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.722990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.723695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.842395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:52.854163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:52.855878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:52.857789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84b78e90-8dde-438a-a183-29c9f691154f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.153363 May 19 08:38:52.867505 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2986/4311] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:52 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:52.889860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:52.891268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:52.902561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.903022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:52.903829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:52.904354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:53.139360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:53.153757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08a80fc8-db2d-457d-a80d-692ee90e8ccb tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.283029 May 19 08:38:53.155674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2987/4312] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:52 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:53.198922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:53.200261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:53.215254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:53.215756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:53.216662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:53.217111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:53.509014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:53.521688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e18eb51-90e5-49ed-b0c1-a1246429c19c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.340582 May 19 08:38:53.530816 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2988/4313] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:53 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:53.544001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:53.545404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:53.562597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:53.563835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:53.565650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:53.566905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:53.847645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:53.856674 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f19df55d-8772-46f7-b741-84bfed656b81 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.324006 May 19 08:38:53.857924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2989/4314] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:53 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:53.877545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28fd533d-5551-455b-8812-d98dae14ba60 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:53.878081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28fd533d-5551-455b-8812-d98dae14ba60 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 59a86bac-0c87-41fc-98f8-21252060e1ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-28fd533d-5551-455b-8812-d98dae14ba60 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 59a86bac-0c87-41fc-98f8-21252060e1ec could not be found. May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28fd533d-5551-455b-8812-d98dae14ba60 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/59a86bac-0c87-41fc-98f8-21252060e1ec/action HTTP/1.1 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: {"unpause": {}} May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 59a86bac-0c87-41fc-98f8-21252060e1ec could not be found. May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '59a86bac-0c87-41fc-98f8-21252060e1ec', 'body': {'unpause': {}}} May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a86bac-0c87-41fc-98f8-21252060e1ec could not be found. May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a86bac-0c87-41fc-98f8-21252060e1ec could not be found. May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:53.921534 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a86bac-0c87-41fc-98f8-21252060e1ec could not be found. May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28fd533d-5551-455b-8812-d98dae14ba60 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 59a86bac-0c87-41fc-98f8-21252060e1ec could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28fd533d-5551-455b-8812-d98dae14ba60 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/59a86bac-0c87-41fc-98f8-21252060e1ec/action" status: 404 len: 111 microversion: 2.1 time: 0.049429 May 19 08:38:53.926110 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2990/4315] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:53 2022] POST /compute/v2.1/servers/59a86bac-0c87-41fc-98f8-21252060e1ec/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:38:53.935460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:53.936080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:53.945956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:53.946407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:53.947188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:53.947624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.264554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:54.286803 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bb1c2e5-111d-4250-912e-8cd514fe1a69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.355827 May 19 08:38:54.288991 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2991/4316] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:53 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:54.307628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:54.308806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:54.325369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:54.326203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.332642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:54.333600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.492707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:54.521297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:54.524510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:54.526508 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fdaa3a78-2328-4335-93c7-1cca269dcc57 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.232390 May 19 08:38:54.537338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2992/4317] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:54 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:54.537338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:54.537338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:54.549705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:54.550252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.551391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:54.552001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.890908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:54.899915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10979c77-ab92-4d78-8a12-1d82023ad8b2 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.370531 May 19 08:38:54.905710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2993/4318] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:54 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:54.911767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:54.911767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:54.932328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:54.936494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:54.936961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.946216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:54.946688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:54.972495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:38:55.168447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:55.191812 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e6c297a-d248-4b3e-8d55-8e068c41a3fc tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.284830 May 19 08:38:55.193696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2994/4319] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:54 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:55.227702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:55.230218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:55.250509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:55.251872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:55.252761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:55.253219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:55.622981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:55.637939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a63c4c74-15ad-423d-bf09-350db26d065f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.425822 May 19 08:38:55.638938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2995/4320] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:55 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:55.645535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:55.648200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:55.661930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:55.663359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:55.665010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:55.666252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:56.379209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:56.405275 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9fc344fb-12be-4bf5-9cf2-d5fab8b56fe7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.764552 May 19 08:38:56.409119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2996/4321] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:55 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:56.427409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:56.428581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:56.443508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:56.444860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:56.446915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:56.447295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:56.763209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:56.783099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:56.784661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:56.785979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c16c1645-68b7-43e8-9174-cb1d9bae7f99 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.375361 May 19 08:38:56.786878 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2997/4322] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:56 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:56.808585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:56.815017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:56.833115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:56.833849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:56.834658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:56.835845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:56.898718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'unpause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 15 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: {"unpause": {}} May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'unpause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'unpause': {}}} May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state active. Cannot unpause while the instance is in this state. May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:56.900377 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:56.904293 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:56.904293 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:56.904293 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:56.904293 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:56.904293 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:56.904293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'unpause' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:56.914424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9cc7c392-9faa-4387-9712-6b671f23c9ce tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 145 microversion: 2.1 time: 0.126645 May 19 08:38:56.918168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2998/4323] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:56 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 145 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:38:56.920487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:56.921220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:56.942289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:56.942747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:56.943559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:56.943996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:57.312704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:57.327020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65e97de5-650a-42a7-96d1-975b3841c0cb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.405912 May 19 08:38:57.341718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 2999/4324] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:56 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:57.351984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:57.352877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:57.360473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:57.361168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:57.362534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:57.363133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:57.586100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:57.599651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10069a16-7299-45fa-be57-219fec808c7f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.254645 May 19 08:38:57.605769 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3000/4325] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:57 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:57.612685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:57.613286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:57.620333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:57.620782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:57.621593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:57.622036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:57.861040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:57.875169 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac757a2e-2179-4af0-a52c-efd8d56f24ab tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1497 microversion: 2.1 time: 0.268061 May 19 08:38:57.888114 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3001/4326] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:57 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:57.893764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:57.894713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:57.904913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:57.905684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:57.907864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:57.908493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.134664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:58.148265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-09b8f0d5-b6c6-42c7-bf2d-5bc6b82380dd tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.258170 May 19 08:38:58.150046 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3002/4327] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:57 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:58.171458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:58.173008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:58.188937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.189811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.190835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.191464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.280906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:58.292601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:58.294556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:58.296279 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-437a6372-91c5-4105-95e7-9be2acc2ccc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.135976 May 19 08:38:58.297935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3003/4328] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:58 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:58.310709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-470721fa-be00-45c7-bd5a-e38bdd5631e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:58.312180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-470721fa-be00-45c7-bd5a-e38bdd5631e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 1b900ef7-713d-4263-9730-7769e89099c5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:58.322102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-470721fa-be00-45c7-bd5a-e38bdd5631e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 1b900ef7-713d-4263-9730-7769e89099c5 could not be found. May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-470721fa-be00-45c7-bd5a-e38bdd5631e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/1b900ef7-713d-4263-9730-7769e89099c5/action HTTP/1.1 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 18 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: {"unshelve": null} May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1b900ef7-713d-4263-9730-7769e89099c5 could not be found. May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1b900ef7-713d-4263-9730-7769e89099c5', 'body': {'unshelve': None}} May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b900ef7-713d-4263-9730-7769e89099c5 could not be found. May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b900ef7-713d-4263-9730-7769e89099c5 could not be found. May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:58.324732 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:58.330432 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:58.330432 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:58.330432 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:58.330432 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b900ef7-713d-4263-9730-7769e89099c5 could not be found. May 19 08:38:58.330432 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:58.330823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-470721fa-be00-45c7-bd5a-e38bdd5631e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 1b900ef7-713d-4263-9730-7769e89099c5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:58.333896 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-470721fa-be00-45c7-bd5a-e38bdd5631e1 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/1b900ef7-713d-4263-9730-7769e89099c5/action" status: 404 len: 111 microversion: 2.1 time: 0.034424 May 19 08:38:58.338636 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3004/4329] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:58 2022] POST /compute/v2.1/servers/1b900ef7-713d-4263-9730-7769e89099c5/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:38:58.343644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:58.344265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:58.353289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.354043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.355274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.355898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.618277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:58.628680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55efb104-3b7c-4740-ab86-f3be2de45c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.288730 May 19 08:38:58.629768 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3005/4330] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:58 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:58.645038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:58.648193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:58.655096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.655702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.656784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.657463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.858341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:58.868280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7000d031-2ae5-433c-a038-4be2d7ff2f8a tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.236381 May 19 08:38:58.878954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3006/4331] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:58 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:58.886114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:58.887038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:58.895855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.896727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:58.898396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:58.899032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.064521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:59.074808 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a98affb-b544-4cf3-9481-7e08a896ee32 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.194369 May 19 08:38:59.088646 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3007/4332] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:58 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:59.095730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:59.096594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:59.104167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.104875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.105907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.106493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.284412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:59.298577 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6ee4be4-569d-4cad-a179-eb5f21bdecba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 200 len: 1474 microversion: 2.1 time: 0.208135 May 19 08:38:59.316487 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3008/4333] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:38:59 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 1474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:38:59.325616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:59.326456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:59.334675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.335731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.337161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.338120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.374758 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Cannot 'unshelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action HTTP/1.1 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 18 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: {"unshelve": null} May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'unshelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'unshelve': None}} May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d in vm_state active. Cannot unshelve while the instance is in this state. May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:59.376952 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active May 19 08:38:59.381667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:38:59.383653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 409 to user: Cannot 'unshelve' instance 83bf71d1-ffb2-4636-ad87-2a206d45851d while it is in vm_state active {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:38:59.386516 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94a525b9-9243-4042-af03-36de6a3b1d1e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action" status: 409 len: 146 microversion: 2.1 time: 0.068475 May 19 08:38:59.387367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3009/4334] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:59 2022] POST /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d/action => generated 146 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:38:59.394744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:38:59.395611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:59.404597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.405129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.406071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.406537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.493340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:59.506100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:59.508952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:38:59.510621 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-14c060fc-fbaf-4e67-aa4b-71bd44507c0e tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.122039 May 19 08:38:59.511436 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3010/4335] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:38:59 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:38:59.527164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-90509279"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:38:59.528701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:38:59.535544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.536546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.537610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:38:59.538687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:38:59.983646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:00.017355 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5fd9bdd3-fc1d-4a41-bddf-45a2acd05272 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0/action" status: 202 len: 0 microversion: 2.1 time: 0.504119 May 19 08:39:00.018452 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3011/4336] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:38:59 2022] POST /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:39:00.047275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:00.048203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:00.069201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:00.069856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:00.070665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:00.071105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:00.286484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:00.298857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-42e830cc-9acc-4b9f-9d7f-2dc9c90fc747 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.278790 May 19 08:39:00.300381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3012/4337] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:00 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:00.317687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:00.318462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:00.326622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:00.327386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:00.328418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:00.329188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:00.561515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:00.584284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c30d8fd5-108f-41ac-a4d8-bf47e59577d3 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.282745 May 19 08:39:00.585061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3013/4338] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:00 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:00.593595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7551c9ee-3e37-49b1-af2e-92f7c024066b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f0700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:00.662134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7551c9ee-3e37-49b1-af2e-92f7c024066b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.074034 May 19 08:39:00.663392 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3014/4339] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:00 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:00.669523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:00.670323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:00.678104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:00.679048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:00.680387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:00.681214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.001704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:01.013731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ea4b96b-5ee3-4794-bbe2-253ba0c3e7f0 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.348819 May 19 08:39:01.025372 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3015/4340] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:00 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:01.038805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:01.040891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:01.056730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:01.061534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.063132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:01.065929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.222875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:01.244595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:01.255428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:01.259459 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1d28ed2-d6e7-4b13-a35c-7eb6622bddb9 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.237999 May 19 08:39:01.260592 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3016/4341] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:01 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:01.286119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-824cb356-9072-46e5-b9ed-51ec158d7afc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-530315030_updated"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:01.289439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-824cb356-9072-46e5-b9ed-51ec158d7afc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: d75d4d57-ee8f-4038-bf8d-5c414af30b9e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:01.306278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-824cb356-9072-46e5-b9ed-51ec158d7afc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance d75d4d57-ee8f-4038-bf8d-5c414af30b9e could not be found. May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-824cb356-9072-46e5-b9ed-51ec158d7afc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/servers/d75d4d57-ee8f-4038-bf8d-5c414af30b9e HTTP/1.1 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 80 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-530315030_updated"}} May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d75d4d57-ee8f-4038-bf8d-5c414af30b9e could not be found. May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd75d4d57-ee8f-4038-bf8d-5c414af30b9e', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-530315030_updated'}}} May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75d4d57-ee8f-4038-bf8d-5c414af30b9e could not be found. May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 19 08:39:01.310136 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75d4d57-ee8f-4038-bf8d-5c414af30b9e could not be found. May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75d4d57-ee8f-4038-bf8d-5c414af30b9e could not be found. May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:01.316806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-824cb356-9072-46e5-b9ed-51ec158d7afc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance d75d4d57-ee8f-4038-bf8d-5c414af30b9e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:01.323770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-824cb356-9072-46e5-b9ed-51ec158d7afc tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "PUT /compute/v2.1/servers/d75d4d57-ee8f-4038-bf8d-5c414af30b9e" status: 404 len: 111 microversion: 2.1 time: 0.053212 May 19 08:39:01.324217 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3017/4342] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:39:01 2022] PUT /compute/v2.1/servers/d75d4d57-ee8f-4038-bf8d-5c414af30b9e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:01.343299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:01.343944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:01.367934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:01.368800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.370021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:01.370548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.680128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:01.703235 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-feb9849f-bc9c-4287-8704-dc0e38d73821 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.372416 May 19 08:39:01.720385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3018/4343] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:01 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:01.732450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:01.733141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:01.756501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:01.757706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.759453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:01.760127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:01.980838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:01.996242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c04c5256-eda8-4123-99e7-eba32b2661fe tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.273828 May 19 08:39:01.997217 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3019/4344] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:01 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:02.015204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de97e1c0-25f5-47ee-a8ce-fd437e6406bd tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210540ee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:02.072068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de97e1c0-25f5-47ee-a8ce-fd437e6406bd tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.060431 May 19 08:39:02.073545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3020/4345] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:01 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:02.078311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:02.078935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:02.086839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.087302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.088093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.088543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.295372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:02.304700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5af20a25-8a04-42bc-a0a2-ab830e8d49e8 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.229981 May 19 08:39:02.305365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3021/4346] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:02 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:02.321876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:02.322520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:02.330297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.330885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.331974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.332964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.444852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:02.458063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:02.461176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:02.463073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-703d750f-e8ce-4c91-abd9-eaad5ec28dc3 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.156384 May 19 08:39:02.464117 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3022/4347] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:02 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:02.471249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2192511-e7de-4150-a874-a6b1cd4abce4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2192511-e7de-4150-a874-a6b1cd4abce4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d HTTP/1.1 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 280 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.474617 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2192511-e7de-4150-a874-a6b1cd4abce4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2192511-e7de-4150-a874-a6b1cd4abce4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "PUT /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 400 len: 619 microversion: 2.1 time: 0.011065 May 19 08:39:02.482549 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3023/4348] 10.222.0.78 () {60 vars in 1256 bytes} [Thu May 19 08:39:02 2022] PUT /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:39:02.513956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:02.517383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:02.542868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.543645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.546515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.547298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.847022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:02.863207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17983bc3-755a-418e-9214-7785455a6c76 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.361470 May 19 08:39:02.865293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3024/4349] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:02 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:02.883931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:02.885086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:02.893354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.894208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:02.895298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:02.895974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.160643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:03.175076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a915f312-56a0-4acd-85f2-ca483d5c7564 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.296000 May 19 08:39:03.175906 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3025/4350] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:02 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:39:03.191639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:03.192307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:03.212135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.212588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.213435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.213910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.503424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:03.520565 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70a01e36-e4b4-4525-a2be-5816778b1674 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.343455 May 19 08:39:03.522614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3026/4351] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:03 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:03.532400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ab7d514-cfaf-4f32-b6d7-6b9d272df4df tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f0e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:03.649957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ab7d514-cfaf-4f32-b6d7-6b9d272df4df tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.124826 May 19 08:39:03.663591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3027/4352] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:03 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:03.676282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a2e13a9-85ca-4c41-b4a6-6b59c631891a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a2e13a9-85ca-4c41-b4a6-6b59c631891a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: request: PUT /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d HTTP/1.1 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 24 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": ""}} May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute name. Value: . '' is too short May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d', 'body': {'server': {'name': ''}}} May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '' May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:39:03.684042 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a2e13a9-85ca-4c41-b4a6-6b59c631891a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a2e13a9-85ca-4c41-b4a6-6b59c631891a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "PUT /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 400 len: 108 microversion: 2.1 time: 0.021158 May 19 08:39:03.690404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3028/4353] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:39:03 2022] PUT /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:39:03.698806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-21b0b91e-8d80-431e-a20b-57a387ac6d99 req-589ecf18-9559-4433-af76-e0518ce7573a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8500c9aa-dd15-47c0-9906-9d73f704fca0", "name": "network-vif-plugged", "status": "completed", "tag": "24685e5f-7060-411b-a9ed-5b4052fe1e17"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:03.739974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-21b0b91e-8d80-431e-a20b-57a387ac6d99 req-589ecf18-9559-4433-af76-e0518ce7573a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.740833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-21b0b91e-8d80-431e-a20b-57a387ac6d99 req-589ecf18-9559-4433-af76-e0518ce7573a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.789888 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-21b0b91e-8d80-431e-a20b-57a387ac6d99 req-589ecf18-9559-4433-af76-e0518ce7573a service nova] Creating event network-vif-plugged:24685e5f-7060-411b-a9ed-5b4052fe1e17 for instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 on chh1-842464-2 May 19 08:39:03.798582 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-21b0b91e-8d80-431e-a20b-57a387ac6d99 req-589ecf18-9559-4433-af76-e0518ce7573a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107523 May 19 08:39:03.799875 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3029/4354] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:03.809191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:03.810402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:03.822420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.823168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.824362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.825030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.936848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:03.947429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:03.951416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:03.951848 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a577584-0c21-423d-b538-552b46453297 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.150311 May 19 08:39:03.952493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3030/4355] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:03 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:03.965653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:03.966911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:03.973104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.973682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:03.974523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:03.975033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:04.209364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:04.219822 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b14b5ca-619b-4a28-acc6-25ce7867685e tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1506 microversion: 2.1 time: 0.257448 May 19 08:39:04.220658 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3031/4356] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:03 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:04.545547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:04.546171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:04.560478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:04.560861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:04.561683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:04.562121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:05.050168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:05.067406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24bba654-2cd5-4e33-b5b0-0026adbf6363 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.525641 May 19 08:39:05.085385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3032/4357] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:04 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:05.098937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc316c2d-90c3-4954-976c-5d02038d4d5a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210483160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:05.263465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc316c2d-90c3-4954-976c-5d02038d4d5a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.171258 May 19 08:39:05.265128 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3033/4358] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:05 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:05.285840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:05.291807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:05.318797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:05.321145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:05.324066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:05.332041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:05.494995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:05.509108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:05.511201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:05.512859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71ea3178-4250-428b-a3c9-876a76383eac tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.242245 May 19 08:39:05.527426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3034/4359] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:05 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:06.106364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:06.109112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:06.136101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:06.136625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:06.138702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:06.141860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:06.620978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:06.627757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:06.659754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9cfa976e-5d84-4ca4-9747-2f5e7cb0a5b1 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.557274 May 19 08:39:06.677180 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3035/4360] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:06 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:06.703636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d9a4509-58e3-45f6-8502-f53d1fae0862 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210483b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:06.829276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d9a4509-58e3-45f6-8502-f53d1fae0862 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.147825 May 19 08:39:06.837367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3036/4361] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:06 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:06.863796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:06.864703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:06.891389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:06.892408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:06.893366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:06.893967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:07.020728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:07.039105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:07.045128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:07.049013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df41bc48-adc0-4dcf-9625-446b01e4b0f7 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.210146 May 19 08:39:07.069497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3037/4362] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:06 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:07.697635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:07.699076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:07.765841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:07.770551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:07.777923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:07.781727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:08.268612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:08.281967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afaa60a8-90fc-43e5-96e1-e013968a6037 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.599301 May 19 08:39:08.287660 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3038/4363] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:07 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:08.305678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb8eb971-6589-41f4-b765-69c779e8c704 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210483f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:08.384281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb8eb971-6589-41f4-b765-69c779e8c704 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.094534 May 19 08:39:08.385360 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3039/4364] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:08 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:08.405066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:08.419437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:08.435457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:08.437378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:08.439638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:08.440467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:08.748785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:08.778940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:08.786983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:08.796646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3099462d-8970-406c-95d7-f7dc1fca6d74 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.401399 May 19 08:39:08.801878 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3040/4365] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:08 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:09.302744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:09.303384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:09.313696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:09.314297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:09.314928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:09.315357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:09.531595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:09.551666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4cbd2992-d808-4a9f-a3e3-4f3a657c3fe4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.253049 May 19 08:39:09.559523 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3041/4366] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:09 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:09.565242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0550c7e8-1109-4fd1-bc7e-4ea30583f7aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f0a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:09.643498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0550c7e8-1109-4fd1-bc7e-4ea30583f7aa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.082473 May 19 08:39:09.644580 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3042/4367] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:09 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:09.825931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:09.826886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:09.855669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:09.861974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:09.865210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:09.867389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:10.129074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:10.139543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:10.141249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:10.142567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e745eaec-eabd-4e49-8bd0-dd4d59b2c9bd tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.325150 May 19 08:39:10.167332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3043/4368] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:09 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:10.581706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:10.583198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:10.620490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:10.621608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:10.622657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:10.623758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:10.969338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:10.980275 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8c934e8-1745-4dfb-ab15-75bda932612e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 0.407748 May 19 08:39:10.980883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3044/4369] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:10 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:11.000595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fdefb1e6-fb57-4337-ad7b-e295aadd7986 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32105785e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:11.150804 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fdefb1e6-fb57-4337-ad7b-e295aadd7986 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.156541 May 19 08:39:11.154723 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3045/4370] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:10 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:11.200230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:11.200956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:11.215217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:11.215670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:11.216547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:11.223430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:11.361659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:11.380081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:11.387396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:11.392439 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76b17ac5-58ba-41c4-a26f-8e05d223b28f tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.210133 May 19 08:39:11.393224 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3046/4371] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:11 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:12.005170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:12.008621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:12.044676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:12.047467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:12.055977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:12.057198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:13.426168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:13.439025 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a4ae962-f031-4d60-8018-7580d5babc1d tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 1.440880 May 19 08:39:13.439999 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3047/4372] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:11 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:13.447160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fbc1816-5401-46e4-b9cd-08c9ec16f9ec tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210540a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:13.715889 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fbc1816-5401-46e4-b9cd-08c9ec16f9ec tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 0.274091 May 19 08:39:13.719635 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3048/4373] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:13 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:13.738930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:13.739969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:13.765718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:13.766456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:13.767621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:13.773954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:13.929289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:13.940602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:13.942702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0126ef7c31e4cf2b1149b77645f5a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ffb0dc38014b07bf39a33b520e0502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:13.954818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2114d1f-e3cf-4f54-b80e-7ff8b71dada1 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 200 len: 1604 microversion: 2.42 time: 0.233644 May 19 08:39:13.955523 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3049/4374] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:13 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:14.456226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:14.458017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:14.492300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:14.501361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:14.503673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:14.504224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:15.579970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:15.596591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c588b39-edfa-4590-877a-9357b389174b tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1510 microversion: 2.1 time: 1.144205 May 19 08:39:15.601743 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3050/4375] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:14 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1510 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:39:15.618841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f5c506e-d84c-48f0-a9be-880c8c4fda43 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f0790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:24.492191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=90 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:25.593892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=60 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:26.559744 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f5c506e-d84c-48f0-a9be-880c8c4fda43 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1410 microversion: 2.1 time: 10.956211 May 19 08:39:26.562151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3051/4376] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:15 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1410 bytes in 10959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:26.575682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:26.578477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:26.603684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.604767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.606661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.607381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.631827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] HTTP exception thrown: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Request method failure captured: May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 HTTP/1.1 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgA3clD84-U3cf7VndN_IG2PskVJJSa-RjLEyten9qEgr2H0SzeZeFbmknbdKD4-tlyF4lPAtl2F8gK3bCBuOWifszMm1QSRLwtwMzY4kY2hHJsAMfVdowzpm7Uizatri6y768Z7XJzzboDa3O_u_rFHall95Ow875lca6N89VVr0pE May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.42 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 12ffb0dc38014b07bf39a33b520e0502 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 12ffb0dc38014b07bf39a33b520e0502 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TaggedBootDevicesTest_v242-2037668298-project May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b0126ef7c31e4cf2b1149b77645f5a74 May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2037668298-project May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '79f8801e-9604-49c1-9aca-12652b7a90e6'} May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.633565 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Returning 404 to user: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07e8a251-0b9d-483a-b5f4-fd03a2ff6981 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 404 len: 111 microversion: 2.42 time: 0.071104 May 19 08:39:26.637990 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3052/4377] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:26 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:39:26.640705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:26.641417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:26.649118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.649729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.650415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.650875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.858075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:26.869441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f73eb950-d760-4915-8d66-e3b0d2ed4554 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1487 microversion: 2.1 time: 0.232840 May 19 08:39:26.877421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3053/4378] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:26 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1487 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:26.884428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:26.885839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:26.899396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.900201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.901521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.903980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.926818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 HTTP/1.1 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3ee93b28-80ce-457d-93fe-0fba061d0f07'} May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:26.929607 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-deab0339-a84e-4562-9ccb-7e9a66b5932f tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 404 len: 111 microversion: 2.1 time: 0.055566 May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3054/4379] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:26 2022] DELETE /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:26.937355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:26.938956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:26.947315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.947784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.948612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:26.949056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:26.982091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c81c57ae-c703-42f0-835b-39720cd2a840 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/ips" status: 200 len: 150 microversion: 2.20 time: 0.049113 May 19 08:39:26.982703 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3055/4380] 10.222.0.78 () {60 vars in 1288 bytes} [Thu May 19 08:39:26 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:39:26.987653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4839d157-8c06-4caa-99ae-0c928d98d4db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '.version_select at 0x7f3210463700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:27.013661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4839d157-8c06-4caa-99ae-0c928d98d4db tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514807272" status: 204 len: 0 microversion: 2.42 time: 0.029647 May 19 08:39:27.018298 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3056/4381] 10.222.0.78 () {60 vars in 1258 bytes} [Thu May 19 08:39:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514807272 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:39:27.024368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-807441474"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:27.026269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:27.033764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.034228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.035066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.035514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.121858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a7b59e6-bb5b-427d-ae38-eaa4e5afa426 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "PUT /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1060 microversion: 2.1 time: 0.101675 May 19 08:39:27.129349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3057/4382] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 08:39:27 2022] PUT /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1060 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:27.129349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:27.129349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 3ee93b28-80ce-457d-93fe-0fba061d0f07] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:27.135622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.136221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.137345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.137800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.157841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 HTTP/1.1 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3ee93b28-80ce-457d-93fe-0fba061d0f07'} May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:27.162271 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 3ee93b28-80ce-457d-93fe-0fba061d0f07 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83c3e7e2-9d1c-45da-9b9b-323b16cbd61c tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07" status: 404 len: 111 microversion: 2.1 time: 0.041427 May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3058/4383] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:27 2022] GET /compute/v2.1/servers/3ee93b28-80ce-457d-93fe-0fba061d0f07 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:27.172006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:27.179248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.179710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.180554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.180948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.463746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:27.477180 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02107489-8156-4869-9346-376e97702771 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1487 microversion: 2.1 time: 0.307909 May 19 08:39:27.483061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3059/4384] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:27 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1487 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:27.490581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:27.490581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:27.499267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.499856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.500768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.501334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.529777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:39:27.665942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a983c26-5e47-468a-b1d7-601b2e4be531 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "DELETE /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 204 len: 0 microversion: 2.1 time: 0.186485 May 19 08:39:27.668745 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3060/4385] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:27 2022] DELETE /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:39:27.679837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:27.681928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:27.696686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.697963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.699791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:27.700807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:27.942801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:27.955607 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-68798e66-4354-4f63-b3ab-fe810367bbde tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1487 microversion: 2.1 time: 0.284212 May 19 08:39:27.966686 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3061/4386] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:27 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1487 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:27.977378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47bd5363-9091-465c-ac7f-5b8a32fbb606 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210455d30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:28.048580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47bd5363-9091-465c-ac7f-5b8a32fbb606 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1419 microversion: 2.1 time: 0.080302 May 19 08:39:28.049810 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3062/4387] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:27 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1419 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:28.059660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:28.061757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:28.072656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:28.073519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:28.075091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:28.076112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:28.325162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:28.339184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-68c12f9d-5066-4bf1-a2b3-51a50c0b73c6 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.285940 May 19 08:39:28.341337 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3063/4388] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:28 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:28.359224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:28.365131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:28.382783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:28.383498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:28.387536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:28.388348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:28.436919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:39:28.618328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-865772ef-ef51-426f-84d8-56a0b1144991 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 204 len: 0 microversion: 2.1 time: 0.262691 May 19 08:39:28.618949 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3064/4389] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:28 2022] DELETE /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:39:28.644253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5594f20-ceea-4391-ac53-9eec394179a9 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104551f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:28.735440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5594f20-ceea-4391-ac53-9eec394179a9 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 200 len: 1419 microversion: 2.1 time: 0.113227 May 19 08:39:28.737779 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3065/4390] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:39:28 2022] GET /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 1419 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:28.747145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:28.751105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:28.764038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:28.765341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:28.766178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:28.767583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:29.221960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:29.233871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b01cf10e-f498-4bce-87fe-36f6ec977880 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1493 microversion: 2.1 time: 0.492942 May 19 08:39:29.234658 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3066/4391] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:28 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1493 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:29.245554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73a3967d-e10a-4fe9-9352-9fc35789607d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f40d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:30.542227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73a3967d-e10a-4fe9-9352-9fc35789607d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 204 len: 0 microversion: 2.1 time: 1.306687 May 19 08:39:30.546326 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3067/4392] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:29 2022] DELETE /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 0 bytes in 1308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:39:30.552951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:30.556370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:30.571525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:30.572905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:30.574437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:30.575366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:30.897366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:30.914496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44621cf0-416f-45d0-b6bc-317b949c964a tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.361385 May 19 08:39:30.927789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3068/4393] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:30 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:30.938085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:30.942626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:30.954858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:30.955621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:30.956733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:30.957438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:31.469293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:31.482725 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea67fb70-75db-4176-b31a-1d8333f6d4ea tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 200 len: 1493 microversion: 2.1 time: 0.552492 May 19 08:39:31.494809 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3069/4394] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:30 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 1493 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:31.503753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:31.504260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:31.518402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:31.518861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:31.519672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:31.520117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:31.618654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:39:31.633765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:31.809494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ab1f7fa-d050-45f2-bc03-c7cbce7d5f99 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 204 len: 0 microversion: 2.1 time: 0.313072 May 19 08:39:31.810542 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3070/4395] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:31 2022] DELETE /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:39:31.816437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d803df64-04b0-418e-9b06-76710aca90f8 req-84738bf0-7bf6-4228-8bb0-6e9ee0f7d40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8500c9aa-dd15-47c0-9906-9d73f704fca0", "name": "network-vif-unplugged", "status": "completed", "tag": "24685e5f-7060-411b-a9ed-5b4052fe1e17"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:31.833671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d803df64-04b0-418e-9b06-76710aca90f8 req-84738bf0-7bf6-4228-8bb0-6e9ee0f7d40b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:31.835448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d803df64-04b0-418e-9b06-76710aca90f8 req-84738bf0-7bf6-4228-8bb0-6e9ee0f7d40b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:31.856539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d803df64-04b0-418e-9b06-76710aca90f8 req-84738bf0-7bf6-4228-8bb0-6e9ee0f7d40b service nova] Creating event network-vif-unplugged:24685e5f-7060-411b-a9ed-5b4052fe1e17 for instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 on chh1-842464-2 May 19 08:39:31.869363 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d803df64-04b0-418e-9b06-76710aca90f8 req-84738bf0-7bf6-4228-8bb0-6e9ee0f7d40b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056159 May 19 08:39:31.871359 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3071/4396] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:31.881184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:31.883704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:31.895563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:31.896689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:31.898518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:31.899358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:31.970211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lazy-loading 'flavor' on Instance uuid 1bb4a893-1b86-4fcc-91a3-8fb603359cce {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:39:32.565737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cacc767-e72b-4ad6-9ac3-eff1cb8679d1 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/action" status: 202 len: 0 microversion: 2.20 time: 0.692085 May 19 08:39:32.572808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3072/4397] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:39:31 2022] POST /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/action => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:39:32.580080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b0c7ebb1-eec5-47b1-8dc9-83f410cdc526 req-8536112e-223d-4ce2-9f04-5acb088f0549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8657e95-60cb-4754-a3ed-e57983d41079", "name": "network-vif-deleted", "tag": "85c236aa-9f2f-4be7-a589-2efda0925871"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:32.618339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b0c7ebb1-eec5-47b1-8dc9-83f410cdc526 req-8536112e-223d-4ce2-9f04-5acb088f0549 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:32.618803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b0c7ebb1-eec5-47b1-8dc9-83f410cdc526 req-8536112e-223d-4ce2-9f04-5acb088f0549 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:32.650684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b0c7ebb1-eec5-47b1-8dc9-83f410cdc526 req-8536112e-223d-4ce2-9f04-5acb088f0549 service nova] Creating event network-vif-deleted:85c236aa-9f2f-4be7-a589-2efda0925871 for instance f8657e95-60cb-4754-a3ed-e57983d41079 on chh1-842464-2 May 19 08:39:32.676146 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b0c7ebb1-eec5-47b1-8dc9-83f410cdc526 req-8536112e-223d-4ce2-9f04-5acb088f0549 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095187 May 19 08:39:32.677608 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3073/4398] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:32.690653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:32.691885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:32.702960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:32.703938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:32.704903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:32.705607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:33.123808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cedbe79cf76418d815e2608f5f480ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '144d9ead33364453bd7e349add7a8284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:33.147420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7982dfa7-0734-4517-95e9-818cbdf79ca3 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 200 len: 1512 microversion: 2.1 time: 0.467232 May 19 08:39:33.149298 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3074/4399] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:32 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:33.157371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1074932213", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "1a050905-faf4-46cc-bb59-12e712335300"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:33.284861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] validate_networks() for [('1a050905-faf4-46cc-bb59-12e712335300', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:39:35.028922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:39:35.030136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:39:35.030648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:39:35.031062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:39:35.031482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:39:35.051874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.052328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.055495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.056072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.102396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:39:35.114708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for user f59b91044370427fa198cff1a2c604e9 and project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:39:35.154081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:39:35.156401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:39:35.276870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b996b3cc-e14a-4f18-8513-eb2731479b97 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126099 May 19 08:39:35.278923 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3075/4400] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:39:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:39:35.294878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:35.300415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:35.347153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.348864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.350431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.350930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.375145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 HTTP/1.1 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f8657e95-60cb-4754-a3ed-e57983d41079'} May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.377082 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-29b556e0-b067-4524-bf1a-022ad95a1736 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 404 len: 111 microversion: 2.1 time: 0.094664 May 19 08:39:35.382763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3076/4401] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:35 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:35.395903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:35.396545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:35.423551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.424534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.425557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.427455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.712726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:35.723506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:35.726819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:35.728653 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3550b509-067e-4e99-b009-df23d32632e5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.348143 May 19 08:39:35.743434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3077/4402] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:35 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:35.749174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-528753f3-a399-48d2-b4d5-eeee9c52b7e5 req-d983a29a-e662-4851-8d10-07ad96a6a6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bf71d1-ffb2-4636-ad87-2a206d45851d", "name": "network-vif-deleted", "tag": "dd872ee5-3152-4351-a644-7f3684672d4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:35.770901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-528753f3-a399-48d2-b4d5-eeee9c52b7e5 req-d983a29a-e662-4851-8d10-07ad96a6a6e1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.771465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-528753f3-a399-48d2-b4d5-eeee9c52b7e5 req-d983a29a-e662-4851-8d10-07ad96a6a6e1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.808993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-528753f3-a399-48d2-b4d5-eeee9c52b7e5 req-d983a29a-e662-4851-8d10-07ad96a6a6e1 service nova] Creating event network-vif-deleted:dd872ee5-3152-4351-a644-7f3684672d4b for instance 83bf71d1-ffb2-4636-ad87-2a206d45851d on chh1-842464-2 May 19 08:39:35.815846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-528753f3-a399-48d2-b4d5-eeee9c52b7e5 req-d983a29a-e662-4851-8d10-07ad96a6a6e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070675 May 19 08:39:35.816938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3078/4403] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:35.823042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:35.823755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] [instance: 83bf71d1-ffb2-4636-ad87-2a206d45851d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:35.830271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.830952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.831902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.832506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.855519 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] HTTP exception thrown: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d could not be found. May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Request method failure captured: May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d HTTP/1.1 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgECOW68EjXGPCRG0eopyzkTrZXrbz363XLeKJwHTacLW1P2DEa1kciE695GCJxocHsMDd57ky3VfTfnahgT3ZWqaSqFmST9aX3JN0Am0RGqqjajSqP4irj_n81SQfLTkQ3y0vYWFcMterNVwFxRZdnAjN_ycT9OqALy_hQO8Z0yS_U May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/144d9ead33364453bd7e349add7a8284"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_144d9ead33364453bd7e349add7a8284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/144d9ead33364453bd7e349add7a8284"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 144d9ead33364453bd7e349add7a8284 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-707725152 May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5cedbe79cf76418d815e2608f5f480ed May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-707725152-project May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d could not be found. May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '83bf71d1-ffb2-4636-ad87-2a206d45851d'} May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d could not be found. May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d could not be found. May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:35.857558 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d could not be found. May 19 08:39:35.861929 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.864129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] Returning 404 to user: Instance 83bf71d1-ffb2-4636-ad87-2a206d45851d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:35.865105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e264fd2b-aed5-4441-b3dc-3e13d76477f4 tempest-ServersNegativeTestJSON-707725152 tempest-ServersNegativeTestJSON-707725152-project] 10.222.0.78 "GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d" status: 404 len: 111 microversion: 2.1 time: 0.046878 May 19 08:39:35.865866 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3079/4404] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:35 2022] GET /compute/v2.1/servers/83bf71d1-ffb2-4636-ad87-2a206d45851d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:35.873180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:35.873901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:35.887167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.890161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.893231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:35.893708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:35.931883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] HTTP exception thrown: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Request method failure captured: May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 HTTP/1.1 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgA3clD84-U3cf7VndN_IG2PskVJJSa-RjLEyten9qEgr2H0SzeZeFbmknbdKD4-tlyF4lPAtl2F8gK3bCBuOWifszMm1QSRLwtwMzY4kY2hHJsAMfVdowzpm7Uizatri6y768Z7XJzzboDa3O_u_rFHall95Ow875lca6N89VVr0pE May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.42 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 12ffb0dc38014b07bf39a33b520e0502 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 12ffb0dc38014b07bf39a33b520e0502 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TaggedBootDevicesTest_v242-2037668298-project May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b0126ef7c31e4cf2b1149b77645f5a74 May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2037668298-project May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '79f8801e-9604-49c1-9aca-12652b7a90e6'} May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:35.933515 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Returning 404 to user: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:35.937940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e83fc0da-4cae-4163-a2da-30a1ac24d3a6 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 404 len: 111 microversion: 2.42 time: 0.067666 May 19 08:39:35.939002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3080/4405] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:39:35 2022] DELETE /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:39:35.957666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e08d845d-dc5c-4cdb-8179-61021ab6054f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:35.958250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e08d845d-dc5c-4cdb-8179-61021ab6054f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.060634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e08d845d-dc5c-4cdb-8179-61021ab6054f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:36.079495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e08d845d-dc5c-4cdb-8179-61021ab6054f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1208 microversion: 2.1 time: 0.139384 May 19 08:39:36.082839 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3081/4406] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:35 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1208 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:36.098943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.103250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.127138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.130407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.135921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.138395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.188879 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 HTTP/1.1 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f8657e95-60cb-4754-a3ed-e57983d41079'} May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:36.194654 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.199226 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.216971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:36.221276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-caba2acd-1cb2-4d45-9f8f-2864494bd8d0 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 404 len: 111 microversion: 2.1 time: 0.137158 May 19 08:39:36.225227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3082/4407] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:36 2022] DELETE /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:36.256240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.261745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] [instance: 79f8801e-9604-49c1-9aca-12652b7a90e6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.283403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.283774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.290040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.295230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.325042 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] HTTP exception thrown: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Request method failure captured: May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 HTTP/1.1 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgA3clD84-U3cf7VndN_IG2PskVJJSa-RjLEyten9qEgr2H0SzeZeFbmknbdKD4-tlyF4lPAtl2F8gK3bCBuOWifszMm1QSRLwtwMzY4kY2hHJsAMfVdowzpm7Uizatri6y768Z7XJzzboDa3O_u_rFHall95Ow875lca6N89VVr0pE May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.42 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 12ffb0dc38014b07bf39a33b520e0502 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/12ffb0dc38014b07bf39a33b520e0502"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 12ffb0dc38014b07bf39a33b520e0502 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2037668298 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TaggedBootDevicesTest_v242-2037668298-project May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b0126ef7c31e4cf2b1149b77645f5a74 May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2037668298-project May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '79f8801e-9604-49c1-9aca-12652b7a90e6'} May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.327661 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. May 19 08:39:36.331573 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.337076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] Returning 404 to user: Instance 79f8801e-9604-49c1-9aca-12652b7a90e6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:36.338449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbcdd8ee-d168-4d83-abb0-1bbea5386990 tempest-TaggedBootDevicesTest_v242-2037668298 tempest-TaggedBootDevicesTest_v242-2037668298-project] 10.222.0.78 "GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6" status: 404 len: 111 microversion: 2.42 time: 0.109862 May 19 08:39:36.339533 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3083/4408] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:36 2022] GET /compute/v2.1/servers/79f8801e-9604-49c1-9aca-12652b7a90e6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:39:36.361252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.362088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: f8657e95-60cb-4754-a3ed-e57983d41079] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.396614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.405695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.407598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.412174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.478033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 HTTP/1.1 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f8657e95-60cb-4754-a3ed-e57983d41079'} May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.481970 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance f8657e95-60cb-4754-a3ed-e57983d41079 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-754b2aa6-c309-485a-bc76-8c3c65c8ec60 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079" status: 404 len: 111 microversion: 2.1 time: 0.144278 May 19 08:39:36.487869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3084/4409] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:36 2022] GET /compute/v2.1/servers/f8657e95-60cb-4754-a3ed-e57983d41079 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:36.519819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.520337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.567865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.571103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.574304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.574778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.639019 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 HTTP/1.1 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'da1eafe1-5443-4f50-b3c1-73582eef2478'} May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:36.640848 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:36.644693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-143477ba-27fb-4bc6-a321-f2f623e4584e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 404 len: 111 microversion: 2.1 time: 0.147485 May 19 08:39:36.650332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3085/4410] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:36 2022] DELETE /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:36.658038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.659653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: da1eafe1-5443-4f50-b3c1-73582eef2478] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.665956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:36.673768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.675050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.676330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.677022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.697198 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 HTTP/1.1 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'da1eafe1-5443-4f50-b3c1-73582eef2478'} May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.699229 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.704009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.704009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.704009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:36.704009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:36.704009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. May 19 08:39:36.704009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.707093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance da1eafe1-5443-4f50-b3c1-73582eef2478 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:36.708214 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6470cfc2-98de-4d7e-99e4-9b503ed7283e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478" status: 404 len: 111 microversion: 2.1 time: 0.056692 May 19 08:39:36.712786 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3086/4411] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:36 2022] GET /compute/v2.1/servers/da1eafe1-5443-4f50-b3c1-73582eef2478 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:36.735807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.738546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.750112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.750967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.752535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.754706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.791809 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e HTTP/1.1 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0779eef3-859e-45b7-a4e2-0cdf527d358e'} May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:36.793989 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:36.797978 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:36.799483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:36.805510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de55a4d0-9394-4c70-a9e3-838cf4e44983 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 404 len: 111 microversion: 2.1 time: 0.091053 May 19 08:39:36.807343 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3087/4412] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:36 2022] DELETE /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:36.819916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:36.820588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:36.857688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.858402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:36.864625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:36.865277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.403791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:37.416485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:37.423654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:37.430175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1ace951-d0de-4554-b8d0-392f4e8257ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.616583 May 19 08:39:37.430951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3088/4413] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:36 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:37.449961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:37.450803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 0779eef3-859e-45b7-a4e2-0cdf527d358e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:37.463756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.464965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.466685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.467383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.502398 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e HTTP/1.1 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '0779eef3-859e-45b7-a4e2-0cdf527d358e'} May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.504529 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.508856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.508856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.508856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:37.508856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:37.508856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. May 19 08:39:37.508856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.511410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 0779eef3-859e-45b7-a4e2-0cdf527d358e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:37.513391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-383d9bdf-511e-4f84-8867-0b6ffded4e9f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e" status: 404 len: 111 microversion: 2.1 time: 0.066896 May 19 08:39:37.514553 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3089/4414] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:37 2022] GET /compute/v2.1/servers/0779eef3-859e-45b7-a4e2-0cdf527d358e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:37.521891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:37.522962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:37.530778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.531713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.532776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.533413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.684174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:37.699596 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34b99bfa-49e7-4ae8-8558-0647da8fa79e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1266 microversion: 2.1 time: 0.180259 May 19 08:39:37.702474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3090/4415] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:37 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:37.726212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:37.726212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:37.750928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.751770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.755375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.758705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.791421 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f HTTP/1.1 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b8105472-c446-4604-9a41-b4a40bdcc14f'} May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:37.793263 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:37.797211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eed2e19a-8bda-4585-b0ac-a8034eed629e tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 404 len: 111 microversion: 2.1 time: 0.090455 May 19 08:39:37.800760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3091/4416] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:37 2022] DELETE /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:37.806320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:37.806948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: b8105472-c446-4604-9a41-b4a40bdcc14f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:37.829388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.829795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.832124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.832606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.878670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f HTTP/1.1 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b8105472-c446-4604-9a41-b4a40bdcc14f'} May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.885057 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.889385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance b8105472-c446-4604-9a41-b4a40bdcc14f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:37.891905 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c40c413b-23d6-461f-ad80-3d0b552a3a84 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f" status: 404 len: 111 microversion: 2.1 time: 0.087125 May 19 08:39:37.898663 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3092/4417] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:37 2022] GET /compute/v2.1/servers/b8105472-c446-4604-9a41-b4a40bdcc14f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:37.908204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:37.909165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:37.916221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.916675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.917477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.917909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.934743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c HTTP/1.1 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5470bba9-72f6-47d6-a99f-d95406958a0c'} May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:37.936611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a76ec3d4-aa91-47d5-a658-382433c1b1eb tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 404 len: 111 microversion: 2.1 time: 0.038364 May 19 08:39:37.940376 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3093/4418] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:37 2022] DELETE /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:37.952898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-551ac33e-a1e9-46b6-9d44-0b544130ca1d req-bca3ca6c-d33f-4e22-b88e-7a5800e1e1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8500c9aa-dd15-47c0-9906-9d73f704fca0", "name": "network-vif-deleted", "tag": "24685e5f-7060-411b-a9ed-5b4052fe1e17"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:37.969600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-551ac33e-a1e9-46b6-9d44-0b544130ca1d req-bca3ca6c-d33f-4e22-b88e-7a5800e1e1a5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:37.970044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-551ac33e-a1e9-46b6-9d44-0b544130ca1d req-bca3ca6c-d33f-4e22-b88e-7a5800e1e1a5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:37.995465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-551ac33e-a1e9-46b6-9d44-0b544130ca1d req-bca3ca6c-d33f-4e22-b88e-7a5800e1e1a5 service nova] Creating event network-vif-deleted:24685e5f-7060-411b-a9ed-5b4052fe1e17 for instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 on chh1-842464-2 May 19 08:39:38.015149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-551ac33e-a1e9-46b6-9d44-0b544130ca1d req-bca3ca6c-d33f-4e22-b88e-7a5800e1e1a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075228 May 19 08:39:38.015942 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3094/4419] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:38.027802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:38.047694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 5470bba9-72f6-47d6-a99f-d95406958a0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:38.075724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.077444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.078273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.078721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.115919 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c HTTP/1.1 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5470bba9-72f6-47d6-a99f-d95406958a0c'} May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.117633 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.122257 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.122257 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.122257 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:38.122257 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:38.122257 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. May 19 08:39:38.122257 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.123824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 5470bba9-72f6-47d6-a99f-d95406958a0c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:38.124898 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-665508c2-278e-45e8-b33f-b65f80d63b2f tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c" status: 404 len: 111 microversion: 2.1 time: 0.101384 May 19 08:39:38.125729 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3095/4420] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:38 2022] GET /compute/v2.1/servers/5470bba9-72f6-47d6-a99f-d95406958a0c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:38.138803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:38.139302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:38.150178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.150628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.151410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.151846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.182416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 HTTP/1.1 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ddf1234a-053c-432d-b904-25e00946d453'} May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:38.194507 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-165754dc-4348-45a1-aabd-41cf870604b2 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 404 len: 111 microversion: 2.1 time: 0.061748 May 19 08:39:38.198737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3096/4421] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:38 2022] DELETE /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:38.205356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:38.206003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: ddf1234a-053c-432d-b904-25e00946d453] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:38.223332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.223770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.236624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.237253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.282427 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 HTTP/1.1 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ddf1234a-053c-432d-b904-25e00946d453'} May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.283979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance ddf1234a-053c-432d-b904-25e00946d453 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:38.288951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e9cd58e-66c0-4a13-be8d-98e5a52c6790 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453" status: 404 len: 111 microversion: 2.1 time: 0.084533 May 19 08:39:38.291493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3097/4422] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:38 2022] GET /compute/v2.1/servers/ddf1234a-053c-432d-b904-25e00946d453 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:39:38.319196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:38.319705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:38.337095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.337743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.344266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.344850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.395566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 HTTP/1.1 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1467cda6-8c56-4b17-aa71-9d445ac9b118'} May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:38.397643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.402410 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.403372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:38.404867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e3d725b-fe97-46e7-926f-14ec18711536 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 404 len: 111 microversion: 2.1 time: 0.108099 May 19 08:39:38.408609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3098/4423] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:38 2022] DELETE /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:38.417819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:38.425745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: 1467cda6-8c56-4b17-aa71-9d445ac9b118] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:38.433816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.435259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.436114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.436660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.466662 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 HTTP/1.1 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1467cda6-8c56-4b17-aa71-9d445ac9b118'} May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.469658 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:38.474166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:38.474166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:38.474166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:38.474166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:38.474166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. May 19 08:39:38.474166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:38.477214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance 1467cda6-8c56-4b17-aa71-9d445ac9b118 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:38.478530 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40b4587c-08b0-400f-8c5c-d7aa8a090aba tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118" status: 404 len: 111 microversion: 2.1 time: 0.065761 May 19 08:39:38.479677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3099/4424] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:38 2022] GET /compute/v2.1/servers/1467cda6-8c56-4b17-aa71-9d445ac9b118 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:38.484934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:38.486070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:38.494964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.496172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.497738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:38.498337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:38.504487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:39.062126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:39.075753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:39.079515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:39.082824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5d987b5-eb91-4a3b-b550-7ecf08abfc58 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.601609 May 19 08:39:39.103302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3100/4425] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:38 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:39.577364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:39.578083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:39.594795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:39.597802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:39.601439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:39.603550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:39.699321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:39:39.898765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccd80847-4bdd-4c2c-acf4-28f943ef2fbd tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 204 len: 0 microversion: 2.1 time: 0.793951 May 19 08:39:39.902159 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3101/4426] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:39:39 2022] DELETE /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:39:39.921556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:39.922286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:39.954909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:39.955370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:39.956379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:39.956609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:40.534723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:40.545701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bbe9858-0961-4425-9f83-00e404cffae8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 0.640021 May 19 08:39:40.547767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3102/4427] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:39 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:40.568251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:40.571410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:40.592756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:40.594235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:40.599544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:40.600867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:41.348108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:41.364356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-206b5750-c8f9-4105-89a4-f159d5b95fc4 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1481 microversion: 2.1 time: 0.804942 May 19 08:39:41.370469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3103/4428] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:40 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1481 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:41.388549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:41.390876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:41.407682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:41.411173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:41.413272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:41.414094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:42.189533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:42.205907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:42.210897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:42.218464 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f682687c-cdb3-4384-a642-12cf03224823 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.840370 May 19 08:39:42.219777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3104/4429] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:41 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:42.232212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9a840f8f-9ba5-405a-aa04-92f71057327e req-71a5ffbe-43a9-414b-9884-4adfca2ce446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1eab8fe7-e628-4770-b188-cdb0ca3992af", "tag": "738de1f1-50a8-4034-ab38-2b73d7fae71d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:42.246841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9a840f8f-9ba5-405a-aa04-92f71057327e req-71a5ffbe-43a9-414b-9884-4adfca2ce446 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:42.249928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9a840f8f-9ba5-405a-aa04-92f71057327e req-71a5ffbe-43a9-414b-9884-4adfca2ce446 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:42.269859 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9a840f8f-9ba5-405a-aa04-92f71057327e req-71a5ffbe-43a9-414b-9884-4adfca2ce446 service nova] Creating event network-changed:738de1f1-50a8-4034-ab38-2b73d7fae71d for instance 1eab8fe7-e628-4770-b188-cdb0ca3992af on chh1-842464-2 May 19 08:39:42.276598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9a840f8f-9ba5-405a-aa04-92f71057327e req-71a5ffbe-43a9-414b-9884-4adfca2ce446 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055384 May 19 08:39:42.277497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3105/4430] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:42.283993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:42.284947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:42.292505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:42.293600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:42.294594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:42.295182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:42.854326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:42.866203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c384f8a3-d77c-4402-9c84-5e76dc75fadb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 0.586970 May 19 08:39:42.870367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3106/4431] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:42 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:42.892198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:42.893193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:42.919457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:42.921953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:42.926245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:42.930520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:43.090722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd72580bf62b6451ab10b45bc77c1f899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b526d88e8814c29b0c49b8c3dcd4c8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:43.101850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84ada419-f3c3-4940-9f1d-7f6c668bdb33 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 200 len: 1439 microversion: 2.1 time: 0.227691 May 19 08:39:43.102717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3107/4432] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:42 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 1439 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:43.237213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:43.238241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:43.245773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:43.251784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:43.254580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:43.257421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:43.762018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:43.770854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:43.776541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:43.788890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b162335a-83ff-46fa-a779-61c7692bbb88 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.555337 May 19 08:39:43.797829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3108/4433] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:43 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:43.806123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7aaff7e3-8bf7-40ab-8d10-21d47478d6ee req-2e566d5c-01f1-4660-8f07-8283745897d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae64075-10a6-4385-a09b-f3d64eb71c45", "name": "network-vif-deleted", "tag": "edeb457c-a4b7-4082-8653-451d613bc77e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:43.844495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7aaff7e3-8bf7-40ab-8d10-21d47478d6ee req-2e566d5c-01f1-4660-8f07-8283745897d7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:43.849089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7aaff7e3-8bf7-40ab-8d10-21d47478d6ee req-2e566d5c-01f1-4660-8f07-8283745897d7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:43.891179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7aaff7e3-8bf7-40ab-8d10-21d47478d6ee req-2e566d5c-01f1-4660-8f07-8283745897d7 service nova] Creating event network-vif-deleted:edeb457c-a4b7-4082-8653-451d613bc77e for instance aae64075-10a6-4385-a09b-f3d64eb71c45 on chh1-842464-2 May 19 08:39:43.917998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7aaff7e3-8bf7-40ab-8d10-21d47478d6ee req-2e566d5c-01f1-4660-8f07-8283745897d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115934 May 19 08:39:43.919152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3109/4434] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:43.932792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:43.939687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:43.962387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:43.967561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:43.971397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:43.973885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:44.670246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:44.691890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f661da25-11d2-4948-bc09-b81dc7fff61d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 0.768584 May 19 08:39:44.692813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3110/4435] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:43 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:44.701378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:44.711443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] [instance: aae64075-10a6-4385-a09b-f3d64eb71c45] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:44.722229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:44.722934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:44.724160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:44.724774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:44.763244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] HTTP exception thrown: Instance aae64075-10a6-4385-a09b-f3d64eb71c45 could not be found. May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Request method failure captured: May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 HTTP/1.1 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgEdp95sOi7jjcAASEQydeIHS3p1ZDRFiCTSwGMUYDF1p74waYeeG9GthUVmJ8r5PWGS8sM8pQqodrdd70GH7Q7M-33SXXyIgGN1Q1ip432nM5X_mtZIJjvsjiIMzUGIR-rprsmoLNKF263p8rWOWEJAXO0VGKFLKy5x03agTVgKSx4 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b526d88e8814c29b0c49b8c3dcd4c8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersTestJSON-1470334317 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6b526d88e8814c29b0c49b8c3dcd4c8d May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersTestJSON-1470334317 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersTestJSON-1470334317-project May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d72580bf62b6451ab10b45bc77c1f899 May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersTestJSON-1470334317-project May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance aae64075-10a6-4385-a09b-f3d64eb71c45 could not be found. May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'aae64075-10a6-4385-a09b-f3d64eb71c45'} May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae64075-10a6-4385-a09b-f3d64eb71c45 could not be found. May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae64075-10a6-4385-a09b-f3d64eb71c45 could not be found. May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:44.765209 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:39:44.769914 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:39:44.769914 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:39:44.769914 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:39:44.769914 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:39:44.769914 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae64075-10a6-4385-a09b-f3d64eb71c45 could not be found. May 19 08:39:44.769914 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:39:44.771627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] Returning 404 to user: Instance aae64075-10a6-4385-a09b-f3d64eb71c45 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:39:44.773239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-207a4d70-46ec-40ed-9283-2ed802a2a801 tempest-ServersTestJSON-1470334317 tempest-ServersTestJSON-1470334317-project] 10.222.0.78 "GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45" status: 404 len: 111 microversion: 2.1 time: 0.079049 May 19 08:39:44.773989 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3111/4436] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:44 2022] GET /compute/v2.1/servers/aae64075-10a6-4385-a09b-f3d64eb71c45 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:39:44.821398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:44.822425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:44.835068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:44.835903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:44.836979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:44.837657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:45.074591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:45.949575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:45.961071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:45.965225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:45.969607 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d96d9d7-f2d4-434a-9652-bf1306fc2b7e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1742 microversion: 2.20 time: 1.158458 May 19 08:39:45.970904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3112/4437] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:44 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1742 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:39:45.980670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:45.981782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:45.995323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:45.999515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:46.001145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:46.004240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:46.069825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:46.543069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:46.551264 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4449ff74-c77b-4bb4-b3a4-8c131dcbde5e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 0.578949 May 19 08:39:46.572203 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3113/4438] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:45 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:46.988592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:46.989253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:46.997925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:47.013277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:47.014567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:47.040574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:47.665641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:47.690274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:47.716346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:47.723265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77398a4b-ce24-46c3-ab60-83d9aba6d777 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.738406 May 19 08:39:47.727283 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3114/4439] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:46 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:39:47.760547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:47.768790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:47.833568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:47.837443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:47.840569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:47.841425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:48.767893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:48.779922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9b6688c-38d2-4be2-b469-b1b7df942965 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 1.051218 May 19 08:39:48.786613 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3115/4440] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:47 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:48.829160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:48.830164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:48.847673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:48.848488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:48.849545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:48.850929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:49.452199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:49.465860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:49.473030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:49.476208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea256c43-0f5e-428a-88e0-a1cc4ceb052e tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.676005 May 19 08:39:49.480821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3116/4441] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:48 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:49.829604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:49.842224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:49.879513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:49.880425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:49.890023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:49.890872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:49.998451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:50.828322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:50.841910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8df533a-07b5-4b4c-bbdb-eae90ef978b8 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 1.038644 May 19 08:39:50.857826 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3117/4442] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:49 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:50.868114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:50.874741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:50.923199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:50.927592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:50.942180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:50.942180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:51.506764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:51.524935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:51.526728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:51.533644 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b3f45f8-c986-4a50-88db-f088cd23a76d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.674436 May 19 08:39:51.536419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3118/4443] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:50 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:51.857271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1768260275", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": "none"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:51.999802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:39:52.000621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:39:52.001340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:39:52.001995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:39:52.002666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:39:52.020610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:52.025842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:52.027042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:52.031372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:52.080791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Getting quotas for project 835715cca630405c938ff046224aa176. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:39:52.091816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Getting quotas for user 510a8068f4bb43f4a6b0f724422645e3 and project 835715cca630405c938ff046224aa176. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:39:52.133286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:39:52.136156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:39:52.260724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-627d437c-0527-47b9-930a-350d462d9c65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.722359 May 19 08:39:52.262056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3119/4444] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:39:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:39:52.274454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:52.275464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:52.296784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:52.337968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:52.341390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:52.344008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:53.997950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:54.019327 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17670708-fc25-4520-aac8-c127df5dff1a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 1.754629 May 19 08:39:54.028205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3120/4445] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:52 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:54.057297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:54.062688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:54.091597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:54.092546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:54.093577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:54.101093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:54.364764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:54.383385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:54.385013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:54.386328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2098928d-82e0-4e3a-8428-a82d147b762c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1330 microversion: 2.54 time: 0.355957 May 19 08:39:54.386920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3121/4446] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:54 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1330 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:54.406398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:54.407035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:54.427919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:54.428362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:54.429141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:54.434478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:55.385550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:55.399761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:55.406539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:55.407786 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71f6e735-c330-4c5a-8224-e8649eadd8ee tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 1.005283 May 19 08:39:55.408369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3122/4447] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:54 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:55.424953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1307890d-96cf-40d0-89a0-dde1c017716d req-8442c1d1-c811-4c4d-b40f-28ccad1fa09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eab8fe7-e628-4770-b188-cdb0ca3992af", "name": "network-vif-plugged", "status": "completed", "tag": "738de1f1-50a8-4034-ab38-2b73d7fae71d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:55.438000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1307890d-96cf-40d0-89a0-dde1c017716d req-8442c1d1-c811-4c4d-b40f-28ccad1fa09f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:55.440491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1307890d-96cf-40d0-89a0-dde1c017716d req-8442c1d1-c811-4c4d-b40f-28ccad1fa09f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:55.471046 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1307890d-96cf-40d0-89a0-dde1c017716d req-8442c1d1-c811-4c4d-b40f-28ccad1fa09f service nova] Creating event network-vif-plugged:738de1f1-50a8-4034-ab38-2b73d7fae71d for instance 1eab8fe7-e628-4770-b188-cdb0ca3992af on chh1-842464-2 May 19 08:39:55.478447 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1307890d-96cf-40d0-89a0-dde1c017716d req-8442c1d1-c811-4c4d-b40f-28ccad1fa09f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056927 May 19 08:39:55.479310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3123/4448] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:55.485191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:55.486359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:55.510699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:55.511907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:55.512957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:55.526101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:56.333070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:56.345943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ab772044-5ba6-4d27-9724-594b1fa222e0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 0.865144 May 19 08:39:56.346537 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3124/4449] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:55 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:39:56.363396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:56.365538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:56.390633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:56.391383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:56.410238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:56.411707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:56.566264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:56.580180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:56.583919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:56.589618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac3fe091-22c9-4b48-88b2-36722a981b71 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1336 microversion: 2.54 time: 0.241095 May 19 08:39:56.590547 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3125/4450] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:56 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1336 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:56.603302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:56.604269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:56.617822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:39:56.633836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:56.635844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:56.636961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:56.638929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:57.238120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:57.258392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:57.263797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:57.268036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f551279e-9530-4655-a33d-63b9726c851c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.670623 May 19 08:39:57.271137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3126/4451] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:56 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:57.366335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:57.366979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:57.398838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:57.399579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:57.400155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:57.406160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:58.524199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:58.535063 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-444ae3a9-cbfd-44e7-ac5b-b934e361b382 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1308 microversion: 2.1 time: 1.175684 May 19 08:39:58.541051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3127/4452] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:39:57 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1308 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:39:58.548809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c62af0a0-5924-4a61-bcfd-8be404915dcf req-57b54bf4-cbe0-477f-8aae-8d96d761fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "name": "network-vif-plugged", "status": "completed", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:39:58.570247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c62af0a0-5924-4a61-bcfd-8be404915dcf req-57b54bf4-cbe0-477f-8aae-8d96d761fe0e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:58.574272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c62af0a0-5924-4a61-bcfd-8be404915dcf req-57b54bf4-cbe0-477f-8aae-8d96d761fe0e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:58.603989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c62af0a0-5924-4a61-bcfd-8be404915dcf req-57b54bf4-cbe0-477f-8aae-8d96d761fe0e service nova] Creating event network-vif-plugged:e821d61e-ed3c-4c43-b51a-a5ae486dc9d3 for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce on chh1-842464-2 May 19 08:39:58.646250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c62af0a0-5924-4a61-bcfd-8be404915dcf req-57b54bf4-cbe0-477f-8aae-8d96d761fe0e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103604 May 19 08:39:58.651180 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3128/4453] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:39:58.669824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:58.670540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:58.688182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:58.688644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:58.695617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:58.696079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:59.004678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:59.020520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:59.024037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:39:59.026824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b586ce2-d9c9-4987-9c74-03339f0c4f24 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1357 microversion: 2.54 time: 0.374254 May 19 08:39:59.046689 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3129/4454] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:58 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1357 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:39:59.063468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:39:59.067757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:39:59.087226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:59.090035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:39:59.092130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:39:59.101817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:00.668396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:00.686296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:00.687962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:00.695071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d44812c3-713f-4706-9cca-c7caed8f1eed tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 1.646897 May 19 08:40:00.695940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3130/4455] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:39:59 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:00.710724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ab7496c-5c22-43d6-8d1a-383ab748926a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Action: 'create', calling method: .version_select at 0x7f3210476310>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-12063997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHkTYB2DgqDFla83lwPnBKulxfotfETuDYfXXjukS4huzS+bWpW+tiXxwQulMfkb/qmTh45ODAGGIgPMq+astv7nP/v2mr+ninfhl8SJYKaZY5CZv+zLNyz7F4Ya37Vlg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:00.761145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9ab7496c-5c22-43d6-8d1a-383ab748926a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Getting quotas for project 835715cca630405c938ff046224aa176. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:40:00.773488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9ab7496c-5c22-43d6-8d1a-383ab748926a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Getting quotas for user 510a8068f4bb43f4a6b0f724422645e3 and project 835715cca630405c938ff046224aa176. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:40:00.843935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ab7496c-5c22-43d6-8d1a-383ab748926a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.54 time: 0.146553 May 19 08:40:00.844836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3131/4456] 10.222.0.78 () {62 vars in 1199 bytes} [Thu May 19 08:40:00 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 08:40:00.851710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:00.854213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:00.882691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:00.883253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:00.885780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:00.886351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:02.062683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:02.132999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:02.152583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8fe6ae0-1c0b-465a-a7be-591c65758aba tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1488 microversion: 2.1 time: 1.300644 May 19 08:40:02.156504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3132/4457] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:00 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1488 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:02.175848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-12063997", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:02.187599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:02.215516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:02.215982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:02.217476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:02.230107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:02.469903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:40:02.470324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:40:02.470812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:40:02.471214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:40:02.471626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:40:02.657297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:02.665595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:02.666216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:02.667521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:02.668138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:02.716469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a2002484-4e63-4429-9567-c7a4a9b3e96a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "POST /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0/action" status: 202 len: 1138 microversion: 2.54 time: 0.557757 May 19 08:40:02.717373 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3133/4458] 10.222.0.78 () {62 vars in 1319 bytes} [Thu May 19 08:40:02 2022] POST /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0/action => generated 1138 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 19 08:40:03.303312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cab0b271-2a10-45a4-a3d2-e545fb2ef3ae tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: .version_select at 0x7f3210470040>, body: {"keypair": {"name": "tempest-keypair-667494726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy2HjRSfbTSpd5nlmv/HpwxFgDbQp0miEfYoi+mDDgdEf3XTwmZSIsN40uz7lGzKCi5HSsUTUsKhdSPx0T1om8Ez3rptaEbCBxyOlupxEll/WvG3kMhiW7b2JyQ8IYNEQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:03.351440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-cab0b271-2a10-45a4-a3d2-e545fb2ef3ae tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for project b5544135087c43e9929fee886ac58afd. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:40:03.364631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-cab0b271-2a10-45a4-a3d2-e545fb2ef3ae tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for user 982a8a134680453bb66192b6d7cbb477 and project b5544135087c43e9929fee886ac58afd. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:40:03.422808 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cab0b271-2a10-45a4-a3d2-e545fb2ef3ae tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.703019 May 19 08:40:03.425196 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3134/4459] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:40:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:03.433005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:03.437333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:03.458269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:03.459122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:03.460644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:03.461340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:03.502074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:03.769638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:03.790989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:03.797347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:03.801553 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ec99f50-4dd3-485a-8700-66ca1e85baf3 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.372645 May 19 08:40:03.804534 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3135/4460] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:03 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:03.820310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:03.821699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:03.858535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:03.864396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:03.870395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:03.876858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:04.008802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lazy-loading 'flavor' on Instance uuid 1eab8fe7-e628-4770-b188-cdb0ca3992af {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:40:04.223181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58cd2571-d74c-4e3b-959b-7603b5c26b67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af/action" status: 202 len: 0 microversion: 2.1 time: 0.417141 May 19 08:40:04.227736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3136/4461] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:40:03 2022] POST /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:40:04.235399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:04.241266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:04.273799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:04.274180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:04.275043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:04.275477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:04.453813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:04.469705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:04.471276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:04.472493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bece1b5d-2585-4f85-844f-58d7911289f0 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.246385 May 19 08:40:04.473062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3137/4462] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:04 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:04.492129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:04.498602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:04.513472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:04.523936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:04.525046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:04.528316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:04.885037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:04.917055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5be106e9-e4b4-4af2-9f53-1e11499e8100 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1496 microversion: 2.1 time: 0.436973 May 19 08:40:04.918554 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3138/4463] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:04 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1496 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:04.940715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:04.941373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:04.990672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:04.996103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:04.998568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:05.000385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:05.443279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:05.452972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:05.469259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:05.471973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd8787f8-2df6-4a91-92ec-1c6e5603eb02 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.548971 May 19 08:40:05.474908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3139/4464] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:04 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:05.499415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:05.503188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:05.527342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:05.529277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:05.530460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:05.533526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:05.700855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:05.725274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:05.728635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:05.734292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e5ce2de-bbfe-4c7e-833a-722d5288d3ae tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.245178 May 19 08:40:05.737497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3140/4465] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:05 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:05.936193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:05.941591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:05.958298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:05.960481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:05.963867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:05.964644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:06.321676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:06.338009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e21f64c1-7a3a-489b-9f6c-9aabd3a69c67 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 200 len: 1479 microversion: 2.1 time: 0.405376 May 19 08:40:06.339606 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3141/4466] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:05 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 1479 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:40:06.361204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-808297904"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:06.362617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:06.388201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:06.392686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:06.393833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:06.394415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:07.156239 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f90ce0e6-a7a2-4ee5-9ff4-7f35d472c816 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af/action" status: 202 len: 0 microversion: 2.1 time: 0.798751 May 19 08:40:07.164198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3142/4467] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:40:06 2022] POST /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af/action => generated 0 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:40:07.205655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:07.206497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:07.216988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:07.217469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:07.230038 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:40:07.230537 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:40:07.233959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:07.237045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:07.758483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:07.768237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:07.783556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:07.795567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36f2ac08-aac5-4818-b7a4-84b5a4bd7af5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.626286 May 19 08:40:07.807154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3143/4468] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:07 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:07.827834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:07.830062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:07.874753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:07.876824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:07.886595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:07.887696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:08.152270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:08.175310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:08.191446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:08.192692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ad23bb6-330b-4a46-8e17-4aa4f7cf5c05 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.382637 May 19 08:40:08.193263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3144/4469] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:07 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:08.214168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1480f09-38bf-463d-8786-c6761b3ade9a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321042c820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:08.357743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1480f09-38bf-463d-8786-c6761b3ade9a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.151023 May 19 08:40:08.364357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3145/4470] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:08 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:08.388607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1063359158", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6fde95d-7231-4c7b-9cf2-edbbe1908c28"}], "security_groups": [{"name": "tempest-securitygroup--53838172"}], "key_name": "tempest-keypair-667494726", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:08.737808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] validate_networks() for [('e6fde95d-7231-4c7b-9cf2-edbbe1908c28', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:40:09.805405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:40:09.807273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:40:09.808974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:40:09.809597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:40:09.810187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:40:09.860145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:09.861743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:09.862604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:09.863007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:09.909801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for project b5544135087c43e9929fee886ac58afd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:40:09.917441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for user 982a8a134680453bb66192b6d7cbb477 and project b5544135087c43e9929fee886ac58afd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:40:09.943026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:40:09.946306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:40:10.056028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c85a5f7-8b11-437d-8031-84baf4d7bade tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.686909 May 19 08:40:10.062674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3146/4471] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:40:08 2022] POST /compute/v2.1/servers => generated 400 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:40:10.093261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:10.097408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:10.110418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:10.111126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:10.112080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:10.112705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:10.478011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:10.491281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:10.498012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:10.499823 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73b96c07-b595-4b80-8e60-22458f083093 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.435593 May 19 08:40:10.501823 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3147/4472] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:10 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:10.518005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:10.518865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:10.542918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:10.543673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:10.544774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:10.546173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:10.781618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:10.805491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:10.819512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:10.828466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f361a1fd-d896-411f-92fb-1df5c68a78f2 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.318389 May 19 08:40:10.828466 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3148/4473] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:10 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:10.831829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a1040a4-6845-4e3d-a767-eeb45a8a6c81 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f0e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:11.160469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a1040a4-6845-4e3d-a767-eeb45a8a6c81 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.332056 May 19 08:40:11.161916 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3149/4474] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:10 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:11.194956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:11.196066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:11.207827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:11.216655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:11.217842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:11.219842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:11.374748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:11.398934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdc0e87c-b318-4c5f-97bf-aea7ea42bd33 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1241 microversion: 2.1 time: 0.227506 May 19 08:40:11.406939 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3150/4475] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:11 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:11.529867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:11.531371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:11.580943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:11.582423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:11.608580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:11.610085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:12.151610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:12.155969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:12.172531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:12.182071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:12.185951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1120ae84-58ac-49d6-8a69-6320eafa49cb tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1737 microversion: 2.20 time: 0.667630 May 19 08:40:12.198628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3151/4476] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:11 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1737 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:40:12.207339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:12.229962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:12.251344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:12.257264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:12.258825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:12.259298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:12.663674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:12.680022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:12.687579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:12.689166 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47cd6fe2-5d26-43c6-a0a7-9b97d5b201c9 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.488191 May 19 08:40:12.692297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3152/4477] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:12 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:12.707143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2395f919-524c-4f07-b3f5-aa92bcb37eea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210432b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:18.969731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2395f919-524c-4f07-b3f5-aa92bcb37eea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 6.271732 May 19 08:40:18.969731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3153/4478] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:12 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 6275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:18.983688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-69fdab37-2fc7-4aa9-8907-ed82da0e018f req-4e0c1ae3-d96d-44f4-b935-1b3fd56e30f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eab8fe7-e628-4770-b188-cdb0ca3992af", "name": "network-vif-plugged", "status": "completed", "tag": "738de1f1-50a8-4034-ab38-2b73d7fae71d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:19.007698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-69fdab37-2fc7-4aa9-8907-ed82da0e018f req-4e0c1ae3-d96d-44f4-b935-1b3fd56e30f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:19.008062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-69fdab37-2fc7-4aa9-8907-ed82da0e018f req-4e0c1ae3-d96d-44f4-b935-1b3fd56e30f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:19.031574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-69fdab37-2fc7-4aa9-8907-ed82da0e018f req-4e0c1ae3-d96d-44f4-b935-1b3fd56e30f3 service nova] Creating event network-vif-plugged:738de1f1-50a8-4034-ab38-2b73d7fae71d for instance 1eab8fe7-e628-4770-b188-cdb0ca3992af on chh1-842464-2 May 19 08:40:19.042919 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-69fdab37-2fc7-4aa9-8907-ed82da0e018f req-4e0c1ae3-d96d-44f4-b935-1b3fd56e30f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068745 May 19 08:40:19.049231 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3154/4479] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:19.078219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:19.079213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:19.097673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:19.098612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:19.100322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:19.101029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:19.426359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:19.447366 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d224126-a08e-4a55-a865-da1c09427ae9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1361 microversion: 2.1 time: 0.392403 May 19 08:40:19.448038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3155/4480] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:19 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:19.474246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:19.480553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:19.499151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:19.499605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:19.500458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:19.500904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:19.900252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:19.937398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=20 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:20.027962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:20.047916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:20.050035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:20.057391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0b44d86-8de2-490c-9c71-163d367cd3ce tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1719 microversion: 2.20 time: 0.608141 May 19 08:40:20.064762 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3156/4481] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:19 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1719 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:20.086557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:20.087583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:20.106370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:20.106820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:20.117247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:20.117856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:20.300683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:20.321704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:20.324104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:20.325354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4889acfd-8d8c-4ad5-9493-bffed0963319 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.259180 May 19 08:40:20.343286 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3157/4482] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:20 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:20.352159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0a01ee81-afc2-427d-b01d-a2344961c1d0 req-64a4ee68-2716-47c2-b7b0-252266d6b0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ede4f4-ba88-460e-9998-80e614faf431", "tag": "26c2d915-769d-4b52-85a7-9fd235199d22"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:20.367303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:20.377021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0a01ee81-afc2-427d-b01d-a2344961c1d0 req-64a4ee68-2716-47c2-b7b0-252266d6b0d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:20.381899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0a01ee81-afc2-427d-b01d-a2344961c1d0 req-64a4ee68-2716-47c2-b7b0-252266d6b0d5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:20.411671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0a01ee81-afc2-427d-b01d-a2344961c1d0 req-64a4ee68-2716-47c2-b7b0-252266d6b0d5 service nova] Creating event network-changed:26c2d915-769d-4b52-85a7-9fd235199d22 for instance 35ede4f4-ba88-460e-9998-80e614faf431 on chh1-842464-2 May 19 08:40:20.425073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0a01ee81-afc2-427d-b01d-a2344961c1d0 req-64a4ee68-2716-47c2-b7b0-252266d6b0d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080387 May 19 08:40:20.428862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3158/4483] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:20.441438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6deba60-5277-4a2e-a484-9cff5caf54ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32103d6dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:20.538162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6deba60-5277-4a2e-a484-9cff5caf54ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.107117 May 19 08:40:20.545147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3159/4484] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:20 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:20.556654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:20.557448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:20.573914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:20.577489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:20.578384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:20.578829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:21.409290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.418476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e6f3487-4812-4d9d-80ff-e356635d8d9d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1361 microversion: 2.1 time: 0.870832 May 19 08:40:21.419067 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3160/4485] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:20 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1361 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:21.435356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:21.435987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:21.450738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:21.451910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:21.452708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:21.455974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:21.743511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.757636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.759390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.765423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ade6535f-725e-4af1-b414-aa5c96f52cfc tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1719 microversion: 2.20 time: 0.329378 May 19 08:40:21.766991 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3161/4486] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:21 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1719 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:21.779357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:21.780451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:21.789256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:21.798673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:21.799487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:21.799941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:21.925830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.936058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.942136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:21.946197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3820f92-3578-4c94-a392-6d87ab65df7c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.178174 May 19 08:40:21.952190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3162/4487] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:21 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:21.962421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39576808-fda5-4cb8-b198-7e76794b22cd tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210426280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:22.061609 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39576808-fda5-4cb8-b198-7e76794b22cd tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.107605 May 19 08:40:22.062418 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3163/4488] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:21 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:22.302141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b365e74e-2ad7-4acd-b653-aef7b1f1d8bf req-b04f7546-c848-4c3d-acde-025263a57e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ede4f4-ba88-460e-9998-80e614faf431", "name": "network-vif-plugged", "status": "completed", "tag": "26c2d915-769d-4b52-85a7-9fd235199d22"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:22.314026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b365e74e-2ad7-4acd-b653-aef7b1f1d8bf req-b04f7546-c848-4c3d-acde-025263a57e2b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:22.320972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b365e74e-2ad7-4acd-b653-aef7b1f1d8bf req-b04f7546-c848-4c3d-acde-025263a57e2b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:22.392930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b365e74e-2ad7-4acd-b653-aef7b1f1d8bf req-b04f7546-c848-4c3d-acde-025263a57e2b service nova] Creating event network-vif-plugged:26c2d915-769d-4b52-85a7-9fd235199d22 for instance 35ede4f4-ba88-460e-9998-80e614faf431 on chh1-842464-2 May 19 08:40:22.415752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b365e74e-2ad7-4acd-b653-aef7b1f1d8bf req-b04f7546-c848-4c3d-acde-025263a57e2b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122267 May 19 08:40:22.417119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3164/4489] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 08:40:22.436821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:22.441881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:22.465815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:22.469849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:22.471332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:22.477510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:22.800426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:22.830119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f067aed-c337-40b4-8a76-8b49ddc16719 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1361 microversion: 2.1 time: 0.384629 May 19 08:40:22.831436 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3165/4490] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:22 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:22.840875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:22.853146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:22.887141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:22.887944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:22.892107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:22.892577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:23.237531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:23.250632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:23.259463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:23.261118 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46fd1915-a586-4244-8cf7-0caaef1d05ba tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1719 microversion: 2.20 time: 0.428382 May 19 08:40:23.269365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3166/4491] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:22 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1719 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:23.278157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:23.280118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:23.294743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:23.295202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:23.299185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:23.299672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:23.525359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:23.547092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:23.552291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:23.557152 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99fc6458-1f47-468c-881a-ad18a465afeb tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.293696 May 19 08:40:23.568396 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3167/4492] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:23 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:23.568396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd23793d-673b-4b14-a9bb-ce5b1754b939 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321042c3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:23.690598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd23793d-673b-4b14-a9bb-ce5b1754b939 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.130985 May 19 08:40:23.692277 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3168/4493] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:23 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:23.850938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:23.854741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:23.880364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:23.882149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:23.883303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:23.884645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:24.386620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:24.394327 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62a78e8c-7a59-413d-aa43-2d9548f76a70 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1361 microversion: 2.1 time: 0.549070 May 19 08:40:24.417755 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3169/4494] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:23 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:24.430748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:24.431386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:24.465602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:24.468018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:24.469135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:24.473155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:25.067288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:25.088066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:25.096099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:25.099632 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b4b21e9-c028-4fb7-a6e9-9c49cab1e386 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1662 microversion: 2.20 time: 0.679981 May 19 08:40:25.103474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3170/4495] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:24 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1662 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:25.119270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:25.120471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:25.140832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:25.145777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:25.148333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:25.149390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:25.347237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:25.363315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:25.364828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:25.378109 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6dd928f0-9f3e-45b6-8204-c7f6f66d0c72 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.269801 May 19 08:40:25.378951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3171/4496] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:25 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:25.406562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7997a8e5-387c-4648-aee6-f3ed1d366c9d req-ae580bf2-0772-4a07-ad72-8149caa3d9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "name": "network-vif-unplugged", "status": "completed", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:25.431162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7997a8e5-387c-4648-aee6-f3ed1d366c9d req-ae580bf2-0772-4a07-ad72-8149caa3d9b3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:25.433278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7997a8e5-387c-4648-aee6-f3ed1d366c9d req-ae580bf2-0772-4a07-ad72-8149caa3d9b3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:25.460690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.compute.server_external_events [req-7997a8e5-387c-4648-aee6-f3ed1d366c9d req-ae580bf2-0772-4a07-ad72-8149caa3d9b3 service nova] Unable to find a host for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce. Dropping event network-vif-unplugged {{(pid=119072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 08:40:25.462678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7997a8e5-387c-4648-aee6-f3ed1d366c9d req-ae580bf2-0772-4a07-ad72-8149caa3d9b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060719 May 19 08:40:25.465948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3172/4497] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 86 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 08:40:25.471434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59c6d4ba-1188-4ad4-a599-a9ee462ba385 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104340d0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:25.573869 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59c6d4ba-1188-4ad4-a599-a9ee462ba385 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.105254 May 19 08:40:25.573869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3173/4498] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:25 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:25.594635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5ba78f7-2342-4eaa-9577-128bec4f524e"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:25.596966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:25.625091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:25.626593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:25.627419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:25.627858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:26.155499 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:40:26.156592 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:40:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:40:26.258923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:26.522290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c85b73d7-cdaf-43dc-889c-559ec8dfc7fa tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.941964 May 19 08:40:26.532948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3174/4499] 10.222.0.78 () {62 vars in 1363 bytes} [Thu May 19 08:40:25 2022] POST /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-volume_attachments => generated 188 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:40:26.541238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:26.542261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:26.551385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:26.552091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:26.554525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:26.555454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:27.617809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:27.663885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5af4cf25-0b8f-4f5b-aedc-c10b17b2a8bb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1547 microversion: 2.1 time: 1.125340 May 19 08:40:27.667829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3175/4500] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:26 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1547 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:27.688768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:27.691463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:27.716337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:27.721628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:27.726654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:27.727705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:27.819239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:27.831025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:27.832878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:27.835310 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d892b49b-3396-418a-9735-f0279f6061a5 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.161528 May 19 08:40:27.847162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3176/4501] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:27 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:27.853075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90fcc250-cb01-456d-94db-d16444d16573 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210470550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:27.926649 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90fcc250-cb01-456d-94db-d16444d16573 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.078022 May 19 08:40:27.934369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3177/4502] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:27 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:27.938791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:27.942417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:27.961796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:27.965665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:27.966888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:27.968866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:28.825837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67ae34d5-98a7-40cd-8cdd-b10d585780df tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-volume_attachments/d5ba78f7-2342-4eaa-9577-128bec4f524e" status: 202 len: 0 microversion: 2.20 time: 0.896553 May 19 08:40:28.829635 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3178/4503] 10.222.0.78 () {60 vars in 1456 bytes} [Thu May 19 08:40:27 2022] DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-volume_attachments/d5ba78f7-2342-4eaa-9577-128bec4f524e => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:40:28.837329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:28.842716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:28.857625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:28.867216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:28.872665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:28.873356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:29.166242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4851da17-7ae0-4647-af8e-0af99be58796 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335004 May 19 08:40:29.166971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3179/4504] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:40:28 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:29.172403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:29.173173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:29.197514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:29.198578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:29.199421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:29.199941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:29.506719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:29.531155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:29.536227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:29.560583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2178991-ae1a-49f6-b099-eb96a607bc43 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.379027 May 19 08:40:29.562581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3180/4505] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:29 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:29.583609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d10d75be-7a3d-4406-a068-8eeccc802ba9 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321042f8b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:29.718552 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d10d75be-7a3d-4406-a068-8eeccc802ba9 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.152625 May 19 08:40:29.722169 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3181/4506] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:29 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:29.749729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:29.754866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:29.783000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:29.783643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:29.801658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:29.803957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:30.129277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-726a5d7b-9b72-492d-9002-708199b34996 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "POST /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/action" status: 202 len: 0 microversion: 2.20 time: 0.404459 May 19 08:40:30.131804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3182/4507] 10.222.0.78 () {62 vars in 1318 bytes} [Thu May 19 08:40:29 2022] POST /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 08:40:30.142052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:30.150263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:30.177001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:30.178676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:30.179814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:30.187387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:30.973758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:30.988904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:30.997545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:30.999045 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-271e6cbc-ef3d-40fd-a631-64ce3e3dcfcd tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1670 microversion: 2.20 time: 0.862109 May 19 08:40:31.000087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3183/4508] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:30 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1670 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:31.007577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:31.014373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:31.041634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:31.042361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:31.043379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:31.044525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:31.240423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:31.250678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:31.252162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:31.284135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be6ef242-b86f-4f6e-bb60-000f34aa1f25 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.252165 May 19 08:40:31.284857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3184/4509] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:31 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:31.311239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f93201d-9d23-462e-b8ef-c0c7c3e0b2ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210401940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:31.439049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f93201d-9d23-462e-b8ef-c0c7c3e0b2ea tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.131444 May 19 08:40:31.439630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3185/4510] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:31 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:32.034182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:32.035388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:32.060095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:32.060836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:32.064670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:32.065298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:33.495657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:33.520203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:33.522840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:33.526255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc88dbe5-9804-491d-8513-a676aaa52399 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1670 microversion: 2.20 time: 1.496643 May 19 08:40:33.530333 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3186/4511] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:32 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1670 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:40:33.546472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:33.549708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:33.564181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:33.566258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:33.573334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:33.574185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:33.947899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:33.958114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:33.971968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:33.974590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-193494c6-5522-4be9-809b-eddf3e4b9a6c tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1407 microversion: 2.54 time: 0.431897 May 19 08:40:33.978113 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3187/4512] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:33 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:33.988157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0dceeffe-12a7-41b2-9965-060d7c3f45f2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321038a280>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:34.058388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0dceeffe-12a7-41b2-9965-060d7c3f45f2 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.078891 May 19 08:40:34.064369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3188/4513] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:33 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:34.076854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5690d0f3-1273-4825-b5ff-c59923b29e7b req-b1be8733-d598-466a-b22f-f54189063924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ede4f4-ba88-460e-9998-80e614faf431", "tag": "26c2d915-769d-4b52-85a7-9fd235199d22"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:34.099630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5690d0f3-1273-4825-b5ff-c59923b29e7b req-b1be8733-d598-466a-b22f-f54189063924 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:34.100079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5690d0f3-1273-4825-b5ff-c59923b29e7b req-b1be8733-d598-466a-b22f-f54189063924 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:34.142246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5690d0f3-1273-4825-b5ff-c59923b29e7b req-b1be8733-d598-466a-b22f-f54189063924 service nova] Creating event network-changed:26c2d915-769d-4b52-85a7-9fd235199d22 for instance 35ede4f4-ba88-460e-9998-80e614faf431 on chh1-842464-2 May 19 08:40:34.157417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5690d0f3-1273-4825-b5ff-c59923b29e7b req-b1be8733-d598-466a-b22f-f54189063924 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090082 May 19 08:40:34.159850 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3189/4514] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:34.552229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:34.554174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:34.574726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:34.576884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:34.581041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:34.584854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:35.239474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:35.274434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:35.276024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:35.277326 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ae44f27-dc66-414c-b94e-75538db2cfaf tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.730327 May 19 08:40:35.289895 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3190/4515] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:34 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:35.295380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:35.296019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:35.316329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:35.316794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:35.317633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:35.319088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:35.547327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:35.556998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:35.575042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:35.576652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:35.578767 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b224a922-12c5-41a6-a6c6-f28a8aff791a tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1413 microversion: 2.54 time: 0.287370 May 19 08:40:35.582060 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3191/4516] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:35 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1413 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:35.589183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ae44d36-b225-4b9d-9045-080ac2dfe694 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32103e8670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:35.658287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ae44d36-b225-4b9d-9045-080ac2dfe694 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1437 microversion: 2.1 time: 0.074767 May 19 08:40:35.665258 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3192/4517] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:35 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:36.310925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:36.320648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:36.338174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:36.346779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:36.350656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:36.352398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:36.699624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:36.715903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:36.724111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:36.726378 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-239722cd-30f2-42c5-b770-c3415ae775ec tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.434059 May 19 08:40:36.733382 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3193/4518] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:36 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:36.739023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:36.742545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:36.754737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:36.762214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:36.763809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:36.764636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:36.927081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:36.943979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:36.961845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:36.963217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87ab6412-e260-4804-b8ae-bbe41013ea65 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1413 microversion: 2.54 time: 0.228496 May 19 08:40:36.980643 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3194/4519] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:36 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1413 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:37.000384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49d8bd4d-c816-4b24-a0bb-d405f223f25a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210470940>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:40.660946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49d8bd4d-c816-4b24-a0bb-d405f223f25a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1446 microversion: 2.1 time: 3.676944 May 19 08:40:40.662936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3195/4520] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:36 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1446 bytes in 3679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:40.674006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:40.681473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:40.689538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:40.690303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:40.691592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:40.692284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:41.121397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:41.135561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:41.143852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:41.147990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79197d91-bc5c-405a-92f1-6d4d0388842d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.482033 May 19 08:40:41.151091 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3196/4521] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:40 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:41.173188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:41.199628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:41.247394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:41.248955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:41.251383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:41.255016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:41.422719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:41.450567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:41.463040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:41.465538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5e57a79-1ef3-4b5d-82f8-0f105a42e133 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1398 microversion: 2.54 time: 0.312040 May 19 08:40:41.468734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3197/4522] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:41 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1398 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:41.481674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17841238-20a5-4101-83cd-c38a179616d1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104f0790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:41.561519 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17841238-20a5-4101-83cd-c38a179616d1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 200 len: 1446 microversion: 2.1 time: 0.090174 May 19 08:40:41.569330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3198/4523] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:40:41 2022] GET /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:41.579676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-387bae71-1409-424f-bf22-8db676086dda tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '.version_select at 0x7f321039cdc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:41.648960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-387bae71-1409-424f-bf22-8db676086dda tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-12063997" status: 204 len: 0 microversion: 2.54 time: 0.077309 May 19 08:40:41.650766 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3199/4524] 10.222.0.78 () {60 vars in 1312 bytes} [Thu May 19 08:40:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-12063997 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:40:41.666931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b281b67f-7d52-4f41-9cbf-be852bf84172 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210401af0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:43.014143 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b281b67f-7d52-4f41-9cbf-be852bf84172 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 204 len: 0 microversion: 2.1 time: 1.354017 May 19 08:40:43.014749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3200/4525] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:41 2022] DELETE /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 0 bytes in 1359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:40:43.026482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:43.033930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:43.052732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:43.061110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:43.062380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:43.063002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:43.133463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:40:43.358976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a00992ec-d81c-4535-a28f-f79e4617fc4e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "DELETE /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 204 len: 0 microversion: 2.54 time: 0.342356 May 19 08:40:43.359937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3201/4526] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:40:43 2022] DELETE /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:40:43.390363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:43.391342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:43.399707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:43.400392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:43.401621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:43.402228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:43.718333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:43.733049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:43.734938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:43.738467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27016a91-8456-403f-a85d-d8b84bca83b5 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.377014 May 19 08:40:43.739910 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3202/4527] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:43 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:43.757719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:43.759072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:43.784900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:43.794723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:43.796951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:43.804884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:43.879130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:40:44.114382 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee99a736-491b-4913-95da-60886fed02c1 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 204 len: 0 microversion: 2.1 time: 0.372247 May 19 08:40:44.115836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3203/4528] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:40:43 2022] DELETE /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:40:44.146486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:44.146486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:44.155413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:44.165845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:44.168476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:44.169792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:44.431358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:44.441702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:44.455235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:44.457108 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7589494d-9754-4396-8a10-241feba988df tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1404 microversion: 2.54 time: 0.335533 May 19 08:40:44.479815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3204/4529] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:44 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1404 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:44.495618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e1989aa0-80df-40dd-861b-f0d316d6bf91 req-8f136449-4930-4a3b-8c91-193fef929b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eab8fe7-e628-4770-b188-cdb0ca3992af", "name": "network-vif-unplugged", "status": "completed", "tag": "738de1f1-50a8-4034-ab38-2b73d7fae71d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:44.509820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e1989aa0-80df-40dd-861b-f0d316d6bf91 req-8f136449-4930-4a3b-8c91-193fef929b8c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:44.510275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e1989aa0-80df-40dd-861b-f0d316d6bf91 req-8f136449-4930-4a3b-8c91-193fef929b8c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:44.541796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e1989aa0-80df-40dd-861b-f0d316d6bf91 req-8f136449-4930-4a3b-8c91-193fef929b8c service nova] Creating event network-vif-unplugged:738de1f1-50a8-4034-ab38-2b73d7fae71d for instance 1eab8fe7-e628-4770-b188-cdb0ca3992af on chh1-842464-2 May 19 08:40:44.550549 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e1989aa0-80df-40dd-861b-f0d316d6bf91 req-8f136449-4930-4a3b-8c91-193fef929b8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068549 May 19 08:40:44.554099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3205/4530] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:44.563720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-780961246", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "1a050905-faf4-46cc-bb59-12e712335300"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:44.656845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] validate_networks() for [('1a050905-faf4-46cc-bb59-12e712335300', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:40:45.416407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:40:45.417733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:40:45.418471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:40:45.419122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:40:45.419694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:40:45.433955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:45.434722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:45.435921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:45.436636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:45.462140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:40:45.470396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Getting quotas for user f59b91044370427fa198cff1a2c604e9 and project 1e83663823b543c69d166476233ac240. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:40:45.488179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:40:45.492160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:40:45.531328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:45.551854 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d719224f-acea-49e1-aa1e-dbee0a92df35 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993288 May 19 08:40:45.555429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3206/4531] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:40:45.569991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:45.570960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:45.630678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:45.631555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:45.633222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:45.633888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:45.994268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.006948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.009243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.012813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67e21e82-ac3e-47dc-84dc-0c1294b8d226 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.456106 May 19 08:40:46.014264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3207/4532] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:45 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:46.019645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:46.020556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:46.028863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:46.029781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:46.031022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:46.031946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:46.120872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.129962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.132489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.133760 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46f346e9-e251-45eb-9913-7dfbdf3c1fb6 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1404 microversion: 2.54 time: 0.118274 May 19 08:40:46.144951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3208/4533] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:46 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:46.150769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84bbde9b-a6e7-4ba5-8bb8-cc9a6640fc31 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:46.151862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84bbde9b-a6e7-4ba5-8bb8-cc9a6640fc31 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:46.239308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84bbde9b-a6e7-4ba5-8bb8-cc9a6640fc31 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:46.248164 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84bbde9b-a6e7-4ba5-8bb8-cc9a6640fc31 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1207 microversion: 2.1 time: 0.101966 May 19 08:40:46.248775 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3209/4534] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:46 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1207 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:47.033635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:47.035227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:47.050777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:47.051912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:47.054152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:47.055147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:47.428125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:47.445671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:47.458230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:47.463773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a3107ef-9f45-42ae-8fc9-a0aa69fdd87b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.434937 May 19 08:40:47.467282 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3210/4535] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:47 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:40:47.493242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:47.497101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:47.524140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:47.529875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:47.530961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:47.531539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:47.672956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:47.688529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:47.704154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:47.710085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4c291d7-3921-40b1-b6c6-44801477d646 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1404 microversion: 2.54 time: 0.239353 May 19 08:40:47.724136 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3211/4536] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:47 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:47.730439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:47.731846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:47.763154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:47.764517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:47.767637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:47.769622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:47.836195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:48.028763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:48.039496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e941220-38d2-478a-af1e-100df7843203 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1211 microversion: 2.1 time: 0.322722 May 19 08:40:48.041102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3212/4537] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:47 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1211 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:48.344910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-376131708", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "d197f221-63ca-43f3-8d75-a5ee472e1a59"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:48.436752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] validate_networks() for [('d197f221-63ca-43f3-8d75-a5ee472e1a59', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:40:49.452955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:40:49.454205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:40:49.454851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:40:49.455428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:40:49.456043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:40:49.475895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:49.476651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:49.480312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:49.481023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:49.529357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Getting quotas for project 34410676c09d4ba39f1bd1a0dbeff948. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:40:49.538608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Getting quotas for user cdf24df159274625b82a8a3a2ccb93d6 and project 34410676c09d4ba39f1bd1a0dbeff948. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:40:49.579214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:40:49.581271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:40:49.694015 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8050b9c0-d68e-447c-b432-e6a446cc9872 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.652629 May 19 08:40:49.694683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3213/4538] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:40:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:40:49.714692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:49.715318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:49.734046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:49.734505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:49.735303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:49.735745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.103471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.129482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.132300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.139112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04c022c8-1da1-4f4a-b895-81ec292aa64d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.428452 May 19 08:40:50.139944 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3214/4539] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:49 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:50.152083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:50.165420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:50.191383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:50.195254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.197151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:50.210470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.279576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:50.280412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.281163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lazy-loading 'fault' on Instance uuid 68b99037-d489-4235-aa49-739c293726e0 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:40:50.433969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.455207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.462760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '510a8068f4bb43f4a6b0f724422645e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835715cca630405c938ff046224aa176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.482740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-249b0c6e-0d87-4140-a93a-1a89b0f1d317 tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 200 len: 1409 microversion: 2.54 time: 0.339211 May 19 08:40:50.484856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3215/4540] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:50 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 1409 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:50.499880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:50.500510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:50.513221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:50.514376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.515593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:50.516312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.585941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.595651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a546c9af-7610-4e68-bbbe-dc329440b336 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1267 microversion: 2.1 time: 0.108845 May 19 08:40:50.596876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3216/4541] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:50 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:50.609589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-87fa2aa1-d38d-4333-88cb-63682750a6df req-4c7f7355-240f-4495-babb-768700286ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1eab8fe7-e628-4770-b188-cdb0ca3992af", "name": "network-vif-deleted", "tag": "738de1f1-50a8-4034-ab38-2b73d7fae71d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:50.643994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87fa2aa1-d38d-4333-88cb-63682750a6df req-4c7f7355-240f-4495-babb-768700286ae1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:50.645715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87fa2aa1-d38d-4333-88cb-63682750a6df req-4c7f7355-240f-4495-babb-768700286ae1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:50.685945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-87fa2aa1-d38d-4333-88cb-63682750a6df req-4c7f7355-240f-4495-babb-768700286ae1 service nova] Creating event network-vif-deleted:738de1f1-50a8-4034-ab38-2b73d7fae71d for instance 1eab8fe7-e628-4770-b188-cdb0ca3992af on chh1-842464-2 May 19 08:40:50.703807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-87fa2aa1-d38d-4333-88cb-63682750a6df req-4c7f7355-240f-4495-babb-768700286ae1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105375 May 19 08:40:50.705100 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3217/4542] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:50.711535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d48fb856-4ee7-467d-b6a0-33b936209a5d tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:50.717294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d48fb856-4ee7-467d-b6a0-33b936209a5d tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:50.842910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d48fb856-4ee7-467d-b6a0-33b936209a5d tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:50.855193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d48fb856-4ee7-467d-b6a0-33b936209a5d tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1216 microversion: 2.1 time: 0.148361 May 19 08:40:50.858415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3218/4543] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:50 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:51.158810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:51.159421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:51.170523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.172068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.173130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.173846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.457262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:51.468808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:51.470614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:51.475098 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4827abcb-b1a3-44d1-8d64-8aafea554a59 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.320095 May 19 08:40:51.475911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3219/4544] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:51 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:40:51.502738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:51.503616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] [instance: 68b99037-d489-4235-aa49-739c293726e0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:51.516998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.517725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.518676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.519291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.559070 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] HTTP exception thrown: Instance 68b99037-d489-4235-aa49-739c293726e0 could not be found. May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Request method failure captured: May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 HTTP/1.1 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJWnC9Ucbqa09KJY2oZzDYtuou6ehBsf1dCDoynMQeFa3FIiaxAc5_HnpiUrAWHZhhA_ASxJHfeT-VqkNG9phAekyG0Vh6o3l57f1akKa0PgZxirKVcy0DifgG0NP0l6NJhNwtIaYik1YYRWNojwR5VaInkqHOEtuid4Q0iA4LlpQI May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.54 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 835715cca630405c938ff046224aa176 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerShowV254Test-307802571 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/835715cca630405c938ff046224aa176"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835715cca630405c938ff046224aa176"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_835715cca630405c938ff046224aa176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/835715cca630405c938ff046224aa176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerShowV254Test-307802571 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 835715cca630405c938ff046224aa176 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerShowV254Test-307802571 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerShowV254Test-307802571-project May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 510a8068f4bb43f4a6b0f724422645e3 May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerShowV254Test-307802571-project May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 68b99037-d489-4235-aa49-739c293726e0 could not be found. May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '68b99037-d489-4235-aa49-739c293726e0'} May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b99037-d489-4235-aa49-739c293726e0 could not be found. May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b99037-d489-4235-aa49-739c293726e0 could not be found. May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:40:51.560931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b99037-d489-4235-aa49-739c293726e0 could not be found. May 19 08:40:51.565930 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:40:51.567168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] Returning 404 to user: Instance 68b99037-d489-4235-aa49-739c293726e0 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:40:51.568224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e7473bb-85c9-4771-aee8-147936efc92e tempest-ServerShowV254Test-307802571 tempest-ServerShowV254Test-307802571-project] 10.222.0.78 "GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0" status: 404 len: 111 microversion: 2.54 time: 0.069604 May 19 08:40:51.569486 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3220/4545] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:51 2022] GET /compute/v2.1/servers/68b99037-d489-4235-aa49-739c293726e0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:40:51.614816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:51.618123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:51.628118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.629545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.631400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.632525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.796617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:51.810292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba388cef-effc-4a5f-9cc7-8d90f03f0fbb tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1277 microversion: 2.1 time: 0.200016 May 19 08:40:51.816510 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3221/4546] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:51 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:51.875158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:51.876547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:51.886344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.887066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.888537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:51.889191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:51.968809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:51.979796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2069ac21-c789-4c1f-9b60-2489f96ea4fd tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1220 microversion: 2.1 time: 0.110343 May 19 08:40:51.980677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3222/4547] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:51 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:52.497290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:52.497950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:52.507758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:52.508230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:52.509049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:52.509534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:52.715640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:52.724773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:52.726829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:52.728397 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c5d07d0-51a4-4a9b-9027-670daef07b3f tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.235335 May 19 08:40:52.739739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3223/4548] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:52 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:52.833138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:52.834422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:52.853686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:52.854780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:52.855802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:52.856599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:52.937859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:52.951077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-333ece18-ac48-4fe8-94fa-eee7c3e8f65a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1265 microversion: 2.1 time: 0.122185 May 19 08:40:52.955054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3224/4549] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:52 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:52.997910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:52.998993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:53.007959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:53.008526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:53.009431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:53.009936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:53.091300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:53.107258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98ef4dc1-5b9e-47cc-a299-278fe657ea35 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1212 microversion: 2.1 time: 0.112418 May 19 08:40:53.115634 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3225/4550] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:52 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:40:53.749643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:53.750511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:53.768080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:53.768659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:53.769423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:53.770858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:54.148626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:54.168188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:54.182991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:54.186792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8224e25d-9593-4b21-883e-12772c4d2cea tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.443177 May 19 08:40:54.201403 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3226/4551] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:53 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:54.208187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:54.209517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:54.234791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:54.235599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:54.243092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:54.243785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:54.841155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:54.853819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26a4c92e-7e12-42b7-a090-8f65b17b7621 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1307 microversion: 2.1 time: 0.660912 May 19 08:40:54.860402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3227/4552] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:54 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1307 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:54.874224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:54.875255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:54.900893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:54.901534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:54.903799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:54.905771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:55.222856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:55.243631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-321be2f7-e964-4086-ab70-12893fcbba56 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1274 microversion: 2.1 time: 0.381401 May 19 08:40:55.249994 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3228/4553] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:54 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1274 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:55.260196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:55.268924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:55.300076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:55.301063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:55.305142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:55.307931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:56.004988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:56.018384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:56.024958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:56.028492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2518bbc8-87f2-4614-9ebc-646ee8c1b1af tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.777100 May 19 08:40:56.042035 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3229/4554] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:55 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:56.056116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1cd7a4cb-c4f2-4ad1-83b6-8af253e394a6 req-0d824f55-a9d7-4e07-a956-7984801554ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95518dc8-e9e6-459e-bf2c-96c8319139ff", "tag": "a5cd7dc4-82e5-499c-b027-97c0272fb82a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:56.079030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1cd7a4cb-c4f2-4ad1-83b6-8af253e394a6 req-0d824f55-a9d7-4e07-a956-7984801554ba service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:56.079906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1cd7a4cb-c4f2-4ad1-83b6-8af253e394a6 req-0d824f55-a9d7-4e07-a956-7984801554ba service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:56.119327 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1cd7a4cb-c4f2-4ad1-83b6-8af253e394a6 req-0d824f55-a9d7-4e07-a956-7984801554ba service nova] Creating event network-changed:a5cd7dc4-82e5-499c-b027-97c0272fb82a for instance 95518dc8-e9e6-459e-bf2c-96c8319139ff on chh1-842464-2 May 19 08:40:56.124699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1cd7a4cb-c4f2-4ad1-83b6-8af253e394a6 req-0d824f55-a9d7-4e07-a956-7984801554ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081181 May 19 08:40:56.125844 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3230/4555] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:56.133682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:56.135211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:56.164219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:56.165889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:56.166896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:56.168703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:56.762147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:56.779802 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-370666d1-d049-40e2-9c86-c04a5f70013d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1307 microversion: 2.1 time: 0.650594 May 19 08:40:56.782434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3231/4556] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:56 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1307 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:56.788199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:56.802309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:56.825621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:56.826140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:56.835093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:56.841264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:56.864378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:57.205181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:57.215117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08818aa2-910d-4896-a2b7-c1268eb7dc88 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1316 microversion: 2.1 time: 0.431278 May 19 08:40:57.218950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3232/4557] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:56 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:57.224533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6605924d-3586-4e43-8866-535edc1a63aa req-31b20de4-02dd-4aa8-b739-d2aec575b816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "name": "network-vif-plugged", "status": "completed", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:57.263250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6605924d-3586-4e43-8866-535edc1a63aa req-31b20de4-02dd-4aa8-b739-d2aec575b816 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:57.263714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6605924d-3586-4e43-8866-535edc1a63aa req-31b20de4-02dd-4aa8-b739-d2aec575b816 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:57.283591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6605924d-3586-4e43-8866-535edc1a63aa req-31b20de4-02dd-4aa8-b739-d2aec575b816 service nova] Creating event network-vif-plugged:e821d61e-ed3c-4c43-b51a-a5ae486dc9d3 for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce on chh1-842464-2 May 19 08:40:57.304075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6605924d-3586-4e43-8866-535edc1a63aa req-31b20de4-02dd-4aa8-b739-d2aec575b816 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082735 May 19 08:40:57.307812 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3233/4558] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:57.324338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:57.325059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:57.345838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:57.346300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:57.351375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:57.352104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:57.682698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:57.723068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:57.763421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:57.780112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3489e15e-17ec-40b4-827b-5c2145406f56 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.458379 May 19 08:40:57.796626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3234/4559] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:57 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:58.142671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-44366bc7-da8a-4e9c-92d7-22903c2b5661 req-fcecbb9e-b4e7-4719-b277-b9062be35402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bef8a7a-33a1-4520-b8c5-42703ddce59b", "tag": "19cfb60c-65f0-4d6e-9b88-8cf739c1ccfd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:40:58.155500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-44366bc7-da8a-4e9c-92d7-22903c2b5661 req-fcecbb9e-b4e7-4719-b277-b9062be35402 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:58.156942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-44366bc7-da8a-4e9c-92d7-22903c2b5661 req-fcecbb9e-b4e7-4719-b277-b9062be35402 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:58.174231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-44366bc7-da8a-4e9c-92d7-22903c2b5661 req-fcecbb9e-b4e7-4719-b277-b9062be35402 service nova] Creating event network-changed:19cfb60c-65f0-4d6e-9b88-8cf739c1ccfd for instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b on chh1-842464-2 May 19 08:40:58.181555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-44366bc7-da8a-4e9c-92d7-22903c2b5661 req-fcecbb9e-b4e7-4719-b277-b9062be35402 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382326 May 19 08:40:58.183611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3235/4560] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:40:58.190794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:58.194141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:58.221851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:58.226888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:58.230638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:58.232707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:58.747336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:58.762343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c11c8243-81f0-4f50-85a1-33fe85cceb69 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1307 microversion: 2.1 time: 0.574810 May 19 08:40:58.765197 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3236/4561] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:58 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1307 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:58.777525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:58.782368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:58.806106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:58.806560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:58.815801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:58.816273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:59.209556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:59.230013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7cc4efd3-803f-4c23-9ea2-823849085a21 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1316 microversion: 2.1 time: 0.462430 May 19 08:40:59.231516 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3237/4562] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:58 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:40:59.247558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:59.250626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:59.275673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:59.277346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:59.278573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:59.283088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:59.498805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:40:59.519697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:59.528712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:59.534300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:40:59.539273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78a003ac-785d-4626-9223-e94d0811a517 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.305118 May 19 08:40:59.550830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3238/4563] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:40:59 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:40:59.782265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:40:59.783036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:40:59.791925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:59.792384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:40:59.793679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:40:59.794142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:00.225239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:00.239935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee69f53b-1485-4c66-9143-56f5649e2586 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1307 microversion: 2.1 time: 0.461467 May 19 08:41:00.246045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3239/4564] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:40:59 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1307 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:00.252589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:00.253416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:00.303664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:00.304697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:00.312001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:00.314395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:00.847459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=16 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:00.922461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:00.931166 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-711208a5-16c6-4f97-aee9-66e6146d6312 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1316 microversion: 2.1 time: 0.683898 May 19 08:41:00.935958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3240/4565] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:00 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:00.951402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:00.954563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:00.971390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:00.972072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:00.973064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:00.973709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:01.339900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:01.352545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:01.358630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:01.360467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de20c682-c442-44d3-b7e7-2815d3f38d34 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.423147 May 19 08:41:01.365331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3241/4566] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:00 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:41:01.386224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1e85576e-0b2c-443b-a127-be06c502e4c9 req-5bf5396f-5908-4ab6-9c2a-da39c6dd428e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95518dc8-e9e6-459e-bf2c-96c8319139ff", "name": "network-vif-plugged", "status": "completed", "tag": "a5cd7dc4-82e5-499c-b027-97c0272fb82a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:01.405869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e85576e-0b2c-443b-a127-be06c502e4c9 req-5bf5396f-5908-4ab6-9c2a-da39c6dd428e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:01.406570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e85576e-0b2c-443b-a127-be06c502e4c9 req-5bf5396f-5908-4ab6-9c2a-da39c6dd428e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:01.423824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1e85576e-0b2c-443b-a127-be06c502e4c9 req-5bf5396f-5908-4ab6-9c2a-da39c6dd428e service nova] Creating event network-vif-plugged:a5cd7dc4-82e5-499c-b027-97c0272fb82a for instance 95518dc8-e9e6-459e-bf2c-96c8319139ff on chh1-842464-2 May 19 08:41:01.433419 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1e85576e-0b2c-443b-a127-be06c502e4c9 req-5bf5396f-5908-4ab6-9c2a-da39c6dd428e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063151 May 19 08:41:01.434220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3242/4567] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:01.448623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:01.449828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:01.462179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:01.463110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:01.464090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:01.464684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:01.823273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:01.843409 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f759f0d3-6e6a-4387-be4f-c1980f877454 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1307 microversion: 2.1 time: 0.400020 May 19 08:41:01.843409 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3243/4568] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:01 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:01.952864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:01.953814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:01.963352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:01.964231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:01.965445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:01.966070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:02.243473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:02.257893 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-769b4081-3cc8-4d7b-9b88-da6039c6bae9 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1316 microversion: 2.1 time: 0.304601 May 19 08:41:02.275728 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3244/4569] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:01 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:02.386591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:02.388022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:02.401730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:02.405641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:02.406525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:02.407563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:02.408272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:03.008346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:03.018169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:03.019953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:03.022018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a61d174a-10ed-4aff-874c-d8b935975e64 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1728 microversion: 2.20 time: 0.640201 May 19 08:41:03.023419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3245/4570] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:02 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1728 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:41:03.029146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:03.030043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:03.037951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:03.038596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:03.039563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:03.040249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:03.260797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:03.270215 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ea4c516-6f0a-4aa5-92e2-41c165f235c0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1486 microversion: 2.1 time: 0.245515 May 19 08:41:03.282073 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3246/4571] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:03 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1486 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:03.290222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:03.291259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:03.299418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:03.300258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:03.301264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:03.301956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:03.579067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:03.587837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbefe505-ea8d-40a4-af2b-fc6977c799e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1316 microversion: 2.1 time: 0.303903 May 19 08:41:03.598499 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3247/4572] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:03 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:03.604426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1383803843"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:03.606182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:03.614677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:03.614677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:03.615651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:03.616157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:04.005987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc1a343a-b457-495a-b94b-b52cbdbcadee tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "POST /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff/action" status: 202 len: 0 microversion: 2.1 time: 0.404424 May 19 08:41:04.007383 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3248/4573] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:41:03 2022] POST /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:41:04.016109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cbdbd003-ac6c-4699-bae9-055c881b86af req-77d470f8-6c57-4507-ae82-9b317affa5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bef8a7a-33a1-4520-b8c5-42703ddce59b", "name": "network-vif-plugged", "status": "completed", "tag": "19cfb60c-65f0-4d6e-9b88-8cf739c1ccfd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:04.034831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cbdbd003-ac6c-4699-bae9-055c881b86af req-77d470f8-6c57-4507-ae82-9b317affa5fd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:04.036346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cbdbd003-ac6c-4699-bae9-055c881b86af req-77d470f8-6c57-4507-ae82-9b317affa5fd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:04.049479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cbdbd003-ac6c-4699-bae9-055c881b86af req-77d470f8-6c57-4507-ae82-9b317affa5fd service nova] Creating event network-vif-plugged:19cfb60c-65f0-4d6e-9b88-8cf739c1ccfd for instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b on chh1-842464-2 May 19 08:41:04.062862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cbdbd003-ac6c-4699-bae9-055c881b86af req-77d470f8-6c57-4507-ae82-9b317affa5fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053857 May 19 08:41:04.063602 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3249/4574] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:04.084424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-136d07de-aa76-4b74-a13c-80b5d9b73668 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210352700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:04.155018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-136d07de-aa76-4b74-a13c-80b5d9b73668 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377" status: 200 len: 1412 microversion: 2.1 time: 0.076486 May 19 08:41:04.155941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3250/4575] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:41:04 2022] GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:04.162556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:04.163558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:04.173242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:04.173740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:04.175110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:04.175598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:04.198058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:04.445488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:04.456417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:04.459489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:04.460997 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1309193-0c9a-430a-bd4c-27d952c94a99 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1715 microversion: 2.20 time: 0.303492 May 19 08:41:04.462039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3251/4576] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:04 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1715 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:41:04.467217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3dcfd41a-9687-4c67-97be-0f0f332b4d2a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210352d30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:04.527668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3dcfd41a-9687-4c67-97be-0f0f332b4d2a tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377" status: 200 len: 1412 microversion: 2.1 time: 0.064426 May 19 08:41:04.528819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3252/4577] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:41:04 2022] GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:04.552039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9103b890-c6ef-4259-a57b-f610723a7cd5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321034ae50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:04.755518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9103b890-c6ef-4259-a57b-f610723a7cd5 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377" status: 204 len: 0 microversion: 2.1 time: 0.218170 May 19 08:41:04.759673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3253/4578] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:04 2022] DELETE /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:41:04.762462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:04.763087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:04.776581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:04.778047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:04.778942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:04.779303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:04.952381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:04.968262 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6607e4cf-4e28-4f65-ac78-77c25a057691 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1316 microversion: 2.1 time: 0.210148 May 19 08:41:04.971297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3254/4579] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:04 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:04.984466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c60b7b4b-5adf-4fe6-997a-bb0a6601081e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f321034a1f0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:05.010401 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c60b7b4b-5adf-4fe6-997a-bb0a6601081e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Image not found. May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c60b7b4b-5adf-4fe6-997a-bb0a6601081e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 HTTP/1.1 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '05a8c1c8-3fd5-45a3-963f-cbde5056e377'} May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 05a8c1c8-3fd5-45a3-963f-cbde5056e377 May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 19 08:41:05.028282 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05a8c1c8-3fd5-45a3-963f-cbde5056e377 could not be found. May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c60b7b4b-5adf-4fe6-997a-bb0a6601081e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c60b7b4b-5adf-4fe6-997a-bb0a6601081e tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377" status: 404 len: 62 microversion: 2.1 time: 0.052231 May 19 08:41:05.036996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3255/4580] 10.222.0.78 () {58 vars in 1232 bytes} [Thu May 19 08:41:04 2022] GET /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:41:05.040820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:05.041651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:05.050292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:05.051172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:05.053374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:05.054070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:05.261648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:05.274765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73cd984b-2331-4fa7-82c4-35402e0075d4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1498 microversion: 2.1 time: 0.238477 May 19 08:41:05.275362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3256/4581] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:05 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:05.291146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:05.293232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:05.300058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:05.300886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:05.301895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:05.303134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:05.347334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ea1ff38-5706-4e89-93cd-f25effd92759 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/ips" status: 200 len: 146 microversion: 2.1 time: 0.060754 May 19 08:41:05.348208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3257/4582] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:41:05 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/ips => generated 146 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:05.986904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:05.988406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:05.996086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:05.996895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:05.997970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:05.998752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:06.533098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:06.547158 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5158b4e1-f834-4475-8815-2cf043f942fa tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1505 microversion: 2.1 time: 0.563905 May 19 08:41:06.548543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3258/4583] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:05 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:06.556199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:06.557422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:06.570328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:06.571654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:06.573569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:06.574682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:06.839350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:06.847732 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae42361b-5ffa-4508-924f-156f64f1f560 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1504 microversion: 2.1 time: 0.297459 May 19 08:41:06.849865 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3259/4584] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:06 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1504 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:06.855010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:06.855550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:06.867143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:06.867603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:06.869890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:06.870232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:06.909781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:06.910795 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52c1bae0-8293-4a76-8c6c-be74e7564d39 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b/os-instance-actions/req-8050b9c0-d68e-447c-b432-e6a446cc9872" status: 200 len: 313 microversion: 2.1 time: 0.059872 May 19 08:41:06.912575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3260/4585] 10.222.0.78 () {58 vars in 1418 bytes} [Thu May 19 08:41:06 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b/os-instance-actions/req-8050b9c0-d68e-447c-b432-e6a446cc9872 => generated 313 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:06.931337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:06.935031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:06.954237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:06.955415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:06.956879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:06.957776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:07.071153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88917874-ae84-4077-b01e-1254179c48da tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "POST /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b/action" status: 202 len: 0 microversion: 2.1 time: 0.150216 May 19 08:41:07.072641 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3261/4586] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:41:06 2022] POST /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:41:07.081580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:07.082632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:07.090379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:07.091338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:07.092483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:07.093007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:07.377809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:07.387728 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-220bd708-f80e-4b29-a109-4d80c2905346 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1507 microversion: 2.1 time: 0.310495 May 19 08:41:07.392679 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3262/4587] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:07 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:07.866589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:07.867308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:07.898066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:07.898538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:07.899373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:07.899823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:08.238649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:08.248082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75e9cc90-6dab-4459-ba24-88b1c1f7206c tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1504 microversion: 2.1 time: 0.385757 May 19 08:41:08.254115 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3263/4588] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:07 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1504 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:08.419448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:08.421574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:08.441013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:08.442239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:08.444579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:08.445196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:08.793035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:08.812870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ca43a05-3801-44e4-9fab-fdd88816995a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1512 microversion: 2.1 time: 0.402836 May 19 08:41:08.814637 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3264/4589] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:08 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:08.826247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3e3baa6a-dad4-4963-8c41-55b9f83dba82 req-6e5435b2-7905-483e-abb7-3bc2f53c05d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95518dc8-e9e6-459e-bf2c-96c8319139ff", "name": "network-vif-plugged", "status": "completed", "tag": "a5cd7dc4-82e5-499c-b027-97c0272fb82a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:08.855716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3e3baa6a-dad4-4963-8c41-55b9f83dba82 req-6e5435b2-7905-483e-abb7-3bc2f53c05d7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:08.856174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3e3baa6a-dad4-4963-8c41-55b9f83dba82 req-6e5435b2-7905-483e-abb7-3bc2f53c05d7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:08.907926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3e3baa6a-dad4-4963-8c41-55b9f83dba82 req-6e5435b2-7905-483e-abb7-3bc2f53c05d7 service nova] Creating event network-vif-plugged:a5cd7dc4-82e5-499c-b027-97c0272fb82a for instance 95518dc8-e9e6-459e-bf2c-96c8319139ff on chh1-842464-2 May 19 08:41:08.933519 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3e3baa6a-dad4-4963-8c41-55b9f83dba82 req-6e5435b2-7905-483e-abb7-3bc2f53c05d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109675 May 19 08:41:08.934864 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3265/4590] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:09.281020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:09.282550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:09.291959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:09.292748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:09.294061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:09.294728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:09.579315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:09.592743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bd4e190-a218-4c27-9b03-d1b4a1019f41 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1486 microversion: 2.1 time: 0.325555 May 19 08:41:09.605687 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3266/4591] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:09 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1486 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:09.620081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:09.622834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:09.644261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:09.646114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:09.647749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:09.648428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:09.689063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:41:09.809836 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86800b6c-3812-40e3-8b67-e923348218b0 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 204 len: 0 microversion: 2.1 time: 0.200340 May 19 08:41:09.817766 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3267/4592] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:09 2022] DELETE /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:41:09.831697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6977db95-b420-41ef-aa0c-ca3e84199d49 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210432670>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:09.897972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6977db95-b420-41ef-aa0c-ca3e84199d49 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Image not found. May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6977db95-b420-41ef-aa0c-ca3e84199d49 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 HTTP/1.1 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '05a8c1c8-3fd5-45a3-963f-cbde5056e377'} May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 05a8c1c8-3fd5-45a3-963f-cbde5056e377 to delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 05a8c1c8-3fd5-45a3-963f-cbde5056e377 could not be found. May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.901789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:09.907601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6977db95-b420-41ef-aa0c-ca3e84199d49 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:09.928594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6977db95-b420-41ef-aa0c-ca3e84199d49 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377" status: 404 len: 62 microversion: 2.1 time: 0.102762 May 19 08:41:09.933619 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3268/4593] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:09 2022] DELETE /compute/v2.1/images/05a8c1c8-3fd5-45a3-963f-cbde5056e377 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:41:09.946843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:09.951831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:09.968815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:09.970417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:09.971713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:09.973724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.290345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:10.316916 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f989ec1-ff6f-483a-a266-62231e4a285a tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1505 microversion: 2.1 time: 0.385285 May 19 08:41:10.318475 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3269/4594] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:09 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:10.348250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:10.349718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:10.364270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:10.367600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.369176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:10.373476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.424643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:10.432261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:41:10.509538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Instance is already in deleting state, ignoring this request May 19 08:41:10.510470 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ff55a64-34b7-4942-9418-664e4eb8ed87 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 204 len: 0 microversion: 2.1 time: 0.190791 May 19 08:41:10.515962 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3270/4595] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:10 2022] DELETE /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:41:10.528088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '.version_select at 0x7f3210432820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:10.530282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:10.552656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:10.553192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.555275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:10.556289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.646149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23bb7978-b510-4b13-8810-094a6be20d40 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.128840 May 19 08:41:10.652730 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3271/4596] 10.222.0.78 () {58 vars in 1295 bytes} [Thu May 19 08:41:10 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b/os-instance-actions => generated 611 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:10.665045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:10.666253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:10.680841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:10.682074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.682948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:10.683586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:10.981764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:11.001916 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2ad45c1-e7f3-4b22-a653-3fdde935236f tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1492 microversion: 2.1 time: 0.345622 May 19 08:41:11.012490 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3272/4597] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:10 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1492 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:11.014886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:11.016317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:11.026773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:11.027232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:11.028036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:11.028473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:11.088898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:41:11.242365 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5354a90c-dded-4e95-8f2e-12708a6f04e6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 204 len: 0 microversion: 2.1 time: 0.237099 May 19 08:41:11.243639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3273/4598] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:11 2022] DELETE /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:41:11.251752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e57658a8-7ddb-4080-af48-24d12b6e7a87"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:11.253229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:11.262125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:11.262588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:11.263566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:11.264186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:12.909787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae5579d3-42da-495c-ab16-2b453e0aa0f1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.665181 May 19 08:41:12.929290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3274/4599] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:41:11 2022] POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-volume_attachments => generated 194 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:12.944626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:12.945441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:12.977709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:12.978158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:12.983650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:12.984145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:13.535350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:13.545841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdef8253-17d3-4852-aeb7-824ec2a8ef9c tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1511 microversion: 2.1 time: 0.615389 May 19 08:41:13.556176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3275/4600] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:12 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:13.577082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:13.578634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:13.606048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:13.610034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:13.611212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:13.613687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:13.930848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f59b91044370427fa198cff1a2c604e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e83663823b543c69d166476233ac240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:13.939065 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7e83548-9d84-433d-a019-443337df82c7 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 200 len: 1450 microversion: 2.1 time: 0.381534 May 19 08:41:13.939657 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3276/4601] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:13 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 1450 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:13.954143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3e10ea58-69fd-47f1-897f-f970a13b5dd8 req-92e26797-7a80-4d0a-8b0e-a8b5d717a196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95518dc8-e9e6-459e-bf2c-96c8319139ff", "name": "network-vif-unplugged", "status": "completed", "tag": "a5cd7dc4-82e5-499c-b027-97c0272fb82a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:13.976792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3e10ea58-69fd-47f1-897f-f970a13b5dd8 req-92e26797-7a80-4d0a-8b0e-a8b5d717a196 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:13.977291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3e10ea58-69fd-47f1-897f-f970a13b5dd8 req-92e26797-7a80-4d0a-8b0e-a8b5d717a196 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.013158 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3e10ea58-69fd-47f1-897f-f970a13b5dd8 req-92e26797-7a80-4d0a-8b0e-a8b5d717a196 service nova] Creating event network-vif-unplugged:a5cd7dc4-82e5-499c-b027-97c0272fb82a for instance 95518dc8-e9e6-459e-bf2c-96c8319139ff on chh1-842464-2 May 19 08:41:14.020368 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3e10ea58-69fd-47f1-897f-f970a13b5dd8 req-92e26797-7a80-4d0a-8b0e-a8b5d717a196 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079442 May 19 08:41:14.021181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3277/4602] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:14.038786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-469dfcb2-1d53-47dc-b1e5-3bbf51ca7d64 req-dd7de3fb-a8fe-4179-96d2-fa70e13f2355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95518dc8-e9e6-459e-bf2c-96c8319139ff", "name": "network-vif-deleted", "tag": "a5cd7dc4-82e5-499c-b027-97c0272fb82a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:14.048342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-469dfcb2-1d53-47dc-b1e5-3bbf51ca7d64 req-dd7de3fb-a8fe-4179-96d2-fa70e13f2355 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.048993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-469dfcb2-1d53-47dc-b1e5-3bbf51ca7d64 req-dd7de3fb-a8fe-4179-96d2-fa70e13f2355 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.064590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-469dfcb2-1d53-47dc-b1e5-3bbf51ca7d64 req-dd7de3fb-a8fe-4179-96d2-fa70e13f2355 service nova] Creating event network-vif-deleted:a5cd7dc4-82e5-499c-b027-97c0272fb82a for instance 95518dc8-e9e6-459e-bf2c-96c8319139ff on chh1-842464-2 May 19 08:41:14.071573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-469dfcb2-1d53-47dc-b1e5-3bbf51ca7d64 req-dd7de3fb-a8fe-4179-96d2-fa70e13f2355 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037366 May 19 08:41:14.072442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3278/4603] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:14.117252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-efcae1a4-6e0c-4e75-aa66-fa90365c7416 req-dbd2abd4-41e1-4a4d-9f87-2feb1fe22c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bef8a7a-33a1-4520-b8c5-42703ddce59b", "name": "network-vif-deleted", "tag": "19cfb60c-65f0-4d6e-9b88-8cf739c1ccfd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:14.150098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-efcae1a4-6e0c-4e75-aa66-fa90365c7416 req-dbd2abd4-41e1-4a4d-9f87-2feb1fe22c90 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.151873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-efcae1a4-6e0c-4e75-aa66-fa90365c7416 req-dbd2abd4-41e1-4a4d-9f87-2feb1fe22c90 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.198442 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-efcae1a4-6e0c-4e75-aa66-fa90365c7416 req-dbd2abd4-41e1-4a4d-9f87-2feb1fe22c90 service nova] Creating event network-vif-deleted:19cfb60c-65f0-4d6e-9b88-8cf739c1ccfd for instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b on chh1-842464-2 May 19 08:41:14.206518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-efcae1a4-6e0c-4e75-aa66-fa90365c7416 req-dbd2abd4-41e1-4a4d-9f87-2feb1fe22c90 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098439 May 19 08:41:14.212338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3279/4604] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:14.571784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:14.572520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:14.586007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.586454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.587414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.588011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.678660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.681974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.682647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lazy-loading 'fault' on Instance uuid 3bef8a7a-33a1-4520-b8c5-42703ddce59b {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:41:14.784168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf24df159274625b82a8a3a2ccb93d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34410676c09d4ba39f1bd1a0dbeff948', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:14.793675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af924350-f0ee-4adf-bcc6-e75bb48aac9b tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 200 len: 1306 microversion: 2.1 time: 0.226903 May 19 08:41:14.798158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3280/4605] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:14 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 1306 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:14.957954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:14.960997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 95518dc8-e9e6-459e-bf2c-96c8319139ff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:14.970350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.971247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.972718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:14.973545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:14.993886 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 95518dc8-e9e6-459e-bf2c-96c8319139ff could not be found. May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff HTTP/1.1 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 95518dc8-e9e6-459e-bf2c-96c8319139ff could not be found. May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '95518dc8-e9e6-459e-bf2c-96c8319139ff'} May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95518dc8-e9e6-459e-bf2c-96c8319139ff could not be found. May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95518dc8-e9e6-459e-bf2c-96c8319139ff could not be found. May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:14.996116 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.001237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.001237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.001237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.001237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.001237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95518dc8-e9e6-459e-bf2c-96c8319139ff could not be found. May 19 08:41:15.001237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.002834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 95518dc8-e9e6-459e-bf2c-96c8319139ff could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.012588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4281f468-75d7-498d-8203-f484c116c761 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff" status: 404 len: 111 microversion: 2.1 time: 0.050999 May 19 08:41:15.016976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3281/4606] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:14 2022] GET /compute/v2.1/servers/95518dc8-e9e6-459e-bf2c-96c8319139ff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:15.028809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3092bdd7-c60d-425a-a957-6f2e404f0e56 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32104324c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.057533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3092bdd7-c60d-425a-a957-6f2e404f0e56 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Image not found. May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3092bdd7-c60d-425a-a957-6f2e404f0e56 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c HTTP/1.1 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4ea256b4-04bf-4f3e-9e9f-a172b8a8959c'} May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ea256b4-04bf-4f3e-9e9f-a172b8a8959c to delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ea256b4-04bf-4f3e-9e9f-a172b8a8959c could not be found. May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.060267 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:41:15.064485 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.072401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3092bdd7-c60d-425a-a957-6f2e404f0e56 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.076440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3092bdd7-c60d-425a-a957-6f2e404f0e56 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c" status: 404 len: 62 microversion: 2.1 time: 0.057408 May 19 08:41:15.080933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3282/4607] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] DELETE /compute/v2.1/images/4ea256b4-04bf-4f3e-9e9f-a172b8a8959c => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:41:15.087228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.087737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.095712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.096168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.097548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.097548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.153690 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af HTTP/1.1 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1eab8fe7-e628-4770-b188-cdb0ca3992af'} May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.159185 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f1e9c9b-b220-4612-a669-9e8fea6b73c4 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 404 len: 111 microversion: 2.1 time: 0.078797 May 19 08:41:15.165629 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3283/4608] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:15 2022] DELETE /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:15.184793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.185327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 1eab8fe7-e628-4770-b188-cdb0ca3992af] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.191843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.192298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.193443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.193890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.235802 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af HTTP/1.1 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1eab8fe7-e628-4770-b188-cdb0ca3992af'} May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.237403 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.242052 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.242052 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.242052 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.242052 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.242052 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. May 19 08:41:15.242052 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.244604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 1eab8fe7-e628-4770-b188-cdb0ca3992af could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.245831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ef42231-8e15-4a5c-9c1d-f6453c40bd00 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af" status: 404 len: 111 microversion: 2.1 time: 0.075971 May 19 08:41:15.249801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3284/4609] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] GET /compute/v2.1/servers/1eab8fe7-e628-4770-b188-cdb0ca3992af => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:15.255063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8488f3c4-09d0-48bc-a312-c76ab1d37802 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f3210434f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.280322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8488f3c4-09d0-48bc-a312-c76ab1d37802 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Image not found. May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8488f3c4-09d0-48bc-a312-c76ab1d37802 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 HTTP/1.1 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ce380bcd-52b0-4f2d-b5da-50add78bc973'} May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ce380bcd-52b0-4f2d-b5da-50add78bc973 to delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ce380bcd-52b0-4f2d-b5da-50add78bc973 could not be found. May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.283536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:41:15.287676 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.291999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8488f3c4-09d0-48bc-a312-c76ab1d37802 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.293406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8488f3c4-09d0-48bc-a312-c76ab1d37802 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973" status: 404 len: 62 microversion: 2.1 time: 0.042261 May 19 08:41:15.297813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3285/4610] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] DELETE /compute/v2.1/images/ce380bcd-52b0-4f2d-b5da-50add78bc973 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:41:15.304609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.305528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.313656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.315043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.316608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.317285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.336122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 HTTP/1.1 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8500c9aa-dd15-47c0-9906-9d73f704fca0'} May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.338046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.342556 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.343545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.343910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-681618df-1b30-4bc9-a219-d80c38e29655 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 404 len: 111 microversion: 2.1 time: 0.044625 May 19 08:41:15.344610 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3286/4611] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:15 2022] DELETE /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:15.353584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.354203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 8500c9aa-dd15-47c0-9906-9d73f704fca0] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.362598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.363054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.364120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.365074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.388243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 HTTP/1.1 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8500c9aa-dd15-47c0-9906-9d73f704fca0'} May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.391046 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 8500c9aa-dd15-47c0-9906-9d73f704fca0 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a95855d-1eb9-4daa-b47a-35b98d3288fa tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0" status: 404 len: 111 microversion: 2.1 time: 0.045553 May 19 08:41:15.396190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3287/4612] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] GET /compute/v2.1/servers/8500c9aa-dd15-47c0-9906-9d73f704fca0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:41:15.404098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee780fa6-5f8a-40bd-acac-b646658a919d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '.version_select at 0x7f32103b5310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.427504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ee780fa6-5f8a-40bd-acac-b646658a919d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Image not found. May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee780fa6-5f8a-40bd-acac-b646658a919d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 HTTP/1.1 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: method: May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: exception: Image not found. May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6dac7cc8-b287-4ca8-83a1-8987d0f40028'} May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6dac7cc8-b287-4ca8-83a1-8987d0f40028 to delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6dac7cc8-b287-4ca8-83a1-8987d0f40028 could not be found. May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.430577 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 19 08:41:15.434775 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.437847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee780fa6-5f8a-40bd-acac-b646658a919d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Image not found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.438924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee780fa6-5f8a-40bd-acac-b646658a919d tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028" status: 404 len: 62 microversion: 2.1 time: 0.038627 May 19 08:41:15.444622 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3288/4613] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] DELETE /compute/v2.1/images/6dac7cc8-b287-4ca8-83a1-8987d0f40028 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 08:41:15.450982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.451643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.461038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.462127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.463550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.464149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.483365 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 HTTP/1.1 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '13a7feae-e67f-46d7-be63-e50adf2c1a49'} May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.486489 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.491767 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.493829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.494936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-540e62f7-842a-4a1f-b26c-d83bb9934981 tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 404 len: 111 microversion: 2.1 time: 0.048988 May 19 08:41:15.496048 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3289/4614] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:15 2022] DELETE /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:15.505178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.507237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] [instance: 13a7feae-e67f-46d7-be63-e50adf2c1a49] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.515274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.516442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.517726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.518724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.549076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] HTTP exception thrown: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Request method failure captured: May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 HTTP/1.1 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgG-GExntTfxagQBR5LzBIHAU7KvkcZavjGjjVdV0RgPyy2Jcn4jLnwxeFQvbRmyUnrelaAn2_GdwNDBU8iaHgJ-n0T996qlC3qoiAFRK5wgm7R3dabo0z6aNAtcdBjs1XQH3XEtyWe6cC1cSSVTXsC-G87zH8URBvhtjaZhitSzj1s May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1e83663823b543c69d166476233ac240"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1e83663823b543c69d166476233ac240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1e83663823b543c69d166476233ac240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ImagesTestJSON-338034185 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 1e83663823b543c69d166476233ac240 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ImagesTestJSON-338034185 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f59b91044370427fa198cff1a2c604e9 May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ImagesTestJSON-338034185-project May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '13a7feae-e67f-46d7-be63-e50adf2c1a49'} May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.550876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.556129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.556129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.556129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.556129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.556129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. May 19 08:41:15.556129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.557148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] Returning 404 to user: Instance 13a7feae-e67f-46d7-be63-e50adf2c1a49 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.558536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-275e75ca-3db8-4370-b8a4-0bd1d7a2ca8b tempest-ImagesTestJSON-338034185 tempest-ImagesTestJSON-338034185-project] 10.222.0.78 "GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49" status: 404 len: 111 microversion: 2.1 time: 0.057778 May 19 08:41:15.559215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3290/4615] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] GET /compute/v2.1/servers/13a7feae-e67f-46d7-be63-e50adf2c1a49 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:15.819236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:15.820110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] [instance: 3bef8a7a-33a1-4520-b8c5-42703ddce59b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:15.834639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.845241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.847014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:15.850911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:15.901343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] HTTP exception thrown: Instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b could not be found. May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Request method failure captured: May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b HTTP/1.1 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgKPZ6a5THcvKNQDPreF7R6r3NJm44eUR_PcZwl0FtiawzyvYXdaLtgNyZrui6bkBJoO_XavQtxIxJCmudHaCQRD57R3xJ0OptZ4O3K3N9LMV30b6ACuvKzH9ts4eYqzFPz6wjJy2g2Okxw290IQhW6L-TcfxenaqMVXmconI8XkfJs May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 34410676c09d4ba39f1bd1a0dbeff948 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-InstanceActionsTestJSON-392512479 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/34410676c09d4ba39f1bd1a0dbeff948"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/34410676c09d4ba39f1bd1a0dbeff948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_34410676c09d4ba39f1bd1a0dbeff948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/34410676c09d4ba39f1bd1a0dbeff948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-InstanceActionsTestJSON-392512479 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 34410676c09d4ba39f1bd1a0dbeff948 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-InstanceActionsTestJSON-392512479 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-InstanceActionsTestJSON-392512479-project May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: cdf24df159274625b82a8a3a2ccb93d6 May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-InstanceActionsTestJSON-392512479-project May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b could not be found. May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3bef8a7a-33a1-4520-b8c5-42703ddce59b'} May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b could not be found. May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b could not be found. May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:15.905827 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b could not be found. May 19 08:41:15.912166 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:15.914038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] Returning 404 to user: Instance 3bef8a7a-33a1-4520-b8c5-42703ddce59b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:15.915128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6bba466-d521-40e5-9449-56a5c68e67d6 tempest-InstanceActionsTestJSON-392512479 tempest-InstanceActionsTestJSON-392512479-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b" status: 404 len: 111 microversion: 2.1 time: 0.104168 May 19 08:41:15.920739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3291/4616] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:15 2022] GET /compute/v2.1/servers/3bef8a7a-33a1-4520-b8c5-42703ddce59b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:41:23.075593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-134084323", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "596d91a1-b770-44be-9b5f-905f731eae2f"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:23.172138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] validate_networks() for [('596d91a1-b770-44be-9b5f-905f731eae2f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:41:24.606558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:41:24.607108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:41:24.607625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:41:24.608913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:41:24.629810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:41:24.672538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:24.673002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:24.674379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:24.675799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:24.742258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Getting quotas for project 6628bde2fcc9454999cb8aa4f7e8b004. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:41:24.750883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Getting quotas for user ca8d70c9f3534db38174b9265ed355b9 and project 6628bde2fcc9454999cb8aa4f7e8b004. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:41:24.757130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:24.776013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Going to run 2 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:41:24.781163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: e2028718-6227-4f13-87b3-cece6a5a82df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:41:24.829150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=e2028718-6227-4f13-87b3-cece6a5a82df,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:41:24.953912 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7782a295-39b6-4270-9389-179482e81dd8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.151475 May 19 08:41:24.955263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3292/4617] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:41:24.981447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:24.996796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:25.002073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Searching by: {'deleted': False, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:41:25.067546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:25.077798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:25.090063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:25.099016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:25.195726 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76f03127-95af-4b3c-8ee4-f504abb5ffb9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.226622 May 19 08:41:25.202006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3293/4618] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:41:24 2022] GET /compute/v2.1/servers => generated 675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:25.214673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6fa34ec3-dd95-4acc-94cf-a48aefa0cbcc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:25.215718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6fa34ec3-dd95-4acc-94cf-a48aefa0cbcc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:25.574609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6fa34ec3-dd95-4acc-94cf-a48aefa0cbcc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:25.595093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6fa34ec3-dd95-4acc-94cf-a48aefa0cbcc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1219 microversion: 2.1 time: 0.386802 May 19 08:41:25.605764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3294/4619] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:25 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1219 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:26.624321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f813a8d-f120-49da-b70c-8c22f874c1d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:26.627185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f813a8d-f120-49da-b70c-8c22f874c1d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:26.997693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f813a8d-f120-49da-b70c-8c22f874c1d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:27.040720 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f813a8d-f120-49da-b70c-8c22f874c1d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1219 microversion: 2.1 time: 0.428758 May 19 08:41:27.045920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3295/4620] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:26 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1219 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:28.063875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:28.065344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:28.079866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:28.081940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:28.084019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:28.085770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:28.150765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:28.438270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:28.455967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78edf390-ed7f-4871-8ad9-b06e9de78376 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1279 microversion: 2.1 time: 0.392174 May 19 08:41:28.456925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3296/4621] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:28 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:29.477380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:29.478074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:29.495930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:29.496389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:29.501030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:29.501564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:30.544081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:30.554098 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e50547e-662e-46cd-8993-3c74492ce8e7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1319 microversion: 2.1 time: 1.082322 May 19 08:41:30.557207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3297/4622] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:29 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1319 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:31.573091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:31.573800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:31.592075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:31.593138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:31.593987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:31.594625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:32.523378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:32.542986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-035a21b8-204e-4ba0-8f23-29f4dfb776f9 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1319 microversion: 2.1 time: 0.974417 May 19 08:41:32.545616 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3298/4623] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:31 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1319 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:33.238306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7f4e0908-537f-4765-9f6a-fbd23406f6ce req-84d1cef1-79bd-46d5-90d9-e5c94c75cf56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be94590e-be23-43ae-9ab4-4d9f8c21ddb6", "tag": "4f720c1a-8e6f-4f78-98e9-7d98df6e5deb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:33.279499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7f4e0908-537f-4765-9f6a-fbd23406f6ce req-84d1cef1-79bd-46d5-90d9-e5c94c75cf56 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:33.279966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7f4e0908-537f-4765-9f6a-fbd23406f6ce req-84d1cef1-79bd-46d5-90d9-e5c94c75cf56 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:33.358244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7f4e0908-537f-4765-9f6a-fbd23406f6ce req-84d1cef1-79bd-46d5-90d9-e5c94c75cf56 service nova] Creating event network-changed:4f720c1a-8e6f-4f78-98e9-7d98df6e5deb for instance be94590e-be23-43ae-9ab4-4d9f8c21ddb6 on chh1-842464-2 May 19 08:41:33.389622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7f4e0908-537f-4765-9f6a-fbd23406f6ce req-84d1cef1-79bd-46d5-90d9-e5c94c75cf56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154105 May 19 08:41:33.400368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3299/4624] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:33.562442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:33.563377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:33.581554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:33.582150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:33.583109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:33.583668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:34.257429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:34.291661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3de4cbc3-5477-40c2-9680-6f274b0e7dac tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1319 microversion: 2.1 time: 0.734638 May 19 08:41:34.302205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3300/4625] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:33 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1319 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:34.803364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1091820415", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:34.910629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] validate_networks() for [('725d9bbc-557f-4cc2-aeb7-d297e3230388', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:41:35.129576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:36.846873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:41:36.848679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:41:36.849648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:41:36.850295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:41:36.850922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:41:36.875803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:36.876340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:36.878515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:36.883571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:36.932827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Getting quotas for project e7f22c3f59044f4799e176bed3ddfe4e. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:41:36.947015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Getting quotas for user f6f83ecbd9044c939510bcd5b8246f10 and project e7f22c3f59044f4799e176bed3ddfe4e. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:41:36.991858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:41:36.999572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:41:37.192712 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4500b69e-757a-4be8-88be-2e609c54917b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.767620 May 19 08:41:37.202847 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3301/4626] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:41:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:41:37.228711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e5bba94d-3d58-4cd4-b1af-bb36ac4a56b8 req-c70a8dc8-bfea-46c6-8160-3878e7a1c625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2028718-6227-4f13-87b3-cece6a5a82df", "tag": "4f00633b-dfea-4fad-a8d9-cd87f01f985c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:37.287113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e5bba94d-3d58-4cd4-b1af-bb36ac4a56b8 req-c70a8dc8-bfea-46c6-8160-3878e7a1c625 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:37.289642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e5bba94d-3d58-4cd4-b1af-bb36ac4a56b8 req-c70a8dc8-bfea-46c6-8160-3878e7a1c625 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:37.331047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e5bba94d-3d58-4cd4-b1af-bb36ac4a56b8 req-c70a8dc8-bfea-46c6-8160-3878e7a1c625 service nova] Creating event network-changed:4f00633b-dfea-4fad-a8d9-cd87f01f985c for instance e2028718-6227-4f13-87b3-cece6a5a82df on chh1-842464-2 May 19 08:41:37.352490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e5bba94d-3d58-4cd4-b1af-bb36ac4a56b8 req-c70a8dc8-bfea-46c6-8160-3878e7a1c625 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144721 May 19 08:41:37.358495 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3302/4627] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:37.391841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:37.392658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:37.429255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:37.434297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:37.435407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:37.435882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:38.452613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:38.465990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-229203aa-6377-4e29-aaa3-e18524f53fe2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1319 microversion: 2.1 time: 1.106164 May 19 08:41:38.468684 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3303/4628] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:37 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1319 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:38.483302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:38.483302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:38.500179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:38.500676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:38.501546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:38.502001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:38.773911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:38.798241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1535e69a-cecf-4d54-aaad-3f289f91c1f4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1219 microversion: 2.1 time: 0.328408 May 19 08:41:38.802808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3304/4629] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:38 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1219 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:38.815727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:38.817373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:38.835895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:38.837020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:38.838107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:38.839710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:38.918298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c831088-5335-4c1d-954f-9e0d24200421 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.112453 May 19 08:41:38.920365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3305/4630] 10.222.0.78 () {60 vars in 1342 bytes} [Thu May 19 08:41:38 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:39.051230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:39.051937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:39.068599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.071183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:39.072887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.075592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:39.185496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:41:39.440537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60edfd09-8371-4c63-8eb6-e21387b70103 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 204 len: 0 microversion: 2.20 time: 0.395033 May 19 08:41:39.444144 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3306/4631] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:41:39 2022] DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:41:39.457029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c7aeeb7e-4124-488a-8647-e3d2b8335465 req-70790384-a785-4786-9fd5-236fe823657a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be94590e-be23-43ae-9ab4-4d9f8c21ddb6", "name": "network-vif-plugged", "status": "completed", "tag": "4f720c1a-8e6f-4f78-98e9-7d98df6e5deb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:39.469415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c7aeeb7e-4124-488a-8647-e3d2b8335465 req-70790384-a785-4786-9fd5-236fe823657a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.470108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c7aeeb7e-4124-488a-8647-e3d2b8335465 req-70790384-a785-4786-9fd5-236fe823657a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:39.488878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c7aeeb7e-4124-488a-8647-e3d2b8335465 req-70790384-a785-4786-9fd5-236fe823657a service nova] Creating event network-vif-plugged:4f720c1a-8e6f-4f78-98e9-7d98df6e5deb for instance be94590e-be23-43ae-9ab4-4d9f8c21ddb6 on chh1-842464-2 May 19 08:41:39.495151 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c7aeeb7e-4124-488a-8647-e3d2b8335465 req-70790384-a785-4786-9fd5-236fe823657a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049359 May 19 08:41:39.498351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3307/4632] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:39.511824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:39.514859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:39.532250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.534634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:39.535579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.538229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:39.907847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:39.927944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:39.943092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:39.944934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f27f72d3-40e8-4be1-a7b2-2206899326e4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.444950 May 19 08:41:39.945792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3308/4633] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:39 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:41:39.956276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:39.959404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:39.983795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.984446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:39.986993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:39.986993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:40.312468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:40.323883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1087073-cf7b-42de-9a7a-5f4307371072 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1319 microversion: 2.1 time: 0.374290 May 19 08:41:40.327484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3309/4634] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:39 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:40.338878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:40.341239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:40.354910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:40.357987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:40.359249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:40.361032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:40.546392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:40.557284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25a80dc0-ec6c-4779-9434-6f90f9976651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1293 microversion: 2.1 time: 0.228221 May 19 08:41:40.568651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3310/4635] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:40 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1293 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:40.969855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:40.971573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:40.995191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:40.997815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:40.999033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:40.999651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:41.685328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:41.705477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:41.719329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:41.731946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2975be06-6ca6-43dd-b2d1-3bdf7578a881 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1721 microversion: 2.20 time: 0.770302 May 19 08:41:41.737182 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3311/4636] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:40 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1721 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:41:41.744377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:41.745014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:41.829274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:41.829910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:41.834051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:41.836611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:42.515256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:42.531862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2792d9a-fa21-4e62-886d-e7227d4b504d tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1319 microversion: 2.1 time: 0.791674 May 19 08:41:42.544638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3312/4637] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:41 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1319 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:42.560869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4cbff02-1ec0-439b-a23c-51a5b92de4a5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:42.578634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4cbff02-1ec0-439b-a23c-51a5b92de4a5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:42.579444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4cbff02-1ec0-439b-a23c-51a5b92de4a5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:42.676834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4cbff02-1ec0-439b-a23c-51a5b92de4a5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:41:42.697350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:42.843597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4cbff02-1ec0-439b-a23c-51a5b92de4a5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action" status: 202 len: 0 microversion: 2.1 time: 0.294315 May 19 08:41:42.849290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3313/4638] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:41:42 2022] POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:41:42.875695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-27a1a4e4-05d4-4fd0-8e6f-b46a6c4a3a86 req-8c301693-9d60-4778-ada6-f095bc7913a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2028718-6227-4f13-87b3-cece6a5a82df", "name": "network-vif-plugged", "status": "completed", "tag": "4f00633b-dfea-4fad-a8d9-cd87f01f985c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:42.898811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27a1a4e4-05d4-4fd0-8e6f-b46a6c4a3a86 req-8c301693-9d60-4778-ada6-f095bc7913a0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:42.899533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27a1a4e4-05d4-4fd0-8e6f-b46a6c4a3a86 req-8c301693-9d60-4778-ada6-f095bc7913a0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:42.980435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-27a1a4e4-05d4-4fd0-8e6f-b46a6c4a3a86 req-8c301693-9d60-4778-ada6-f095bc7913a0 service nova] Creating event network-vif-plugged:4f00633b-dfea-4fad-a8d9-cd87f01f985c for instance e2028718-6227-4f13-87b3-cece6a5a82df on chh1-842464-2 May 19 08:41:43.008771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-27a1a4e4-05d4-4fd0-8e6f-b46a6c4a3a86 req-8c301693-9d60-4778-ada6-f095bc7913a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154581 May 19 08:41:43.016387 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3314/4639] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:43.032899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:43.035822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:43.059574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:43.064153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:43.067207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:43.070040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:43.745986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:43.766807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e51110a-3d73-4f72-b835-67e2bcb24d80 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 0.748993 May 19 08:41:43.772026 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3315/4640] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:43 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:43.799437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:43.804864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:43.824898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:43.826105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:43.829992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:43.831422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:44.081135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:44.095554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:44.099358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '666f1bf89e4940a38d63dbe3a2380a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b207c0cef1024b6294e3b8c482ca8deb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:44.101538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-216216eb-ce05-45ac-ad62-86f8013e2c78 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 200 len: 1653 microversion: 2.20 time: 0.327672 May 19 08:41:44.126021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3316/4641] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:43 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 1653 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:41:44.134674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:44.136500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:44.147344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:44.148010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:44.149113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:44.149756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:44.548383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:44.558166 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b24cd776-2ea8-4edb-99d3-3be35ddc75b2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.430581 May 19 08:41:44.559467 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3317/4642] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:44 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:44.565005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:44.568365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:44.590236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:44.591309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:44.592441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:44.593146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:45.312778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:45.326664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51a9dbcc-98d4-45bf-b2c0-466c1f5d8940 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 200 len: 1506 microversion: 2.1 time: 0.766002 May 19 08:41:45.327782 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3318/4643] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:44 2022] GET /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:45.340178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-054fbb37-5255-47c8-9133-365227995e94 req-30c4acc9-ab6b-428d-b49a-534d2fa9062a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:45.371716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-054fbb37-5255-47c8-9133-365227995e94 req-30c4acc9-ab6b-428d-b49a-534d2fa9062a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:45.384764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-054fbb37-5255-47c8-9133-365227995e94 req-30c4acc9-ab6b-428d-b49a-534d2fa9062a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:45.412882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-054fbb37-5255-47c8-9133-365227995e94 req-30c4acc9-ab6b-428d-b49a-534d2fa9062a service nova] Creating event network-changed:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:41:45.434007 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-054fbb37-5255-47c8-9133-365227995e94 req-30c4acc9-ab6b-428d-b49a-534d2fa9062a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104768 May 19 08:41:45.435027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3319/4644] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:45.440607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-882f4550-1a6f-427c-abd6-751aecf042ee req-0a560a5f-f756-4bc5-af63-e4d19b3df8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb4a893-1b86-4fcc-91a3-8fb603359cce", "name": "network-vif-deleted", "tag": "e821d61e-ed3c-4c43-b51a-a5ae486dc9d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:45.460729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-882f4550-1a6f-427c-abd6-751aecf042ee req-0a560a5f-f756-4bc5-af63-e4d19b3df8e0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:45.461916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-882f4550-1a6f-427c-abd6-751aecf042ee req-0a560a5f-f756-4bc5-af63-e4d19b3df8e0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:45.492463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-882f4550-1a6f-427c-abd6-751aecf042ee req-0a560a5f-f756-4bc5-af63-e4d19b3df8e0 service nova] Creating event network-vif-deleted:e821d61e-ed3c-4c43-b51a-a5ae486dc9d3 for instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce on chh1-842464-2 May 19 08:41:45.502162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-882f4550-1a6f-427c-abd6-751aecf042ee req-0a560a5f-f756-4bc5-af63-e4d19b3df8e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065461 May 19 08:41:45.514480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3320/4645] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:45.522153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:45.523114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:45.539416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:45.539894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:45.540691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:45.541155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.014813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:46.023577 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95c1809f-83ce-4ee6-9607-690e68b6d83c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 0.507270 May 19 08:41:46.028986 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3321/4646] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:45 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:46.037694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:46.046149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:46.088906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:46.090760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.094611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:46.095552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.164453 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] HTTP exception thrown: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Request method failure captured: May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce HTTP/1.1 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDkGRaHAytumnh5B6BiCrOD4rpSHaXHYu8f3EoON-tDdgZ9nSjsFBk5lkNrbIldF66YdNp6Ga_eV4fsbBaYQVxkB17gqTaYo_iuICdY6OKIlVvEeRMx8NRV899PsImFpFZCB7637AzyhVnOHfDkHlWDefMxhWaj8_nz7mZ54jXZAo4 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.20 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 666f1bf89e4940a38d63dbe3a2380a1f May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1bb4a893-1b86-4fcc-91a3-8fb603359cce'} May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:46.168210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:46.178968 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:46.182128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Returning 404 to user: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:46.184634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17a8e573-1736-47cd-96e8-95e41018ed3b tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 404 len: 111 microversion: 2.20 time: 0.153450 May 19 08:41:46.186039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3322/4647] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:46 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:41:46.210175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:46.214006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: e2028718-6227-4f13-87b3-cece6a5a82df] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:46.231197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:46.231991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.233626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:46.234418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.461542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:46.478343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac1f2a16-c6c0-461f-9bcc-649a75567a88 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/e2028718-6227-4f13-87b3-cece6a5a82df" status: 200 len: 1506 microversion: 2.1 time: 0.290305 May 19 08:41:46.481480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3323/4648] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:46 2022] GET /compute/v2.1/servers/e2028718-6227-4f13-87b3-cece6a5a82df => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:46.503222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:46.504148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:46.523730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:46.524599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.527782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:46.528515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:46.902973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:46.970127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=16 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:46.977579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:46.991813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f21b4232-fce1-4544-a9a7-22e1a6345562 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.511266 May 19 08:41:46.997948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3324/4649] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:46 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:47.011828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11c1be5e-9ace-486d-af7d-4e7782c870b2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '.version_select at 0x7f32104254c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:47.040979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:47.070138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11c1be5e-9ace-486d-af7d-4e7782c870b2 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393739733" status: 204 len: 0 microversion: 2.20 time: 0.070673 May 19 08:41:47.072167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3325/4650] 10.222.0.78 () {60 vars in 1258 bytes} [Thu May 19 08:41:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393739733 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:41:47.088247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:47.089393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: e2028718-6227-4f13-87b3-cece6a5a82df] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:47.110646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:47.111247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:47.112305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:47.112825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:47.183985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: e2028718-6227-4f13-87b3-cece6a5a82df] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:41:47.339542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-600f2add-89a1-4cea-9d0d-85dd702f66fa tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e2028718-6227-4f13-87b3-cece6a5a82df" status: 204 len: 0 microversion: 2.1 time: 0.265860 May 19 08:41:47.341481 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3326/4651] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:47 2022] DELETE /compute/v2.1/servers/e2028718-6227-4f13-87b3-cece6a5a82df => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:41:47.353908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:47.354993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:47.363029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:47.367171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:47.369399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:47.370074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:47.669885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:47.690591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6a0bcb2-ef62-4b8a-a342-72d6a62f5ab8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 0.339992 May 19 08:41:47.703744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3327/4652] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:47 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:47.714870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:47.716353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:47.731589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:47.732325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:47.734654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:47.741992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:47.819901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: be94590e-be23-43ae-9ab4-4d9f8c21ddb6] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:41:48.051413 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2b04996-5a76-4b34-8522-4034079a931c tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "DELETE /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6" status: 204 len: 0 microversion: 2.1 time: 0.345953 May 19 08:41:48.052457 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3328/4653] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:41:47 2022] DELETE /compute/v2.1/servers/be94590e-be23-43ae-9ab4-4d9f8c21ddb6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:41:48.068365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:48.070635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:48.078033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:48.079087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:48.080101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:48.080719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:48.514843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:48.532294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:48.544768 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dae66833-6bf9-48ba-afc2-ff2d7575ccc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.489847 May 19 08:41:48.545692 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3329/4654] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:48 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:48.556417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-99851572", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "596d91a1-b770-44be-9b5f-905f731eae2f"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:48.684058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] validate_networks() for [('596d91a1-b770-44be-9b5f-905f731eae2f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:41:49.732673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:41:49.733173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:41:49.733811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:41:49.734978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:41:49.736075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:41:49.760223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:49.764590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:49.766433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:49.767135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:49.826851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Getting quotas for project 6628bde2fcc9454999cb8aa4f7e8b004. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:41:49.848887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Getting quotas for user ca8d70c9f3534db38174b9265ed355b9 and project 6628bde2fcc9454999cb8aa4f7e8b004. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:41:49.887374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Going to run 2 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:41:49.896466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:41:50.034671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=c7302759-03fe-4a5f-be5e-37ea684010ec,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:41:50.203141 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-275f09ee-8bf9-4679-94a6-820268825ad4 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.654274 May 19 08:41:50.204631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3330/4655] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:41:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 1658 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 19 08:41:50.212130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:50.224661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:50.232912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:50.235895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:50.238254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:50.239412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:51.250739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:51.273219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b86c5ab9-5bd9-4bd8-8095-7672d6af04c8 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 1.065929 May 19 08:41:51.275151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3331/4656] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:50 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:51.282002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:51.282861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:51.291936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:51.292685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:51.293867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:51.294747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:51.686622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:51.700129 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43801641-d853-40dd-b03d-6553a615038e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.422798 May 19 08:41:51.703067 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3332/4657] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:51 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:51.718615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:51.722197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:51.723919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Searching by: {'deleted': False, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 08:41:51.743113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:51.744539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:51.745710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:51.746159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:51.799221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 08:41:51.865062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-904c32a5-7210-46f7-a2ab-fdfbec0b46cc tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.150309 May 19 08:41:51.871392 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3333/4658] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 08:41:51 2022] GET /compute/v2.1/servers => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:51.877014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3947c3d-b247-4579-9177-90738b0e9305 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:51.877739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3947c3d-b247-4579-9177-90738b0e9305 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:52.079685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3947c3d-b247-4579-9177-90738b0e9305 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:52.087317 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3947c3d-b247-4579-9177-90738b0e9305 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1216 microversion: 2.1 time: 0.214390 May 19 08:41:52.091579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3334/4659] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:51 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1216 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:52.161444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6463a4d9-7473-4637-b295-1db980bd5bd8 req-95f1c286-5986-4442-91bc-a23f9a9f7dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be94590e-be23-43ae-9ab4-4d9f8c21ddb6", "name": "network-vif-deleted", "tag": "4f720c1a-8e6f-4f78-98e9-7d98df6e5deb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:52.174348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6463a4d9-7473-4637-b295-1db980bd5bd8 req-95f1c286-5986-4442-91bc-a23f9a9f7dc7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:52.177821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6463a4d9-7473-4637-b295-1db980bd5bd8 req-95f1c286-5986-4442-91bc-a23f9a9f7dc7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:52.219930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6463a4d9-7473-4637-b295-1db980bd5bd8 req-95f1c286-5986-4442-91bc-a23f9a9f7dc7 service nova] Creating event network-vif-deleted:4f720c1a-8e6f-4f78-98e9-7d98df6e5deb for instance be94590e-be23-43ae-9ab4-4d9f8c21ddb6 on chh1-842464-2 May 19 08:41:52.231226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6463a4d9-7473-4637-b295-1db980bd5bd8 req-95f1c286-5986-4442-91bc-a23f9a9f7dc7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074209 May 19 08:41:52.232295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3335/4660] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:41:52.300571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:52.303874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:52.321902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:52.322600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:52.335396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:52.335859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:52.738241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:52.751787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03cb49c3-0cfe-48d4-b766-2fca04f79d72 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 0.459174 May 19 08:41:52.760771 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3336/4661] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:52 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:52.774298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:52.775226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:52.792569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:52.793459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:52.795147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:52.796777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:53.112979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:53.130744 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1888002-3a3e-43a1-bcb4-4b9f3c3a0616 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.365083 May 19 08:41:53.131501 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3337/4662] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:52 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:53.153691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6bb37241-5214-4086-8de4-a7e42f77d21d req-77c8256b-d7ea-4616-9cfd-72bc25651a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "name": "network-vif-plugged", "status": "completed", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:53.178620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6bb37241-5214-4086-8de4-a7e42f77d21d req-77c8256b-d7ea-4616-9cfd-72bc25651a1f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:53.179472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6bb37241-5214-4086-8de4-a7e42f77d21d req-77c8256b-d7ea-4616-9cfd-72bc25651a1f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:53.215119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6bb37241-5214-4086-8de4-a7e42f77d21d req-77c8256b-d7ea-4616-9cfd-72bc25651a1f service nova] Creating event network-vif-plugged:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:41:53.226679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6bb37241-5214-4086-8de4-a7e42f77d21d req-77c8256b-d7ea-4616-9cfd-72bc25651a1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081625 May 19 08:41:53.228407 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3338/4663] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:53.244539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:53.245262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:53.261218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:53.264029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:53.264847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:53.265288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:53.404953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:53.423700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3774bce-cedc-40e0-8252-7dd4c487302b tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1268 microversion: 2.1 time: 0.189042 May 19 08:41:53.424575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3339/4664] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:53 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:53.788387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:53.789263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:53.819936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:53.832198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:53.834382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:53.836044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:54.108402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:54.119376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3eda66a-9109-4741-9a69-1217653cfd7d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 0.336327 May 19 08:41:54.124576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3340/4665] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:53 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:54.149734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:54.151023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:54.166208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:54.169823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:54.171398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:54.173178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:54.424660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:54.448513 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e3dce30-229e-4100-bc2c-e79d896ec9e4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.303209 May 19 08:41:54.462642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3341/4666] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:54 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:54.468867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-38839c71-0e59-44df-bade-b5b02f40ff01 req-03532492-7eb8-4914-bcac-6c57201ddf9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2028718-6227-4f13-87b3-cece6a5a82df", "name": "network-vif-deleted", "tag": "4f00633b-dfea-4fad-a8d9-cd87f01f985c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:54.484572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-38839c71-0e59-44df-bade-b5b02f40ff01 req-03532492-7eb8-4914-bcac-6c57201ddf9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:54.485597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-38839c71-0e59-44df-bade-b5b02f40ff01 req-03532492-7eb8-4914-bcac-6c57201ddf9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:54.506172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-38839c71-0e59-44df-bade-b5b02f40ff01 req-03532492-7eb8-4914-bcac-6c57201ddf9e service nova] Creating event network-vif-deleted:4f00633b-dfea-4fad-a8d9-cd87f01f985c for instance e2028718-6227-4f13-87b3-cece6a5a82df on chh1-842464-2 May 19 08:41:54.511603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-38839c71-0e59-44df-bade-b5b02f40ff01 req-03532492-7eb8-4914-bcac-6c57201ddf9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047574 May 19 08:41:54.513570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3342/4667] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:41:54.520126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:54.520908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:54.531143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:54.531264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:54.532006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:54.532625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:54.624109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:54.636405 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-930873d6-c208-49f8-8ab0-0f411978e5d5 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1274 microversion: 2.1 time: 0.120393 May 19 08:41:54.638125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3343/4668] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:54 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:55.142866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:55.143414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:55.157630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:55.157630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:55.157630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:55.158081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:55.762635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:55.774618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22e75170-b4ed-46e5-bd13-38a8fe97211b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1323 microversion: 2.1 time: 0.634383 May 19 08:41:55.775815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3344/4669] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:55 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:41:55.810582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:55.814619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:55.831621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:55.832149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:55.836786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:55.837337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:56.352196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:56.374252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3c1706f-8aaf-4059-9035-b5eb489b938f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.580814 May 19 08:41:56.375728 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3345/4670] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:55 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:56.390147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:56.391197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:56.400738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:56.401612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:56.404088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:56.405214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:56.755924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:56.765500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb324946-bbbe-4a18-9b4d-d8c70004b815 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1274 microversion: 2.1 time: 0.388370 May 19 08:41:56.768996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3346/4671] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:56 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1274 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:56.793099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:56.794050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:56.808985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:56.809644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:56.810571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:56.822084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.182009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:57.193393 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee481f31-3012-4203-844b-896d3e0ed1e4 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1517 microversion: 2.1 time: 0.403564 May 19 08:41:57.208424 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3347/4672] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:56 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:57.208424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:57.209471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:57.222740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.226683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.238087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.241804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.287692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] HTTP exception thrown: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Request method failure captured: May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce HTTP/1.1 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDkGRaHAytumnh5B6BiCrOD4rpSHaXHYu8f3EoON-tDdgZ9nSjsFBk5lkNrbIldF66YdNp6Ga_eV4fsbBaYQVxkB17gqTaYo_iuICdY6OKIlVvEeRMx8NRV899PsImFpFZCB7637AzyhVnOHfDkHlWDefMxhWaj8_nz7mZ54jXZAo4 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.20 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 666f1bf89e4940a38d63dbe3a2380a1f May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1bb4a893-1b86-4fcc-91a3-8fb603359cce'} May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:57.294112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Returning 404 to user: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd31ab56-a62a-4a46-9ada-ad17ce1c9c3c tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 404 len: 111 microversion: 2.20 time: 0.096733 May 19 08:41:57.299328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3348/4673] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:41:57 2022] DELETE /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:41:57.308321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:41:57.309319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:57.328680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.329140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.329975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.335959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.397335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lazy-loading 'flavor' on Instance uuid 458ca55f-1ad3-4c53-bb03-72af391164ab {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:41:57.451582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:41:57.550154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c80ec4e3-e00b-47fc-be83-4ffbd768ef3f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action" status: 200 len: 32 microversion: 2.1 time: 0.249537 May 19 08:41:57.555532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3349/4674] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:41:57 2022] POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action => generated 32 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:41:57.567056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:57.570490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 1bb4a893-1b86-4fcc-91a3-8fb603359cce] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:57.608984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.618484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.620313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.623685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.663860 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] HTTP exception thrown: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Request method failure captured: May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce HTTP/1.1 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDkGRaHAytumnh5B6BiCrOD4rpSHaXHYu8f3EoON-tDdgZ9nSjsFBk5lkNrbIldF66YdNp6Ga_eV4fsbBaYQVxkB17gqTaYo_iuICdY6OKIlVvEeRMx8NRV899PsImFpFZCB7637AzyhVnOHfDkHlWDefMxhWaj8_nz7mZ54jXZAo4 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.20 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 666f1bf89e4940a38d63dbe3a2380a1f May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1bb4a893-1b86-4fcc-91a3-8fb603359cce'} May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.666113 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. May 19 08:41:57.670933 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:41:57.675738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Returning 404 to user: Instance 1bb4a893-1b86-4fcc-91a3-8fb603359cce could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:41:57.677121 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d5018d6-5df3-4814-aaef-1f7e4d0404d4 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce" status: 404 len: 111 microversion: 2.20 time: 0.120680 May 19 08:41:57.681231 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3350/4675] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:41:57 2022] GET /compute/v2.1/servers/1bb4a893-1b86-4fcc-91a3-8fb603359cce => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:41:57.690935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:57.693152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:57.709781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.710217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:57.711198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:57.713097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:58.128128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:58.140057 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04839089-080c-4ad1-ab83-9ac9e7b19102 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1722 microversion: 2.1 time: 0.457520 May 19 08:41:58.140910 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3351/4676] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:57 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:58.180175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:58.181391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:58.200418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:58.206276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:58.208562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:58.216352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:59.516599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:41:59.530822 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48ae503b-57e2-412b-8427-cc22e667480f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 1.380191 May 19 08:41:59.540755 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3352/4677] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:58 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:41:59.550919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:41:59.561350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:41:59.587070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:59.591653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:41:59.594844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:41:59.599187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:01.019822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:01.036093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6875cce-3e05-4925-8b9f-1cdfb6fd5230 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1316 microversion: 2.1 time: 1.493663 May 19 08:42:01.045828 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3353/4678] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:41:59 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1316 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:01.049482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0fca7bb0-9ffb-4b71-9ebf-ff9c506e0ebc req-9e3200e8-07f9-4a6f-b51e-e3c8e3910d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7302759-03fe-4a5f-be5e-37ea684010ec", "tag": "dc2acc61-47e3-4837-a127-3ac428e3c60b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:01.081739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0fca7bb0-9ffb-4b71-9ebf-ff9c506e0ebc req-9e3200e8-07f9-4a6f-b51e-e3c8e3910d9a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:01.082970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0fca7bb0-9ffb-4b71-9ebf-ff9c506e0ebc req-9e3200e8-07f9-4a6f-b51e-e3c8e3910d9a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:01.157976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0fca7bb0-9ffb-4b71-9ebf-ff9c506e0ebc req-9e3200e8-07f9-4a6f-b51e-e3c8e3910d9a service nova] Creating event network-changed:dc2acc61-47e3-4837-a127-3ac428e3c60b for instance c7302759-03fe-4a5f-be5e-37ea684010ec on chh1-842464-2 May 19 08:42:01.206229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0fca7bb0-9ffb-4b71-9ebf-ff9c506e0ebc req-9e3200e8-07f9-4a6f-b51e-e3c8e3910d9a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164219 May 19 08:42:01.211402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3354/4679] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:01.252416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:01.253283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:01.303591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:01.304421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:01.307134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:01.308699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:01.761699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:02.062194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:02.077335 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65428486-a70e-4ed3-a583-f145fe08e989 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1699 microversion: 2.1 time: 0.863586 May 19 08:42:02.078339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3355/4680] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:01 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1699 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:02.084454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:02.085636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:02.092228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:02.095311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:02.097262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:02.099257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:02.099954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:02.734570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:02.743282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-862b46f3-f458-43de-8682-05e5c86d2ad0 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.663600 May 19 08:42:02.743885 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3356/4681] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:02 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:02.761444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:02.762077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:02.781633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:02.782094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:02.782966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:02.783428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:03.462754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:03.478610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8aa3030a-907f-4dea-a4f0-35558d31dcb8 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1316 microversion: 2.1 time: 0.719465 May 19 08:42:03.480492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3357/4682] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:02 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1316 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:03.518301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a6fc7f9-ceb7-4fa6-8ad6-a9061b0825f4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:03.543016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:03.549737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a6fc7f9-ceb7-4fa6-8ad6-a9061b0825f4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:03.551164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a6fc7f9-ceb7-4fa6-8ad6-a9061b0825f4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:03.593818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a6fc7f9-ceb7-4fa6-8ad6-a9061b0825f4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 08:42:03.676101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a6fc7f9-ceb7-4fa6-8ad6-a9061b0825f4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action" status: 202 len: 0 microversion: 2.1 time: 0.192548 May 19 08:42:03.676887 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3358/4683] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:42:03 2022] POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:42:03.686361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-664e170c-6ab6-49a4-8ad4-2398aa9c5006 req-8ac06c59-e32a-4ab8-890d-c34754c1ef7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11e10ef-b49f-4fe2-bf3d-a2286a657736", "tag": "2245847d-c8e5-44d4-9ec1-38349187226e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:03.701139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-664e170c-6ab6-49a4-8ad4-2398aa9c5006 req-8ac06c59-e32a-4ab8-890d-c34754c1ef7d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:03.701726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-664e170c-6ab6-49a4-8ad4-2398aa9c5006 req-8ac06c59-e32a-4ab8-890d-c34754c1ef7d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:03.721514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-664e170c-6ab6-49a4-8ad4-2398aa9c5006 req-8ac06c59-e32a-4ab8-890d-c34754c1ef7d service nova] Creating event network-changed:2245847d-c8e5-44d4-9ec1-38349187226e for instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 on chh1-842464-2 May 19 08:42:03.729038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-664e170c-6ab6-49a4-8ad4-2398aa9c5006 req-8ac06c59-e32a-4ab8-890d-c34754c1ef7d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049387 May 19 08:42:03.733004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3359/4684] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:03.740525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:03.741479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:03.748242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:03.748709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:03.749603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:03.749981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:03.964297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:03.973964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b51a304-2c46-4cd8-9522-f244908a5fe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1708 microversion: 2.1 time: 0.239337 May 19 08:42:03.986095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3360/4685] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:03 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1708 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:03.998292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:04.000421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:04.014058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:04.015133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:04.016513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:04.018825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:04.180907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:04.194032 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56df306a-6112-443f-accb-8908d8f7303c tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.205819 May 19 08:42:04.195497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3361/4686] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:03 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:04.508041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:04.508765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:04.532187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:04.532657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:04.540271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:04.540939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:05.159077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:05.167614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9feb3aee-f7b4-430e-bcde-4da2d85d8f57 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1316 microversion: 2.1 time: 0.664590 May 19 08:42:05.171577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3362/4687] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:04 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:05.187738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:05.188369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:05.204903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:05.209646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:05.210921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:05.211518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:05.735031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:05.746279 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e978180-354b-4c1d-b313-4b75c37c35a2 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1708 microversion: 2.1 time: 0.573434 May 19 08:42:05.752786 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3363/4688] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:05 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1708 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:06.250598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:06.251197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:06.263545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:06.264308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:06.265139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:06.267053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:06.341634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:42:06.451793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:06.518972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-586bbcf7-b6c8-442c-a670-7f4959c0a52a tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 204 len: 0 microversion: 2.1 time: 0.764322 May 19 08:42:06.519925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3364/4689] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:42:05 2022] DELETE /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:42:06.528164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:06.529130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:06.555050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:06.557191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:06.558118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:06.558642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:06.738720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:06.747777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a463712a-88ef-4454-baad-3a9a2a64ec90 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.225074 May 19 08:42:06.759081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3365/4690] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:06 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:07.083361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d022564a-8389-4d1c-9ce4-1b1f13382020 req-006ae1d1-dda7-44b1-bc77-79a37daf9909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7302759-03fe-4a5f-be5e-37ea684010ec", "name": "network-vif-plugged", "status": "completed", "tag": "dc2acc61-47e3-4837-a127-3ac428e3c60b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:07.120283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d022564a-8389-4d1c-9ce4-1b1f13382020 req-006ae1d1-dda7-44b1-bc77-79a37daf9909 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:07.120760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d022564a-8389-4d1c-9ce4-1b1f13382020 req-006ae1d1-dda7-44b1-bc77-79a37daf9909 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:07.157240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d022564a-8389-4d1c-9ce4-1b1f13382020 req-006ae1d1-dda7-44b1-bc77-79a37daf9909 service nova] Creating event network-vif-plugged:dc2acc61-47e3-4837-a127-3ac428e3c60b for instance c7302759-03fe-4a5f-be5e-37ea684010ec on chh1-842464-2 May 19 08:42:07.175649 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d022564a-8389-4d1c-9ce4-1b1f13382020 req-006ae1d1-dda7-44b1-bc77-79a37daf9909 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.414208 May 19 08:42:07.176822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3366/4691] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:07.207387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:07.208352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:07.243632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:07.246835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:07.257877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:07.258695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:08.069838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:08.081525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3072766a-b66b-40ae-8649-46e9b779cd3a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1316 microversion: 2.1 time: 0.903398 May 19 08:42:08.082994 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3367/4692] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:07 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1316 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:08.088404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:08.089339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:08.096632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:08.097580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:08.110732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:08.111344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:08.322640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7109e0e5f69c431eaf502a01c0881319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b787317040f45919dfe88c57a9c8c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:08.331241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71e308ac-b5b5-4d8e-a700-4e143c0c64c9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 200 len: 1664 microversion: 2.1 time: 0.246952 May 19 08:42:08.332139 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3368/4693] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:08 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:08.339445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:08.340397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:08.351649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:08.352233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:08.357361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:08.357986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:08.753504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:08.767747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5b5eb16-a41b-415c-8196-fa073b65c8ee tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1712 microversion: 2.1 time: 0.433563 May 19 08:42:08.771629 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3369/4694] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:08 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1712 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:08.803377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:08.804772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:08.826074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:08.826453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:08.827237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:08.827687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:09.333818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:09.345540 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ba1bf9b-c3c1-4d31-8dde-e4cbd296ed42 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.568485 May 19 08:42:09.347164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3370/4695] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:08 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:09.353520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9610ae8c-6fb4-4bcd-bb5f-9172811a75df req-2e5e5c1f-f2a9-4cfd-8e6a-0f4bfd2522eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06abe74-2b86-4b72-986c-63ff3e4f7960", "name": "network-vif-deleted", "tag": "4bae762b-ae85-4613-bd9a-b5116343346b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:09.384596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9610ae8c-6fb4-4bcd-bb5f-9172811a75df req-2e5e5c1f-f2a9-4cfd-8e6a-0f4bfd2522eb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:09.387062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9610ae8c-6fb4-4bcd-bb5f-9172811a75df req-2e5e5c1f-f2a9-4cfd-8e6a-0f4bfd2522eb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:09.417096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9610ae8c-6fb4-4bcd-bb5f-9172811a75df req-2e5e5c1f-f2a9-4cfd-8e6a-0f4bfd2522eb service nova] Creating event network-vif-deleted:4bae762b-ae85-4613-bd9a-b5116343346b for instance d06abe74-2b86-4b72-986c-63ff3e4f7960 on chh1-842464-2 May 19 08:42:09.429901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9610ae8c-6fb4-4bcd-bb5f-9172811a75df req-2e5e5c1f-f2a9-4cfd-8e6a-0f4bfd2522eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078939 May 19 08:42:09.431184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3371/4696] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:09.443326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:09.445192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:09.463357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:09.464034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:09.468082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:09.468812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:09.506617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] HTTP exception thrown: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Request method failure captured: May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b HTTP/1.1 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDkGRaHAytumnh5B6BiCrOD4rpSHaXHYu8f3EoON-tDdgZ9nSjsFBk5lkNrbIldF66YdNp6Ga_eV4fsbBaYQVxkB17gqTaYo_iuICdY6OKIlVvEeRMx8NRV899PsImFpFZCB7637AzyhVnOHfDkHlWDefMxhWaj8_nz7mZ54jXZAo4 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.20 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 666f1bf89e4940a38d63dbe3a2380a1f May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64fedff0-296a-4a9a-9743-30c679548b9b'} May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:09.513789 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:09.518713 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:09.521914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Returning 404 to user: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:09.524444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f4d7d48-6d34-46db-ac38-15f446c6211d tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 404 len: 111 microversion: 2.20 time: 0.090553 May 19 08:42:09.525772 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3372/4697] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:42:09 2022] DELETE /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:42:09.542554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:09.544099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:09.559121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:09.565457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:09.568263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:09.568910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.157729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:10.169227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b95d4a4f-1248-4468-b0d5-babf82f0a97a tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1316 microversion: 2.1 time: 0.641017 May 19 08:42:10.170095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3373/4698] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:09 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:10.185928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9184a62b-d515-492f-8e72-24f1d3c424ee req-e8bc7821-683e-49db-a1f9-4f6be3df269a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11e10ef-b49f-4fe2-bf3d-a2286a657736", "name": "network-vif-plugged", "status": "completed", "tag": "2245847d-c8e5-44d4-9ec1-38349187226e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:10.204447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9184a62b-d515-492f-8e72-24f1d3c424ee req-e8bc7821-683e-49db-a1f9-4f6be3df269a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.204900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9184a62b-d515-492f-8e72-24f1d3c424ee req-e8bc7821-683e-49db-a1f9-4f6be3df269a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.249691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9184a62b-d515-492f-8e72-24f1d3c424ee req-e8bc7821-683e-49db-a1f9-4f6be3df269a service nova] Creating event network-vif-plugged:2245847d-c8e5-44d4-9ec1-38349187226e for instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 on chh1-842464-2 May 19 08:42:10.267670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9184a62b-d515-492f-8e72-24f1d3c424ee req-e8bc7821-683e-49db-a1f9-4f6be3df269a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088140 May 19 08:42:10.268785 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3374/4699] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:10.298461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:10.299663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:10.322935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.323405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.329582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.329582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.359541 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] HTTP exception thrown: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Request method failure captured: May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 HTTP/1.1 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGMCF-Oz9dk2Qd5RAsEwLc-tfFl8cKpcFUKXm9JeYNjgqVN2Ph-DOjijC1hEc9uFMIsEyNDXZKPpPbaReYvyVXhkU1fx3Dmp-r7ATFX2-emv4XKjymuGIFv5VobEtdDrdwHzc2HjCBUlVfzf2tnfa9oKOgsiR9d6IpV24dkpnpi38Y May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9b787317040f45919dfe88c57a9c8c54 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestServerBasicOps-1534740220 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestServerBasicOps-1534740220 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9b787317040f45919dfe88c57a9c8c54 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestServerBasicOps-1534740220 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestServerBasicOps-1534740220-project May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7109e0e5f69c431eaf502a01c0881319 May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestServerBasicOps-1534740220-project May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd06abe74-2b86-4b72-986c-63ff3e4f7960'} May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:10.362884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Returning 404 to user: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:10.368099 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ea04ff5-dc05-48fc-8dc8-16495a227625 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 404 len: 111 microversion: 2.1 time: 0.094453 May 19 08:42:10.370321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3375/4700] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:10 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:42:10.375785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:10.376411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] [instance: 64fedff0-296a-4a9a-9743-30c679548b9b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:10.384583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.385049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.386165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.387050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.411456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] HTTP exception thrown: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Request method failure captured: May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b HTTP/1.1 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgDkGRaHAytumnh5B6BiCrOD4rpSHaXHYu8f3EoON-tDdgZ9nSjsFBk5lkNrbIldF66YdNp6Ga_eV4fsbBaYQVxkB17gqTaYo_iuICdY6OKIlVvEeRMx8NRV899PsImFpFZCB7637AzyhVnOHfDkHlWDefMxhWaj8_nz7mZ54jXZAo4 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.20 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b207c0cef1024b6294e3b8c482ca8deb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b207c0cef1024b6294e3b8c482ca8deb May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-867410789 May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 666f1bf89e4940a38d63dbe3a2380a1f May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-867410789-project May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '64fedff0-296a-4a9a-9743-30c679548b9b'} May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.418442 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. May 19 08:42:10.423424 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:10.426405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] Returning 404 to user: Instance 64fedff0-296a-4a9a-9743-30c679548b9b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:10.431287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb39b814-f5c7-4c53-a029-4f52d2098b60 tempest-AttachVolumeShelveTestJSON-867410789 tempest-AttachVolumeShelveTestJSON-867410789-project] 10.222.0.78 "GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b" status: 404 len: 111 microversion: 2.20 time: 0.059677 May 19 08:42:10.432486 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3376/4701] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:42:10 2022] GET /compute/v2.1/servers/64fedff0-296a-4a9a-9743-30c679548b9b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:42:10.446843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:10.448061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:10.463614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.466482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:10.467701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:10.469590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.007382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:11.022017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a318646-8a57-4ec5-a5ac-f12d1351c798 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.585390 May 19 08:42:11.024987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3377/4702] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:10 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:11.186755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:11.187371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:11.214979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:11.215671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.216686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:11.217616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.605460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:11.621696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6de39891-bb6a-450a-9725-812d10d8f8c7 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1316 microversion: 2.1 time: 0.433499 May 19 08:42:11.622380 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3378/4703] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:11 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:11.820720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:11.821236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:11.838602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:11.839053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.839913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:11.840267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.893665 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] HTTP exception thrown: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Request method failure captured: May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 HTTP/1.1 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGMCF-Oz9dk2Qd5RAsEwLc-tfFl8cKpcFUKXm9JeYNjgqVN2Ph-DOjijC1hEc9uFMIsEyNDXZKPpPbaReYvyVXhkU1fx3Dmp-r7ATFX2-emv4XKjymuGIFv5VobEtdDrdwHzc2HjCBUlVfzf2tnfa9oKOgsiR9d6IpV24dkpnpi38Y May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9b787317040f45919dfe88c57a9c8c54 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestServerBasicOps-1534740220 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestServerBasicOps-1534740220 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9b787317040f45919dfe88c57a9c8c54 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestServerBasicOps-1534740220 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestServerBasicOps-1534740220-project May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7109e0e5f69c431eaf502a01c0881319 May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestServerBasicOps-1534740220-project May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd06abe74-2b86-4b72-986c-63ff3e4f7960'} May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:11.907867 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Returning 404 to user: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6715407e-73d9-4216-b869-bbf1e0db8fe9 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 404 len: 111 microversion: 2.1 time: 0.094648 May 19 08:42:11.914941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3379/4704] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:42:11 2022] DELETE /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:42:11.920275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:11.920917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] [instance: d06abe74-2b86-4b72-986c-63ff3e4f7960] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:11.962269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:11.963149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.964420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:11.965100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:11.998333 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] HTTP exception thrown: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Request method failure captured: May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 HTTP/1.1 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgGMCF-Oz9dk2Qd5RAsEwLc-tfFl8cKpcFUKXm9JeYNjgqVN2Ph-DOjijC1hEc9uFMIsEyNDXZKPpPbaReYvyVXhkU1fx3Dmp-r7ATFX2-emv4XKjymuGIFv5VobEtdDrdwHzc2HjCBUlVfzf2tnfa9oKOgsiR9d6IpV24dkpnpi38Y May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9b787317040f45919dfe88c57a9c8c54 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestServerBasicOps-1534740220 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9b787317040f45919dfe88c57a9c8c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestServerBasicOps-1534740220 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9b787317040f45919dfe88c57a9c8c54 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestServerBasicOps-1534740220 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestServerBasicOps-1534740220-project May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7109e0e5f69c431eaf502a01c0881319 May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestServerBasicOps-1534740220-project May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd06abe74-2b86-4b72-986c-63ff3e4f7960'} May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:11.999911 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. May 19 08:42:12.004910 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:12.016939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Returning 404 to user: Instance d06abe74-2b86-4b72-986c-63ff3e4f7960 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:12.027903 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad275315-cd10-4e71-8a34-7f36c89f1dbe tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960" status: 404 len: 111 microversion: 2.1 time: 0.111665 May 19 08:42:12.030004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3380/4705] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:11 2022] GET /compute/v2.1/servers/d06abe74-2b86-4b72-986c-63ff3e4f7960 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:42:12.074508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:12.086590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:12.108327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:12.110116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:12.111932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:12.113939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:12.683478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:12.710777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17507e8a-297e-47b3-96d1-5c893e5d909f tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.666478 May 19 08:42:12.728716 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3381/4706] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:12 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:12.742844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50e94e58-af3c-46bf-adcb-8c9b17be0830 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] Calling method '.version_select at 0x7f3217b04160>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:12.793827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50e94e58-af3c-46bf-adcb-8c9b17be0830 tempest-TestServerBasicOps-1534740220 tempest-TestServerBasicOps-1534740220-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-207141368" status: 202 len: 0 microversion: 2.1 time: 0.061139 May 19 08:42:12.798183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3382/4707] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 08:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-207141368 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:42:12.824048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:12.824953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:12.842290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:12.843800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:12.846663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:12.849117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:13.395308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:13.408566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-047346be-d929-4e3b-b3a1-7daf0b395a18 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1503 microversion: 2.1 time: 0.605711 May 19 08:42:13.409447 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3383/4708] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:12 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:13.428411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:13.429405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:13.440002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:13.440549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:13.441267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:13.441751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:13.899439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:13.916003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30e5be31-91a5-4ff7-9cb3-da45a05f076f tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec" status: 200 len: 1504 microversion: 2.1 time: 0.492058 May 19 08:42:13.931300 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3384/4709] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:13 2022] GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:13.947560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:13.948539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:13.959092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:13.960958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:13.963988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:13.965688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:14.570926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:14.605992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b7cc16d-968c-4b60-b42b-e21d04dbb331 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.672820 May 19 08:42:14.609707 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3385/4710] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:13 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:14.621457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:14.624853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:14.642029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:14.642778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:14.644025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:14.644684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:14.705867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:42:14.757454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:14.911807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccf67ed1-6d00-4cda-b8e6-964dbc4bf964 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec" status: 204 len: 0 microversion: 2.1 time: 0.299325 May 19 08:42:14.915812 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3386/4711] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:42:14 2022] DELETE /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:42:14.922799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:14.923313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:14.935088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:14.935505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:14.936322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:14.936764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:14.996557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:42:15.122610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fafb84d-648e-4a83-a445-ef5a56f7b6db tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 204 len: 0 microversion: 2.1 time: 0.205169 May 19 08:42:15.126564 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3387/4712] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:42:14 2022] DELETE /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:42:15.133815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:15.134546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:15.143227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:15.148545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:15.150043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:15.150490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:16.016827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:16.028888 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4713a718-f040-497e-8eb0-3f6cd192d9ed tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec" status: 200 len: 1510 microversion: 2.1 time: 0.898015 May 19 08:42:16.040866 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3388/4713] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:15 2022] GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec => generated 1510 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:16.046177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:16.059384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:16.076884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:16.085525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:16.088678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:16.102096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:16.502430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:16.517884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31509b05-83b9-4cb3-90f7-892bf10fb58a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.475434 May 19 08:42:16.518715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3389/4714] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:16 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:17.050071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:17.050745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:17.059057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:17.059812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:17.060852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:17.066213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:17.608222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:17.621010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae7dfe5d-4de6-495e-85e9-733f2cbb2f03 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec" status: 200 len: 1510 microversion: 2.1 time: 0.574965 May 19 08:42:17.635054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3390/4715] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:17 2022] GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec => generated 1510 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:17.676890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:17.678696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:17.722800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:17.723974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:17.724926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:17.725406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:18.287098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:18.292695 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34ac5d84-23c4-49c1-9ee1-a59d95d79297 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.655937 May 19 08:42:18.299447 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3391/4716] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:17 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:18.663797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:18.667033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:18.720545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:18.723738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:18.728007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:18.730694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:18.941692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:18.977693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-690988a2-9b9e-4b61-90f1-936c46402644 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec" status: 200 len: 1468 microversion: 2.1 time: 0.335182 May 19 08:42:18.979370 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3392/4717] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:18 2022] GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:19.432675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-33f0320a-0270-4251-b4c4-c6eebb75cbc4 req-080145d5-0595-4ed3-8b0a-d456a6e3ff8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7302759-03fe-4a5f-be5e-37ea684010ec", "name": "network-vif-deleted", "tag": "dc2acc61-47e3-4837-a127-3ac428e3c60b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:19.444583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-33f0320a-0270-4251-b4c4-c6eebb75cbc4 req-080145d5-0595-4ed3-8b0a-d456a6e3ff8c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:19.445035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-33f0320a-0270-4251-b4c4-c6eebb75cbc4 req-080145d5-0595-4ed3-8b0a-d456a6e3ff8c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:19.463846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-33f0320a-0270-4251-b4c4-c6eebb75cbc4 req-080145d5-0595-4ed3-8b0a-d456a6e3ff8c service nova] Creating event network-vif-deleted:dc2acc61-47e3-4837-a127-3ac428e3c60b for instance c7302759-03fe-4a5f-be5e-37ea684010ec on chh1-842464-2 May 19 08:42:19.470206 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-33f0320a-0270-4251-b4c4-c6eebb75cbc4 req-080145d5-0595-4ed3-8b0a-d456a6e3ff8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323891 May 19 08:42:19.471541 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3393/4718] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:42:19.482725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:19.483590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:19.499286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:19.499740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:19.500530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:19.506057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.265243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:20.280589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee06670a-41bd-4fcb-a3d4-d6119f57a966 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.807716 May 19 08:42:20.285857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3394/4719] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:19 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:20.299122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:20.300148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: c7302759-03fe-4a5f-be5e-37ea684010ec] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:20.311779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:20.318038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.320861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:20.325803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.356810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] HTTP exception thrown: Instance c7302759-03fe-4a5f-be5e-37ea684010ec could not be found. May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Request method failure captured: May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec HTTP/1.1 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgKyG3fgoocXVxCCirY8X39BqyVu38Ge-YFYsZh21UZ3GAULOFTIeQbj2SVBGxwONGZOgq8WhrCZzL_YVWxjndMEbGW1d3xKghhZr0F0QUZQUMbJObZA8iu9_0CbbKk_OFvQZvx_YIX2-yKDKhrYvXOx6wiKrD7E2bKb3haZaNNQ-8A May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6628bde2fcc9454999cb8aa4f7e8b004 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateTestJSON-2081326841 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateTestJSON-2081326841 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6628bde2fcc9454999cb8aa4f7e8b004 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2081326841 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateTestJSON-2081326841-project May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca8d70c9f3534db38174b9265ed355b9 May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateTestJSON-2081326841-project May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance c7302759-03fe-4a5f-be5e-37ea684010ec could not be found. May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'c7302759-03fe-4a5f-be5e-37ea684010ec'} May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7302759-03fe-4a5f-be5e-37ea684010ec could not be found. May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7302759-03fe-4a5f-be5e-37ea684010ec could not be found. May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:20.359120 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7302759-03fe-4a5f-be5e-37ea684010ec could not be found. May 19 08:42:20.365362 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:20.368720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Returning 404 to user: Instance c7302759-03fe-4a5f-be5e-37ea684010ec could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:20.369967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48d4a38f-0a02-4646-b040-0074c599add2 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec" status: 404 len: 111 microversion: 2.1 time: 0.082719 May 19 08:42:20.374240 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3395/4720] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:20 2022] GET /compute/v2.1/servers/c7302759-03fe-4a5f-be5e-37ea684010ec => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:42:20.381791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-57ccd314-d16e-4ca2-aa70-a078bc3f5c5f req-43d76470-019e-43d5-94a1-9e40fa7ae95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11e10ef-b49f-4fe2-bf3d-a2286a657736", "name": "network-vif-deleted", "tag": "2245847d-c8e5-44d4-9ec1-38349187226e"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:20.414163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-57ccd314-d16e-4ca2-aa70-a078bc3f5c5f req-43d76470-019e-43d5-94a1-9e40fa7ae95a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:20.414658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-57ccd314-d16e-4ca2-aa70-a078bc3f5c5f req-43d76470-019e-43d5-94a1-9e40fa7ae95a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.432817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-57ccd314-d16e-4ca2-aa70-a078bc3f5c5f req-43d76470-019e-43d5-94a1-9e40fa7ae95a service nova] Creating event network-vif-deleted:2245847d-c8e5-44d4-9ec1-38349187226e for instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 on chh1-842464-2 May 19 08:42:20.445874 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-57ccd314-d16e-4ca2-aa70-a078bc3f5c5f req-43d76470-019e-43d5-94a1-9e40fa7ae95a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069608 May 19 08:42:20.446543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3396/4721] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:20.460614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:20.461765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:20.479970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:20.480638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.481736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:20.482338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.555320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:20.568120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:20.568582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:20.585355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lazy-loading 'fault' on Instance uuid a11e10ef-b49f-4fe2-bf3d-a2286a657736 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:42:20.731221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8d70c9f3534db38174b9265ed355b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6628bde2fcc9454999cb8aa4f7e8b004', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:20.740955 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d58988aa-3caa-4707-8bba-1b13154ab268 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 200 len: 1306 microversion: 2.1 time: 0.292983 May 19 08:42:20.748127 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3397/4722] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:20 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 1306 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:21.307001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:21.318183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:21.326190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:21.327314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:21.328445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:21.328910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:21.703396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:21.722168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23859c67-1d2d-463f-a84a-26ad52ecb651 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 0.422275 May 19 08:42:21.736120 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3398/4723] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:21 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:42:21.766784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:21.769690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] [instance: a11e10ef-b49f-4fe2-bf3d-a2286a657736] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:21.787460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:21.788160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:21.789458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:21.792665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:21.816599 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] HTTP exception thrown: Instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 could not be found. May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Request method failure captured: May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 HTTP/1.1 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgKyG3fgoocXVxCCirY8X39BqyVu38Ge-YFYsZh21UZ3GAULOFTIeQbj2SVBGxwONGZOgq8WhrCZzL_YVWxjndMEbGW1d3xKghhZr0F0QUZQUMbJObZA8iu9_0CbbKk_OFvQZvx_YIX2-yKDKhrYvXOx6wiKrD7E2bKb3haZaNNQ-8A May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6628bde2fcc9454999cb8aa4f7e8b004 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-MultipleCreateTestJSON-2081326841 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6628bde2fcc9454999cb8aa4f7e8b004"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-MultipleCreateTestJSON-2081326841 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6628bde2fcc9454999cb8aa4f7e8b004 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2081326841 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-MultipleCreateTestJSON-2081326841-project May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca8d70c9f3534db38174b9265ed355b9 May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-MultipleCreateTestJSON-2081326841-project May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 could not be found. May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a11e10ef-b49f-4fe2-bf3d-a2286a657736'} May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 could not be found. May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 could not be found. May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:42:21.824598 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 could not be found. May 19 08:42:21.831140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:42:21.835176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] Returning 404 to user: Instance a11e10ef-b49f-4fe2-bf3d-a2286a657736 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:42:21.836219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3280995e-d5f7-481b-9430-a0d0a5a45150 tempest-MultipleCreateTestJSON-2081326841 tempest-MultipleCreateTestJSON-2081326841-project] 10.222.0.78 "GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736" status: 404 len: 111 microversion: 2.1 time: 0.075593 May 19 08:42:21.837576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3399/4724] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:21 2022] GET /compute/v2.1/servers/a11e10ef-b49f-4fe2-bf3d-a2286a657736 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:42:22.743776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:22.745285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:22.762210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:22.762687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:22.763513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:22.763955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:24.589523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:24.604154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47502280-4985-47fa-b54f-4c516be46562 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 1.866129 May 19 08:42:24.607207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3400/4725] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:22 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:42:25.626317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:25.626939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:25.647026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:25.647559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:25.648452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:25.648896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:26.838343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:26.854268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-454293df-288c-48c2-84ae-de940cbddb9a tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 1.226642 May 19 08:42:26.855967 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3401/4726] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:25 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:27.873792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:27.874582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:27.885870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:27.886326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:27.896225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:27.896676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:29.046410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:29.071775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-166832e7-a709-41b0-979f-25cd3e25844d tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1523 microversion: 2.1 time: 1.202733 May 19 08:42:29.076767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3402/4727] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:27 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1523 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:30.093143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:30.094101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:30.123473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:30.126529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:30.134040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:30.140114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:30.157097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:31.179257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:31.189575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e028e797-3112-4d93-8956-144e4016a5e7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1503 microversion: 2.1 time: 1.103803 May 19 08:42:31.203230 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3403/4728] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:30 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1503 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:31.208870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93688cfa-964e-4647-9109-7cdb44d9e7ad tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'create', calling method: .version_select at 0x7f3210f7aaf0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-940432247", "description": "tempest-description-1998826483"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:32.390688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93688cfa-964e-4647-9109-7cdb44d9e7ad tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.185728 May 19 08:42:32.398233 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3404/4729] 10.222.0.78 () {60 vars in 1179 bytes} [Thu May 19 08:42:31 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:42:32.403921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-940432247"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:32.404767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:32.412854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:32.413641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:32.414617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:32.415235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:33.327613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Adding security group 237b1b44-ddbe-4bb7-be88-07d7cae080e8 to port a519336e-25d6-461e-9c1e-90a1c8399435 May 19 08:42:34.924938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb8d600f-dccd-40e5-a1ac-36eab08c9761 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action" status: 202 len: 0 microversion: 2.1 time: 2.525147 May 19 08:42:34.927161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3405/4730] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:42:32 2022] POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action => generated 0 bytes in 2528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:42:35.990191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1677584965", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:36.107145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] validate_networks() for [('7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:42:38.290979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:42:38.292144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:42:38.292969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:42:38.297034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:42:38.301396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:42:38.316413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:38.317954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:38.319810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:38.320646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:38.358627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Getting quotas for project d1c3533286a849b8929dc24aace3b73e. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:42:38.378228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Getting quotas for user f5aa2af9f30d436087af02be75461cd3 and project d1c3533286a849b8929dc24aace3b73e. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:42:38.402038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:42:38.405074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:42:38.486570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69e9da55-096a-4c1b-8b72-ddaa5dc76852 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.557627 May 19 08:42:38.487547 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3406/4731] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:42:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:42:38.498269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-940432247"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:38.499549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:38.545932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:38.546824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:38.548060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:38.550878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:39.256304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Removing security group 237b1b44-ddbe-4bb7-be88-07d7cae080e8 from port a519336e-25d6-461e-9c1e-90a1c8399435 May 19 08:42:41.522792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a3ff9d1-2308-4dd1-8f00-6da8ea10ef27 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action" status: 202 len: 0 microversion: 2.1 time: 3.029660 May 19 08:42:41.524471 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3407/4732] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:42:38 2022] POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action => generated 0 bytes in 3036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:42:41.531692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fbfbbfc8-fb32-4577-aeff-988677fef013 req-b740113f-3026-4217-b9a3-b30bc59615d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:41.561248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fbfbbfc8-fb32-4577-aeff-988677fef013 req-b740113f-3026-4217-b9a3-b30bc59615d6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:41.561722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fbfbbfc8-fb32-4577-aeff-988677fef013 req-b740113f-3026-4217-b9a3-b30bc59615d6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:41.610268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fbfbbfc8-fb32-4577-aeff-988677fef013 req-b740113f-3026-4217-b9a3-b30bc59615d6 service nova] Creating event network-changed:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:42:41.628598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fbfbbfc8-fb32-4577-aeff-988677fef013 req-b740113f-3026-4217-b9a3-b30bc59615d6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102624 May 19 08:42:41.642354 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3408/4733] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:41.670300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:41.679919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:41.706339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:41.706950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:41.708202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:41.708753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:42.125020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa2af9f30d436087af02be75461cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c3533286a849b8929dc24aace3b73e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:42.136349 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33c77050-f74e-4e43-bb51-b2aca9c72009 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 200 len: 1282 microversion: 2.1 time: 0.479340 May 19 08:42:42.153458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3409/4734] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:41 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 1282 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:42.162244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6340de3c-3089-4095-8801-4e04c912185b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'create', calling method: .version_select at 0x7f3217b2d1f0>, body: {"pool": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:47.554507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6340de3c-3089-4095-8801-4e04c912185b tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.399856 May 19 08:42:47.561100 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3410/4735] 10.222.0.78 () {60 vars in 1169 bytes} [Thu May 19 08:42:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:47.561100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:47.561335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:47.582889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:47.583347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:47.584162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:47.584620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:47.874742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lazy-loading 'services' on Instance uuid 35ede4f4-ba88-460e-9998-80e614faf431 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:42:48.072871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6edba56a-a273-44e1-9040-a49fdd7035a0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-volume_attachments/e57658a8-7ddb-4080-af48-24d12b6e7a87" status: 202 len: 0 microversion: 2.1 time: 0.513133 May 19 08:42:48.073803 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3411/4736] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:42:47 2022] DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-volume_attachments/e57658a8-7ddb-4080-af48-24d12b6e7a87 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:42:48.342195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:48.394673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:48.617331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0ecb2fa-a418-47c6-9588-efdf08ccb91f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2042557996", "availability_zone": "foo_zone"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:48.652737 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:42:48.652737 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:42:48.654368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.aggregate [None req-d0ecb2fa-a418-47c6-9588-efdf08ccb91f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Generated uuid e259c859-1a71-4a39-821e-5bf75648b63f for aggregate {{(pid=119072) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 19 08:42:48.747755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0ecb2fa-a418-47c6-9588-efdf08ccb91f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.670085 May 19 08:42:48.755380 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3412/4737] 10.222.0.78 () {60 vars in 1163 bytes} [Thu May 19 08:42:48 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:48.774615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:48.776492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:48.808110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:48.808547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:48.815046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:48.815756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:49.392973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa2af9f30d436087af02be75461cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c3533286a849b8929dc24aace3b73e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:49.406247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89af563b-982d-4431-888e-5d554ee4fb58 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 200 len: 1324 microversion: 2.1 time: 0.649122 May 19 08:42:49.406860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3413/4738] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:48 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:49.427894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2c876a9d-985e-4738-ae1e-a0ae8ccd282e req-c4a80b8d-4fb3-41ce-b457-1d9fb01acf5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:49.449061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2c876a9d-985e-4738-ae1e-a0ae8ccd282e req-c4a80b8d-4fb3-41ce-b457-1d9fb01acf5c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:49.451382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2c876a9d-985e-4738-ae1e-a0ae8ccd282e req-c4a80b8d-4fb3-41ce-b457-1d9fb01acf5c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:49.518087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2c876a9d-985e-4738-ae1e-a0ae8ccd282e req-c4a80b8d-4fb3-41ce-b457-1d9fb01acf5c service nova] Creating event network-changed:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:42:49.541241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2c876a9d-985e-4738-ae1e-a0ae8ccd282e req-c4a80b8d-4fb3-41ce-b457-1d9fb01acf5c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132165 May 19 08:42:49.541935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3414/4739] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:49.564038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.33.1.36"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:49.565395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:49.592801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:49.593632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:49.594848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:49.596794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:49.669600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Acquired lock "refresh_cache-458ca55f-1ad3-4c53-bb03-72af391164ab" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:42:55.274101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Building network info cache for instance {{(pid=119072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:42:56.743629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Updating instance_info_cache with network_info: [{"id": "a519336e-25d6-461e-9c1e-90a1c8399435", "address": "fa:16:3e:3c:0c:37", "network": {"id": "725d9bbc-557f-4cc2-aeb7-d297e3230388", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-285899427-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.33.1.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7f22c3f59044f4799e176bed3ddfe4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa519336e-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:42:56.767966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Releasing lock "refresh_cache-458ca55f-1ad3-4c53-bb03-72af391164ab" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:42:56.769022 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f253e8b8-dd2d-4c1d-9ae1-481f2885e521 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action" status: 202 len: 0 microversion: 2.1 time: 7.223516 May 19 08:42:56.771967 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3415/4740] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:42:49 2022] POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action => generated 0 bytes in 7227 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:42:56.789117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d4a8ab8-ed4a-4bae-98fa-4e404a4d6d08 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:56.798119 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:42:56.798119 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:42:56.832676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:42:56.884688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d4a8ab8-ed4a-4bae-98fa-4e404a4d6d08 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.109634 May 19 08:42:56.890547 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3416/4741] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:42:56 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:56.911311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:42:56.914204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:56.935482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:56.938723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:56.939687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:56.943168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:57.277210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa2af9f30d436087af02be75461cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c3533286a849b8929dc24aace3b73e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:42:57.305376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26512191-814b-4e05-b2e6-86499da68695 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 200 len: 1324 microversion: 2.1 time: 0.405427 May 19 08:42:57.306821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3417/4742] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:42:56 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:42:57.317786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1f84f79f-eb13-4da3-bc43-4305f8abc74a req-2cb7e5b0-0546-4847-9efc-0c1f4b6bb288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f12a46-92aa-466b-aa68-842ecc051e0d", "tag": "302cf2c1-d9d0-4e05-a72b-c71d8fea90db"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:57.369531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1f84f79f-eb13-4da3-bc43-4305f8abc74a req-2cb7e5b0-0546-4847-9efc-0c1f4b6bb288 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:57.370228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1f84f79f-eb13-4da3-bc43-4305f8abc74a req-2cb7e5b0-0546-4847-9efc-0c1f4b6bb288 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:57.399926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1f84f79f-eb13-4da3-bc43-4305f8abc74a req-2cb7e5b0-0546-4847-9efc-0c1f4b6bb288 service nova] Creating event network-changed:302cf2c1-d9d0-4e05-a72b-c71d8fea90db for instance 76f12a46-92aa-466b-aa68-842ecc051e0d on chh1-842464-2 May 19 08:42:57.410187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1f84f79f-eb13-4da3-bc43-4305f8abc74a req-2cb7e5b0-0546-4847-9efc-0c1f4b6bb288 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101674 May 19 08:42:57.411199 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3418/4743] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:57.425054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4eee0797-652e-4596-915e-b829b5bbf973 req-a149a4cb-5984-4ea7-825a-f4a4a3666093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f12a46-92aa-466b-aa68-842ecc051e0d", "name": "network-vif-plugged", "status": "completed", "tag": "302cf2c1-d9d0-4e05-a72b-c71d8fea90db"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:57.441269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4eee0797-652e-4596-915e-b829b5bbf973 req-a149a4cb-5984-4ea7-825a-f4a4a3666093 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:57.442566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4eee0797-652e-4596-915e-b829b5bbf973 req-a149a4cb-5984-4ea7-825a-f4a4a3666093 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:57.478237 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4eee0797-652e-4596-915e-b829b5bbf973 req-a149a4cb-5984-4ea7-825a-f4a4a3666093 service nova] Creating event network-vif-plugged:302cf2c1-d9d0-4e05-a72b-c71d8fea90db for instance 76f12a46-92aa-466b-aa68-842ecc051e0d on chh1-842464-2 May 19 08:42:57.483969 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4eee0797-652e-4596-915e-b829b5bbf973 req-a149a4cb-5984-4ea7-825a-f4a4a3666093 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071063 May 19 08:42:57.486682 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3419/4744] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:42:57.493454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.33.1.36"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:42:57.936677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:42:57.951677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:57.956631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:57.959215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:42:57.961456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:42:58.422335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Acquired lock "refresh_cache-458ca55f-1ad3-4c53-bb03-72af391164ab" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 08:43:00.881902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Building network info cache for instance {{(pid=119072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 19 08:43:00.887547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:03.696635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Updating instance_info_cache with network_info: [{"id": "a519336e-25d6-461e-9c1e-90a1c8399435", "address": "fa:16:3e:3c:0c:37", "network": {"id": "725d9bbc-557f-4cc2-aeb7-d297e3230388", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-285899427-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7f22c3f59044f4799e176bed3ddfe4e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa519336e-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 19 08:43:03.728097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Releasing lock "refresh_cache-458ca55f-1ad3-4c53-bb03-72af391164ab" {{(pid=119072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 08:43:03.740084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-239e577a-7e50-431d-a26c-c9035812dbf7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action" status: 202 len: 0 microversion: 2.1 time: 6.241856 May 19 08:43:03.769265 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3420/4745] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:42:57 2022] POST /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab/action => generated 0 bytes in 6259 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 19 08:43:03.806684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f8baebe-c410-41fa-9bd3-fef8a800563f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:03.813211 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:03.813211 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:03.818990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8baebe-c410-41fa-9bd3-fef8a800563f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:03.820288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8baebe-c410-41fa-9bd3-fef8a800563f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:03.823215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8baebe-c410-41fa-9bd3-fef8a800563f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:03.825205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8baebe-c410-41fa-9bd3-fef8a800563f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:03.888745 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f8baebe-c410-41fa-9bd3-fef8a800563f tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.116315 May 19 08:43:03.889503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3421/4746] 10.222.0.78 () {58 vars in 1175 bytes} [Thu May 19 08:43:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:03.902433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:03.903375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:03.916108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:03.916621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:03.917527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:03.918233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:04.929826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa2af9f30d436087af02be75461cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c3533286a849b8929dc24aace3b73e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:04.949174 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb2b45cc-02c5-4f4c-839d-8fe293466aa7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 200 len: 1520 microversion: 2.1 time: 1.051061 May 19 08:43:04.950180 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3422/4747] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:03 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 1520 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:04.955319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b57bc577-e19a-4ebc-962f-fbfed6c7224f req-ef99ace1-0f3e-4acd-a686-edcc710a9dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:04.982959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b57bc577-e19a-4ebc-962f-fbfed6c7224f req-ef99ace1-0f3e-4acd-a686-edcc710a9dd2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:04.989001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b57bc577-e19a-4ebc-962f-fbfed6c7224f req-ef99ace1-0f3e-4acd-a686-edcc710a9dd2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:05.031882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b57bc577-e19a-4ebc-962f-fbfed6c7224f req-ef99ace1-0f3e-4acd-a686-edcc710a9dd2 service nova] Creating event network-changed:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:43:05.053690 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b57bc577-e19a-4ebc-962f-fbfed6c7224f req-ef99ace1-0f3e-4acd-a686-edcc710a9dd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101783 May 19 08:43:05.059109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3423/4748] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:05.076892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba68520f-fca2-4b40-b65f-213a59b1e2c1 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '.version_select at 0x7f3210e23ca0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:08.100170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba68520f-fca2-4b40-b65f-213a59b1e2c1 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/9e67bc73-65db-4729-ad17-b49c6ef0ece3" status: 202 len: 0 microversion: 2.1 time: 3.039405 May 19 08:43:08.101020 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3424/4749] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:43:05 2022] DELETE /compute/v2.1/os-floating-ips/9e67bc73-65db-4729-ad17-b49c6ef0ece3 => generated 0 bytes in 3041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:43:08.109274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a4fa116-644a-4e8b-9762-77af663ce6bd tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:08.110278 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:08.110278 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:08.138981 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a4fa116-644a-4e8b-9762-77af663ce6bd tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.037017 May 19 08:43:08.139784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3425/4750] 10.222.0.78 () {58 vars in 1142 bytes} [Thu May 19 08:43:08 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:08.152385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-639e7d52-751f-43f1-b586-75b97de159b4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-475494480", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-639e7d52-751f-43f1-b586-75b97de159b4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 242 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-475494480", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-475494480', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8'}]}}} May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:43:08.167152 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-639e7d52-751f-43f1-b586-75b97de159b4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-639e7d52-751f-43f1-b586-75b97de159b4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027985 May 19 08:43:08.172977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3426/4751] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:08 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:43:08.219214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fba65b39-1229-47f4-875f-3e3848c8652c req-393fb72c-9253-4c9b-b78d-46c60842e7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:08.254843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fba65b39-1229-47f4-875f-3e3848c8652c req-393fb72c-9253-4c9b-b78d-46c60842e7fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:08.255294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fba65b39-1229-47f4-875f-3e3848c8652c req-393fb72c-9253-4c9b-b78d-46c60842e7fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:08.279568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fba65b39-1229-47f4-875f-3e3848c8652c req-393fb72c-9253-4c9b-b78d-46c60842e7fa service nova] Creating event network-changed:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:43:08.311126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fba65b39-1229-47f4-875f-3e3848c8652c req-393fb72c-9253-4c9b-b78d-46c60842e7fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100460 May 19 08:43:08.318980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3427/4752] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:08.345834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1410069-4114-4e65-9755-26a37817135e tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '.version_select at 0x7f3217a59700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:10.101338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1410069-4114-4e65-9755-26a37817135e tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/237b1b44-ddbe-4bb7-be88-07d7cae080e8" status: 202 len: 0 microversion: 2.1 time: 1.780925 May 19 08:43:10.103133 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3428/4753] 10.222.0.78 () {58 vars in 1271 bytes} [Thu May 19 08:43:08 2022] DELETE /compute/v2.1/os-security-groups/237b1b44-ddbe-4bb7-be88-07d7cae080e8 => generated 0 bytes in 1783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:43:10.109757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1278187d-c227-4f61-a6de-78a3ec73cf4a tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:10.111632 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:10.111632 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:10.123694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1278187d-c227-4f61-a6de-78a3ec73cf4a tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:10.124539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1278187d-c227-4f61-a6de-78a3ec73cf4a tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:10.599119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1278187d-c227-4f61-a6de-78a3ec73cf4a tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.494532 May 19 08:43:10.615241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3429/4754] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:43:10 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:10.624208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2da43a3f-02a7-47a1-8acb-4f3a9bb7a0dc tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:10.625819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2da43a3f-02a7-47a1-8acb-4f3a9bb7a0dc tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 3336f271-b32b-425a-ab2e-8fcfc637a1db] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:10.637283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2da43a3f-02a7-47a1-8acb-4f3a9bb7a0dc tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] HTTP exception thrown: Instance 3336f271-b32b-425a-ab2e-8fcfc637a1db could not be found. May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2da43a3f-02a7-47a1-8acb-4f3a9bb7a0dc tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3336f271-b32b-425a-ab2e-8fcfc637a1db/metadata HTTP/1.1 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3336f271-b32b-425a-ab2e-8fcfc637a1db could not be found. May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '3336f271-b32b-425a-ab2e-8fcfc637a1db'} May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3336f271-b32b-425a-ab2e-8fcfc637a1db could not be found. May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3336f271-b32b-425a-ab2e-8fcfc637a1db could not be found. May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:10.645667 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:10.654523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:43:10.654523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:43:10.654523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3336f271-b32b-425a-ab2e-8fcfc637a1db could not be found. May 19 08:43:10.654523 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:10.654523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2da43a3f-02a7-47a1-8acb-4f3a9bb7a0dc tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 404 to user: Instance 3336f271-b32b-425a-ab2e-8fcfc637a1db could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:10.656119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2da43a3f-02a7-47a1-8acb-4f3a9bb7a0dc tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/3336f271-b32b-425a-ab2e-8fcfc637a1db/metadata" status: 404 len: 111 microversion: 2.1 time: 0.038523 May 19 08:43:10.656936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3430/4755] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 08:43:10 2022] GET /compute/v2.1/servers/3336f271-b32b-425a-ab2e-8fcfc637a1db/metadata => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:43:10.679587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:10.680491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:10.703000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:10.703775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:10.707589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:10.710704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:10.752665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:43:10.939608 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2bed7989-82af-4c2b-82f2-59bc5378e380 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "DELETE /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 204 len: 0 microversion: 2.1 time: 0.281080 May 19 08:43:10.940406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3431/4756] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:43:10 2022] DELETE /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:43:10.950539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8993e6b6-3772-400a-bfde-60228d192503 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:10.951618 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:10.951618 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:10.960379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8993e6b6-3772-400a-bfde-60228d192503 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.015309 May 19 08:43:10.961928 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3432/4757] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:43:10 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:10.967076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01ad2941-1ba5-4c65-8cd7-0c95e1fd0617 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:10.975315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01ad2941-1ba5-4c65-8cd7-0c95e1fd0617 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:10.976053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01ad2941-1ba5-4c65-8cd7-0c95e1fd0617 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:11.002424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01ad2941-1ba5-4c65-8cd7-0c95e1fd0617 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 08:43:11.075542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01ad2941-1ba5-4c65-8cd7-0c95e1fd0617 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action" status: 202 len: 0 microversion: 2.1 time: 0.112204 May 19 08:43:11.076293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3433/4758] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:43:10 2022] POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:43:11.089688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-437a5ff4-207d-4377-919b-fffb23aa41a1 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1621624641", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-437a5ff4-207d-4377-919b-fffb23aa41a1 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 499 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1621624641", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1621624641', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8'}]}}} May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:43:11.093158 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:11.096984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-437a5ff4-207d-4377-919b-fffb23aa41a1 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:11.101391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-437a5ff4-207d-4377-919b-fffb23aa41a1 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017166 May 19 08:43:11.102063 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3434/4759] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:11 2022] POST /compute/v2.1/servers => generated 687 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:43:11.136126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:11.138908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:11.159546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:11.164065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:11.166342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:11.169264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:12.162596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:12.175069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-382100ec-cd12-4df1-a3f5-544db2c32707 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1513 microversion: 2.1 time: 1.071389 May 19 08:43:12.180102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3435/4760] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:11 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1513 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:12.214417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb993e6b-7321-437f-8b6c-b45c67e4464c tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-295851728", "availability_zone": "foo_zone"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:12.421382 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:12.421382 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:12.523222 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb993e6b-7321-437f-8b6c-b45c67e4464c tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.341511 May 19 08:43:12.527672 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3436/4761] 10.222.0.78 () {60 vars in 1172 bytes} [Thu May 19 08:43:12 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:12.542676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:12.547476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:12.621877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:12.622970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:12.625480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:12.626491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:13.097083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:13.109520 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3289064-9178-4a8c-bb9c-9d602568807c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1680 microversion: 2.1 time: 0.577920 May 19 08:43:13.112428 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3437/4762] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:12 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1680 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:13.127563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81f5ca35-c5a4-4e10-a419-1326c668be6b tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-611330952", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81f5ca35-c5a4-4e10-a419-1326c668be6b tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 499 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-611330952", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-611330952', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8'}]}}} May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:43:13.138616 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81f5ca35-c5a4-4e10-a419-1326c668be6b tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:13.142364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81f5ca35-c5a4-4e10-a419-1326c668be6b tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025539 May 19 08:43:13.145743 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3438/4763] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:13 2022] POST /compute/v2.1/servers => generated 689 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:43:13.156591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2967aab2-da11-408c-920f-3bb4413c8b82 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:13.160736 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:13.160736 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:13.234680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2967aab2-da11-408c-920f-3bb4413c8b82 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.087854 May 19 08:43:13.236776 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3439/4764] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:43:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:13.247931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:13.253522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:13.271323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:13.273098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:13.275858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:13.276899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:13.842088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:14.264681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:14.275444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2dda98aa-c383-46be-8129-c2565b14d877 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1513 microversion: 2.1 time: 1.033741 May 19 08:43:14.276104 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3440/4765] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:13 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1513 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:14.291148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de77dc9f-a308-4e3a-9fa2-336d4fce3785 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:14.292085 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:14.292085 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:14.315069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de77dc9f-a308-4e3a-9fa2-336d4fce3785 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.037805 May 19 08:43:14.315677 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3441/4766] 10.222.0.78 () {58 vars in 1151 bytes} [Thu May 19 08:43:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:14.339106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6469c8d5-39b8-41f4-8bfd-50559e6e4293 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-344209019", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6469c8d5-39b8-41f4-8bfd-50559e6e4293 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 753 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-344209019", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-344209019', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8'}]}}} May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:43:14.351350 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:43:14.354084 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:43:14.356610 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:14.356610 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:14.356610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6469c8d5-39b8-41f4-8bfd-50559e6e4293 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:14.356610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6469c8d5-39b8-41f4-8bfd-50559e6e4293 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.028368 May 19 08:43:14.359369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3442/4767] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:14 2022] POST /compute/v2.1/servers => generated 1197 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 19 08:43:14.375721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:14.376333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:14.413030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:14.421626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:14.422597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:14.423047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:14.951422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:14.964776 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a332bc6-8ee7-4fba-bc27-76986e33de4d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1680 microversion: 2.1 time: 0.602664 May 19 08:43:14.982052 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3443/4768] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:14 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1680 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:14.995828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69f8b627-8b31-4021-bcb5-a8fe677d20e4 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "chh1-842464-2"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:14.998554 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:14.998554 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:15.008429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69f8b627-8b31-4021-bcb5-a8fe677d20e4 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.014973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69f8b627-8b31-4021-bcb5-a8fe677d20e4 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.251376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69f8b627-8b31-4021-bcb5-a8fe677d20e4 tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.267671 May 19 08:43:15.252014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3444/4769] 10.222.0.78 () {60 vars in 1193 bytes} [Thu May 19 08:43:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:15.267685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f254607b-a717-47c9-ad2e-f674cc7de86d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1134219267", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f254607b-a717-47c9-ad2e-f674cc7de86d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers HTTP/1.1 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 1266 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1134219267", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8"}]}} May 19 08:43:15.282184 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1134219267', 'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '7c1bf682-0f2b-43b6-9ec8-ed21f99cf0e8'}]}}} May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.284372 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['server']: May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 08:43:15.285682 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 08:43:15.287674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 19 08:43:15.287674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.287674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f254607b-a717-47c9-ad2e-f674cc7de86d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:15.288661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f254607b-a717-47c9-ad2e-f674cc7de86d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.028318 May 19 08:43:15.289695 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3445/4770] 10.222.0.78 () {60 vars in 1147 bytes} [Thu May 19 08:43:15 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 19 08:43:15.310910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-533f9df7-0abf-48ae-9583-e0b92da2cde6 req-b7bab474-d35d-45af-8f33-dba499cbfe89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "458ca55f-1ad3-4c53-bb03-72af391164ab", "name": "network-vif-deleted", "tag": "a519336e-25d6-461e-9c1e-90a1c8399435"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:15.328065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-533f9df7-0abf-48ae-9583-e0b92da2cde6 req-b7bab474-d35d-45af-8f33-dba499cbfe89 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.329874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-533f9df7-0abf-48ae-9583-e0b92da2cde6 req-b7bab474-d35d-45af-8f33-dba499cbfe89 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.344788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-533f9df7-0abf-48ae-9583-e0b92da2cde6 req-b7bab474-d35d-45af-8f33-dba499cbfe89 service nova] Creating event network-vif-deleted:a519336e-25d6-461e-9c1e-90a1c8399435 for instance 458ca55f-1ad3-4c53-bb03-72af391164ab on chh1-842464-2 May 19 08:43:15.356352 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-533f9df7-0abf-48ae-9583-e0b92da2cde6 req-b7bab474-d35d-45af-8f33-dba499cbfe89 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060480 May 19 08:43:15.357250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3446/4771] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:15.364416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8cc28495-8a60-4392-92d0-412f90ddb7ea tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:15.365960 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:15.365960 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:15.408787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8cc28495-8a60-4392-92d0-412f90ddb7ea tempest-TestAggregatesBasicOps-741802645 tempest-TestAggregatesBasicOps-741802645-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.049712 May 19 08:43:15.410607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3447/4772] 10.222.0.78 () {58 vars in 1154 bytes} [Thu May 19 08:43:15 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 19 08:43:15.422187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:15.423283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:15.429461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:15.438137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.438950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.440314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.442624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.532583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.533409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.537690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lazy-loading 'fault' on Instance uuid 458ca55f-1ad3-4c53-bb03-72af391164ab {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:43:15.670133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f83ecbd9044c939510bcd5b8246f10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f22c3f59044f4799e176bed3ddfe4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:15.681386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24401413-ddc3-417c-b345-d85f7dc807f7 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 200 len: 1313 microversion: 2.1 time: 0.269210 May 19 08:43:15.681998 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3448/4773] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:15 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:15.698587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20afd4fa-29bf-4d92-8475-8815d6e3a62d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:15.699113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20afd4fa-29bf-4d92-8475-8815d6e3a62d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 7dff6bdd-3a98-4cd0-ad86-b62de503c105] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:15.705961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-20afd4fa-29bf-4d92-8475-8815d6e3a62d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] HTTP exception thrown: Instance 7dff6bdd-3a98-4cd0-ad86-b62de503c105 could not be found. May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20afd4fa-29bf-4d92-8475-8815d6e3a62d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7dff6bdd-3a98-4cd0-ad86-b62de503c105/metadata/test2 HTTP/1.1 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7dff6bdd-3a98-4cd0-ad86-b62de503c105 could not be found. May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '7dff6bdd-3a98-4cd0-ad86-b62de503c105', 'id': 'test2'} May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dff6bdd-3a98-4cd0-ad86-b62de503c105 could not be found. May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dff6bdd-3a98-4cd0-ad86-b62de503c105 could not be found. May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:15.707835 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:15.712550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:43:15.712550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:43:15.712550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dff6bdd-3a98-4cd0-ad86-b62de503c105 could not be found. May 19 08:43:15.712550 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:15.712550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20afd4fa-29bf-4d92-8475-8815d6e3a62d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 404 to user: Instance 7dff6bdd-3a98-4cd0-ad86-b62de503c105 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:15.712550 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20afd4fa-29bf-4d92-8475-8815d6e3a62d tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/7dff6bdd-3a98-4cd0-ad86-b62de503c105/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016017 May 19 08:43:15.718921 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3449/4774] 10.222.0.78 () {58 vars in 1280 bytes} [Thu May 19 08:43:15 2022] GET /compute/v2.1/servers/7dff6bdd-3a98-4cd0-ad86-b62de503c105/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:43:15.724550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:15.725069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:15.741066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.741637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.742490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:15.742940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:15.794234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:43:15.908053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:16.020314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0656c527-83b0-41d4-98db-671a012132c5 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "DELETE /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 204 len: 0 microversion: 2.1 time: 0.299567 May 19 08:43:16.021485 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3450/4775] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:43:15 2022] DELETE /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:43:16.033464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:16.034190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:16.048281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:16.048748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:16.049614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:16.051135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:16.466217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:16.475034 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1747128b-bbbd-4c38-84a5-10583027b583 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1676 microversion: 2.1 time: 0.448699 May 19 08:43:16.476028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3451/4776] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:16 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1676 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:16.481440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:16.482399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:16.491753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:16.492209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:16.493002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:16.493472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:17.399963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa2af9f30d436087af02be75461cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c3533286a849b8929dc24aace3b73e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:17.408141 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eaf7e704-8216-410c-a09d-013b9924f518 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 200 len: 1526 microversion: 2.1 time: 0.930827 May 19 08:43:17.418764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3452/4777] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:16 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 1526 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:17.424138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:17.425205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] [instance: 458ca55f-1ad3-4c53-bb03-72af391164ab] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:17.432604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:17.433405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:17.434406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:17.435055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:17.450415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] HTTP exception thrown: Instance 458ca55f-1ad3-4c53-bb03-72af391164ab could not be found. May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Request method failure captured: May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab HTTP/1.1 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgK-wqszvWfDdwy1VG5Q5UwHPe_CjPd3ma-F5pvTJ5QkWY1kSthugANR0Ftmfh-ZKaiu6D42KmJeg6oP-r8UUAutWNd928KdpZ6vI9eHJqTHg5g9sz0Rhf0uMmoEfgJwQHUuH8sYlT17xEqUySFbV1wtr3IELUhM8dJo1kfqt703Yyk May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: e7f22c3f59044f4799e176bed3ddfe4e May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1243967221 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e7f22c3f59044f4799e176bed3ddfe4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f22c3f59044f4799e176bed3ddfe4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e7f22c3f59044f4799e176bed3ddfe4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f22c3f59044f4799e176bed3ddfe4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1243967221 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: e7f22c3f59044f4799e176bed3ddfe4e May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1243967221 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueTestJSONUnderV235-1243967221-project May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f6f83ecbd9044c939510bcd5b8246f10 May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1243967221-project May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 458ca55f-1ad3-4c53-bb03-72af391164ab could not be found. May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '458ca55f-1ad3-4c53-bb03-72af391164ab'} May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 458ca55f-1ad3-4c53-bb03-72af391164ab could not be found. May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 458ca55f-1ad3-4c53-bb03-72af391164ab could not be found. May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:17.452637 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 458ca55f-1ad3-4c53-bb03-72af391164ab could not be found. May 19 08:43:17.457553 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:17.459790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] Returning 404 to user: Instance 458ca55f-1ad3-4c53-bb03-72af391164ab could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:17.460881 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e794c76-a035-47b2-8adb-a3b67fcfde59 tempest-ServerRescueTestJSONUnderV235-1243967221 tempest-ServerRescueTestJSONUnderV235-1243967221-project] 10.222.0.78 "GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab" status: 404 len: 111 microversion: 2.1 time: 0.040731 May 19 08:43:17.465458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3453/4778] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:17 2022] GET /compute/v2.1/servers/458ca55f-1ad3-4c53-bb03-72af391164ab => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:43:17.494268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:17.494966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:17.511254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:17.511707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:17.512505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:17.512940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:18.163853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:18.186710 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51f9e2fd-d8b2-4bb6-b57b-d7b46e140045 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1676 microversion: 2.1 time: 0.697224 May 19 08:43:18.187969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3454/4779] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:17 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1676 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:18.394136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38c1d9aa-a54b-4754-97cc-98e038b8695b tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:18.395894 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:43:18.395894 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:43:18.397729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c1d9aa-a54b-4754-97cc-98e038b8695b tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:18.398401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c1d9aa-a54b-4754-97cc-98e038b8695b tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:18.399400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c1d9aa-a54b-4754-97cc-98e038b8695b tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:18.400052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c1d9aa-a54b-4754-97cc-98e038b8695b tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:18.465268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38c1d9aa-a54b-4754-97cc-98e038b8695b tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.273457 May 19 08:43:18.470901 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3455/4780] 10.222.0.78 () {58 vars in 1184 bytes} [Thu May 19 08:43:18 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:18.484259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:18.485412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:18.499639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:18.500301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:18.506000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:18.506616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:19.010492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5aa2af9f30d436087af02be75461cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c3533286a849b8929dc24aace3b73e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:19.027661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5fa75a35-32d1-4540-b386-ba4b8fa499e7 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 200 len: 1526 microversion: 2.1 time: 0.555146 May 19 08:43:19.038356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3456/4781] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:18 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 1526 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:19.044959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1850460993", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "availability_zone": "nova:chh1-842464-2", "networks": [{"uuid": "20d0cbba-df89-46cf-a9a9-3f4a8d6af3a6"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:19.157726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] validate_networks() for [('20d0cbba-df89-46cf-a9a9-3f4a8d6af3a6', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:43:21.451356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:43:21.452439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:43:21.453070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:43:21.453700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:43:21.454522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:43:21.489514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:21.490357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:21.491747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:21.492494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:21.561400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Getting quotas for project 480ba39f3c8c4e23a3e84686a343afce. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:43:21.591247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Getting quotas for user 6135dade37e04910b66d0b17b2cffdb9 and project 480ba39f3c8c4e23a3e84686a343afce. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:43:21.617172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:43:21.620439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:43:21.761224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8de491e6-b00a-438e-88ff-5f54341a42ca tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.721530 May 19 08:43:21.766126 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3457/4782] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:43:21.778555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3c1438d0-79e4-415c-a0e8-305567d024e4 req-9ae80f82-685a-4001-a8c4-7e609a80fefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f12a46-92aa-466b-aa68-842ecc051e0d", "name": "network-vif-deleted", "tag": "302cf2c1-d9d0-4e05-a72b-c71d8fea90db"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:21.803771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3c1438d0-79e4-415c-a0e8-305567d024e4 req-9ae80f82-685a-4001-a8c4-7e609a80fefe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:21.804497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3c1438d0-79e4-415c-a0e8-305567d024e4 req-9ae80f82-685a-4001-a8c4-7e609a80fefe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:21.842117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3c1438d0-79e4-415c-a0e8-305567d024e4 req-9ae80f82-685a-4001-a8c4-7e609a80fefe service nova] Creating event network-vif-deleted:302cf2c1-d9d0-4e05-a72b-c71d8fea90db for instance 76f12a46-92aa-466b-aa68-842ecc051e0d on chh1-842464-2 May 19 08:43:21.862644 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3c1438d0-79e4-415c-a0e8-305567d024e4 req-9ae80f82-685a-4001-a8c4-7e609a80fefe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094912 May 19 08:43:21.863746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3458/4783] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:21.872727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:21.873986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:21.883683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:21.884370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:21.885373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:21.885889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:22.679904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:22.701438 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c1c8050-bb52-448e-bbcd-c033f0977694 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1676 microversion: 2.1 time: 0.832145 May 19 08:43:22.704173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3459/4784] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:21 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1676 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:22.730410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:22.733030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] [instance: 76f12a46-92aa-466b-aa68-842ecc051e0d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:22.765973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:22.767742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:22.771638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:22.772716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:22.815402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] HTTP exception thrown: Instance 76f12a46-92aa-466b-aa68-842ecc051e0d could not be found. May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Request method failure captured: May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d HTTP/1.1 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgL5AU3x_fGBrd0MNTsDPvH6QPb2xbEuuZjsoGR637BUU7b6IU6Pemuiv5EaGPhmc-xffHJHqr0qlqaVH18eOZvzyPLUFVe7S0khC0ilLfQgDCokaABLsJhenVTtKmAp9UqiSCX330XRtES1bc9Lh_DATPke_rOYviKDHF8OLNc6puM May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d1c3533286a849b8929dc24aace3b73e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: d1c3533286a849b8929dc24aace3b73e May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1120744535 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f5aa2af9f30d436087af02be75461cd3 May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1120744535-project May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 76f12a46-92aa-466b-aa68-842ecc051e0d could not be found. May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '76f12a46-92aa-466b-aa68-842ecc051e0d'} May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f12a46-92aa-466b-aa68-842ecc051e0d could not be found. May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f12a46-92aa-466b-aa68-842ecc051e0d could not be found. May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:22.822972 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f12a46-92aa-466b-aa68-842ecc051e0d could not be found. May 19 08:43:22.828521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:43:22.831164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] Returning 404 to user: Instance 76f12a46-92aa-466b-aa68-842ecc051e0d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:43:22.833126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e63e19a-05b7-4aac-bac1-77867eea66c4 tempest-ServerMetadataNegativeTestJSON-1120744535 tempest-ServerMetadataNegativeTestJSON-1120744535-project] 10.222.0.78 "GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d" status: 404 len: 111 microversion: 2.1 time: 0.126927 May 19 08:43:22.837934 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3460/4785] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:22 2022] GET /compute/v2.1/servers/76f12a46-92aa-466b-aa68-842ecc051e0d => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:43:22.846434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:22.847540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:22.855612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:22.856378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:22.857435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:22.858093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:23.112611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c73387e-1b37-46d1-9ae5-6d52ed78ea66 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1346 microversion: 2.1 time: 0.270392 May 19 08:43:23.113285 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3461/4786] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:22 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1346 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:23.721323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:23.722123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:23.744405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:23.744929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:23.745806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:23.746251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:24.966275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:24.987149 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ceeb3b91-1d7b-4591-a7ff-5fcaecccabe9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1653 microversion: 2.1 time: 1.270588 May 19 08:43:24.990949 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3462/4787] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:23 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1653 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:25.011085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:25.011767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:25.018368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:25.019725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:25.020888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:25.021597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:25.198256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bddce376-9249-4466-9621-96264451ffcb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1422 microversion: 2.1 time: 0.205472 May 19 08:43:25.199329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3463/4788] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:24 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1422 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:25.221757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5e74d35-5f50-476f-87ee-f7f0e7a2bd22 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:25.229657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e74d35-5f50-476f-87ee-f7f0e7a2bd22 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:25.230279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e74d35-5f50-476f-87ee-f7f0e7a2bd22 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:25.266884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5e74d35-5f50-476f-87ee-f7f0e7a2bd22 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 08:43:25.359107 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5e74d35-5f50-476f-87ee-f7f0e7a2bd22 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action" status: 202 len: 0 microversion: 2.1 time: 0.149157 May 19 08:43:25.360341 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3464/4789] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:43:25 2022] POST /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:43:25.373216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:25.376112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:25.401230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:25.401836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:25.402755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:25.404915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:26.722962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:26.733766 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-749c98a9-7f27-46e2-ad35-d25c077bb9b6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1662 microversion: 2.1 time: 1.368049 May 19 08:43:26.735208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3465/4790] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:25 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1662 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:26.740735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:26.741811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:26.752013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:26.753199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:26.754542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:26.755299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:27.241940 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:43:27.242567 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:43:27.910257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-91745510-13a0-4675-be34-f92fd5b74694 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 1.168734 May 19 08:43:27.912591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3466/4791] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:26 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:27.932504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:27.940839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:27.970137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:27.971610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:27.976626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:27.977212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:28.789547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:28.808391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61503dc0-7ac5-4d71-8c9f-b75d3e104478 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1662 microversion: 2.1 time: 0.892065 May 19 08:43:28.813104 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3467/4792] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:27 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1662 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:28.933975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:28.934814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:28.951460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:28.957852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:28.960169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:28.963766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:29.350668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e96576b1-3b34-4bb2-a920-d6b9f7544ffb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 0.422482 May 19 08:43:29.366241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3468/4793] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:28 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:29.375338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8beb41ae-60c5-456d-b582-1b8aa898c9b6 req-644653a8-e177-4dcf-9e26-9139f4d0e0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b7e128-d56e-4934-abf0-dbb6271852f7", "tag": "dc09f305-58e2-418e-897e-f42b5e6d48bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:29.389346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8beb41ae-60c5-456d-b582-1b8aa898c9b6 req-644653a8-e177-4dcf-9e26-9139f4d0e0fe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:29.390283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8beb41ae-60c5-456d-b582-1b8aa898c9b6 req-644653a8-e177-4dcf-9e26-9139f4d0e0fe service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:29.409862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:29.412612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8beb41ae-60c5-456d-b582-1b8aa898c9b6 req-644653a8-e177-4dcf-9e26-9139f4d0e0fe service nova] Creating event network-changed:dc09f305-58e2-418e-897e-f42b5e6d48bd for instance 27b7e128-d56e-4934-abf0-dbb6271852f7 on chh1-842464-2 May 19 08:43:29.420382 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8beb41ae-60c5-456d-b582-1b8aa898c9b6 req-644653a8-e177-4dcf-9e26-9139f4d0e0fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051279 May 19 08:43:29.421519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3469/4794] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:29.626410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-133406553", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": "none"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:29.689381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:43:29.690063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:43:29.690646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:43:29.691972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:43:29.693187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:43:29.703499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:29.704041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:29.704915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:29.705455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:29.727362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Getting quotas for project badf7712d7094aa1b15705950bfa038c. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:43:29.733838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Getting quotas for user 245ce1a6a6df41b1b8062892d02e4b0e and project badf7712d7094aa1b15705950bfa038c. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:43:29.750772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:43:29.754111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:43:29.831577 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e5166e7-3506-4309-8e73-db6e9f75e821 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.376615 May 19 08:43:29.838541 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3470/4795] 10.222.0.78 () {62 vars in 1187 bytes} [Thu May 19 08:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 08:43:29.846683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:29.847363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:29.856421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:29.856990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:29.857897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:29.858415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:30.176310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:30.204852 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee432796-e711-448e-bc3c-9215d06fb912 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1666 microversion: 2.1 time: 0.369944 May 19 08:43:30.207226 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3471/4796] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:29 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1666 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:30.215290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48895924-9197-4344-972e-b3ae3c1eca7c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:30.216221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48895924-9197-4344-972e-b3ae3c1eca7c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:30.335057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48895924-9197-4344-972e-b3ae3c1eca7c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:30.348254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48895924-9197-4344-972e-b3ae3c1eca7c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:30.351845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48895924-9197-4344-972e-b3ae3c1eca7c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:30.353705 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48895924-9197-4344-972e-b3ae3c1eca7c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1277 microversion: 2.57 time: 0.145124 May 19 08:43:30.367668 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3472/4797] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:30 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:30.375920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:30.378850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:30.392401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:30.393643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:30.398985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:30.402103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:30.674891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-863220ca-604a-4542-9f40-a8ea0f34eed7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 0.304882 May 19 08:43:30.677767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3473/4798] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:30 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:31.379753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:31.381546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:31.391009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:31.391840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:31.392934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:31.393650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:31.518262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:31.533023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:31.540939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:31.544217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bcc547a-a74e-46ad-86e7-c517d8ca409d tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1337 microversion: 2.57 time: 0.168881 May 19 08:43:31.545557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3474/4799] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:31 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1337 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:43:31.696612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:31.697720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:31.710553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:31.711430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:31.712421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:31.713062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:32.343895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b902bc33-59c6-4ae6-b534-ca061a930823 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 0.653248 May 19 08:43:32.346544 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3475/4800] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:31 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:32.572362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:32.573976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:32.589099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:32.589818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:32.590953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:32.592112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:32.763706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:32.789368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:32.791795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:32.791795 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d174487d-4e83-4313-bec8-954576c901bb tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1335 microversion: 2.57 time: 0.232433 May 19 08:43:32.809279 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3476/4801] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:32 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1335 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:33.365118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:33.366314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:33.369292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:33.384910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:33.385421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:33.386399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:33.386754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:34.423222 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ee991d2-cf22-407a-bc96-c4cea8ab7d9f tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 1.062471 May 19 08:43:34.423940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3477/4802] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:33 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:34.432554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:34.433188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:34.444427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:34.444891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:34.445728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:34.446302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:34.830962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:34.842446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:34.843351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:34.844676 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a44ff60-a638-459f-82a6-67f7b94814f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1356 microversion: 2.57 time: 0.418562 May 19 08:43:34.845357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3478/4803] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:34 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1356 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:34.871152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:34.874618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:34.883927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:34.884638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:34.886364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:34.886952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:34.987464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:43:34.988499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:43:34.989151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:43:34.989607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:43:34.990027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:43:35.083021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:35.095517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:35.096336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:35.098693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:35.099540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:35.138562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ab78122-8bd9-4ef0-b6fd-e91d9782da9b tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "POST /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6/action" status: 202 len: 1137 microversion: 2.57 time: 0.277812 May 19 08:43:35.139852 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3479/4804] 10.222.0.78 () {62 vars in 1319 bytes} [Thu May 19 08:43:34 2022] POST /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6/action => generated 1137 bytes in 280 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 19 08:43:35.157939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:35.158598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:35.169094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:35.169594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:35.170412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:35.171095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:35.373939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:35.390884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:35.392444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:35.393750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7247a4d-69a7-4a10-9e20-2c31dbc24cef tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.240906 May 19 08:43:35.398012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3480/4805] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:35 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:43:35.444173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:35.444930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:35.461974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:35.462827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:35.468189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:35.468858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:36.376379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0f2b0f2-212a-4f84-80f9-280733d99f14 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 0.936065 May 19 08:43:36.380447 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3481/4806] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:35 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:36.389618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-df9004a0-6758-41df-84fc-0164ec78e098 req-8b9487ed-1594-492c-b4b6-20a281dd6f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b7e128-d56e-4934-abf0-dbb6271852f7", "name": "network-vif-plugged", "status": "completed", "tag": "dc09f305-58e2-418e-897e-f42b5e6d48bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:36.416952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-df9004a0-6758-41df-84fc-0164ec78e098 req-8b9487ed-1594-492c-b4b6-20a281dd6f4a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:36.418720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-df9004a0-6758-41df-84fc-0164ec78e098 req-8b9487ed-1594-492c-b4b6-20a281dd6f4a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:36.458865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-df9004a0-6758-41df-84fc-0164ec78e098 req-8b9487ed-1594-492c-b4b6-20a281dd6f4a service nova] Creating event network-vif-plugged:dc09f305-58e2-418e-897e-f42b5e6d48bd for instance 27b7e128-d56e-4934-abf0-dbb6271852f7 on chh1-842464-2 May 19 08:43:36.474839 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-df9004a0-6758-41df-84fc-0164ec78e098 req-8b9487ed-1594-492c-b4b6-20a281dd6f4a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090958 May 19 08:43:36.475889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3482/4807] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:36.493445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:36.497439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:36.518984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:36.520461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:36.522715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:36.524600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:36.782029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:36.806826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:36.809048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:36.825233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1041ccda-4999-4f81-9cfe-82b3d7f8b171 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.343934 May 19 08:43:36.831101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3483/4808] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:36 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:37.397604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:37.398776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:37.413115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:37.415610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:37.416636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:37.418942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:38.351898 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e183c41-53b3-450d-81a2-545ec650b516 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1464 microversion: 2.1 time: 0.959455 May 19 08:43:38.364790 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3484/4809] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:37 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1464 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:38.383624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:38.384257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:38.396583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:38.397042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:38.402688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:38.403449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:38.642412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:38.651245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:38.652853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:38.664308 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac7ce4a1-344f-4acb-ae6e-416223363b6a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.298212 May 19 08:43:38.665146 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3485/4810] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:38 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:39.384760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:39.388310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:39.399608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:39.400501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:39.401521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:39.402125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:39.714952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:39.994340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:40.007057 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b94953f4-ae73-4e80-8c72-dde36d176169 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1647 microversion: 2.1 time: 0.638866 May 19 08:43:40.008247 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3486/4811] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:39 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1647 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:40.017039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:40.017986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:40.032420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:40.044541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:40.045933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:40.046859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:40.341138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:40.466311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:40.499030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:40.508472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:40.515309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9529b57b-061d-464e-87db-77a7270ef237 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.504125 May 19 08:43:40.520752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3487/4812] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:40 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:40.535409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:40.539051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:40.555934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:40.557347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:40.559299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:40.560023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:41.294798 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ab202d5-9532-4724-a544-0e54b9e75ef1 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1647 microversion: 2.1 time: 0.772622 May 19 08:43:41.305497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3488/4813] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:40 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1647 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:41.316537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:41.317461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:41.334608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:41.335116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:41.335983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:41.338798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:41.871631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a63d7fd0-dbd3-4c31-88e7-263affca9975 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1647 microversion: 2.1 time: 0.561135 May 19 08:43:41.881914 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3489/4814] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:41 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1647 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:41.886993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:41.887546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:41.898365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:41.899032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:41.899535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:41.901708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:42.062604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:42.090192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:42.098608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:42.100073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c531087e-a8b6-4c25-9635-7e6b9492e793 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.216858 May 19 08:43:42.111675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3490/4815] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:41 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:42.125803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-983397431", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "availability_zone": "nova:chh2-842464-2", "networks": [{"uuid": "20d0cbba-df89-46cf-a9a9-3f4a8d6af3a6"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:42.233494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] validate_networks() for [('20d0cbba-df89-46cf-a9a9-3f4a8d6af3a6', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:43:43.492182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:43:43.493438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:43:43.494151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:43:43.494814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:43:43.495459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:43:43.511786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:43.512625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:43.516259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:43.517193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:43.592894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Getting quotas for project 480ba39f3c8c4e23a3e84686a343afce. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:43:43.603472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Getting quotas for user 6135dade37e04910b66d0b17b2cffdb9 and project 480ba39f3c8c4e23a3e84686a343afce. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:43:43.621377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:43:43.624614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:43:43.741871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-787a0ee4-2522-4d84-9744-1416a1e71640 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619716 May 19 08:43:43.742826 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3491/4816] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:43:43.752868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:43.754387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:43.772564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:43.772979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:43.773816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:43.774264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:44.006294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:44.017404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:44.020563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:44.022255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12a7bb81-b083-4394-b2fc-176a5311d259 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.277955 May 19 08:43:44.035318 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3492/4817] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:43 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:44.035318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17b18030-ed27-4d8a-9ddb-b6db85524d50 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:44.035318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17b18030-ed27-4d8a-9ddb-b6db85524d50 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:44.211532 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17b18030-ed27-4d8a-9ddb-b6db85524d50 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1328 microversion: 2.1 time: 0.184479 May 19 08:43:44.216031 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3493/4818] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:44 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:45.043804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:45.062147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:45.109955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:45.110485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:45.116232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:45.116707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:45.468851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:45.493828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:45.496147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:45.497751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c70b5f40-17da-4c6d-9cd8-0ba350c2e131 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.459185 May 19 08:43:45.498995 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3494/4819] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:45 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:45.509551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:45.510888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:45.541639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:45.544715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:45.546354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:45.548675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:46.181756 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:43:46.182347 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:43:46.196255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3f4df81-fe86-4db8-b26c-1f3a5462b2d4 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1415 microversion: 2.1 time: 0.695934 May 19 08:43:46.199328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3495/4820] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:45 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1415 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:46.519902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:46.520551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:46.529937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:46.530370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:46.531185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:46.531709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:46.941943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:46.956995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:46.961199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:46.965493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98e6ea11-d0b7-4c7c-9116-9115cc481dc7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.450606 May 19 08:43:46.978614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3496/4821] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:46 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:47.216872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:47.217667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:47.227748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:47.229371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:47.230792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:47.231626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:47.721042 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c7b7a41-6afe-416e-9455-809bf3e2a943 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.508727 May 19 08:43:47.733397 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3497/4822] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:47 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:47.991686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:47.992336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:48.005891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:48.006433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:48.007303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:48.007809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:48.181553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:48.225223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:48.229941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:48.233067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c9fd053-a63f-4233-87ad-875ef92332e5 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.251262 May 19 08:43:48.238713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3498/4823] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:47 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 08:43:48.754338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:48.758195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:48.790023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:48.794018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:48.801443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:48.802926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:49.470424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eed24545-5d3b-4f1f-8fd3-9df612ff8cbe tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.721530 May 19 08:43:49.470424 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3499/4824] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:48 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:49.485273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:49.485273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:49.498410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:49.499294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:49.512941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:49.513284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:49.696750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:49.714184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:49.717243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:49.726864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-366adcaf-d691-42ac-8ff8-c0c34fdc07d6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.258621 May 19 08:43:49.741766 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3500/4825] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:49 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:50.483217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:50.483839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:50.497094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:50.497608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:50.501651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:50.502112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:51.133412 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-594cfae6-3cbb-4b46-9684-b7cd2fdd9112 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.654434 May 19 08:43:51.134752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3501/4826] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:50 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:51.147922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:51.148846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:51.162778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:51.164351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:51.166482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:51.167300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:51.323632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:51.339783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:51.343688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:51.346787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f76e2cc8-7506-437e-a343-1b654514894f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.210735 May 19 08:43:51.350312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3502/4827] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:51 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:52.153042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:52.154521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:52.167454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:52.177806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:52.181006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:52.181818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:53.245145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edf97399-64b7-4c86-93aa-811b26b77fae tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 1.095493 May 19 08:43:53.246289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3503/4828] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:52 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:53.258342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-74cff892-b724-46e0-a56f-aeb3fce3fb55 req-aaeb680b-c5fb-435d-9dfd-3f3ed6c7a912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c45ae584-7e0e-4860-962a-78ee5a68671e", "tag": "015923da-5e23-4391-bad6-ff629631eb57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:53.283336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-74cff892-b724-46e0-a56f-aeb3fce3fb55 req-aaeb680b-c5fb-435d-9dfd-3f3ed6c7a912 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:53.283971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-74cff892-b724-46e0-a56f-aeb3fce3fb55 req-aaeb680b-c5fb-435d-9dfd-3f3ed6c7a912 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:53.323597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-74cff892-b724-46e0-a56f-aeb3fce3fb55 req-aaeb680b-c5fb-435d-9dfd-3f3ed6c7a912 service nova] Creating event network-changed:015923da-5e23-4391-bad6-ff629631eb57 for instance c45ae584-7e0e-4860-962a-78ee5a68671e on chh2-842464-2 May 19 08:43:53.343071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-74cff892-b724-46e0-a56f-aeb3fce3fb55 req-aaeb680b-c5fb-435d-9dfd-3f3ed6c7a912 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094477 May 19 08:43:53.347279 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3504/4829] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:43:53.358714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:53.359432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:53.375810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:53.376280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:53.377091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:53.377571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:53.538479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:53.738236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:53.743037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:53.754358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:53.761092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:53.763900 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b2c238f-c386-432f-9877-6bf4c4571f87 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.414928 May 19 08:43:53.766611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3505/4830] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:53 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:54.267755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:54.268249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:54.342683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:54.346244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:54.347495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:54.353697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:54.354442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:54.721172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3398df26-e92b-4417-9866-c7d895fca83a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.457461 May 19 08:43:54.726436 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3506/4831] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:54 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:43:55.129611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1177052447", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:55.262790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] validate_networks() for [('a5dbb39c-8330-4ed4-96de-9daec31a3c5e', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:43:57.228964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:43:57.229594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:43:57.229952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:43:57.230404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:43:57.230847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:43:57.250782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:57.251488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:57.252534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:57.254356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:57.288074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:43:57.304132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for user 3da072a25d5f48ba881df74877fd0325 and project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:43:57.376914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:43:57.383505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:43:57.518147 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-173ebee4-65e0-4b38-aacb-df3aebd43fc7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.784813 May 19 08:43:57.526441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3507/4832] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:43:57.569289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:57.570285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:57.588187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:57.588509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:57.594281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:57.594830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:58.005414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:58.041026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:58.043664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:58.045140 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16741e31-9629-47dc-afec-a11bd8c6464e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.512768 May 19 08:43:58.045937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3508/4833] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:57 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:58.052209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:58.053139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:58.070394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:43:58.072377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:58.072852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:58.073790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:58.074268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:59.109637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa6ce8af-ea82-4e6f-a1f5-0d2138819bb5 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 1.062171 May 19 08:43:59.125613 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3509/4834] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:58 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:59.136120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:59.136668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:59.160239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:59.160712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:59.164671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:59.165253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:59.277528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:59.290310 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-271bf19d-8810-4c37-9460-ebe86a9c6414 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1274 microversion: 2.1 time: 0.163495 May 19 08:43:59.290931 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3510/4835] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:43:59 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:43:59.304016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:43:59.304016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:43:59.317362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:59.319889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:59.322424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:43:59.322893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:43:59.419020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:59.432588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:59.434559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:43:59.436010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f84f6b0-8dbf-4829-9d3e-7ccc6dc32713 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.144060 May 19 08:43:59.437074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3511/4836] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:43:59 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:43:59.443526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-354602932", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:43:59.522522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] validate_networks() for [('a5dbb39c-8330-4ed4-96de-9daec31a3c5e', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:44:00.223679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:44:00.225096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:44:00.225805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:44:00.226387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:44:00.227014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:44:00.239553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:00.240011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:00.240817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:00.241259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:00.263682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:44:00.270539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for user 3da072a25d5f48ba881df74877fd0325 and project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:44:00.287057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:44:00.291014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:44:00.373006 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b6eb7a3-e806-42d6-afe5-32bc841c6dc5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.934370 May 19 08:44:00.376983 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3512/4837] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:43:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:44:00.390645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:00.392294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:00.405802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:00.406523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:00.407537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:00.408190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:00.752114 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3c7fa46-1721-4203-a0e4-f2e478de1195 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.372261 May 19 08:44:00.753143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3513/4838] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:00 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:00.763796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7cc356c-8049-409b-99c1-0caa3fd0faf3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:00.767835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7cc356c-8049-409b-99c1-0caa3fd0faf3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:00.947909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7cc356c-8049-409b-99c1-0caa3fd0faf3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:00.960874 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7cc356c-8049-409b-99c1-0caa3fd0faf3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1221 microversion: 2.1 time: 0.204730 May 19 08:44:00.962035 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3514/4839] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:00 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:00.967047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:00.973173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:00.991883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:00.992453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:00.993162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:00.995292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:01.194712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:01.204701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:01.206671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:01.208381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6110024-26b4-45c6-b6a3-731da19d6c4a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.245156 May 19 08:44:01.221706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3515/4840] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:00 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:01.771521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:01.772676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:01.788647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:01.789216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:01.790487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:01.806237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:02.496407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ab674e8-b31e-41e9-8bce-87227e29b588 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.726697 May 19 08:44:02.508782 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3516/4841] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:01 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:02.531599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:02.533297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:02.559958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:02.560729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:02.562373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:02.563405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:02.974149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:02.991585 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe10b613-0166-477d-9f0d-e6a7f9ee41de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1279 microversion: 2.1 time: 0.481276 May 19 08:44:02.994380 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3517/4842] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:02 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1279 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:03.000739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:03.001503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:03.022315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:03.023533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:03.027342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:03.027342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:03.336330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:03.358213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:03.366701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:03.370977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99322d94-e64b-4c70-95bb-56ae9c4fbb1f tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.372788 May 19 08:44:03.371843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3518/4843] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:02 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:03.387189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-61a8cfbb-2b47-4cb0-9323-50b857bc940f req-8f79d7cd-9c55-4664-ba36-10681da9770a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45ae584-7e0e-4860-962a-78ee5a68671e", "name": "network-vif-plugged", "status": "completed", "tag": "015923da-5e23-4391-bad6-ff629631eb57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:03.426764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-61a8cfbb-2b47-4cb0-9323-50b857bc940f req-8f79d7cd-9c55-4664-ba36-10681da9770a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:03.432517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-61a8cfbb-2b47-4cb0-9323-50b857bc940f req-8f79d7cd-9c55-4664-ba36-10681da9770a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:03.487681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-61a8cfbb-2b47-4cb0-9323-50b857bc940f req-8f79d7cd-9c55-4664-ba36-10681da9770a service nova] Creating event network-vif-plugged:015923da-5e23-4391-bad6-ff629631eb57 for instance c45ae584-7e0e-4860-962a-78ee5a68671e on chh2-842464-2 May 19 08:44:03.514763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-61a8cfbb-2b47-4cb0-9323-50b857bc940f req-8f79d7cd-9c55-4664-ba36-10681da9770a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141199 May 19 08:44:03.516543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3519/4844] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:03.535336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:03.536442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:03.552048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:03.553978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:03.559384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:03.562846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:04.493933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-911e7e00-7757-4321-9501-c7be160e4056 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1463 microversion: 2.1 time: 0.972592 May 19 08:44:04.502878 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3520/4845] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:03 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1463 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:04.518458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:04.520685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:04.536178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:04.537935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:04.540650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:04.541726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:05.245998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:05.272795 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fee3b9a3-7f76-4b57-b445-b85c1aeed321 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1279 microversion: 2.1 time: 0.767758 May 19 08:44:05.276961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3521/4846] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:04 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1279 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:05.301350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:05.305090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:05.332138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:05.333431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:05.337747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:05.338765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:05.498170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:05.533294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:05.546386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:05.549125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdb365cb-4a59-49fb-987d-2283c94c1a22 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1365 microversion: 2.57 time: 0.267005 May 19 08:44:05.550979 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3522/4847] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:05 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:05.573990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-701227f5-7cc9-4602-aade-e18ac53b1831 req-ddaa0cfe-e538-406b-a61a-346aa52bbc25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f022eb8a-9ec0-449f-b422-d1cdc42b8a57", "tag": "77d4b00c-db14-4a58-a6f2-ec4f9e5c668b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:05.611222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-701227f5-7cc9-4602-aade-e18ac53b1831 req-ddaa0cfe-e538-406b-a61a-346aa52bbc25 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:05.613572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-701227f5-7cc9-4602-aade-e18ac53b1831 req-ddaa0cfe-e538-406b-a61a-346aa52bbc25 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:05.652438 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-701227f5-7cc9-4602-aade-e18ac53b1831 req-ddaa0cfe-e538-406b-a61a-346aa52bbc25 service nova] Creating event network-changed:77d4b00c-db14-4a58-a6f2-ec4f9e5c668b for instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 on chh1-842464-2 May 19 08:44:05.673437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-701227f5-7cc9-4602-aade-e18ac53b1831 req-ddaa0cfe-e538-406b-a61a-346aa52bbc25 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119053 May 19 08:44:05.680821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3523/4848] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:05.697820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:05.701081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:05.725093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:05.725987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:05.727026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:05.727729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:06.379978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-094d221b-13fa-4292-aa5e-3c78e839be43 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1647 microversion: 2.1 time: 0.696643 May 19 08:44:06.383450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3524/4849] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:05 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1647 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:06.398221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:06.399086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:06.416176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:06.416940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:06.418006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:06.418674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:06.748971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:06.803735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98e53f7a-7e94-4a56-9bf8-db2badc19c72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1279 microversion: 2.1 time: 0.406821 May 19 08:44:06.806067 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3525/4850] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:06 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1279 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:06.825838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:06.827293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:06.851116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:06.855118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:06.856315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:06.858608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:06.919538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:07.920865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01ef1c04-b2e0-4d48-a206-3983888e55a7 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1647 microversion: 2.1 time: 1.112702 May 19 08:44:07.933470 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3526/4851] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:06 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1647 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:07.958487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:07.959407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:07.967913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:07.969015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:07.970223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:07.970865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:08.422100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:08.447779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:08.457274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:08.459131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6eb690fa-98a0-43aa-957b-6955f29e3d1a tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1371 microversion: 2.57 time: 0.520900 May 19 08:44:08.461147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3527/4852] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:07 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1371 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:08.484839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:08.485625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:08.506040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:08.506506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:08.510495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:08.510964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:09.416430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:09.430177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f68d9dae-be59-4394-908d-d8b27e0902fd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1321 microversion: 2.1 time: 0.965971 May 19 08:44:09.431200 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3528/4853] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:08 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1321 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:09.436461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:09.444439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:09.460730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:09.462123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:09.462853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:09.463518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:10.281989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:10.310898 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-707790e2-ef04-4e76-a653-cf8783690c1e tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1647 microversion: 2.1 time: 0.878327 May 19 08:44:10.329984 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3529/4854] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:09 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1647 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:10.353765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:10.369587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:10.398672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:10.399147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:10.399965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:10.407691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:10.518371 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a69f5222-3b2d-4d4a-b4e4-2d60bdc37c4f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181558 May 19 08:44:10.531947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3530/4855] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:44:10 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431/os-volume_attachments => generated 25 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:44:10.538953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:10.540463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:10.550507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:10.551254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:10.553576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:10.557346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:10.851866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:10.892186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:10.897359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:10.900813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d442863c-f0d9-4ba1-b311-8f86b535e01c tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1356 microversion: 2.57 time: 0.366875 May 19 08:44:10.902345 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3531/4856] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:10 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1356 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:10.932913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:10.935031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:10.954914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:10.967495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:10.968599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:10.971698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:10.974258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:11.074002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:44:11.383424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19a95187-154e-4353-9506-c7945e3a519c tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 204 len: 0 microversion: 2.1 time: 0.465242 May 19 08:44:11.384205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3532/4857] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:44:10 2022] DELETE /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:44:11.404822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:11.405955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:11.436362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:11.440366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:11.441674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:11.442214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:12.198372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:12.215536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7af55b5f-068c-473c-bd8d-9553cfffec77 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1321 microversion: 2.1 time: 0.829772 May 19 08:44:12.216162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3533/4858] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:11 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1321 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:12.234545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:12.235618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:12.245624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:12.250318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:12.251561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:12.254072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:12.325345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:44:12.632770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c78746fe-6141-4167-af25-dc859a23ceec tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 204 len: 0 microversion: 2.1 time: 0.415298 May 19 08:44:12.634063 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3534/4859] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:44:12 2022] DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:44:12.640436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:12.644204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:12.662051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:12.662511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:12.663309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:12.663746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:12.725617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:44:12.948420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0375f5e-1b28-465c-a06a-b32da7eb17f4 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 204 len: 0 microversion: 2.57 time: 0.311602 May 19 08:44:12.949084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3535/4860] 10.222.0.78 () {60 vars in 1279 bytes} [Thu May 19 08:44:12 2022] DELETE /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 08:44:12.968838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-87757895-ef0e-40dc-89b2-de628fd3a3d7 req-cabff2c2-6af3-47b3-b45b-0862395f3eea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c32265-6611-4a95-92aa-d5d2ca3181cf", "tag": "6667f33d-f684-4bed-8f29-9b0613d06aec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:12.996213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87757895-ef0e-40dc-89b2-de628fd3a3d7 req-cabff2c2-6af3-47b3-b45b-0862395f3eea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:12.996854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87757895-ef0e-40dc-89b2-de628fd3a3d7 req-cabff2c2-6af3-47b3-b45b-0862395f3eea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:13.012932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-87757895-ef0e-40dc-89b2-de628fd3a3d7 req-cabff2c2-6af3-47b3-b45b-0862395f3eea service nova] Creating event network-changed:6667f33d-f684-4bed-8f29-9b0613d06aec for instance b9c32265-6611-4a95-92aa-d5d2ca3181cf on chh1-842464-2 May 19 08:44:13.021805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-87757895-ef0e-40dc-89b2-de628fd3a3d7 req-cabff2c2-6af3-47b3-b45b-0862395f3eea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065769 May 19 08:44:13.023073 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3536/4861] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:13.032873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:13.033656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:13.043521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:13.044249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:13.045142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:13.046126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:13.983177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d259c421-1253-4dc6-a5de-143f4948412d tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1653 microversion: 2.1 time: 0.953866 May 19 08:44:13.990889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3537/4862] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:13 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1653 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:13.996171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:14.005279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:14.021819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:14.022701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:14.023767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:14.024464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:14.093896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:14.584889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:14.596454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0951e8f7-8d17-4566-9e19-dbd9dc544083 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1672 microversion: 2.1 time: 0.604170 May 19 08:44:14.597621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3538/4863] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:13 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1672 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:14.610898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:14.611954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:14.620091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:14.623540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:14.626957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:14.627799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:14.822537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:14.853278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:14.859371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:14.862102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abe91e1e-79a5-4be0-be8a-c321cc4021a7 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1362 microversion: 2.57 time: 0.258598 May 19 08:44:14.865411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3539/4864] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:14 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:14.895355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:14.896208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:14.920624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:14.921698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:14.923175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:14.923924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:15.778033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:15.800241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc55a7c3-7437-4ffd-9c2a-f6eb0aeef144 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1321 microversion: 2.1 time: 0.905594 May 19 08:44:15.802021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3540/4865] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:14 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1321 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:15.808415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-30f30d0e-e987-47ef-bef7-8e7832071259 req-d7d5fbc2-1a0d-4e43-936f-f2e051ed2dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022eb8a-9ec0-449f-b422-d1cdc42b8a57", "name": "network-vif-plugged", "status": "completed", "tag": "77d4b00c-db14-4a58-a6f2-ec4f9e5c668b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:15.884725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-30f30d0e-e987-47ef-bef7-8e7832071259 req-d7d5fbc2-1a0d-4e43-936f-f2e051ed2dcd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:15.885426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-30f30d0e-e987-47ef-bef7-8e7832071259 req-d7d5fbc2-1a0d-4e43-936f-f2e051ed2dcd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:15.932408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-30f30d0e-e987-47ef-bef7-8e7832071259 req-d7d5fbc2-1a0d-4e43-936f-f2e051ed2dcd service nova] Creating event network-vif-plugged:77d4b00c-db14-4a58-a6f2-ec4f9e5c668b for instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 on chh1-842464-2 May 19 08:44:15.948634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-30f30d0e-e987-47ef-bef7-8e7832071259 req-d7d5fbc2-1a0d-4e43-936f-f2e051ed2dcd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144007 May 19 08:44:15.951812 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3541/4866] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:15.970720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:15.972691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:15.981282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:15.994454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:15.995495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:15.996671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:15.997362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:16.047958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:16.048953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:16.049996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lazy-loading 'fault' on Instance uuid c45ae584-7e0e-4860-962a-78ee5a68671e {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:44:16.267730 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4eb09d5-2494-4d1e-926c-454fb190560a tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 200 len: 1453 microversion: 2.1 time: 0.312747 May 19 08:44:16.276271 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3542/4867] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:15 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 1453 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:16.301154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9c495dbc-4904-42c8-8cc6-8c4905cb59e0 req-0b635cef-5a36-4f46-be8c-66fa5f6e3a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c45ae584-7e0e-4860-962a-78ee5a68671e", "name": "network-vif-deleted", "tag": "015923da-5e23-4391-bad6-ff629631eb57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:16.336939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9c495dbc-4904-42c8-8cc6-8c4905cb59e0 req-0b635cef-5a36-4f46-be8c-66fa5f6e3a64 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:16.338825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9c495dbc-4904-42c8-8cc6-8c4905cb59e0 req-0b635cef-5a36-4f46-be8c-66fa5f6e3a64 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:16.362145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9c495dbc-4904-42c8-8cc6-8c4905cb59e0 req-0b635cef-5a36-4f46-be8c-66fa5f6e3a64 service nova] Creating event network-vif-deleted:015923da-5e23-4391-bad6-ff629631eb57 for instance c45ae584-7e0e-4860-962a-78ee5a68671e on chh2-842464-2 May 19 08:44:16.384718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9c495dbc-4904-42c8-8cc6-8c4905cb59e0 req-0b635cef-5a36-4f46-be8c-66fa5f6e3a64 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105957 May 19 08:44:16.389737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3543/4868] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:16.403021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:16.405262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:16.423387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:16.428678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:16.429653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:16.436280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:17.337638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:17.354136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20264cfe-96a1-4fcf-ac2c-d3820b208dc0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1672 microversion: 2.1 time: 0.962108 May 19 08:44:17.355408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3544/4869] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:16 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1672 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:17.372659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:17.373874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:17.385914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:17.390588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:17.397017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:17.399240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:17.678260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:17.709431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:17.712892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '245ce1a6a6df41b1b8062892d02e4b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badf7712d7094aa1b15705950bfa038c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:17.722812 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6db36454-a05b-44df-9c03-d83b4ae6eb1e tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 200 len: 1362 microversion: 2.57 time: 0.364682 May 19 08:44:17.730206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3545/4870] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:17 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 08:44:17.748137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:17.749096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:17.764542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:17.765010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:17.769542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:17.770118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:19.250307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:19.282105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df17ece9-aa21-4409-803a-3090d072f6b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1321 microversion: 2.1 time: 1.542057 May 19 08:44:19.283707 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3546/4871] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:17 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1321 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:19.306099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:19.308260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: c45ae584-7e0e-4860-962a-78ee5a68671e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:19.352179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:19.352780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:19.353696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:19.356954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:19.395069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] HTTP exception thrown: Instance c45ae584-7e0e-4860-962a-78ee5a68671e could not be found. May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Request method failure captured: May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e HTTP/1.1 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgMlM2d1a1EtqRIeWWLXOZ3EIUvHzB-1SfHEeUeVubutxnQF5mUY3s9u0JoaHAnJXnbax6TsIk9x8UqMm0gxiO_2nTchXq6ALuro-PRFO9op6U37zfnGUvpbAmhw8e-tIpiZAq2__eFtB23F4e6tQs4HPxgCJBMe5MIXeikv_vAGFG8 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 480ba39f3c8c4e23a3e84686a343afce May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestServerMultinode-6038978 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestServerMultinode-6038978 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 480ba39f3c8c4e23a3e84686a343afce May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestServerMultinode-6038978 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestServerMultinode-6038978-project-admin May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6135dade37e04910b66d0b17b2cffdb9 May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestServerMultinode-6038978-project-admin May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance c45ae584-7e0e-4860-962a-78ee5a68671e could not be found. May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'c45ae584-7e0e-4860-962a-78ee5a68671e'} May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c45ae584-7e0e-4860-962a-78ee5a68671e could not be found. May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c45ae584-7e0e-4860-962a-78ee5a68671e could not be found. May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:19.397433 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c45ae584-7e0e-4860-962a-78ee5a68671e could not be found. May 19 08:44:19.403506 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:19.471232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Returning 404 to user: Instance c45ae584-7e0e-4860-962a-78ee5a68671e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:44:19.474090 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4165238-1798-42ec-85bb-f690a96b4aeb tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e" status: 404 len: 111 microversion: 2.1 time: 0.188154 May 19 08:44:19.478007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3547/4872] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:19 2022] GET /compute/v2.1/servers/c45ae584-7e0e-4860-962a-78ee5a68671e => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:44:19.487979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:19.488660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:19.514987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:19.515453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:19.516352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:19.516813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:19.799661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:19.825135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e27da4b-5699-45ec-b9fa-16fd2672ac71 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 200 len: 1606 microversion: 2.1 time: 0.343449 May 19 08:44:19.825898 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3548/4873] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:19 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 1606 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:19.841861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aafd49b0-f3b8-4059-861a-395c7d20a788 req-5f1e33e9-5a7c-41ec-a804-4ece403ed4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c32265-6611-4a95-92aa-d5d2ca3181cf", "name": "network-vif-plugged", "status": "completed", "tag": "6667f33d-f684-4bed-8f29-9b0613d06aec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:19.878807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aafd49b0-f3b8-4059-861a-395c7d20a788 req-5f1e33e9-5a7c-41ec-a804-4ece403ed4c8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:19.879140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aafd49b0-f3b8-4059-861a-395c7d20a788 req-5f1e33e9-5a7c-41ec-a804-4ece403ed4c8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:19.915190 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aafd49b0-f3b8-4059-861a-395c7d20a788 req-5f1e33e9-5a7c-41ec-a804-4ece403ed4c8 service nova] Creating event network-vif-plugged:6667f33d-f684-4bed-8f29-9b0613d06aec for instance b9c32265-6611-4a95-92aa-d5d2ca3181cf on chh1-842464-2 May 19 08:44:19.933501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aafd49b0-f3b8-4059-861a-395c7d20a788 req-5f1e33e9-5a7c-41ec-a804-4ece403ed4c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105397 May 19 08:44:19.934135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3549/4874] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:19.989102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:19.990071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] [instance: 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:20.018720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:20.019186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:20.020001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:20.020451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:20.056272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] HTTP exception thrown: Instance 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 could not be found. May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Request method failure captured: May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 HTTP/1.1 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgMxm2PKXOhIoV9cKO4UMfj5MjxrSiMu38NV3Y1ulqjm60feci00WloXd0bS20hi3cAwAXZkpgAY3c4T879dKzqvWMf0kFRiubsVwtZhztJX9fV0bq919aBXxO0GM1mK6aui97gLLZ3kJkcz7zVFnaPA8dHlyKVqEAx5L3hO_ILYDvM May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Openstack-Nova-Api-Version: 2.57 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: badf7712d7094aa1b15705950bfa038c May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerShowV257Test-1666495649 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/badf7712d7094aa1b15705950bfa038c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/badf7712d7094aa1b15705950bfa038c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_badf7712d7094aa1b15705950bfa038c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/badf7712d7094aa1b15705950bfa038c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerShowV257Test-1666495649 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: badf7712d7094aa1b15705950bfa038c May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerShowV257Test-1666495649 May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerShowV257Test-1666495649-project May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 245ce1a6a6df41b1b8062892d02e4b0e May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerShowV257Test-1666495649-project May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 could not be found. May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6'} May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 could not be found. May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 could not be found. May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:20.063528 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 could not be found. May 19 08:44:20.070085 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:20.071797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] Returning 404 to user: Instance 8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:44:20.072920 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bcb48cd9-c9af-44ac-bd79-3a9f297fdab6 tempest-ServerShowV257Test-1666495649 tempest-ServerShowV257Test-1666495649-project] 10.222.0.78 "GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6" status: 404 len: 111 microversion: 2.57 time: 0.137383 May 19 08:44:20.078184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3550/4875] 10.222.0.78 () {60 vars in 1276 bytes} [Thu May 19 08:44:19 2022] GET /compute/v2.1/servers/8a3ca8a7-c112-437f-b7ea-2cfdb35dddc6 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 08:44:20.099095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:20.113289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:20.135739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:20.139983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:20.141109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:20.143269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:20.210545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:44:20.474186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa1f88a0-ce36-4546-aa31-d24d84a75797 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 204 len: 0 microversion: 2.1 time: 0.394176 May 19 08:44:20.476228 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3551/4876] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:44:20 2022] DELETE /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:44:20.482378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:20.483097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:20.516449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:20.517171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:20.518175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:20.521366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:21.765211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:21.776967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-626a8c6a-2745-4e07-b8f2-71c4f3a01079 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1321 microversion: 2.1 time: 1.298774 May 19 08:44:21.792916 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3552/4877] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:20 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1321 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:21.815703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:21.820483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:21.836918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:21.840424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:21.843451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:21.844341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:23.334385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b03c9284-c41d-43db-a5b5-a0b0bc782c59 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1653 microversion: 2.1 time: 1.534643 May 19 08:44:23.337110 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3553/4878] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:21 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1653 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:23.348605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-403d45ee-2c2e-4201-93f4-5ec753f3a047 req-037326e9-7484-435e-92f1-23eba041d322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ede4f4-ba88-460e-9998-80e614faf431", "name": "network-vif-deleted", "tag": "26c2d915-769d-4b52-85a7-9fd235199d22"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:23.376969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-403d45ee-2c2e-4201-93f4-5ec753f3a047 req-037326e9-7484-435e-92f1-23eba041d322 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:23.380042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-403d45ee-2c2e-4201-93f4-5ec753f3a047 req-037326e9-7484-435e-92f1-23eba041d322 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:23.415267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-403d45ee-2c2e-4201-93f4-5ec753f3a047 req-037326e9-7484-435e-92f1-23eba041d322 service nova] Creating event network-vif-deleted:26c2d915-769d-4b52-85a7-9fd235199d22 for instance 35ede4f4-ba88-460e-9998-80e614faf431 on chh1-842464-2 May 19 08:44:23.428451 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-403d45ee-2c2e-4201-93f4-5ec753f3a047 req-037326e9-7484-435e-92f1-23eba041d322 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087871 May 19 08:44:23.432268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3554/4879] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:23.444779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:23.449014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:23.469264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:23.470343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:23.472006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:23.473654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:23.526875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] HTTP exception thrown: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Request method failure captured: May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 HTTP/1.1 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJhiE5z1mSmdDhoz_h658wNGCzc6AcwUs1me2-3p0Un0lFreX73k4m_Qu8eULEXMsX5oogk-rwBY8_UCrpxZDGtfGeTRLkr7-vHXzZg4LqXmnViCCy10o-wj65hzaqEBQJzRP0woM1Y6R7n8Ph-EdlJDgD3XoqtgcYLnNqxsdkOgtE May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b5544135087c43e9929fee886ac58afd May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5544135087c43e9929fee886ac58afd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5544135087c43e9929fee886ac58afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeTestJSON-1387471750 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b5544135087c43e9929fee886ac58afd May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 982a8a134680453bb66192b6d7cbb477 May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '35ede4f4-ba88-460e-9998-80e614faf431'} May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:23.529010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:44:23.537145 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:23.542304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Returning 404 to user: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:44:23.543303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7422e830-c573-45c4-bc96-1ac919d81f4c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 404 len: 111 microversion: 2.1 time: 0.108675 May 19 08:44:23.544017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3555/4880] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:23 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:44:23.549404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:23.551083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:23.567599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:23.568813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:23.570890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:23.571935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:25.438326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:25.465067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e24eaf8f-910c-4514-8b76-caa31c8abd73 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1515 microversion: 2.1 time: 1.917180 May 19 08:44:25.469300 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3556/4881] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:23 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1515 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:25.487599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-074414bb-41ec-4352-8181-f993785a940f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '.version_select at 0x7f3211ad2040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:25.529067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-074414bb-41ec-4352-8181-f993785a940f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-667494726" status: 202 len: 0 microversion: 2.1 time: 0.057384 May 19 08:44:25.537849 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3557/4882] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-667494726 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:44:25.551823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:25.552462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:25.574571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:25.575311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:25.576285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:25.576904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:25.993803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:26.010116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65996be3-25e1-49d5-8b78-e7a512b89598 tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 200 len: 1611 microversion: 2.1 time: 0.470263 May 19 08:44:26.013129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3558/4883] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:25 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 1611 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:26.032279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:26.036596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:26.058395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:26.062503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:26.084306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:26.085263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:26.233989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lazy-loading 'flavor' on Instance uuid b9c32265-6611-4a95-92aa-d5d2ca3181cf {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:44:26.530480 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4955e73-8920-4de5-b01d-93cf89191ee8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action" status: 200 len: 32 microversion: 2.1 time: 0.513337 May 19 08:44:26.531325 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3559/4884] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:44:26 2022] POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:44:26.575995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-da883468-a765-4b9f-a722-1aad8b258b20 req-9bbaeb1e-78fb-45a9-b280-b29a146a3de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b7e128-d56e-4934-abf0-dbb6271852f7", "name": "network-vif-deleted", "tag": "dc09f305-58e2-418e-897e-f42b5e6d48bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:26.637837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-da883468-a765-4b9f-a722-1aad8b258b20 req-9bbaeb1e-78fb-45a9-b280-b29a146a3de6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:26.640554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-da883468-a765-4b9f-a722-1aad8b258b20 req-9bbaeb1e-78fb-45a9-b280-b29a146a3de6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:26.692666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-da883468-a765-4b9f-a722-1aad8b258b20 req-9bbaeb1e-78fb-45a9-b280-b29a146a3de6 service nova] Creating event network-vif-deleted:dc09f305-58e2-418e-897e-f42b5e6d48bd for instance 27b7e128-d56e-4934-abf0-dbb6271852f7 on chh1-842464-2 May 19 08:44:26.713469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-da883468-a765-4b9f-a722-1aad8b258b20 req-9bbaeb1e-78fb-45a9-b280-b29a146a3de6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156813 May 19 08:44:26.715655 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3560/4885] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:26.733162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:26.738132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:26.770421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:26.771473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:26.772872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:26.780102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:27.643065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:27.653813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bef7bab6-6074-49ef-bf7a-578bd6edc505 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.935628 May 19 08:44:27.654429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3561/4886] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:26 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:27.663360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:27.664437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] [instance: 27b7e128-d56e-4934-abf0-dbb6271852f7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:27.684419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:27.684419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:27.685593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:27.686310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:27.762664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] HTTP exception thrown: Instance 27b7e128-d56e-4934-abf0-dbb6271852f7 could not be found. May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Request method failure captured: May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 HTTP/1.1 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgMlM2d1a1EtqRIeWWLXOZ3EIUvHzB-1SfHEeUeVubutxnQF5mUY3s9u0JoaHAnJXnbax6TsIk9x8UqMm0gxiO_2nTchXq6ALuro-PRFO9op6U37zfnGUvpbAmhw8e-tIpiZAq2__eFtB23F4e6tQs4HPxgCJBMe5MIXeikv_vAGFG8 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 480ba39f3c8c4e23a3e84686a343afce May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestServerMultinode-6038978 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/480ba39f3c8c4e23a3e84686a343afce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestServerMultinode-6038978 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 480ba39f3c8c4e23a3e84686a343afce May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestServerMultinode-6038978 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestServerMultinode-6038978-project-admin May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 6135dade37e04910b66d0b17b2cffdb9 May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestServerMultinode-6038978-project-admin May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 27b7e128-d56e-4934-abf0-dbb6271852f7 could not be found. May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '27b7e128-d56e-4934-abf0-dbb6271852f7'} May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b7e128-d56e-4934-abf0-dbb6271852f7 could not be found. May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b7e128-d56e-4934-abf0-dbb6271852f7 could not be found. May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:27.766842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b7e128-d56e-4934-abf0-dbb6271852f7 could not be found. May 19 08:44:27.773475 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:27.789580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] Returning 404 to user: Instance 27b7e128-d56e-4934-abf0-dbb6271852f7 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:44:27.790865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3970354e-fa0a-498c-ace7-42416c140bba tempest-TestServerMultinode-6038978 tempest-TestServerMultinode-6038978-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7" status: 404 len: 111 microversion: 2.1 time: 0.135369 May 19 08:44:27.791545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3562/4887] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:27 2022] GET /compute/v2.1/servers/27b7e128-d56e-4934-abf0-dbb6271852f7 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:44:27.799455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e17a5783-6c20-4611-9595-44e1e7ec2ee5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: .version_select at 0x7f321206d5e0>, body: {"keypair": {"name": "tempest-keypair-1604550591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzjL1Nb1rTGwQJU5ikvC2Srmsn1Wnb6Q2WuYHzTBazZ9DPpN84sf9PS/bkEOmKzDU0AQkstgbGQgyyS22ZLURiuSAYZTHZosztcXmSwK+sZAiTllrEai0go3ZyW8surg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:27.824089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e17a5783-6c20-4611-9595-44e1e7ec2ee5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for project b5544135087c43e9929fee886ac58afd. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:44:27.834063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e17a5783-6c20-4611-9595-44e1e7ec2ee5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for user 982a8a134680453bb66192b6d7cbb477 and project b5544135087c43e9929fee886ac58afd. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:44:27.895394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e17a5783-6c20-4611-9595-44e1e7ec2ee5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098957 May 19 08:44:27.902851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3563/4888] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:44:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:28.673341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:28.676177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:28.703143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:28.704422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:28.710740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:28.711461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:29.656621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:29.686068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 1.017385 May 19 08:44:29.689268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3564/4889] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:28 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:30.468247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:30.469723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30d813ab-7b4f-4e1f-9647-324a7a75c58e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001963 May 19 08:44:30.470252 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3565/4890] 10.222.0.78 () {56 vars in 885 bytes} [Thu May 19 08:44:30 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 19 08:44:30.708027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:30.709495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:30.729362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:30.731849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:30.734553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:30.736609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:31.549067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:31.571715 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbabb015-e722-41c2-bd99-8f3ec2a6afb7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.867385 May 19 08:44:31.572999 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3566/4891] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:30 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:32.602723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:32.606676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:32.629745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:32.630271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:32.632418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:32.635321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:33.740479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:33.782235 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6090a81-2aa1-4726-b0b2-5ead30a51ae3 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 1.195727 May 19 08:44:33.782873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3567/4892] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:32 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:33.797663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1585511747", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6fde95d-7231-4c7b-9cf2-edbbe1908c28"}], "security_groups": [{"name": "tempest-securitygroup--2093713254"}], "key_name": "tempest-keypair-1604550591", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:34.278498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] validate_networks() for [('e6fde95d-7231-4c7b-9cf2-edbbe1908c28', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:44:36.826812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:44:36.827526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:44:36.828446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:44:36.828868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:44:36.829286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:44:36.858469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:36.859338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:36.880673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:36.881653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:36.935840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for project b5544135087c43e9929fee886ac58afd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:44:36.961833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Getting quotas for user 982a8a134680453bb66192b6d7cbb477 and project b5544135087c43e9929fee886ac58afd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:44:37.036692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:44:37.048072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:44:37.208700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edcdb932-97c5-4975-be7e-2c9e3679e664 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.423259 May 19 08:44:37.210349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3568/4893] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:44:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:44:37.225606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:37.248453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:37.279746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:37.280313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:37.285038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:37.286713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:38.441024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:38.459790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a931d651-0c3a-4ebf-9315-7fd35b21b4eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 1.247653 May 19 08:44:38.461922 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3569/4894] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:37 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:38.940337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c450388-cfa0-49ed-817a-0d3f7c189a6f tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] Calling method '.version_select at 0x7f3211a3b700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:39.131726 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c450388-cfa0-49ed-817a-0d3f7c189a6f tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32/defaults" status: 200 len: 371 microversion: 2.1 time: 0.655257 May 19 08:44:39.133815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3570/4895] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:44:38 2022] GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32/defaults => generated 371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:39.151574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:39.153778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:39.175822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:39.177962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:39.179046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:39.181909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:39.432186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:39.442663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa26a62e-31bb-48d8-991f-77bb210918e6 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1308 microversion: 2.1 time: 0.306813 May 19 08:44:39.446273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3571/4896] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:39 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:39.458888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a744910-aac1-4d07-af8c-ae93804781a3 tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] Calling method '.version_select at 0x7f3211a3ba60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:39.630647 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a744910-aac1-4d07-af8c-ae93804781a3 tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32" status: 200 len: 371 microversion: 2.1 time: 0.182876 May 19 08:44:39.631264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3572/4897] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:44:39 2022] GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32 => generated 371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:39.657407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:39.658149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:39.682157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:39.682839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:39.683958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:39.684408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:40.291217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:40.299527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46a0f4dd-7df3-44e5-932c-c199c812244c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.652190 May 19 08:44:40.300612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3573/4898] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:39 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:40.326951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76b79289-70a3-4745-8dea-a956b664bdde tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] Calling method '.version_select at 0x7f3211a3bee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:40.453045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:40.458429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76b79289-70a3-4745-8dea-a956b664bdde tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32/defaults" status: 200 len: 371 microversion: 2.1 time: 0.151342 May 19 08:44:40.466249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3574/4899] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:44:40 2022] GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32/defaults => generated 371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:40.489713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:40.490722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:40.519625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:40.520283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:40.521282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:40.521937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:40.868860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:40.887319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d57419f9-2377-49fd-9ebf-fdadbc86b9c4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1296 microversion: 2.1 time: 0.411454 May 19 08:44:40.887935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3575/4900] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:40 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1296 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:40.899501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-700b9792-254d-4a13-9084-3c191bd692c2 tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] Calling method '.version_select at 0x7f3211c7c310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:41.132754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-700b9792-254d-4a13-9084-3c191bd692c2 tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32" status: 200 len: 371 microversion: 2.1 time: 0.236779 May 19 08:44:41.134215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3576/4901] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 08:44:40 2022] GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32 => generated 371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:41.148318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a79f8603-f35e-44b0-8cbc-b5aad5a676c7 tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] Calling method '.version_select at 0x7f3212208dc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:41.372574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a79f8603-f35e-44b0-8cbc-b5aad5a676c7 tempest-QuotasTestJSON-1659573924 tempest-QuotasTestJSON-1659573924-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32?user_id=594f9fd579164be0b3c839258ff4c477" status: 200 len: 371 microversion: 2.1 time: 0.231050 May 19 08:44:41.374162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3577/4902] 10.222.0.78 () {58 vars in 1322 bytes} [Thu May 19 08:44:41 2022] GET /compute/v2.1/os-quota-sets/f7e8aa764895478496d27f6b65ec3c32?user_id=594f9fd579164be0b3c839258ff4c477 => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:44:41.380027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:41.381025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:41.392189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:41.398251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:41.400321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:41.401086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:42.063192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:42.102603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12292e5b-b6d1-42b5-993c-5a282354b98f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.727035 May 19 08:44:42.105220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3578/4903] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:41 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:42.122684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:42.128664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:42.178041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:42.178802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:42.181272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:42.182194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:42.543296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:42.557544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-99735b09-a9e2-4d3e-8b17-18a8b12b1edc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1296 microversion: 2.1 time: 0.449378 May 19 08:44:42.558809 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3579/4904] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:42 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1296 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:43.124323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:43.124998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:43.150780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:43.151229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:43.152225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:43.152654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:43.807870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:43.820496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87004889-e90b-4edc-ba61-fb7223feafbb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.700691 May 19 08:44:43.832171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3580/4905] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:43 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:43.849123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:43.851697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:43.868109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:43.869036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:43.870131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:43.875546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:44.412362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:44.429012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-076d74ca-7ac3-43f6-878a-a6b3643d00d8 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 0.595299 May 19 08:44:44.429664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3581/4906] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:43 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:44.842692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:44.842692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:44.850607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:44.851099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:44.851926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:44.852384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:44.897977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:46.232027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:46.280975 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a7782db-6a4c-4846-900c-5ffe8ceb8e27 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 1.444225 May 19 08:44:46.284171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3582/4907] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:44 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:46.299023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:46.300380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:46.320618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:46.322798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:46.325762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:46.327949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:46.904044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:47.239838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:47.259409 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26d183a9-a902-4dce-ae8c-9ab6d6c7303d tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 0.970332 May 19 08:44:47.261141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3583/4908] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:46 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:47.301239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:47.302205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:47.308797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:47.309839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:47.310852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:47.311582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:47.857741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:47.881748 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1987be00-67e2-4b48-8c3f-14419aab50af tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.585162 May 19 08:44:47.889405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3584/4909] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:47 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:48.279013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:48.280596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:48.301011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:48.305915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:48.307302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:48.308016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:49.285085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:49.303602 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d271bc3-f5ba-4915-acf3-18115d171085 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 1.025619 May 19 08:44:49.305164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3585/4910] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:48 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:49.317031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d290d506-ab73-42be-b554-82b38bad8aac req-474f0dfe-32e5-4184-a5a8-4ac97c9d39a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d232c78-9c4b-42bf-a485-951ffbb7b009", "tag": "927dee13-92fc-4315-94a2-8a1460261ef9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:49.340866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d290d506-ab73-42be-b554-82b38bad8aac req-474f0dfe-32e5-4184-a5a8-4ac97c9d39a9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:49.341695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d290d506-ab73-42be-b554-82b38bad8aac req-474f0dfe-32e5-4184-a5a8-4ac97c9d39a9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:49.374229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d290d506-ab73-42be-b554-82b38bad8aac req-474f0dfe-32e5-4184-a5a8-4ac97c9d39a9 service nova] Creating event network-changed:927dee13-92fc-4315-94a2-8a1460261ef9 for instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 on chh2-842464-2 May 19 08:44:49.386130 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d290d506-ab73-42be-b554-82b38bad8aac req-474f0dfe-32e5-4184-a5a8-4ac97c9d39a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077952 May 19 08:44:49.388809 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3586/4911] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:44:49.401222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:49.403008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:49.420656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:49.426200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:49.427496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:49.428150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:49.912038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:49.930670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d022ec6-ca9a-4880-8069-eebb6670627d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.540651 May 19 08:44:49.931539 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3587/4912] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:49 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:50.322003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:50.322591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:50.341045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:50.343420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:50.350302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:50.352616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:50.786981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:50.804382 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d83b6623-892c-4ca3-acf4-3e67997f7023 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 0.486529 May 19 08:44:50.811639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3588/4913] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:50 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:50.949762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:50.950856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:50.965634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:50.966401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:50.972355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:50.973192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:51.364680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=18 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:44:51.485288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:51.495753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dff1366c-2816-4564-8bf8-b7488fea1981 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1521 microversion: 2.1 time: 0.550648 May 19 08:44:51.517243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3589/4914] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:50 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:51.825366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:51.826006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:51.841326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:51.841873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:51.842992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:51.843457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:53.294197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:53.321279 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2863c37c-59c9-4a6c-9db8-510da283e345 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 1.500036 May 19 08:44:53.332220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3590/4915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:51 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:44:53.340400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:53.341078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:53.361513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:53.364043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:53.365145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:53.365643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:54.642368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:54.663230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eba8ea52-dca3-4268-97e1-f1b5a3d13ec7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1501 microversion: 2.1 time: 1.332079 May 19 08:44:54.665649 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3591/4916] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:53 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1501 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:54.684828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:54.685713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:54.713504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:54.714500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:54.718770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:54.719785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:55.556825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:55.565346 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3bde616-7188-4b49-a95e-0c9124ed135f tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 0.896513 May 19 08:44:55.571378 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3592/4917] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:54 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:55.583833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:55.586437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:55.598263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:55.598729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:55.605936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:55.606470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:56.156239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:56.172511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b82dc09a-32f2-4ef6-a7f1-10fee97e7499 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1516 microversion: 2.1 time: 0.599881 May 19 08:44:56.182280 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3593/4918] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:55 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1516 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:56.200354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a79b90bf-6941-4ac1-9a67-2982e2ea31bf tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:56.212233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a79b90bf-6941-4ac1-9a67-2982e2ea31bf tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:56.245485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a79b90bf-6941-4ac1-9a67-2982e2ea31bf tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Instance 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1 could not be found. May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a79b90bf-6941-4ac1-9a67-2982e2ea31bf tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/1d4fc056-f49d-4097-b472-6f9f3f5fa2e1/action HTTP/1.1 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 14 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: {"rescue": {}} May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1 could not be found. May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1d4fc056-f49d-4097-b472-6f9f3f5fa2e1', 'body': {'rescue': {}}} May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1 could not be found. May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1 could not be found. May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:56.256605 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1 could not be found. May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a79b90bf-6941-4ac1-9a67-2982e2ea31bf tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 404 to user: Instance 1d4fc056-f49d-4097-b472-6f9f3f5fa2e1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a79b90bf-6941-4ac1-9a67-2982e2ea31bf tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/1d4fc056-f49d-4097-b472-6f9f3f5fa2e1/action" status: 404 len: 111 microversion: 2.1 time: 0.065621 May 19 08:44:56.268009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3594/4919] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:44:56 2022] POST /compute/v2.1/servers/1d4fc056-f49d-4097-b472-6f9f3f5fa2e1/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:44:56.297839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:56.310271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:56.334840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:56.347650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:56.348720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:56.349184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:56.539660 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1504b19c-bae0-48f1-84ea-71778e7d4242 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action" status: 202 len: 0 microversion: 2.1 time: 0.271929 May 19 08:44:56.548433 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3595/4920] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:44:56 2022] POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:44:56.565951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:56.566771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:56.597145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:56.598253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:56.602329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:56.610105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:57.737939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:57.770718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7df6772-81e2-4139-b519-7e68a8939a1c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1521 microversion: 2.1 time: 1.219351 May 19 08:44:57.771861 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3596/4921] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:56 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1521 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:57.790343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:57.809486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:57.840659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:57.841136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:57.850348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:57.851052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:58.566284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:58.580313 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-223b21d8-1915-47df-8874-7e11f43c7d5c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 0.806820 May 19 08:44:58.581266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3597/4922] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:57 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:58.791960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:44:58.792621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:44:58.809193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:58.809685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:58.810489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:44:58.810934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:44:59.655615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:44:59.668010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fc04c1d-531a-4976-af94-63a1187aa678 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1501 microversion: 2.1 time: 0.880053 May 19 08:44:59.677996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3598/4923] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:44:58 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1501 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:44:59.924876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-faaebc4d-8bc3-48bb-9bd2-fd0ad7bc16cb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: .version_select at 0x7f321223bca0>, body: {"keypair": {"name": "tempest-keypair-1365714777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrMP8ViWtcsNWPaIfHYgpsFc+1bt6uM9m1SJQiD2Lw2Y9eNz2kdsGCQ4zO+6wicxKoZWW0Ro7TIXTDSAGD21LIbXxYSCyUcSdzuFbr/OUNx4eBaXaKBiw4ArAFchMmh8Q=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:44:59.958581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-faaebc4d-8bc3-48bb-9bd2-fd0ad7bc16cb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:44:59.984809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-faaebc4d-8bc3-48bb-9bd2-fd0ad7bc16cb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:45:00.036712 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-faaebc4d-8bc3-48bb-9bd2-fd0ad7bc16cb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.349854 May 19 08:45:00.038187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3599/4924] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:44:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:00.056446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:00.057076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:00.080562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:00.081695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:00.082504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:00.082951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:00.807607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:00.820623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:00.825884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66b747f8-ef32-4f88-8589-6e41e65ef7cc tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 0.785641 May 19 08:45:00.832342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3600/4925] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:00 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:00.856815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:00.866457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:00.923650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:00.925157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:00.929500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:00.936368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:01.013121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lazy-loading 'flavor' on Instance uuid f022eb8a-9ec0-449f-b422-d1cdc42b8a57 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:45:01.065853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Cannot 'rescue' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state paused May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action HTTP/1.1 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 14 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: {"rescue": {}} May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'rescue' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state paused May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f022eb8a-9ec0-449f-b422-d1cdc42b8a57', 'body': {'rescue': {}}} May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 in vm_state paused. Cannot rescue while the instance is in this state. May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state paused May 19 08:45:01.067741 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state paused May 19 08:45:01.073223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:01.075517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 409 to user: Cannot 'rescue' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state paused {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:45:01.076620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e409d25-842a-4198-81a3-8cff759cf636 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action" status: 409 len: 144 microversion: 2.1 time: 0.240712 May 19 08:45:01.090469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3601/4926] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:45:00 2022] POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action => generated 144 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:45:01.100517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:01.101513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:01.111147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:01.112036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:01.113374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:01.114119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:01.222259 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8778931-37a9-4c37-b2eb-a38eabf1f629 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action" status: 202 len: 0 microversion: 2.1 time: 0.124228 May 19 08:45:01.237273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3602/4927] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:45:01 2022] POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:45:01.263849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:01.277163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:01.312686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:01.314553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:01.316953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:01.318612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:02.962193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:02.977927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00f83acf-2965-49d7-aabd-76787c3e7a38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1508 microversion: 2.1 time: 1.734998 May 19 08:45:02.988386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3603/4928] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:01 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1508 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:03.005656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-242e7b33-235d-48b6-bcba-fbf2f13a0f05 req-45c68d76-2a99-4982-8bac-d5ee313a1d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d232c78-9c4b-42bf-a485-951ffbb7b009", "name": "network-vif-plugged", "status": "completed", "tag": "927dee13-92fc-4315-94a2-8a1460261ef9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:03.049261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-242e7b33-235d-48b6-bcba-fbf2f13a0f05 req-45c68d76-2a99-4982-8bac-d5ee313a1d70 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:03.053751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-242e7b33-235d-48b6-bcba-fbf2f13a0f05 req-45c68d76-2a99-4982-8bac-d5ee313a1d70 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:03.091562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-242e7b33-235d-48b6-bcba-fbf2f13a0f05 req-45c68d76-2a99-4982-8bac-d5ee313a1d70 service nova] Creating event network-vif-plugged:927dee13-92fc-4315-94a2-8a1460261ef9 for instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 on chh2-842464-2 May 19 08:45:03.111533 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-242e7b33-235d-48b6-bcba-fbf2f13a0f05 req-45c68d76-2a99-4982-8bac-d5ee313a1d70 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127103 May 19 08:45:03.117751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3604/4929] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:03.494649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:03.499046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:03.540001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:03.542349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:03.545981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:03.546843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:04.592275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:04.610758 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac5cad2c-ab0d-477c-bcfb-a440004fa090 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1364 microversion: 2.1 time: 1.485277 May 19 08:45:04.611466 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3605/4930] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:03 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1364 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:04.633949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:04.634597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:04.641356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:04.641822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:04.642627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:04.644056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:05.142710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:05.153906 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f485c4c-ac6b-4b9a-8e60-45c89d113e34 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1516 microversion: 2.1 time: 0.536314 May 19 08:45:05.154514 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3606/4931] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:04 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1516 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:05.633697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:05.635025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:05.646725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:05.652799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:05.654182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:05.658052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:06.079855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:06.128828 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1ab56c5-09af-430b-aa41-66dc9dc6a034 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1551 microversion: 2.1 time: 0.478828 May 19 08:45:06.147241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3607/4932] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:05 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1551 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:06.162953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:06.166139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:06.183995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:06.184907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:06.192322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:06.193249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:06.496434 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2581bb5d-3d9a-4072-95b6-a4a35d42ef2e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.347626 May 19 08:45:06.497622 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3608/4933] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:45:06 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-interface => generated 285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:09.905846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e4a4532a-6b94-44c7-8515-9a10af494227 req-f8807dea-fbaa-446c-afd2-a87c7e19e961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d232c78-9c4b-42bf-a485-951ffbb7b009", "tag": "927dee13-92fc-4315-94a2-8a1460261ef9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:09.935192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e4a4532a-6b94-44c7-8515-9a10af494227 req-f8807dea-fbaa-446c-afd2-a87c7e19e961 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:09.937868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e4a4532a-6b94-44c7-8515-9a10af494227 req-f8807dea-fbaa-446c-afd2-a87c7e19e961 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:09.973265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e4a4532a-6b94-44c7-8515-9a10af494227 req-f8807dea-fbaa-446c-afd2-a87c7e19e961 service nova] Creating event network-changed:927dee13-92fc-4315-94a2-8a1460261ef9 for instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 on chh2-842464-2 May 19 08:45:09.988288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e4a4532a-6b94-44c7-8515-9a10af494227 req-f8807dea-fbaa-446c-afd2-a87c7e19e961 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086120 May 19 08:45:09.990915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3609/4934] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:45:10.523851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:10.531885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:10.541039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:10.582414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:10.584416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:10.584866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:10.591829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:10.595897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:10.753209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lazy-loading 'flavor' on Instance uuid f022eb8a-9ec0-449f-b422-d1cdc42b8a57 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:45:10.970578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60dee71b-ea4f-4073-8d14-1fb788196a1b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action" status: 200 len: 32 microversion: 2.1 time: 0.438472 May 19 08:45:10.973545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3610/4935] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:45:10 2022] POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action => generated 32 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:45:10.990625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-944501793", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05c219cb-d37a-447f-853c-897fd14c1619"}], "security_groups": [{"name": "tempest-securitygroup--946649298"}], "key_name": "tempest-keypair-1365714777", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:12.213111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] validate_networks() for [('05c219cb-d37a-447f-853c-897fd14c1619', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:45:15.467553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:45:15.468147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:45:15.468457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:45:15.468878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:45:15.469733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:45:15.491982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:15.492492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:15.495327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:15.496039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:15.570469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:45:15.596974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:45:15.634019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:45:15.636909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:45:15.751018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22d1876b-043e-46e7-89ed-d813d63247f9 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.763227 May 19 08:45:15.751791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3611/4936] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:45:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 4778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:45:15.764514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:15.767520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:15.786920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:15.789721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:15.792480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:15.795665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:16.462570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:16.482313 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-35b8c72c-6d7d-4afe-a173-f0fa78e860a6 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.727891 May 19 08:45:16.484543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3612/4937] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:15 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:16.497743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8761f861-6521-4728-bea1-5417478000ba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:16.508624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8761f861-6521-4728-bea1-5417478000ba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:16.665498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8761f861-6521-4728-bea1-5417478000ba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:16.682651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8761f861-6521-4728-bea1-5417478000ba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1241 microversion: 2.1 time: 0.192526 May 19 08:45:16.692678 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3613/4938] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:16 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1241 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:17.500865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:17.501874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:17.514437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:17.519430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:17.520772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:17.525756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:18.063341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:18.082584 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d40fbd3e-70ab-4823-bc75-fc7d69431d7f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.585933 May 19 08:45:18.083528 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3614/4939] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:17 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:18.088520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:18.089166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:18.107057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:18.107366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:18.108144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:18.108591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:18.771317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:18.785519 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf8cd0e2-8426-46b9-a36f-512aeabb08be tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1299 microversion: 2.1 time: 0.696569 May 19 08:45:18.786199 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3615/4940] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:18 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1299 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:19.103913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:19.135146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:19.148787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:19.149743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:19.150813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:19.151446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:19.530632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:19.541223 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48db5e8c-f8ad-4bc8-bfc9-27e3b38c8b09 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.442510 May 19 08:45:19.544737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3616/4941] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:19 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:19.821584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:19.822417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:19.834403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:19.837605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:19.838732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:19.841796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:20.025123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:20.031855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:20.034464 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ebc3a264-fcca-44be-8486-44719289f472 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1299 microversion: 2.1 time: 0.234342 May 19 08:45:20.041788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3617/4942] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:19 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:20.050737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-981451768", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:20.125940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:45:20.825556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:45:20.826218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:45:20.828479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:45:20.833867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:45:20.834322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:45:20.855241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:20.855699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:20.856506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:20.856951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:20.883015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Getting quotas for project 55a611565eca4f9e9085b5190f14748f. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:45:20.889467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Getting quotas for user 46e00280e3df4c8a8928d0e1ab68fe71 and project 55a611565eca4f9e9085b5190f14748f. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:45:20.904520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:45:20.906784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:45:21.009952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-824ffb39-abc5-4372-ad3a-2cff7915881b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966673 May 19 08:45:21.011287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3618/4943] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:45:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:45:21.016718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:21.017642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:21.025503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:21.026245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:21.027261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:21.027872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:21.317526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:21.332498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9824616f-05d5-4b02-a418-9ca77332d10f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.319815 May 19 08:45:21.333125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3619/4944] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:21 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:21.339400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00f5cd99-7e80-4644-96b5-36903110ae3b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:21.340048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00f5cd99-7e80-4644-96b5-36903110ae3b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:21.446534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00f5cd99-7e80-4644-96b5-36903110ae3b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:21.459590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00f5cd99-7e80-4644-96b5-36903110ae3b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1214 microversion: 2.1 time: 0.124570 May 19 08:45:21.460824 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3620/4945] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:21 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:21.467566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:21.468659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:21.476116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:21.477231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:21.478502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:21.479270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:22.253094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:22.261972 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e903dcd-7840-409d-ba1b-84b1df724c05 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1366 microversion: 2.1 time: 0.799720 May 19 08:45:22.262828 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3621/4946] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:21 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1366 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:22.351453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:22.352540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:22.360318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:22.361018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:22.362897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:22.363528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:22.871818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:22.881626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e802bf61-0519-4df1-b51d-bb76888996b5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.534478 May 19 08:45:22.895201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3622/4947] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:22 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:22.912714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:22.913673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:22.921844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:22.922372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:22.923227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:22.923895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:23.103426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:23.116077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ddec7890-e2cd-4526-8a3d-391b397ac635 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1272 microversion: 2.1 time: 0.219547 May 19 08:45:23.132389 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3623/4948] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:22 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:23.282953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:23.284156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:23.295428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:23.296840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:23.298562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:23.300136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:23.887359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:23.912002 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1def40d-5328-45dd-90ec-929e1c4b9dbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1366 microversion: 2.1 time: 0.635387 May 19 08:45:23.912941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3624/4949] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:23 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1366 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:23.948612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5f446bf5-ae21-429d-86d3-53436e99dd2c req-45262133-3e96-4e7f-a4b5-15dcd1884dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d1e95a-431d-4672-9e95-72e0956a248f", "tag": "96a52830-fa39-4200-9dbe-5349717768b5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:23.985843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5f446bf5-ae21-429d-86d3-53436e99dd2c req-45262133-3e96-4e7f-a4b5-15dcd1884dfd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:23.987503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5f446bf5-ae21-429d-86d3-53436e99dd2c req-45262133-3e96-4e7f-a4b5-15dcd1884dfd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:24.008025 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5f446bf5-ae21-429d-86d3-53436e99dd2c req-45262133-3e96-4e7f-a4b5-15dcd1884dfd service nova] Creating event network-changed:96a52830-fa39-4200-9dbe-5349717768b5 for instance b0d1e95a-431d-4672-9e95-72e0956a248f on chh2-842464-2 May 19 08:45:24.018978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5f446bf5-ae21-429d-86d3-53436e99dd2c req-45262133-3e96-4e7f-a4b5-15dcd1884dfd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103275 May 19 08:45:24.021175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3625/4950] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:24.027710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:24.028945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:24.038133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:24.039126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:24.040625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:24.041338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:24.770318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:24.782033 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8382426-3122-46f4-931c-bf8098cca407 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.758840 May 19 08:45:24.785580 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3626/4951] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:24 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:24.807519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:24.808495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:24.824167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:24.830149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:24.832151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:24.832777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:24.969543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:24.986271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-886e7f12-6e2b-4c6b-b40e-ed82c3a78ab8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1272 microversion: 2.1 time: 0.188189 May 19 08:45:24.988184 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3627/4952] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:24 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:25.003150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:25.005658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:25.015954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:25.016527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:25.021567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:25.022213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:25.421007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:25.463406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec0ad732-aac8-4919-b7b0-2eaf42e579bd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1366 microversion: 2.1 time: 0.469649 May 19 08:45:25.482305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3628/4953] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:24 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1366 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:25.807416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:25.809153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:25.828734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:25.833502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:25.834637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:25.835349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:26.673055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:26.697473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd6bb279-219d-4213-98a7-4b90ac24e982 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.899268 May 19 08:45:26.698095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3629/4954] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:25 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:26.717208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:26.723003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:26.732339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:26.733921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:26.734995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:26.735622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:27.318336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:27.330417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be215e25-f42d-4f3d-93c3-1e3a542bdf03 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.628117 May 19 08:45:27.331515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3630/4955] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:26 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:27.353668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:27.367779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:27.387972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:27.389046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:27.392330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:27.393973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:27.756598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:27.769701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-522771a9-f11f-403e-aebd-77f2260cb898 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1366 microversion: 2.1 time: 0.431337 May 19 08:45:27.781377 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3631/4956] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:27 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:27.811607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:27.812242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:27.850501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:27.851004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:27.855245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:27.855706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:28.298698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:28.317630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b01c4c6e-b75f-4147-b0eb-36dd5511bc95 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.534612 May 19 08:45:28.327317 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3632/4957] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:27 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:28.338974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4c0143b3-f645-4493-b529-a7ebffd554b6 req-0f7fe491-9662-4583-8007-6cf98734993f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a", "tag": "4c9cc1a2-f172-4c13-8d73-7328516fb537"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:28.364062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4c0143b3-f645-4493-b529-a7ebffd554b6 req-0f7fe491-9662-4583-8007-6cf98734993f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:28.364891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4c0143b3-f645-4493-b529-a7ebffd554b6 req-0f7fe491-9662-4583-8007-6cf98734993f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:28.392529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4c0143b3-f645-4493-b529-a7ebffd554b6 req-0f7fe491-9662-4583-8007-6cf98734993f service nova] Creating event network-changed:4c9cc1a2-f172-4c13-8d73-7328516fb537 for instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a on chh1-842464-2 May 19 08:45:28.402633 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4c0143b3-f645-4493-b529-a7ebffd554b6 req-0f7fe491-9662-4583-8007-6cf98734993f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082652 May 19 08:45:28.403433 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3633/4958] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:28.415090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:28.418059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:28.438579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:28.439411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:28.440800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:28.441488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:28.806639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:28.823866 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-346d7bf3-4ff6-41b4-ae68-1e41d02eb00a tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.412865 May 19 08:45:28.835973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3634/4959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:28 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:28.843670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:28.844798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:28.856132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:28.857081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:28.858234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:28.859068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:29.097722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:29.116184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f52a7f28-39b8-49ac-b409-2fe39d237f13 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1366 microversion: 2.1 time: 0.278064 May 19 08:45:29.117180 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3635/4960] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:28 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:29.336182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:29.337597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:29.344804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:29.345609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:29.348789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:29.349584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:29.641943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:29.655013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcc5e19c-2fbb-42e5-9225-e09422accf98 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.322797 May 19 08:45:29.655628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3636/4961] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:29 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:29.824750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-66db4df4-a150-4dbe-9649-fa47b00780a2 req-ae63287b-a5ff-4b17-8685-27aff78b53a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d1e95a-431d-4672-9e95-72e0956a248f", "name": "network-vif-plugged", "status": "completed", "tag": "96a52830-fa39-4200-9dbe-5349717768b5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:29.837814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-66db4df4-a150-4dbe-9649-fa47b00780a2 req-ae63287b-a5ff-4b17-8685-27aff78b53a3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:29.838700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-66db4df4-a150-4dbe-9649-fa47b00780a2 req-ae63287b-a5ff-4b17-8685-27aff78b53a3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:29.859668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-66db4df4-a150-4dbe-9649-fa47b00780a2 req-ae63287b-a5ff-4b17-8685-27aff78b53a3 service nova] Creating event network-vif-plugged:96a52830-fa39-4200-9dbe-5349717768b5 for instance b0d1e95a-431d-4672-9e95-72e0956a248f on chh2-842464-2 May 19 08:45:29.868319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-66db4df4-a150-4dbe-9649-fa47b00780a2 req-ae63287b-a5ff-4b17-8685-27aff78b53a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046599 May 19 08:45:29.869807 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3637/4962] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:29.876272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:29.878010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:29.887777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:29.888580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:29.889716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:29.890520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:29.929389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:30.277644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:30.288871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23c16df2-8090-4836-a1d8-e912a63139ca tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.417252 May 19 08:45:30.289202 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3638/4963] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:29 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:30.294295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:30.295290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:30.302243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:30.302760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:30.303790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:30.304455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:30.553855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:30.568074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e42ed0e6-86fe-49b0-84b9-727a2b526c94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1366 microversion: 2.1 time: 0.277464 May 19 08:45:30.578564 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3639/4964] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:30 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:30.681794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:30.681794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:30.686196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:30.686539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:30.687566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:30.688014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:30.868702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:30.967370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:30.978085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb94b8da-3866-482d-b11b-c02857ac2ce5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.306550 May 19 08:45:30.978779 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3640/4965] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:30 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:31.313163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:31.314332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:31.324532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:31.325234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:31.326409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:31.327169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:31.452250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=16 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:31.542983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:31.556845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18d4ce7a-8f54-4e92-af58-9c9da83c39f8 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.252406 May 19 08:45:31.558678 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3641/4966] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:31 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:31.586586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:31.587732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:31.594611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:31.595418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:31.597839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:31.598532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:31.932327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:31.946788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0eda9682-65df-4a2b-9bab-627319e8538f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1556 microversion: 2.1 time: 0.364229 May 19 08:45:31.948842 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3642/4967] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:31 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1556 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:31.970566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:31.971458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:31.988454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:31.993042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:31.994058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:31.995362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:31.996097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:32.140767 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79120dfe-b36d-478d-ba55-3758b60445bb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178061 May 19 08:45:32.141973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3643/4968] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:45:31 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:45:32.152584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:32.153220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:32.169924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:32.170605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:32.173461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:32.174815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:32.504520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:32.516950 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7928c22f-2580-4234-ad7b-77e864ec2f02 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.373660 May 19 08:45:32.528081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3644/4969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:32 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:32.577561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:32.578290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:32.585440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:32.586177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:32.587244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:32.587860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:33.131354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:33.140601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b74fb03-ebe4-4e65-964d-261755576cde tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.568468 May 19 08:45:33.153728 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3645/4970] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:32 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:33.535263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:33.535892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:33.544931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:33.545901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:33.548353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:33.549101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:33.780109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:33.800778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc1e479b-60ec-4e21-863f-88dc355443dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1502 microversion: 2.1 time: 0.259028 May 19 08:45:33.826308 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3646/4971] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:33 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1502 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:33.833092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f2a9efe-6699-4757-9f7e-3beb6881ff28"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:33.836075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:33.844230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:33.845122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:33.847090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:33.847981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:33.881163 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Cannot 'attach_volume' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state rescued May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/os-volume_attachments HTTP/1.1 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 74 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: {"volumeAttachment": {"volumeId": "2f2a9efe-6699-4757-9f7e-3beb6881ff28"}} May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'attach_volume' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state rescued May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': 'f022eb8a-9ec0-449f-b422-d1cdc42b8a57', 'body': {'volumeAttachment': {'volumeId': '2f2a9efe-6699-4757-9f7e-3beb6881ff28'}}} May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 08:45:33.883365 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state rescued May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state rescued May 19 08:45:33.890651 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:33.891874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 409 to user: Cannot 'attach_volume' instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 while it is in vm_state rescued {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:45:33.895084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fcf9c12-b52e-436a-afda-8e09c542d3b9 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064987 May 19 08:45:33.896053 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3647/4972] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:45:33 2022] POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:45:33.906829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:33.907380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:33.918654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:33.919399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:33.921131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:33.921782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:34.045871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c26c5cf7-0bc2-441a-b69d-c4b7a813e9a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action" status: 202 len: 0 microversion: 2.1 time: 0.139616 May 19 08:45:34.047833 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3648/4973] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:45:33 2022] POST /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:45:34.066346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:34.067184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:34.086849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:34.088203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:34.090274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:34.091898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:34.524211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:34.541381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-788f72b2-aca6-4481-88a0-e347e304dd9b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1510 microversion: 2.1 time: 0.479752 May 19 08:45:34.553279 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3649/4974] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:34 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1510 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:34.558207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:34.561456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:34.572151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:34.573238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:34.574348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:34.574998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:34.944654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:34.956329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e880579e-0436-46ef-ab6c-0aaf0c0c770b tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.401764 May 19 08:45:34.958009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3650/4975] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:34 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:34.974180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f1008f14-178d-43b1-ba32-d31f14e92d1c req-a5d44e46-d4ca-4170-b44e-bb512cb0e991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a", "name": "network-vif-plugged", "status": "completed", "tag": "4c9cc1a2-f172-4c13-8d73-7328516fb537"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:34.996064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1008f14-178d-43b1-ba32-d31f14e92d1c req-a5d44e46-d4ca-4170-b44e-bb512cb0e991 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:34.996989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1008f14-178d-43b1-ba32-d31f14e92d1c req-a5d44e46-d4ca-4170-b44e-bb512cb0e991 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:35.017490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f1008f14-178d-43b1-ba32-d31f14e92d1c req-a5d44e46-d4ca-4170-b44e-bb512cb0e991 service nova] Creating event network-vif-plugged:4c9cc1a2-f172-4c13-8d73-7328516fb537 for instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a on chh1-842464-2 May 19 08:45:35.031458 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f1008f14-178d-43b1-ba32-d31f14e92d1c req-a5d44e46-d4ca-4170-b44e-bb512cb0e991 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072050 May 19 08:45:35.034907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3651/4976] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:35.089477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-87aec837-1a07-4b5b-a15f-2deb2449f704 req-617982eb-e830-454e-912a-ff5ca00bb589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d1e95a-431d-4672-9e95-72e0956a248f", "tag": "96a52830-fa39-4200-9dbe-5349717768b5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:35.113108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87aec837-1a07-4b5b-a15f-2deb2449f704 req-617982eb-e830-454e-912a-ff5ca00bb589 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:35.114443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87aec837-1a07-4b5b-a15f-2deb2449f704 req-617982eb-e830-454e-912a-ff5ca00bb589 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:35.144904 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-87aec837-1a07-4b5b-a15f-2deb2449f704 req-617982eb-e830-454e-912a-ff5ca00bb589 service nova] Creating event network-changed:96a52830-fa39-4200-9dbe-5349717768b5 for instance b0d1e95a-431d-4672-9e95-72e0956a248f on chh2-842464-2 May 19 08:45:35.163778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-87aec837-1a07-4b5b-a15f-2deb2449f704 req-617982eb-e830-454e-912a-ff5ca00bb589 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079784 May 19 08:45:35.166881 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3652/4977] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:45:35.558347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:35.559063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:35.578112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:35.578597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:35.579393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:35.579839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:36.004223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:36.016969 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d99a4a68-5491-4075-8364-68542bc29a4c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1510 microversion: 2.1 time: 0.463888 May 19 08:45:36.020137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3653/4978] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:35 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:36.031233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:36.036510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:36.056505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:36.057338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:36.058848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:36.058848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:36.345704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:36.363519 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad02fe3c-0a50-4dad-8e59-dfbe75098513 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.340964 May 19 08:45:36.374830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3654/4979] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:36 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:37.036967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:37.038352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:37.057231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:37.057722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:37.058772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:37.059210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:37.361001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:37.366040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:37.378741 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72fbeebf-1057-47f6-b41d-00e5f87e94b4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1510 microversion: 2.1 time: 0.345641 May 19 08:45:37.380088 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3655/4980] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:37 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1510 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:37.385221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:37.386187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:37.395001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:37.397152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:37.399433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:37.400141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:37.705230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:37.715480 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-427abaaf-6a8d-4dc3-8060-3b179f36c3ac tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1314 microversion: 2.1 time: 0.333920 May 19 08:45:37.716735 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3656/4981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:37 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:38.397995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:38.398676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:38.426697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:38.427185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:38.428004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:38.429264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:38.639375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:38.649224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2491414-4567-42fd-a25d-efa1a2ca2135 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1516 microversion: 2.1 time: 0.256569 May 19 08:45:38.649838 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3657/4982] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:38 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:38.741207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:38.742243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:38.758231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:38.759154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:38.762645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:38.763429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:39.063496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:39.087408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43e29c7a-93a4-4810-bdb8-b6a7b88dddfd tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1464 microversion: 2.1 time: 0.356468 May 19 08:45:39.088613 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3658/4983] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:38 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1464 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:39.206650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:39.207878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:39.222368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:39.223962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:39.225626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:39.226621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:39.265626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:45:39.403615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d9c13ad-afd7-4c02-a9fd-82f37aee088c tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 204 len: 0 microversion: 2.1 time: 0.204968 May 19 08:45:39.406378 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3659/4984] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:45:39 2022] DELETE /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:45:39.435400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:39.437569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:39.453674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:39.454145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:39.455112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:39.455791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:39.755306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:39.770968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3835fd04-b8d0-4311-ae50-68dc70632381 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1470 microversion: 2.1 time: 0.353104 May 19 08:45:39.784061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3660/4985] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:39 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:40.799264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:40.800100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:40.833100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:40.833578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:40.834375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:40.834843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:41.336498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e00280e3df4c8a8928d0e1ab68fe71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a611565eca4f9e9085b5190f14748f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:41.347138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70e0a896-1e75-41da-a93e-3c6662c76d59 tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 200 len: 1470 microversion: 2.1 time: 0.561158 May 19 08:45:41.362479 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3661/4986] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:40 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 1470 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:41.739314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7d4c40b8-1f43-49b5-a4bb-032d9ae79fed req-bcc94738-8308-440c-937e-69d31e4b3550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a", "name": "network-vif-deleted", "tag": "4c9cc1a2-f172-4c13-8d73-7328516fb537"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:41.775324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7d4c40b8-1f43-49b5-a4bb-032d9ae79fed req-bcc94738-8308-440c-937e-69d31e4b3550 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:41.776361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7d4c40b8-1f43-49b5-a4bb-032d9ae79fed req-bcc94738-8308-440c-937e-69d31e4b3550 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:41.794232 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7d4c40b8-1f43-49b5-a4bb-032d9ae79fed req-bcc94738-8308-440c-937e-69d31e4b3550 service nova] Creating event network-vif-deleted:4c9cc1a2-f172-4c13-8d73-7328516fb537 for instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a on chh1-842464-2 May 19 08:45:41.802543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7d4c40b8-1f43-49b5-a4bb-032d9ae79fed req-bcc94738-8308-440c-937e-69d31e4b3550 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077443 May 19 08:45:41.804433 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3662/4987] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:45:42.371946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:42.373054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] [instance: ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:42.384741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:42.385505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:42.386533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:42.387146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:42.415449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] HTTP exception thrown: Instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a could not be found. May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Request method failure captured: May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a HTTP/1.1 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgObYa5CPVJL_SNeKJB3dc-9G2Zx2bQy8rGaErk_zBHaSeBlGV2FnnNJiUXIxr1g6kVyIJaTMKSBC-5VXlPxU4dpQnS7ZaH3WtaOYOqsXj-aA5HJ88zV-oOeMg_KKNUTJiqnQ-ll--saUObip9lmiMidjI8F5nke00bMl5wWi9qSRR4 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 55a611565eca4f9e9085b5190f14748f May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesNegativeTest-1931760706 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/55a611565eca4f9e9085b5190f14748f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55a611565eca4f9e9085b5190f14748f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_55a611565eca4f9e9085b5190f14748f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/55a611565eca4f9e9085b5190f14748f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesNegativeTest-1931760706 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 55a611565eca4f9e9085b5190f14748f May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesNegativeTest-1931760706 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesNegativeTest-1931760706-project May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 46e00280e3df4c8a8928d0e1ab68fe71 May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesNegativeTest-1931760706-project May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a could not be found. May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a'} May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a could not be found. May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a could not be found. May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:45:42.420053 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a could not be found. May 19 08:45:42.427589 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:45:42.433485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] Returning 404 to user: Instance ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:45:42.434331 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e83bb115-eaf7-458b-b115-7d0efbb5359f tempest-VolumesNegativeTest-1931760706 tempest-VolumesNegativeTest-1931760706-project] 10.222.0.78 "GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a" status: 404 len: 111 microversion: 2.1 time: 0.069880 May 19 08:45:42.442788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3663/4988] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:42 2022] GET /compute/v2.1/servers/ed4cf7ed-7afd-41bf-9ebc-c80f36226c0a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:45:42.512145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ad5e4c6-42d5-499c-a673-1c2c27f91531 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'create', calling method: .version_select at 0x7f32122089d0>, body: {"keypair": {"name": "tempest-keypair-799578982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdsRKAJbLeEqaKDyqwRPz1OoJ9Swt4JG1lxs+UMLSPVi8+hmrb1UcpXQR8ify35iWQis8MMjQF/jwwszGcYKFCGknDY4sLPUl4aNunzjqjV1t9r0s8fnoTFUt1RyfZ8pQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:42.550830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8ad5e4c6-42d5-499c-a673-1c2c27f91531 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:45:42.558093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-8ad5e4c6-42d5-499c-a673-1c2c27f91531 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for user 3da072a25d5f48ba881df74877fd0325 and project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:45:42.593391 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ad5e4c6-42d5-499c-a673-1c2c27f91531 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085091 May 19 08:45:42.595349 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3664/4989] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:45:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:45:42.897705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:42.901412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:42.921595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:42.922683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:42.924370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:42.926686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:42.998271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04721966-b1e7-475f-9c37-1f513ad08619 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/ips" status: 200 len: 146 microversion: 2.1 time: 0.126468 May 19 08:45:43.000466 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3665/4990] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:45:42 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/ips => generated 146 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:45:46.338585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1287565636", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5dbb39c-8330-4ed4-96de-9daec31a3c5e"}], "security_groups": [{"name": "tempest-securitygroup--1929991929"}], "key_name": "tempest-keypair-799578982", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:46.822915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] validate_networks() for [('a5dbb39c-8330-4ed4-96de-9daec31a3c5e', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:45:47.926434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:45:47.927471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:45:47.927663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:45:47.928245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:45:47.928665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:45:47.956655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:47.957419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:47.961615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:47.962391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:47.994413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:45:48.002225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Getting quotas for user 3da072a25d5f48ba881df74877fd0325 and project 6e9a93ccd3c94a318058de400a6a5a11. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:45:48.018933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:45:48.022146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:45:48.090064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-604455a2-798e-46b6-8b5c-adb821ee5cf1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.757359 May 19 08:45:48.096664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3666/4991] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:45:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:45:48.098597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31dd8116-8be5-43a0-b65b-58d940723435"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:48.099833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:48.106852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:48.107319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:48.108124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:48.108558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:48.776990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0c71af6-ae30-4027-b398-b7ff040cc42a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673684 May 19 08:45:48.780591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3667/4992] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:45:48 2022] POST /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:48.809643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4679b3f-426b-47b3-81b9-d89470a0a43c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:48.816934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4679b3f-426b-47b3-81b9-d89470a0a43c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:49.004936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4679b3f-426b-47b3-81b9-d89470a0a43c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:49.015877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4679b3f-426b-47b3-81b9-d89470a0a43c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1245 microversion: 2.1 time: 0.233506 May 19 08:45:49.016504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3668/4993] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:48 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1245 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:50.042841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:50.047793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:50.104511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:50.114848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:50.121706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:50.122600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:50.393831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:50.422053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21c151a1-dad5-458f-8dc9-68313b0e22e4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1303 microversion: 2.1 time: 0.390972 May 19 08:45:50.423221 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3669/4994] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:50 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1303 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:51.442325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:51.443716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:51.467214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:51.468114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:51.469132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:51.469836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:51.651425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:51.666841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ac5ce3c-8d00-433e-9942-bd2c2f876272 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1303 microversion: 2.1 time: 0.231221 May 19 08:45:51.667883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3670/4995] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:51 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:52.690819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:52.691788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:52.710550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:52.711193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:52.718803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:52.719644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:53.395900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:53.412861 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96e1b2ba-8786-439d-921a-a6df1b6bad4d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1371 microversion: 2.1 time: 0.726869 May 19 08:45:53.417474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3671/4996] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:52 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1371 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:54.435471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:54.440502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:54.467157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:54.476355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:54.478421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:54.479192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:55.566739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:55.590432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db76ec9b-80f5-46e4-9cfd-0e979d448017 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1371 microversion: 2.1 time: 1.161246 May 19 08:45:55.594718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3672/4997] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:54 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1371 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:45:55.615477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b2c56c35-826e-4cbf-99cc-74352c952979 req-667ab07d-f65c-4ebe-9180-499516a9aabf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:45:55.662696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b2c56c35-826e-4cbf-99cc-74352c952979 req-667ab07d-f65c-4ebe-9180-499516a9aabf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:55.664457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b2c56c35-826e-4cbf-99cc-74352c952979 req-667ab07d-f65c-4ebe-9180-499516a9aabf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:55.740487 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b2c56c35-826e-4cbf-99cc-74352c952979 req-667ab07d-f65c-4ebe-9180-499516a9aabf service nova] Creating event network-changed:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:45:55.764021 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b2c56c35-826e-4cbf-99cc-74352c952979 req-667ab07d-f65c-4ebe-9180-499516a9aabf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164413 May 19 08:45:55.766969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3673/4998] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:45:56.613429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:56.614156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:56.630194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:56.631818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:56.639305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:56.640103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:56.717373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:57.195651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:57.207931 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9c7fe29-a1a5-4e84-be60-3843ace889e2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1371 microversion: 2.1 time: 0.597831 May 19 08:45:57.211399 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3674/4999] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:56 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1371 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:45:58.240930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:45:58.242479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:45:58.259353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:58.271810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:58.274485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:58.276969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:45:58.280405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:45:59.010445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:45:59.156827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:45:59.198142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4604c71-ff9f-4856-8b2c-892bb9310024 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1371 microversion: 2.1 time: 0.958784 May 19 08:45:59.210822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3675/5000] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:45:58 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1371 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:46:00.220004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:00.221537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:00.229860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:46:00.232019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:00.232955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:00.234232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:00.234950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:00.503774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:00.513016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-652bf104-328f-4779-917b-69136f74a780 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1371 microversion: 2.1 time: 0.299011 May 19 08:46:00.531086 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3676/5001] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:00 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:46:00.545460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-db4c285f-8612-41d5-82db-22ee937d9656 req-2aa24574-0f07-4396-805f-6e34546045a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "name": "network-vif-plugged", "status": "completed", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:00.559851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-db4c285f-8612-41d5-82db-22ee937d9656 req-2aa24574-0f07-4396-805f-6e34546045a3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:00.560624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-db4c285f-8612-41d5-82db-22ee937d9656 req-2aa24574-0f07-4396-805f-6e34546045a3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:00.575026 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-db4c285f-8612-41d5-82db-22ee937d9656 req-2aa24574-0f07-4396-805f-6e34546045a3 service nova] Creating event network-vif-plugged:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:46:00.580960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-db4c285f-8612-41d5-82db-22ee937d9656 req-2aa24574-0f07-4396-805f-6e34546045a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048239 May 19 08:46:00.582324 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3677/5002] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:01.544983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:01.548533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:01.571797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:01.586338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:01.587587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:01.588418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:01.926689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:01.937075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f3d7651-949f-46cf-b211-92a769000e72 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1371 microversion: 2.1 time: 0.401791 May 19 08:46:01.947262 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3678/5003] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:01 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:46:02.960810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:02.963115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:03.008427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:03.020477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:03.021510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:03.027832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:03.597579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:03.610645 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7506b1b3-b8fd-42a8-8bca-1edb7e8a65c1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1565 microversion: 2.1 time: 0.660169 May 19 08:46:03.627900 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3679/5004] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:02 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1565 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:46:03.646786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:03.647754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:03.668923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:03.669346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:03.670274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:03.670865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:03.964463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2326062-e466-4a39-b3db-0fbcd73a2c7a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.334667 May 19 08:46:03.974227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3680/5005] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:46:03 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-interface => generated 284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:07.883707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-023efacb-35b6-42bd-8bfc-d004beeaa46e req-8d8c4f15-01c9-4c49-a25f-80ed66e01866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:07.901653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-023efacb-35b6-42bd-8bfc-d004beeaa46e req-8d8c4f15-01c9-4c49-a25f-80ed66e01866 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:07.902107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-023efacb-35b6-42bd-8bfc-d004beeaa46e req-8d8c4f15-01c9-4c49-a25f-80ed66e01866 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:07.957838 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-023efacb-35b6-42bd-8bfc-d004beeaa46e req-8d8c4f15-01c9-4c49-a25f-80ed66e01866 service nova] Creating event network-changed:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:46:07.970252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-023efacb-35b6-42bd-8bfc-d004beeaa46e req-8d8c4f15-01c9-4c49-a25f-80ed66e01866 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553391 May 19 08:46:07.976148 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3681/5006] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:46:09.128724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:09.129420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:09.157264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:09.166046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:09.166991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:09.171586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:09.267271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2746dcfe-554b-4eab-880d-20bdb972d1ee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/ips" status: 200 len: 150 microversion: 2.1 time: 0.143580 May 19 08:46:09.275571 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3682/5007] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:46:09 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/ips => generated 150 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:15.339721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fed1872f-1952-43ac-bf3e-09365a197150"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:15.340889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:15.380315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:15.383702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:15.384727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:15.388008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:15.898386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b684e22b-8fe8-46f8-961e-db6ec62b0f9d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.562555 May 19 08:46:15.914676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3683/5008] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:46:15 2022] POST /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:19.681385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:19.684800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:19.709581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:19.710547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:19.715006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:19.715878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:19.801918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f2f9495-e536-48a6-bba0-b07275229497 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123134 May 19 08:46:19.805411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3684/5009] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:46:19 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:19.823768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:19.824789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:19.848670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:19.849133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:19.849955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:19.850395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:19.936883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f13ded49-efb0-41c5-9173-72a1eddb714a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/31dd8116-8be5-43a0-b65b-58d940723435" status: 200 len: 194 microversion: 2.1 time: 0.126528 May 19 08:46:19.937548 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3685/5010] 10.222.0.78 () {58 vars in 1412 bytes} [Thu May 19 08:46:19 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/31dd8116-8be5-43a0-b65b-58d940723435 => generated 194 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:24.150071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0e70a57-1a6f-4f4a-ad2f-da5fc2932486"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:24.151881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:24.162415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:24.170268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:24.172774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:24.173524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:24.974244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50c25a05-0748-4936-9679-da7e94018597 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "POST /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.828117 May 19 08:46:24.977357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3686/5011] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:46:24 2022] POST /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:46:40.578148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd26d5ce-8215-4785-a9d0-ec81cef30d98"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:40.579371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:40.603979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=21 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:46:40.604793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:46:40.615222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:40.615824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:40.616728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:40.617244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:41.578529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5cf24c7-ed7b-4c50-bf83-0103c3114129 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.003786 May 19 08:46:41.583160 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3687/5012] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:46:40 2022] POST /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 194 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:46:47.252092 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:46:47.252833 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:46:48.216991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b90d4c9e-645e-4b1d-922f-cf3cc093a66f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: .version_select at 0x7f321049edc0>, body: {"keypair": {"name": "tempest-keypair-793933002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8SukEnNxYlJIk34DA9v/ABvjpTbcWUI9WMM7YnUTsQrGU5rdYJa5RYlzOntxtKLxw7I/FSgiGYiA/kCGJ2bMfKRJrR+TT1VhP3fkMz2sC0wy4iZjg/XbLitWAIhXKylA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:48.276998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b90d4c9e-645e-4b1d-922f-cf3cc093a66f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:46:48.293810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b90d4c9e-645e-4b1d-922f-cf3cc093a66f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:46:48.374630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b90d4c9e-645e-4b1d-922f-cf3cc093a66f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171161 May 19 08:46:48.377375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3688/5013] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:46:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:52.377163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:46:52.386997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-441087596", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05c219cb-d37a-447f-853c-897fd14c1619"}], "security_groups": [{"name": "tempest-securitygroup--1976651268"}], "key_name": "tempest-keypair-793933002", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:46:52.773582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] validate_networks() for [('05c219cb-d37a-447f-853c-897fd14c1619', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:46:53.811216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:46:53.811986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:46:53.813153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:46:53.814640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:46:53.815413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:46:53.839642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:53.840098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:53.840908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:53.841393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:53.920159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:46:53.928926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:46:53.955515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:46:53.965426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:46:54.093710 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e68a9d7d-fff8-49fb-842e-9d4520274b27 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.712364 May 19 08:46:54.100558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3689/5014] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:46:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:46:54.114950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:54.133964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:54.150679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:54.151146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:54.152543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:54.153199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:54.240797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-829492a8-afe2-480c-b3e6-02e5bd09feb0 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.139419 May 19 08:46:54.241879 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3690/5015] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:46:54 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments => generated 371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:54.263800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c1cb7d4-554f-4304-b79a-5e76204045cc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:54.268135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c1cb7d4-554f-4304-b79a-5e76204045cc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:54.435002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c1cb7d4-554f-4304-b79a-5e76204045cc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:54.443127 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c1cb7d4-554f-4304-b79a-5e76204045cc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1240 microversion: 2.1 time: 0.187455 May 19 08:46:54.443736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3691/5016] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:54 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1240 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:46:54.459879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:54.460384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:54.489780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:54.494409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:54.499396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:54.503079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:54.583703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-242f6e8a-a1c5-4b85-b470-2a57c6fceaa5 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/31dd8116-8be5-43a0-b65b-58d940723435" status: 200 len: 194 microversion: 2.1 time: 0.138853 May 19 08:46:54.592953 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3692/5017] 10.222.0.78 () {58 vars in 1412 bytes} [Thu May 19 08:46:54 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/31dd8116-8be5-43a0-b65b-58d940723435 => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:46:54.602011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:54.605504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:54.627808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:54.632054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:54.635089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:54.638047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:54.869287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lazy-loading 'services' on Instance uuid 2d232c78-9c4b-42bf-a485-951ffbb7b009 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:46:55.072429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e96bbdb-f6e7-4491-9483-33c3ce1f188c tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/31dd8116-8be5-43a0-b65b-58d940723435" status: 202 len: 0 microversion: 2.1 time: 0.475649 May 19 08:46:55.090884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3693/5018] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:46:54 2022] DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/31dd8116-8be5-43a0-b65b-58d940723435 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:46:55.462371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:55.463316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:55.481519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:55.482150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:55.483256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:55.483850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:55.670178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:55.699007 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b76a726f-9491-4d16-8781-4a63764d7da0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1244 microversion: 2.1 time: 0.241691 May 19 08:46:55.706529 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3694/5019] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:55 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1244 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:46:56.727445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:56.729664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:56.752189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:56.753911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:56.755345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:56.756146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:56.910827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:56.921010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11836b9d-c16a-4407-8cb5-30b130f105db tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1300 microversion: 2.1 time: 0.200555 May 19 08:46:56.924162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3695/5020] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:56 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:46:57.946691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:57.946691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:57.975501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:57.975833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:57.976650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:57.977088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:58.131923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:58.145315 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a4f965a-5929-4404-8b1d-63fa9f78f70f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1298 microversion: 2.1 time: 0.205690 May 19 08:46:58.148421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3696/5021] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:57 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:46:59.169514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:46:59.170356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:46:59.193599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:59.194402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:59.197440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:46:59.202820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:46:59.705063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:46:59.723497 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d4a5e0b-e0ba-4670-9f6c-000f0a2de9dc tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.561087 May 19 08:46:59.724625 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3697/5022] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:46:59 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:00.484844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-00b2c29a-48e9-4fd4-b7b0-f7aacda518dd req-522dcfbe-eb49-472a-827f-8a0203341c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad", "tag": "2d10c21a-8ce3-42b4-a7d0-d90e2edebe54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:00.514451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00b2c29a-48e9-4fd4-b7b0-f7aacda518dd req-522dcfbe-eb49-472a-827f-8a0203341c20 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:00.515116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00b2c29a-48e9-4fd4-b7b0-f7aacda518dd req-522dcfbe-eb49-472a-827f-8a0203341c20 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:00.548996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-00b2c29a-48e9-4fd4-b7b0-f7aacda518dd req-522dcfbe-eb49-472a-827f-8a0203341c20 service nova] Creating event network-changed:2d10c21a-8ce3-42b4-a7d0-d90e2edebe54 for instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad on chh2-842464-2 May 19 08:47:00.564083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-00b2c29a-48e9-4fd4-b7b0-f7aacda518dd req-522dcfbe-eb49-472a-827f-8a0203341c20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081949 May 19 08:47:00.565516 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3698/5023] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:00.743437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:00.744236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:00.755531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:00.761806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:00.762947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:00.763563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:01.246024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:01.255745 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73454962-abae-4fad-a98f-70ce921f7a66 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.516782 May 19 08:47:01.259183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3699/5024] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:00 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:02.276881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:02.278718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:02.287070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:02.287985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:02.289096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:02.289758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:02.479278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:02.488117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d02a2e4e-5dc4-4274-b1d3-c43c9289e654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.215717 May 19 08:47:02.488828 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3700/5025] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:02 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:03.511955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:03.513370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:03.523942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:03.524664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:03.525885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:03.526538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:03.759473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:03.800272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12e05eec-edb5-4e63-ab51-40b127c1146c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.292812 May 19 08:47:03.813195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3701/5026] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:03 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:04.840842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:04.843057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:04.880988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:04.882052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:04.885203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:04.885721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:04.886670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:04.887156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:05.211575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:05.224004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67bfee6d-5cba-4a27-8eda-824c08d9630e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.409074 May 19 08:47:05.225425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3702/5027] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:04 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:06.193432 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:47:06.194069 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:47:06.244144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:06.244807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:06.256022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:06.256475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:06.257276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:06.257746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:06.583899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:06.593211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ab61e98-978e-4359-aa1d-90d0a740dd70 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.355333 May 19 08:47:06.593851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3703/5028] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:06 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:06.809924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-40fb161a-1cb4-466c-bd92-18bf23f12384 req-bcc019fd-b356-4565-bd15-b6921fd5265c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad", "name": "network-vif-plugged", "status": "completed", "tag": "2d10c21a-8ce3-42b4-a7d0-d90e2edebe54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:06.822035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-40fb161a-1cb4-466c-bd92-18bf23f12384 req-bcc019fd-b356-4565-bd15-b6921fd5265c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:06.823315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-40fb161a-1cb4-466c-bd92-18bf23f12384 req-bcc019fd-b356-4565-bd15-b6921fd5265c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:06.841823 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-40fb161a-1cb4-466c-bd92-18bf23f12384 req-bcc019fd-b356-4565-bd15-b6921fd5265c service nova] Creating event network-vif-plugged:2d10c21a-8ce3-42b4-a7d0-d90e2edebe54 for instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad on chh2-842464-2 May 19 08:47:06.848423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-40fb161a-1cb4-466c-bd92-18bf23f12384 req-bcc019fd-b356-4565-bd15-b6921fd5265c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244163 May 19 08:47:06.850139 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3704/5029] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:07.613854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:07.614591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:07.621635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:07.622088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:07.622861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:07.623357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:07.883596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:07.893737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f80ae7d2-ded0-4293-9670-69940853a270 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1366 microversion: 2.1 time: 0.286657 May 19 08:47:07.902945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3705/5030] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:07 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:08.921372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:08.926766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:08.939806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:08.947025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:08.947903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:08.948366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:09.337679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:09.347196 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d3269fa-6b89-410f-9ab9-5ba9f92ac348 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1555 microversion: 2.1 time: 0.430197 May 19 08:47:09.347788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3706/5031] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:08 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1555 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:09.364225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:09.364888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:09.371551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:09.372142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:09.373045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:09.373734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:09.464407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ea1cf67-670a-4c1b-88b8-83201336274c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104378 May 19 08:47:09.466279 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3707/5032] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:47:09 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:11.053647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3bc36bc9-57d3-4598-b037-615df76a88f5 req-6f3a27ca-ece7-4ec1-aaed-f20c6343c8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad", "tag": "2d10c21a-8ce3-42b4-a7d0-d90e2edebe54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:11.066105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:11.070266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3bc36bc9-57d3-4598-b037-615df76a88f5 req-6f3a27ca-ece7-4ec1-aaed-f20c6343c8db service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:11.073639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3bc36bc9-57d3-4598-b037-615df76a88f5 req-6f3a27ca-ece7-4ec1-aaed-f20c6343c8db service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:11.092196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:11.105839 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3bc36bc9-57d3-4598-b037-615df76a88f5 req-6f3a27ca-ece7-4ec1-aaed-f20c6343c8db service nova] Creating event network-changed:2d10c21a-8ce3-42b4-a7d0-d90e2edebe54 for instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad on chh2-842464-2 May 19 08:47:11.116192 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3bc36bc9-57d3-4598-b037-615df76a88f5 req-6f3a27ca-ece7-4ec1-aaed-f20c6343c8db service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 May 19 08:47:11.117481 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3708/5033] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:11.750100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:11.750690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:11.770752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:11.773856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:11.774959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:11.775576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:11.848774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae2455af-1509-45c8-99d4-0805d9115e56 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/e0e70a57-1a6f-4f4a-ad2f-da5fc2932486" status: 200 len: 194 microversion: 2.1 time: 0.103414 May 19 08:47:11.851979 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3709/5034] 10.222.0.78 () {58 vars in 1412 bytes} [Thu May 19 08:47:11 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/e0e70a57-1a6f-4f4a-ad2f-da5fc2932486 => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:11.859580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:11.866272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:11.881594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:11.882674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:11.883621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:11.886414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:12.122129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lazy-loading 'services' on Instance uuid 2d232c78-9c4b-42bf-a485-951ffbb7b009 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:47:12.265050 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee9d601a-b269-41cd-bf6f-3c2b28029c94 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/e0e70a57-1a6f-4f4a-ad2f-da5fc2932486" status: 202 len: 0 microversion: 2.1 time: 0.405619 May 19 08:47:12.270892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3710/5035] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:47:11 2022] DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments/e0e70a57-1a6f-4f4a-ad2f-da5fc2932486 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:47:22.992715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:22.994428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:23.020231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:23.021022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:23.026325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:23.027054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:23.028077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:23.043079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:23.128173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lazy-loading 'flavor' on Instance uuid 76e9d206-9a9e-4c2f-b901-3a0c53a9226d {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:47:23.504626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d22b0dd5-9cd3-494a-8b34-3e1a3adf4cc1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/action" status: 200 len: 32 microversion: 2.1 time: 0.520017 May 19 08:47:23.510476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3711/5036] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:47:22 2022] POST /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:47:23.516906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:23.517709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:23.526880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:23.528003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:23.546146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:23.547189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:24.007387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:24.017799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47009f70-7ef0-4873-b0fe-2b6d617d3c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.505912 May 19 08:47:24.033458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3712/5037] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:23 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:25.036679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:25.038128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:25.062683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:25.063554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:25.064571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:25.065215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:25.571826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:25.593115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee9262ab-5e80-4268-af21-dc07e0cd7cfd tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.550394 May 19 08:47:25.594090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3713/5038] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:25 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:26.612933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:26.614393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:26.624812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:26.627008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:26.629963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:26.630588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:26.880159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:26.888925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b71507db-8fdd-4dfc-a65c-0fcf613f3a48 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.281528 May 19 08:47:26.901417 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3714/5039] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:26 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:27.910683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:27.911350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:27.931661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:27.933511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:27.934646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:27.935300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:28.383586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:28.398373 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e9c2acd-9f9c-4aeb-91eb-83f295132932 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.492828 May 19 08:47:28.402457 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3715/5040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:27 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:29.072984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-020ae543-0550-470c-9e0d-a89134edd397 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: .version_select at 0x7f321050b940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-158291598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZn+ptEDU0h0Tclh/qSBPAqbf5I2SPXDXSU7cbGQvJFGa9sGN7eZGsw909pqsJcSyHljtm68ORj3EYERdDzRurgkiGOzrJp7XJnd+h8QFliPbyTRC2LwOZb3dTU5hy95A=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:29.089647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-020ae543-0550-470c-9e0d-a89134edd397 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:47:29.099025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-020ae543-0550-470c-9e0d-a89134edd397 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:47:29.136135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-020ae543-0550-470c-9e0d-a89134edd397 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.369641 May 19 08:47:29.142420 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3716/5041] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:47:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:47:29.418974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:29.420481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:29.433967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:29.436455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:29.437545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:29.439645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:29.810738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:29.822635 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b574fbe3-b14d-4761-a686-b992687f2e2e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.407655 May 19 08:47:29.832607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3717/5042] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:29 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:30.840318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:30.840916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:30.848554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:30.849261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:30.850241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:30.850842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:31.183023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:31.203298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a51a2080-450d-4b71-9067-707271b0787f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.363491 May 19 08:47:31.205161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3718/5043] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:30 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:31.600008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:31.602694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:31.619874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:31.620689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:31.622453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:31.623430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:31.675827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4561ef4-8c3f-4600-94a8-4d2b169412dd tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083763 May 19 08:47:31.677102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3719/5044] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:47:31 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:47:31.854693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:31.856526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:31.868682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:31.876694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:31.878039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:31.878802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:31.931667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b877ea51-8d14-4fef-a243-19e209182beb tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081800 May 19 08:47:31.932599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3720/5045] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:47:31 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:47:32.065881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:32.066392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:32.079761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:32.082058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:32.083752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:32.084458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:32.154758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:47:32.370808 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-afea8692-db2b-4d3e-87ee-6d0871d061f9 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 204 len: 0 microversion: 2.1 time: 0.311416 May 19 08:47:32.371664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3721/5046] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:47:32 2022] DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:47:32.389866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:32.390593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:32.406960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:32.407945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:32.408811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:32.409254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:32.847209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:32.901532 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a041b4c1-f5af-4f4f-9d34-f1ad9890226a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.520789 May 19 08:47:32.902332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3722/5047] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:32 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:32.919997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:32.921463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:32.931864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:32.932551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:32.934364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:32.935256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:33.387923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:33.406820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90f20896-b62b-496c-9318-3d8486466bc4 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1675 microversion: 2.1 time: 0.502234 May 19 08:47:33.408162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3723/5048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:32 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1675 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:33.920617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:33.924105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:33.934030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:33.934782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:33.935766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:33.936548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:34.201522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:34.210342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:34.226171 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e594e8a2-1841-4bd7-b99f-9da9b326e5eb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.306643 May 19 08:47:34.227922 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3724/5049] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:33 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:34.432165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:34.432788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:34.440204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:34.440649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:34.441464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:34.441904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:34.786680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:34.800106 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1940f430-c069-4bfa-a3e2-42a835dae7ea tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1675 microversion: 2.1 time: 0.373282 May 19 08:47:34.811921 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3725/5050] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:34 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1675 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:35.244814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:35.246762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:35.260311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:35.261667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:35.263175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:35.264239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:35.843818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:35.859495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c46d32f-092a-446f-aaac-f4f9d6eae4b1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.618863 May 19 08:47:35.862896 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3726/5051] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:35 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:35.881443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:35.883823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:35.899259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:35.905218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:35.908584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:35.910778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:36.177986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982a8a134680453bb66192b6d7cbb477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5544135087c43e9929fee886ac58afd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:36.189590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-be852f67-8fb2-46d6-bf1d-d2479af1cb51 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 200 len: 1607 microversion: 2.1 time: 0.323142 May 19 08:47:36.192306 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3727/5052] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:35 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 1607 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:36.927712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0c59a678-0b3a-4d34-a00c-8abe2b6d5757 req-68017131-023a-45a3-9f86-5d20a1340ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d232c78-9c4b-42bf-a485-951ffbb7b009", "name": "network-vif-deleted", "tag": "927dee13-92fc-4315-94a2-8a1460261ef9"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:36.956354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0c59a678-0b3a-4d34-a00c-8abe2b6d5757 req-68017131-023a-45a3-9f86-5d20a1340ba7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:36.957237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0c59a678-0b3a-4d34-a00c-8abe2b6d5757 req-68017131-023a-45a3-9f86-5d20a1340ba7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:36.995603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0c59a678-0b3a-4d34-a00c-8abe2b6d5757 req-68017131-023a-45a3-9f86-5d20a1340ba7 service nova] Creating event network-vif-deleted:927dee13-92fc-4315-94a2-8a1460261ef9 for instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 on chh2-842464-2 May 19 08:47:37.025488 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0c59a678-0b3a-4d34-a00c-8abe2b6d5757 req-68017131-023a-45a3-9f86-5d20a1340ba7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369669 May 19 08:47:37.027306 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3728/5053] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:37.040807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:37.057813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:37.068823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:37.069536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:37.070975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:37.071740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:37.671547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:37.689204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6d722ff-c267-4573-b854-6af77779c9d5 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.660055 May 19 08:47:37.690409 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3729/5054] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:37 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:37.711572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:37.712428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:37.734814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:37.737347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:37.738365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:37.746102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:37.802205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] HTTP exception thrown: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Request method failure captured: May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 HTTP/1.1 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJhiE5z1mSmdDhoz_h658wNGCzc6AcwUs1me2-3p0Un0lFreX73k4m_Qu8eULEXMsX5oogk-rwBY8_UCrpxZDGtfGeTRLkr7-vHXzZg4LqXmnViCCy10o-wj65hzaqEBQJzRP0woM1Y6R7n8Ph-EdlJDgD3XoqtgcYLnNqxsdkOgtE May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b5544135087c43e9929fee886ac58afd May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5544135087c43e9929fee886ac58afd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5544135087c43e9929fee886ac58afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeTestJSON-1387471750 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b5544135087c43e9929fee886ac58afd May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 982a8a134680453bb66192b6d7cbb477 May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2d232c78-9c4b-42bf-a485-951ffbb7b009'} May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:47:37.817002 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:47:37.821237 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:37.822877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Returning 404 to user: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:47:37.831835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6cbed09b-f192-481b-887d-037521c458da tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 404 len: 111 microversion: 2.1 time: 0.139182 May 19 08:47:37.835061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3730/5055] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:37 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:47:37.855773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f681e2a3-d55a-4a96-8750-d39ab3ed829b tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '.version_select at 0x7f3217a87310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:37.904174 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f681e2a3-d55a-4a96-8750-d39ab3ed829b tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604550591" status: 202 len: 0 microversion: 2.1 time: 0.063140 May 19 08:47:37.904838 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3731/5056] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604550591 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:47:38.720047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:38.721715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:38.740951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:38.743260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:38.753149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:38.753983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:39.110013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:39.484777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:39.495165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b033a44-4f40-48a8-82d7-6891f0d2ca38 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.781419 May 19 08:47:39.496157 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3732/5057] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:38 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:40.514662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:40.516133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:40.537597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:40.538336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:40.540447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:40.541889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:41.182193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:41.199373 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d14c67e-97d5-4279-8eef-3119e8862063 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.689523 May 19 08:47:41.204440 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3733/5058] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:40 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:47:42.222374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:42.223716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:42.245446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:42.247377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:42.248400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:42.254138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:43.153842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:43.171030 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae56eeb6-4b57-4eaf-bf29-a90f25e28db2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.948931 May 19 08:47:43.171653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3734/5059] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:42 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:44.193920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:44.194537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:44.225001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:44.227767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:44.230851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:44.231534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:44.961240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:44.979962 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1024c28b-d50c-45a7-a514-b6fda0d4f040 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.791111 May 19 08:47:44.981701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3735/5060] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:44 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:44.995670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-887556124", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "7340605a-7c48-49bf-b13c-bddbd8d6bb4e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-158291598", "security_groups": [{"name": "tempest-secgroup-smoke-157920566"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:45.263120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] validate_networks() for [('7340605a-7c48-49bf-b13c-bddbd8d6bb4e', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:47:46.653617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:47:46.654191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:47:46.654522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:47:46.654925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:47:46.655346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:47:46.687538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:46.690141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:46.693908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:46.695222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:46.722764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:47:46.733472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:47:46.757363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:47:46.762758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:47:46.871285 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f64d039-8804-4bc8-899f-358c90469a3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.888281 May 19 08:47:46.872368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3736/5061] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:47:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:47:46.890238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:46.891131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:46.901193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:46.905674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:46.909256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:46.909743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:46.958812 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5ed8af0-bead-4c46-a16f-b9b0a5f74859 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/ips" status: 200 len: 149 microversion: 2.1 time: 0.085056 May 19 08:47:46.965511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3737/5062] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:47:46 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:46.971775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:46.972408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:46.981654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:46.982114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:46.982907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:46.983354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:47.652788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:47.676131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2af287f1-2c01-4c83-a42e-dad955d223c0 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1734 microversion: 2.1 time: 0.708645 May 19 08:47:47.683294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3738/5063] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:46 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1734 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:47.726378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9ad3de2-601d-4659-a14a-84cf824ac017 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:47.732676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9ad3de2-601d-4659-a14a-84cf824ac017 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:48.017431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9ad3de2-601d-4659-a14a-84cf824ac017 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:48.038703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9ad3de2-601d-4659-a14a-84cf824ac017 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1265 microversion: 2.1 time: 0.352676 May 19 08:47:48.057225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3739/5064] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:47 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:48.089832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fed1872f-1952-43ac-bf3e-09365a197150"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:48.096915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:48.140740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:48.141201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:48.173027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:48.181999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:48.622297 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Invalid volume: volume fed1872f-1952-43ac-bf3e-09365a197150 is already attached to instances: b0d1e95a-431d-4672-9e95-72e0956a248f May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/os-volume_attachments HTTP/1.1 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 74 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: {"volumeAttachment": {"volumeId": "fed1872f-1952-43ac-bf3e-09365a197150"}} May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid volume: volume fed1872f-1952-43ac-bf3e-09365a197150 is already attached to instances: b0d1e95a-431d-4672-9e95-72e0956a248f May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': 'b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad', 'body': {'volumeAttachment': {'volumeId': 'fed1872f-1952-43ac-bf3e-09365a197150'}}} May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fed1872f-1952-43ac-bf3e-09365a197150 is already attached to instances: b0d1e95a-431d-4672-9e95-72e0956a248f May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:47:48.627318 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fed1872f-1952-43ac-bf3e-09365a197150 is already attached to instances: b0d1e95a-431d-4672-9e95-72e0956a248f May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fed1872f-1952-43ac-bf3e-09365a197150 is already attached to instances: b0d1e95a-431d-4672-9e95-72e0956a248f May 19 08:47:48.631792 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:48.647374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 400 to user: Invalid volume: volume fed1872f-1952-43ac-bf3e-09365a197150 is already attached to instances: b0d1e95a-431d-4672-9e95-72e0956a248f {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:47:48.654208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03ebebfc-b558-433e-a1c9-dae59e33b253 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.592693 May 19 08:47:48.664091 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3740/5065] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:47:48 2022] POST /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad/os-volume_attachments => generated 174 bytes in 606 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:47:48.709933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:48.721633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:48.752966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:48.754509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:48.756313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:48.757448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:48.821072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:47:49.025931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:49.123249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6d55602-3846-4632-b905-1902b5896fdd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 204 len: 0 microversion: 2.1 time: 0.443164 May 19 08:47:49.127017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3741/5066] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:47:48 2022] DELETE /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:47:49.142036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:49.144512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:49.159292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:49.160603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:49.162479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:49.165975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:49.970496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:50.010791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d67cbe25-c512-4fd0-a5f9-825e139501fb tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1714 microversion: 2.1 time: 0.881522 May 19 08:47:50.011840 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3742/5067] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:49 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1714 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:50.095734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:50.097227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:50.122549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:50.123355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:50.124731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:50.143182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:50.710184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:50.744264 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c3928be-1385-49e6-9b92-43fa4a100758 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1325 microversion: 2.1 time: 0.685449 May 19 08:47:50.745276 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3743/5068] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:50 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1325 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:50.778922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:50.780041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:50.796904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:50.798088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:50.810597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:50.811424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:50.910949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:51.863052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:51.880523 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ad3b0a3-cb96-4513-9b3f-df68409007fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1680 microversion: 2.1 time: 1.117534 May 19 08:47:51.881168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3744/5069] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:50 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1680 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:51.893171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:51.905668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:51.942308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:51.942764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:51.943556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:51.943996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:52.240590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Cannot 'detach_volume' instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d while it is in vm_state rescued May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments/fd26d5ce-8215-4785-a9d0-ec81cef30d98 HTTP/1.1 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'detach_volume' instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d while it is in vm_state rescued May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '76e9d206-9a9e-4c2f-b901-3a0c53a9226d', 'id': 'fd26d5ce-8215-4785-a9d0-ec81cef30d98'} May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d while it is in vm_state rescued May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:52.247026 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:47:52.251211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:47:52.251211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:47:52.251211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:47:52.251211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:47:52.251211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d while it is in vm_state rescued May 19 08:47:52.251211 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:47:52.254396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 409 to user: Cannot 'detach_volume' instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d while it is in vm_state rescued {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:47:52.262709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98a07648-a5f7-41f8-bbb7-b8e7d625058c tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments/fd26d5ce-8215-4785-a9d0-ec81cef30d98" status: 409 len: 152 microversion: 2.1 time: 0.369789 May 19 08:47:52.263661 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3745/5070] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:47:51 2022] DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments/fd26d5ce-8215-4785-a9d0-ec81cef30d98 => generated 152 bytes in 378 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:47:52.303983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:52.305092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:52.348595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:52.350571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:52.354323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:52.357028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:54.350068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:54.358771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ba74482-e0ca-4416-a624-e71cc126b28d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1390 microversion: 2.1 time: 2.093726 May 19 08:47:54.373909 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3746/5071] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:52 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1390 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:54.384816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:54.385704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:54.400307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:54.403316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:54.405192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:54.406159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:54.720680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1bee7e5f-4f49-4f6c-94ff-567dce1042fe tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/action" status: 202 len: 0 microversion: 2.1 time: 0.337222 May 19 08:47:54.722016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3747/5072] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:47:54 2022] POST /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:47:54.755312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:54.762037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:54.786510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:54.787084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:54.788323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:54.789013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:55.081559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:55.093647 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3dbb00e-284f-4da5-b31f-494a84efd34c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1612 microversion: 2.1 time: 0.364399 May 19 08:47:55.097299 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3748/5073] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:54 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1612 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:55.116126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:55.118311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:55.135448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:55.136106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:55.137088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:55.150320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:56.714383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:57.226145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:57.242631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ec43444-a6a3-45f7-949a-d03048510b29 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1722 microversion: 2.1 time: 2.143635 May 19 08:47:57.243251 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3749/5074] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:55 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1722 bytes in 2145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:57.264618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:57.265260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:57.309716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:57.310186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:57.311015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:57.311471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:58.022481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:47:59.200784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:59.252869 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f96efb3-3090-472f-bf79-481d6e0a1fec tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1390 microversion: 2.1 time: 1.995678 May 19 08:47:59.261982 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3750/5075] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:57 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1390 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:59.268954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b8232398-d385-4cfd-9c30-095c82fe26c8 req-fe3919f1-31e1-4db8-bccf-229b02627940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:47:59.312713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b8232398-d385-4cfd-9c30-095c82fe26c8 req-fe3919f1-31e1-4db8-bccf-229b02627940 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:59.313939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b8232398-d385-4cfd-9c30-095c82fe26c8 req-fe3919f1-31e1-4db8-bccf-229b02627940 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:59.366209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b8232398-d385-4cfd-9c30-095c82fe26c8 req-fe3919f1-31e1-4db8-bccf-229b02627940 service nova] Creating event network-changed:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh2-842464-2 May 19 08:47:59.385984 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b8232398-d385-4cfd-9c30-095c82fe26c8 req-fe3919f1-31e1-4db8-bccf-229b02627940 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122463 May 19 08:47:59.399327 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3751/5076] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:47:59.415949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:59.416710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:59.466450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:59.467073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:59.468305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:59.468800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:59.657541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:59.660048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:59.673844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lazy-loading 'fault' on Instance uuid b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:47:59.824694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:47:59.851064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0beb722-99a2-43fc-a204-ae7cd463de3c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 200 len: 1330 microversion: 2.1 time: 0.435117 May 19 08:47:59.851925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3752/5077] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:59 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 1330 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:47:59.864463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:47:59.876124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:47:59.899871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:59.900344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:47:59.901249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:47:59.902603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:01.658064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:01.679619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d003a887-827c-454a-bb88-1e58a2651415 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1728 microversion: 2.1 time: 1.819416 May 19 08:48:01.680183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3753/5078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:47:59 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1728 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:01.699412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b2c1aa01-857f-4351-be31-0be6d94920a3 req-c7936d42-608a-4c62-9acc-4d826c3cefea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad", "name": "network-vif-deleted", "tag": "2d10c21a-8ce3-42b4-a7d0-d90e2edebe54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:01.746524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b2c1aa01-857f-4351-be31-0be6d94920a3 req-c7936d42-608a-4c62-9acc-4d826c3cefea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:01.746967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b2c1aa01-857f-4351-be31-0be6d94920a3 req-c7936d42-608a-4c62-9acc-4d826c3cefea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:01.816546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b2c1aa01-857f-4351-be31-0be6d94920a3 req-c7936d42-608a-4c62-9acc-4d826c3cefea service nova] Creating event network-vif-deleted:2d10c21a-8ce3-42b4-a7d0-d90e2edebe54 for instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad on chh2-842464-2 May 19 08:48:01.827184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b2c1aa01-857f-4351-be31-0be6d94920a3 req-c7936d42-608a-4c62-9acc-4d826c3cefea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136631 May 19 08:48:01.830540 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3754/5079] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:01.850901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:01.854014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:01.895862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:01.896638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:01.897768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:01.898493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:02.371167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:02.403991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1cb68816-1695-4507-9c35-34c541cfaf53 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1390 microversion: 2.1 time: 0.571845 May 19 08:48:02.415265 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3755/5080] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:01 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1390 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:02.429900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:02.441743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:02.454066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:02.454649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:02.457886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:02.458462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:02.491097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad HTTP/1.1 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad'} May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:02.500126 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:48:02.504486 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:02.505247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:48:02.506380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60ca556b-460e-41c9-8e66-409c8f51cd95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 404 len: 111 microversion: 2.1 time: 0.080372 May 19 08:48:02.511188 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3756/5081] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:02 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:48:02.523187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:02.524596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:02.537750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:02.540225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:02.541186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:02.545231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:02.666099 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c703e87-38d4-4c27-8ebc-a25a74f678f1 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153368 May 19 08:48:02.666836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3757/5082] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:48:02 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:02.671879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9ba3bcd-72c4-48c2-83e6-1ef96f90ee5f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '.version_select at 0x7f32104d6430>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:02.710382 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9ba3bcd-72c4-48c2-83e6-1ef96f90ee5f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-793933002" status: 202 len: 0 microversion: 2.1 time: 0.041794 May 19 08:48:02.714633 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3758/5083] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:48:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-793933002 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:48:03.441911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:03.442768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:03.454524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:03.459486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:03.464088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:03.465417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:04.103340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:04.114242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f62046e-79b6-4d8b-927c-7fef5b632f6d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1390 microversion: 2.1 time: 0.683875 May 19 08:48:04.115202 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3759/5084] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:03 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1390 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:05.133914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:05.135086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:05.159258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:05.171035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:05.172070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:05.174464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:06.106270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:06.132887 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9563dbb3-1cb7-47e8-b37e-513f5979475c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1390 microversion: 2.1 time: 1.003575 May 19 08:48:06.136670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3760/5085] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:05 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1390 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:06.162393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-30575474-d024-442e-8322-4f407036d004 req-8520123d-b0a4-417c-a3c9-1a3c385ecbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "name": "network-vif-plugged", "status": "completed", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:06.187230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-30575474-d024-442e-8322-4f407036d004 req-8520123d-b0a4-417c-a3c9-1a3c385ecbcf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:06.187688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-30575474-d024-442e-8322-4f407036d004 req-8520123d-b0a4-417c-a3c9-1a3c385ecbcf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:06.221858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-30575474-d024-442e-8322-4f407036d004 req-8520123d-b0a4-417c-a3c9-1a3c385ecbcf service nova] Creating event network-vif-plugged:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh2-842464-2 May 19 08:48:06.228238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-30575474-d024-442e-8322-4f407036d004 req-8520123d-b0a4-417c-a3c9-1a3c385ecbcf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078470 May 19 08:48:06.230962 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3761/5086] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:07.160874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:07.162368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:07.171549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:07.177704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:07.179253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:07.179863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:07.853570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:07.863253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4751442d-ce07-4a62-9348-4ed801b310a8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1390 microversion: 2.1 time: 0.712522 May 19 08:48:07.874625 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3762/5087] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:07 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1390 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:07.885440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6cd8218e-0e4b-4c68-8e7d-b7fa570ff810 req-9e3b4ad7-17c7-4eb8-8684-589a867d4610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:07.898394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6cd8218e-0e4b-4c68-8e7d-b7fa570ff810 req-9e3b4ad7-17c7-4eb8-8684-589a867d4610 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:07.898965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6cd8218e-0e4b-4c68-8e7d-b7fa570ff810 req-9e3b4ad7-17c7-4eb8-8684-589a867d4610 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:07.918058 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6cd8218e-0e4b-4c68-8e7d-b7fa570ff810 req-9e3b4ad7-17c7-4eb8-8684-589a867d4610 service nova] Creating event network-changed:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:48:07.925568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6cd8218e-0e4b-4c68-8e7d-b7fa570ff810 req-9e3b4ad7-17c7-4eb8-8684-589a867d4610 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048241 May 19 08:48:07.930323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3763/5088] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:07.940166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:07.941133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:07.954265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:07.955200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:07.956510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:07.957268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:08.004728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:08.206278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lazy-loading 'services' on Instance uuid b0d1e95a-431d-4672-9e95-72e0956a248f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:48:08.427021 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccd6cfbf-14c1-4a15-849d-5c041d8ea1b3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments/fed1872f-1952-43ac-bf3e-09365a197150" status: 202 len: 0 microversion: 2.1 time: 0.495183 May 19 08:48:08.444583 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3764/5089] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:48:07 2022] DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments/fed1872f-1952-43ac-bf3e-09365a197150 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:48:08.461216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:08.465616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:08.503043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:08.503729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:08.504600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:08.505074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:08.621909 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9f65302-d135-4ffd-8ef5-5cbe3fec0ef4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175801 May 19 08:48:08.626708 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3765/5090] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:08 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:08.899693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:08.900422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:08.912259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:08.913850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:08.915177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:08.915798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:09.398428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:09.424211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d135788d-ae7a-4229-821d-bbdf49175263 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1563 microversion: 2.1 time: 0.531731 May 19 08:48:09.436924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3766/5091] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:08 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1563 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:09.443878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:09.444752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:09.452630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:09.453331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:09.455218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:09.455785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:09.678449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:09.687596 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47d7e970-9efd-43b6-b681-5aa328839622 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1563 microversion: 2.1 time: 0.249160 May 19 08:48:09.688609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3767/5092] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:09 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:09.708828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:09.711315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:09.723234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:09.724240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:09.725464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:09.726186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:09.777506 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d49f596e-8bd8-47d9-9f36-c5c7e2e6a653 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077259 May 19 08:48:09.778626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3768/5093] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:09 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:09.943209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-27b19e4e-9726-48a2-8284-1c25e24f2bda req-f8a011ce-8ebd-4beb-abf8-60d35d4c60ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:09.956240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27b19e4e-9726-48a2-8284-1c25e24f2bda req-f8a011ce-8ebd-4beb-abf8-60d35d4c60ca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:09.959151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27b19e4e-9726-48a2-8284-1c25e24f2bda req-f8a011ce-8ebd-4beb-abf8-60d35d4c60ca service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:09.979478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-27b19e4e-9726-48a2-8284-1c25e24f2bda req-f8a011ce-8ebd-4beb-abf8-60d35d4c60ca service nova] Creating event network-changed:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:48:09.987369 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-27b19e4e-9726-48a2-8284-1c25e24f2bda req-f8a011ce-8ebd-4beb-abf8-60d35d4c60ca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048690 May 19 08:48:09.988819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3769/5094] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:48:10.801629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:10.819020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:10.841601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:10.843231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:10.845123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:10.845806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:10.922057 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d55616ee-c1da-472a-90ac-9c5a2dabf8e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134132 May 19 08:48:10.923767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3770/5095] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:10 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:48:11.940376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:11.941887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:11.968648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:11.971164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:11.972196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:11.976042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:12.079296 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1543bf9-ca80-449c-8980-9eadba1443d4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148574 May 19 08:48:12.089764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3771/5096] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:11 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:13.095345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:13.097278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:13.140040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:13.141842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:13.143301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:13.144707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:13.190069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea166aef-9630-467f-8f3f-5a103f1af822 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102922 May 19 08:48:13.204266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3772/5097] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:13 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:14.202033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:14.206109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:14.237623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:14.238081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:14.238876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:14.239323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:14.368954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4ae2736-8983-459d-973f-386947f08bd6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170559 May 19 08:48:14.376673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3773/5098] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:14 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:14.700710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-281353005", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ae975c03-1fd6-42cc-b6fd-3978ea98fd78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:14.835701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:48:16.359430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:48:16.361514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:48:16.362230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:48:16.362874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:48:16.363493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:48:16.380160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:16.383134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:16.384793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:16.389965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:16.479142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:48:16.512363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:48:16.722882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:48:16.724925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae975c03-1fd6-42cc-b6fd-3978ea98fd78',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:48:17.018928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcaa33f5-2e4a-4854-83fc-ac57f9eda705 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.321911 May 19 08:48:17.025642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3774/5099] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:48:17.031121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:17.034857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:17.052318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:17.053008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:17.053974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:17.054559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:17.131248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30253d7e-178c-47f3-88f5-dbde6890e1e8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104110 May 19 08:48:17.131851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3775/5100] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:17 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:17.136482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:17.137103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:17.178670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:17.178670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:17.178670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:17.181643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:17.534277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:17.546002 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d4b1603-bff1-4381-bb2e-b613e5d73891 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1563 microversion: 2.1 time: 0.413082 May 19 08:48:17.558955 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3776/5101] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:17 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1563 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:17.565062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2374700d-8b19-43f5-b6bc-cbd408bec311 req-818adc58-e298-4498-8318-8eb8cdf3510b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:17.588737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2374700d-8b19-43f5-b6bc-cbd408bec311 req-818adc58-e298-4498-8318-8eb8cdf3510b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:17.589463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2374700d-8b19-43f5-b6bc-cbd408bec311 req-818adc58-e298-4498-8318-8eb8cdf3510b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:17.623829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2374700d-8b19-43f5-b6bc-cbd408bec311 req-818adc58-e298-4498-8318-8eb8cdf3510b service nova] Creating event network-changed:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh2-842464-2 May 19 08:48:17.630082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2374700d-8b19-43f5-b6bc-cbd408bec311 req-818adc58-e298-4498-8318-8eb8cdf3510b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070275 May 19 08:48:17.632436 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3777/5102] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:17.649476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-926525a2-a6e6-4d15-8fa1-be102ae0884b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:17.650189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-926525a2-a6e6-4d15-8fa1-be102ae0884b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:17.782096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-926525a2-a6e6-4d15-8fa1-be102ae0884b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:17.790300 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-926525a2-a6e6-4d15-8fa1-be102ae0884b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1056 microversion: 2.1 time: 0.155943 May 19 08:48:17.793152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3778/5103] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:17 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1056 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:18.144405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:18.145439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:18.148699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:18.162197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:18.162918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:18.174803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:18.179548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:18.278855 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e2e5e44-3c08-4c4e-9d8f-5e76a74749fb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139475 May 19 08:48:18.287552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3779/5104] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:18 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:18.811587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:18.812389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:18.853630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:18.860596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:18.865805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:18.866459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:19.071395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:19.083718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c919dd2-9a19-4b1e-95cb-f8256075f221 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1154 microversion: 2.1 time: 0.276742 May 19 08:48:19.088442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3780/5105] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:18 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1154 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:19.293676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:19.294612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:19.316281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:19.316729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:19.317709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:19.318294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:19.407678 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd6003f3-22cc-4740-8d81-4328a1052a79 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118243 May 19 08:48:19.419846 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3781/5106] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:19 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:20.111724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:20.112471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:20.131920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:20.133884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:20.138368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:20.143342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:21.093712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:21.103340 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a2ad7ba-55a6-42d8-9dbd-4c689cbee7f7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1172 microversion: 2.1 time: 0.995730 May 19 08:48:21.115685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3782/5107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:20 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1172 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:21.124856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:21.135498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:21.155370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:21.165500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:21.166726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:21.167115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:21.188378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:21.276233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e30ee9f9-e150-4ea2-a3e3-862df1e0a618 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158707 May 19 08:48:21.276844 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3783/5108] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:21 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:22.128388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:22.129021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:22.154842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:22.155694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:22.161950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:22.162833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:22.484413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:22.498627 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-575a2eb9-d468-4c76-848d-1a11750aa793 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1172 microversion: 2.1 time: 0.374623 May 19 08:48:22.505924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3784/5109] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:22 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1172 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:22.512372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:22.522844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:22.544711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:22.545687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:22.547121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:22.550537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:22.611162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7bebf308-ebdd-4081-868a-460428c1e66c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102819 May 19 08:48:22.615762 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3785/5110] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:22 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:23.519652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:23.520288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:23.541212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:23.542323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:23.547610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:23.552982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:24.103742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:24.117936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c78beaa4-3ec2-4001-b2c9-b770c6d4dd8a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.601705 May 19 08:48:24.119654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3786/5111] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:23 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:24.125554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:24.126839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:24.137953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:24.139181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:24.140447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:24.141644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:24.191423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a9f9b9b-b9c6-4ede-b784-153644bf2a95 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070327 May 19 08:48:24.198075 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3787/5112] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:24 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:25.136917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:25.138650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:25.152516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:25.155752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:25.158924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:25.159697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:25.775318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:25.790545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb117532-c76e-4383-8507-acb111726c57 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.657839 May 19 08:48:25.791822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3788/5113] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:25 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:25.804181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:25.805335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:25.826116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:25.834986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:25.838325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:25.843343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:25.927238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1e8bc57-ec04-4e1f-8fb1-edadf5faf169 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133954 May 19 08:48:25.928440 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3789/5114] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:25 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:25.939117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8e218ef0-0b5b-41ba-9a0b-490d212e6fa7 req-a5c0d2aa-607b-4fe8-a6cf-dfa0ca69bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "316de9bb-b23e-4707-8d04-fc4a36f73ae4", "tag": "8d707601-00aa-443c-9b39-528c45fa7d19"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:25.965172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8e218ef0-0b5b-41ba-9a0b-490d212e6fa7 req-a5c0d2aa-607b-4fe8-a6cf-dfa0ca69bb4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:25.965655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8e218ef0-0b5b-41ba-9a0b-490d212e6fa7 req-a5c0d2aa-607b-4fe8-a6cf-dfa0ca69bb4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:26.008152 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8e218ef0-0b5b-41ba-9a0b-490d212e6fa7 req-a5c0d2aa-607b-4fe8-a6cf-dfa0ca69bb4e service nova] Creating event network-changed:8d707601-00aa-443c-9b39-528c45fa7d19 for instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 on chh1-842464-2 May 19 08:48:26.026140 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8e218ef0-0b5b-41ba-9a0b-490d212e6fa7 req-a5c0d2aa-607b-4fe8-a6cf-dfa0ca69bb4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094822 May 19 08:48:26.029853 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3790/5115] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:26.821717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:26.822665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:26.840285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:26.843029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:26.843514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:26.846307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:26.846786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:27.133725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:27.145256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac203b5b-2500-4fef-80f4-dcd2d207459c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.328509 May 19 08:48:27.146700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3791/5116] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:26 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:27.155626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:27.157952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:27.165759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:27.167270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:27.168698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:27.169361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:27.212357 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d69e33f2-5452-44a8-92ac-be567061a97b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061635 May 19 08:48:27.213617 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3792/5117] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:27 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:28.166810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:28.167682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:28.192814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:28.204663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:28.205517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:28.210347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:28.219706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:28.475369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:28.488792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3b5613c-98b9-4660-810d-ce63b04f6cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.329003 May 19 08:48:28.498056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3793/5118] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:28 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:28.498056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:28.498056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:28.508708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:28.509603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:28.510632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:28.511424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:28.595126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-087c9a9c-144a-45f1-be6b-62b8a710514f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103865 May 19 08:48:28.603353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3794/5119] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:28 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:29.510889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:29.512389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:29.526428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:29.527534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:29.528903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:29.529710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:29.754688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:29.764630 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ad5354c-e03e-4390-b710-b1c7083fef2e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.260988 May 19 08:48:29.766656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3795/5120] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:29 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:29.775411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:29.777608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:29.787149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:29.787870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:29.788849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:29.789532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:29.836742 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4dfc42fa-7f6e-4cab-9579-5c20c2d16234 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068336 May 19 08:48:29.837607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3796/5121] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:29 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:30.785067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:30.787175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:30.797022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:30.799413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:30.800574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:30.801192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.019131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:31.030153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-170da93e-a648-4a5d-849c-d32c9f4d6fa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.250588 May 19 08:48:31.041758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3797/5122] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:30 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:31.064074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:31.065721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:31.084494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:31.088972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.090262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:31.090794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.175932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f29f4b58-afd6-4db8-b59d-b92abb973952 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132738 May 19 08:48:31.176546 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3798/5123] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:31 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:31.201655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:31.202424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:31.214178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:31.215359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.218031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:31.218572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.267917 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] HTTP exception thrown: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Request method failure captured: May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 HTTP/1.1 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJhiE5z1mSmdDhoz_h658wNGCzc6AcwUs1me2-3p0Un0lFreX73k4m_Qu8eULEXMsX5oogk-rwBY8_UCrpxZDGtfGeTRLkr7-vHXzZg4LqXmnViCCy10o-wj65hzaqEBQJzRP0woM1Y6R7n8Ph-EdlJDgD3XoqtgcYLnNqxsdkOgtE May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b5544135087c43e9929fee886ac58afd May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5544135087c43e9929fee886ac58afd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5544135087c43e9929fee886ac58afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeTestJSON-1387471750 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b5544135087c43e9929fee886ac58afd May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 982a8a134680453bb66192b6d7cbb477 May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2d232c78-9c4b-42bf-a485-951ffbb7b009'} May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:48:31.269672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Returning 404 to user: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d0e869a-6dc4-45ea-bbc4-63cdb1549837 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 404 len: 111 microversion: 2.1 time: 0.073591 May 19 08:48:31.273600 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3799/5124] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:48:31 2022] DELETE /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:48:31.279653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:31.280281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 2d232c78-9c4b-42bf-a485-951ffbb7b009] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:31.287288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:31.287748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.288545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:31.288989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:31.307548 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] HTTP exception thrown: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Request method failure captured: May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 HTTP/1.1 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJhiE5z1mSmdDhoz_h658wNGCzc6AcwUs1me2-3p0Un0lFreX73k4m_Qu8eULEXMsX5oogk-rwBY8_UCrpxZDGtfGeTRLkr7-vHXzZg4LqXmnViCCy10o-wj65hzaqEBQJzRP0woM1Y6R7n8Ph-EdlJDgD3XoqtgcYLnNqxsdkOgtE May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b5544135087c43e9929fee886ac58afd May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5544135087c43e9929fee886ac58afd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5544135087c43e9929fee886ac58afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeTestJSON-1387471750 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b5544135087c43e9929fee886ac58afd May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 982a8a134680453bb66192b6d7cbb477 May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '2d232c78-9c4b-42bf-a485-951ffbb7b009'} May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:31.309125 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. May 19 08:48:31.313398 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:31.317100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Returning 404 to user: Instance 2d232c78-9c4b-42bf-a485-951ffbb7b009 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:48:31.318131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5609a504-a926-4145-9e01-5c1ef0e73e6a tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009" status: 404 len: 111 microversion: 2.1 time: 0.042248 May 19 08:48:31.324203 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3800/5125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:31 2022] GET /compute/v2.1/servers/2d232c78-9c4b-42bf-a485-951ffbb7b009 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:48:32.049710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:32.052035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:32.065904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.083182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.084371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.085005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.307860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:32.313763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:32.325211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c89e2bd1-bccc-48c7-8fde-5c93829e16df tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.280197 May 19 08:48:32.326801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3801/5126] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:32 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:32.335771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:32.336976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:32.345866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.346716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.347712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.348374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.396321 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f35a55a-1891-4a21-bac9-4ee17d687dba tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067976 May 19 08:48:32.397421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3802/5127] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:32 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:48:32.485946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:32.486466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:32.493562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.494024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.494825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.495274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.525930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:48:32.701952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a016040-dc6f-467e-8d5c-a3e8cf643c6f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 204 len: 0 microversion: 2.1 time: 0.220386 May 19 08:48:32.706310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3803/5128] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:48:32 2022] DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:48:32.712965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:32.717006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:32.742045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.745439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:32.751856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:32.752972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:33.017863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:33.027426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0179c530-53c1-4477-ab2f-79f06d928915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1681 microversion: 2.1 time: 0.319545 May 19 08:48:33.032171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3804/5129] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:32 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:33.139859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:33.140852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:33.163414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:33.163818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:33.165882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:33.166644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:33.977914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89a3f75a-0700-4fa5-b317-99c66fab7293 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action" status: 200 len: 24563 microversion: 2.1 time: 0.841712 May 19 08:48:33.987169 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3805/5130] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:48:33 2022] POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action => generated 24563 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:48:33.997338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:33.998343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:34.012485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:34.013504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:34.014534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:34.015195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:34.255146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:34.269627 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5cb8583f-4372-425e-aa1d-e54c9c2d4e1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.279865 May 19 08:48:34.279450 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3806/5131] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:33 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:34.284816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:34.285499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:34.305052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:34.305755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:34.306786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:34.307768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:34.598975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:34.613338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-32977cb3-cf66-4c8e-9f4b-907c82e83eef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1681 microversion: 2.1 time: 0.332284 May 19 08:48:34.624602 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3807/5132] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:34 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:35.287988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:35.289698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:35.302359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:35.306891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:35.308056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:35.308677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:35.639155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:35.654456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21871c49-e776-4d4c-81ad-16c81a95a7eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.370647 May 19 08:48:35.657739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3808/5133] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:35 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:35.668373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:35.674538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:35.689727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:35.694880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:35.698259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:35.698936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:35.840352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:35.855521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3852ca01-42a1-4adc-aa6f-eff15edd2090 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 200 len: 1614 microversion: 2.1 time: 0.192364 May 19 08:48:35.856877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3809/5134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:35 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 1614 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:36.188593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-827a8986-fb8a-44df-afe6-99935a108743 req-c17b6100-a8d9-4b40-a4c7-9456b534beb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d1e95a-431d-4672-9e95-72e0956a248f", "name": "network-vif-deleted", "tag": "96a52830-fa39-4200-9dbe-5349717768b5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:36.215055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-827a8986-fb8a-44df-afe6-99935a108743 req-c17b6100-a8d9-4b40-a4c7-9456b534beb2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:36.215924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-827a8986-fb8a-44df-afe6-99935a108743 req-c17b6100-a8d9-4b40-a4c7-9456b534beb2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:36.266641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-827a8986-fb8a-44df-afe6-99935a108743 req-c17b6100-a8d9-4b40-a4c7-9456b534beb2 service nova] Creating event network-vif-deleted:96a52830-fa39-4200-9dbe-5349717768b5 for instance b0d1e95a-431d-4672-9e95-72e0956a248f on chh2-842464-2 May 19 08:48:36.277298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-827a8986-fb8a-44df-afe6-99935a108743 req-c17b6100-a8d9-4b40-a4c7-9456b534beb2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090343 May 19 08:48:36.280250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3810/5135] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:36.679357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:36.680361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:36.702369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:36.702944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:36.703945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:36.704478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:37.120057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:37.135594 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88602a75-9f5c-438b-a142-0ff95b55897a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.464483 May 19 08:48:37.136515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3811/5136] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:36 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:37.147928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:37.149175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:37.159536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:37.160239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:37.163228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:37.164797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:37.185595 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f HTTP/1.1 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b0d1e95a-431d-4672-9e95-72e0956a248f'} May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:48:37.188572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-224cb213-25cb-4415-9adf-d08a91739363 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 404 len: 111 microversion: 2.1 time: 0.052889 May 19 08:48:37.192187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3812/5137] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:37 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:48:37.200515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51f10661-9c3c-47d0-996a-cb320fd47932 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '.version_select at 0x7f32104d6820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:37.235855 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51f10661-9c3c-47d0-996a-cb320fd47932 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365714777" status: 202 len: 0 microversion: 2.1 time: 0.038174 May 19 08:48:37.248940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3813/5138] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:48:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365714777 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:48:38.161927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:38.163105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:38.211708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:38.213230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:38.216752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:38.218058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:38.646140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:38.659634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5954c0ba-9a32-439f-bdf7-e6735ee8c060 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.507409 May 19 08:48:38.660802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3814/5139] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:38 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:38.754152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad25d3c9-50c3-4834-a8f8-bd2ceb1bb805 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: .version_select at 0x7f3212208dc0>, body: {"keypair": {"name": "tempest-keypair-1803139743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvwZVBw561ALUDj82Rn+v8nckrqoQI/DaUnYB2aw5BmYNvf+8Tth70dPnQd3I0l0ZQEMWIwNes41Gtj6IWD84ezGdK75Iil2CI+mJpBU/te3YBfHwnKs8TmTViDlN0reA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:38.773063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ad25d3c9-50c3-4834-a8f8-bd2ceb1bb805 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:48:38.783454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ad25d3c9-50c3-4834-a8f8-bd2ceb1bb805 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:48:38.820221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad25d3c9-50c3-4834-a8f8-bd2ceb1bb805 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068275 May 19 08:48:38.826479 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3815/5140] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:48:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:39.631746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:39.633024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:39.646308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:39.647345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:39.649037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:39.650105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:39.792736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lazy-loading 'services' on Instance uuid 76e9d206-9a9e-4c2f-b901-3a0c53a9226d {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:48:39.954097 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-376a4085-3ab9-4ecc-acbe-2771805f611a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments/fd26d5ce-8215-4785-a9d0-ec81cef30d98" status: 202 len: 0 microversion: 2.1 time: 0.325716 May 19 08:48:39.956849 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3816/5141] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:48:39 2022] DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments/fd26d5ce-8215-4785-a9d0-ec81cef30d98 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:48:39.981880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:39.985350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:40.004796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:40.005492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:40.006317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:40.008580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5edb6428-2246-4da4-8038-d4a545a27478 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.594069 May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3817/5142] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:39 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:40.631019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:40.750806 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73280203-92d6-4d1c-8c7a-30e4431b09ed tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179609 May 19 08:48:40.751473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3818/5143] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:40 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:41.572455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:41.573256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:41.589824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:41.592633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:41.593744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:41.594610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:42.066666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:42.071436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:42.103093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0134ec1d-06d5-4ff3-8486-d1d4f11f249f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.534786 May 19 08:48:42.103714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3819/5144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:41 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:42.129593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:42.130615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:42.143210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:42.155306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:42.155770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:42.157248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:42.166238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:42.280688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c5841e5-937a-4d7b-8187-719ef298a3c2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175799 May 19 08:48:42.281248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3820/5145] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:42 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:42.300887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-638084429", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05c219cb-d37a-447f-853c-897fd14c1619"}], "security_groups": [{"name": "tempest-securitygroup--722857635"}], "key_name": "tempest-keypair-1803139743", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:42.684731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] validate_networks() for [('05c219cb-d37a-447f-853c-897fd14c1619', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:48:43.506228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:48:43.506889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:48:43.507117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:48:43.507828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:48:43.508566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:48:43.526593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:43.527228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:43.528238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:43.532463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:43.583915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:48:43.624049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:48:43.653484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:48:43.656083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:48:43.788879 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2d28861f-6ccf-404b-bd86-0f60cac17915 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.492943 May 19 08:48:43.820478 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3821/5146] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:48:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:48:43.837481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:43.855303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:43.870014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:43.870823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:43.872697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:43.873390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:44.249478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:44.267637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dff9f652-9db6-4609-bf76-9204fec9bbaf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.441235 May 19 08:48:44.270911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3822/5147] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:43 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:44.287076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:44.306646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:44.317506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:44.318356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:44.319383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:44.320036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:44.365086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1dd878e8-d17b-4baa-a937-7c885eced504 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081812 May 19 08:48:44.366724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3823/5148] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:44 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:44.373477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9fc4e218-48b3-4806-a4fb-2b4e6411e7d6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:44.377056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9fc4e218-48b3-4806-a4fb-2b4e6411e7d6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:44.451870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9fc4e218-48b3-4806-a4fb-2b4e6411e7d6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:44.462894 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9fc4e218-48b3-4806-a4fb-2b4e6411e7d6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1241 microversion: 2.1 time: 0.094605 May 19 08:48:44.473242 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3824/5149] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:44 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:45.036537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:45.037514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:45.065218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:45.066149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:45.067418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:45.068019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:45.667144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82287bdc-df5d-4315-9447-f4424fcad6ed tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1832 microversion: 2.1 time: 0.640011 May 19 08:48:45.673880 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3825/5150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:45 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1832 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:45.680574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:45.681214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:45.697424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:45.697880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:45.698666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:45.699113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:45.996018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:46.006415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0bde4581-bb22-4649-af98-b2b99d62799f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.330688 May 19 08:48:46.007914 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3826/5151] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:45 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:46.014521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:46.016559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:46.027304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.028294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.029589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.030199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.112851 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efe36ef5-3e24-4417-a111-18f4fb4878e7 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103206 May 19 08:48:46.115164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3827/5152] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:46 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:46.123599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:46.124493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:46.146005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.148158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.149782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.150415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.249883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:46.259914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7ece13e-0686-40f6-92c8-c7bba77d510d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1299 microversion: 2.1 time: 0.142206 May 19 08:48:46.261578 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3828/5153] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:46 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:46.266632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:46.267566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:46.275415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.276180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.277346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.278025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.523032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:46.533609 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06417667-cc6c-4f7e-9ef8-3fdceac25bcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1681 microversion: 2.1 time: 0.270107 May 19 08:48:46.543000 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3829/5154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:46 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1681 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:46.646549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:46.647516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:46.673014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.673585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.674559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.675007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.764608 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4fa58486-86f0-4f92-892b-1bd2be57e918 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action" status: 200 len: 32636 microversion: 2.1 time: 0.122096 May 19 08:48:46.767007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3830/5155] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:48:46 2022] POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action => generated 32636 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 08:48:46.924609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:46.929580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:46.942048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.942663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.943584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:46.944133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:46.993786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64015fd8e03a44e7a6d30d6119a9cddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4cc15c286a4af3ad041909f0fdc38a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:46.994546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] flavor_id is None. Assuming migration. {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 08:48:46.995099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 08:48:47.283819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f52e187-e1e2-4ec4-83db-d404bce6c175 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action" status: 202 len: 0 microversion: 2.1 time: 0.364830 May 19 08:48:47.286805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3831/5156] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:48:46 2022] POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:48:47.295101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:47.296842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:47.308032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:47.308877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:47.310663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:47.312239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:47.542130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:47.559902 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4af8777-27aa-412f-bfe7-359341d5b7fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.271416 May 19 08:48:47.561062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3832/5157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:47 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:47.571521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:47.578054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:47.602509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:47.603014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:47.603856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:47.606819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:47.713075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-68bfe30d-d93c-4851-ac66-c6fedf90f276 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148399 May 19 08:48:47.720064 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3833/5158] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:47 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:47.733349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:47.734096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:47.764145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:47.768043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:47.770039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:47.770563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:48.206604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:48.225346 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-feac2c63-412e-4a21-812d-0d5be2de684c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.503886 May 19 08:48:48.226427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3834/5159] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:47 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:48.231698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:48.233409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:48.257785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:48.258501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:48.259562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:48.260169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:48.601744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:48.622063 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03318103-b64e-4e9c-91a9-c1b2041fe0d2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1690 microversion: 2.1 time: 0.385123 May 19 08:48:48.623751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3835/5160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:48 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1690 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:48.660074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:48.663098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:48.692172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:48.699996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:48.706262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:48.709778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:49.642285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:49.646917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:49.657417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e27c1a6-19c0-4f46-803d-e77155dfb424 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 1.023433 May 19 08:48:49.658028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3836/5161] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:48 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:49.683166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:49.701692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:49.739559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:49.739965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:49.741467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:49.756353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:49.875860 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d793459-6fd1-410c-b4d6-9648f44f371e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216099 May 19 08:48:49.879913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3837/5162] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:49 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:49.890198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:49.891390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:49.901229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:49.902013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:49.903480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:49.904166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:50.561240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:50.585162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-952842ec-8359-4657-a7f3-fa43b0ff5b8c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.702094 May 19 08:48:50.599750 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3838/5163] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:49 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:50.605585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:50.612446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:50.633566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:50.634894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:50.635984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:50.636684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:51.597195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:51.612878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c56bad65-9369-4040-8b71-93a94015e967 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1690 microversion: 2.1 time: 1.011478 May 19 08:48:51.616043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3839/5164] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:50 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1690 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:51.621441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-98497a34-c19c-4fed-8f5d-fc476d3166c4 req-c41c8218-6610-43d6-8ef9-cb362d09ab9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cde4210-1ebd-4f04-ba8b-c6e59efffa8f", "tag": "fcec440b-31ca-4232-862d-b1d408baed06"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:51.632285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-98497a34-c19c-4fed-8f5d-fc476d3166c4 req-c41c8218-6610-43d6-8ef9-cb362d09ab9b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:51.632982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-98497a34-c19c-4fed-8f5d-fc476d3166c4 req-c41c8218-6610-43d6-8ef9-cb362d09ab9b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:51.649244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-98497a34-c19c-4fed-8f5d-fc476d3166c4 req-c41c8218-6610-43d6-8ef9-cb362d09ab9b service nova] Creating event network-changed:fcec440b-31ca-4232-862d-b1d408baed06 for instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f on chh2-842464-2 May 19 08:48:51.660116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-98497a34-c19c-4fed-8f5d-fc476d3166c4 req-c41c8218-6610-43d6-8ef9-cb362d09ab9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042188 May 19 08:48:51.664560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3840/5165] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:51.672813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:51.673411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:51.686198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:51.691203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:51.694011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:51.694646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:52.043431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:52.073668 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-190ab573-a9bb-4e8e-8a70-33e0fd7b2eac tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.407599 May 19 08:48:52.084296 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3841/5166] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:51 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:52.089644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:52.090889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:52.099984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:52.100629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:52.101619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:52.102204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:52.140810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b70409b0-501e-4fbc-a756-68c1c3e6f288 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055149 May 19 08:48:52.141985 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3842/5167] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:52 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:52.147523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:52.148362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:52.155311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:52.157254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:52.158271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:52.158866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:52.566625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:52.575719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88ec2761-9c58-4b89-8b72-6f3e1be5b41b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.432517 May 19 08:48:52.585519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3843/5168] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:52 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:52.634555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:52.636606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:52.654420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:52.655158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:52.656279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:52.657172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.121049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:53.146018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81a001fa-a20e-4ecf-a88b-73b4fe9f7827 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1690 microversion: 2.1 time: 0.514798 May 19 08:48:53.148067 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3844/5169] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:52 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1690 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:53.154029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:53.182742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:53.190721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:53.191605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.193175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:53.194060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.447497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:53.468417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc51322a-a7e8-4499-9393-9f6e1d0b1afe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.319132 May 19 08:48:53.478005 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3845/5170] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:53 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:53.500344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:53.501766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:53.510806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:53.511583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.512578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:53.513213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.559290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:53.576935 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8164d5a8-7884-405f-929f-53e2a5fceb9a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096690 May 19 08:48:53.578455 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3846/5171] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:53 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:53.606493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:53.622277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:53.635499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:53.638029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.645618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:53.646206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:53.857872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:53.869172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c36124d9-ace2-455d-923a-d5569f11b4d3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.268519 May 19 08:48:53.870498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3847/5172] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:53 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:54.166286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:54.166525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:54.186851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:54.187411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:54.189100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:54.189591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:54.424299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:54.435127 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8dcebd93-be51-4b33-8e28-e1fde629840b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.273472 May 19 08:48:54.436550 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3848/5173] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:54 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:54.507578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:54.511407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:54.521647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:54.525460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:54.526266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:54.529148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:54.529898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:54.817500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:54.830443 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70dc8a4e-0987-4abd-8941-38bee53ce9fc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.340213 May 19 08:48:54.833669 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3849/5174] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:54 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:55.086839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:55.088040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:55.100152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.100865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.105422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.106365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.216491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02520119-f9f4-4415-8fa2-d580f50dd0f2 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.376797 May 19 08:48:55.220017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3850/5175] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:54 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:55.228951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:55.229624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:55.252023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.252738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.254024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.254770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.536656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:55.545639 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a82d9a15-93a0-493f-8c51-51097d6db2d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.324623 May 19 08:48:55.546243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3851/5176] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:55 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:55.570941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:55.572105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:55.582298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.593660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.595138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.595760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.853814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:55.864627 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d4964cd-8cc2-40f4-b6ed-33988f39487d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.317300 May 19 08:48:55.865236 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3852/5177] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:55 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:55.879641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:55.885911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:55.919386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.919844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:55.920658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:55.921103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:56.296159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:56.317456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aaff1a42-9a50-41cb-9f0f-24fae3c1fe55 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.443933 May 19 08:48:56.318294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3853/5178] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:55 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:56.325567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:56.326868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:56.340743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:56.341155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:56.342019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:56.342464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:56.385558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:56.401427 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4ecb27a-13f6-40b7-8618-fe1a610ff3a8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081676 May 19 08:48:56.402205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3854/5179] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:56 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:56.565717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:56.567518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:56.582756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:56.591337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:56.592548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:56.593971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.161355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:57.182043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06aadd76-4cad-494f-989f-55c2d4ff85c8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.622952 May 19 08:48:57.182780 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3855/5180] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:56 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:57.190735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c52ff402-f61d-48f5-b155-ee01edcf0fd9 req-bb1e3076-fb89-4420-b051-a3a33bf208b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cde4210-1ebd-4f04-ba8b-c6e59efffa8f", "name": "network-vif-plugged", "status": "completed", "tag": "fcec440b-31ca-4232-862d-b1d408baed06"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:48:57.202571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c52ff402-f61d-48f5-b155-ee01edcf0fd9 req-bb1e3076-fb89-4420-b051-a3a33bf208b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.203406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c52ff402-f61d-48f5-b155-ee01edcf0fd9 req-bb1e3076-fb89-4420-b051-a3a33bf208b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.220689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c52ff402-f61d-48f5-b155-ee01edcf0fd9 req-bb1e3076-fb89-4420-b051-a3a33bf208b2 service nova] Creating event network-vif-plugged:fcec440b-31ca-4232-862d-b1d408baed06 for instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f on chh2-842464-2 May 19 08:48:57.227245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c52ff402-f61d-48f5-b155-ee01edcf0fd9 req-bb1e3076-fb89-4420-b051-a3a33bf208b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041310 May 19 08:48:57.228090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3856/5181] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:57.239048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:57.240422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:57.264420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.265226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.272551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.273104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.638465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:57.657394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a08c385e-5c5b-4277-9574-5c2134155d04 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.426692 May 19 08:48:57.658210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3857/5182] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:57 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:57.663931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:57.663931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:57.671622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.673737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.676072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.676690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.912879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:57.922982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50868bbd-0157-4b44-9034-e0595cd05f15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.263330 May 19 08:48:57.947115 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3858/5183] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:57 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:57.959453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:57.960866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:57.975182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.975644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:57.979211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:57.979663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:58.056424 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95072a13-264c-4cbd-8dd8-bc6400a38dd4 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108067 May 19 08:48:58.057021 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3859/5184] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:57 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:58.204342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:58.205373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:58.212339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:48:58.214581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:58.216392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:58.217637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:58.218282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:58.559568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:58.573086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-45cc0f69-499d-41c0-b0bc-f3a68720ebfe tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1366 microversion: 2.1 time: 0.373730 May 19 08:48:58.581661 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3860/5185] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:58 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:58.676011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:58.676608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:58.684606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:58.685057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:58.685884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:58.686323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.010244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:59.019323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1956912e-2708-45aa-a86a-f4b68524dbcb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.348094 May 19 08:48:59.030443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3861/5186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:58 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:59.037967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:59.056280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:59.081855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.082328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.083211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.083670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.345040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:59.355543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-440a9b85-9b54-4fa1-b480-4d978a38ae59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.322851 May 19 08:48:59.366551 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3862/5187] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:59 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:48:59.375493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:59.379286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:59.422777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.423527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.427974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.428775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.482764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84be3f88-3c46-4d99-af82-521acc8bf413 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114554 May 19 08:48:59.489661 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3863/5188] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:48:59 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:48:59.597095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:59.597790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:59.611906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.613437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.617628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.618203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.925325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:48:59.939112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb1394be-3d1f-4802-826d-836c21c33a69 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1556 microversion: 2.1 time: 0.346613 May 19 08:48:59.941045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3864/5189] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:48:59 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1556 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:48:59.956598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:48:59.957400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:48:59.970619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.971444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:48:59.972545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:48:59.973099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:00.128380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90f70afa-62b0-4663-ac40-e181a28c2cf6 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175069 May 19 08:49:00.143488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3865/5190] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:48:59 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:49:00.148270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:00.148270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:00.161319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:00.161905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:00.163102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:00.163690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:00.520798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:00.533794 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f13d943-bf79-403c-b1bc-358f99f63768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.394331 May 19 08:49:00.544103 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3866/5191] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:00 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:00.551190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:00.551813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:00.567994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:00.568697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:00.569732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:00.570339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:00.895512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:00.927839 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6949a68-db36-4ff5-8537-8e9b60acc8ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.381916 May 19 08:49:00.929219 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3867/5192] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:00 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:00.934788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:00.936506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:00.944860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:00.945675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:00.965520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:00.966396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:01.052012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da68922f-d60e-4aa5-a4c5-7eb88d71e688 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121280 May 19 08:49:01.053002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3868/5193] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:49:00 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:01.553411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:01.554097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:01.574885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:01.582205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:01.586684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:01.587887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:02.054379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:02.066843 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d8cef99-5bb0-4a00-8361-c16a12f19303 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.517750 May 19 08:49:02.085906 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3869/5194] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:01 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:02.091466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:02.092331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:02.099798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:02.100544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:02.101578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:02.102263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:02.460025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:02.482904 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d23221e-2795-4e1a-84e1-b209d41b7aa7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.395416 May 19 08:49:02.491683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3870/5195] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:02 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:02.508075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0bbd0ac5-a880-4083-b1f9-244259300e35 req-3f23bbf9-0c2c-45f6-b2af-7a0d86425461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cde4210-1ebd-4f04-ba8b-c6e59efffa8f", "tag": "fcec440b-31ca-4232-862d-b1d408baed06"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:02.543669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0bbd0ac5-a880-4083-b1f9-244259300e35 req-3f23bbf9-0c2c-45f6-b2af-7a0d86425461 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:02.550423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0bbd0ac5-a880-4083-b1f9-244259300e35 req-3f23bbf9-0c2c-45f6-b2af-7a0d86425461 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:02.573477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0bbd0ac5-a880-4083-b1f9-244259300e35 req-3f23bbf9-0c2c-45f6-b2af-7a0d86425461 service nova] Creating event network-changed:fcec440b-31ca-4232-862d-b1d408baed06 for instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f on chh2-842464-2 May 19 08:49:02.593562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0bbd0ac5-a880-4083-b1f9-244259300e35 req-3f23bbf9-0c2c-45f6-b2af-7a0d86425461 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100275 May 19 08:49:02.595182 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3871/5196] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:02.614765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:02.616433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:02.624178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:02.625654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:02.626689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:02.627285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:02.656113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:02.718910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-937dc5cb-3d98-4ca4-a875-6748d9f65818 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108983 May 19 08:49:02.720163 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3872/5197] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:49:02 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:03.098242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:03.099508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:03.114589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:03.115322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:03.122373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:03.122843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:03.419497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:03.436773 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e92e282-94f9-42fb-9890-8f0fea11436a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.347300 May 19 08:49:03.437416 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3873/5198] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:03 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:03.500730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:03.501422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:03.516799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:03.524240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:03.526101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:03.526798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:03.957758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:03.973025 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95c52bd2-e831-4cad-a178-bb3ddedc5d50 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.476583 May 19 08:49:03.976847 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3874/5199] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:03 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:04.000241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:04.001781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:04.011306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:04.012825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:04.015318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:04.017094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:04.077513 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e263d9b0-f619-44b2-b85e-6c4b298a272f tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099031 May 19 08:49:04.082754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3875/5200] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:49:03 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:04.455265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:04.455900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:04.462698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:04.463403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:04.464345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:04.464937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:04.691061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:04.707951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-378e01e2-0a1c-4285-89e4-70c6e5b6b35f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.254737 May 19 08:49:04.711334 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3876/5201] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:04 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:04.990783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:04.993252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:05.006193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.007216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.008626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.009292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.293958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:05.304932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4aa8507-bc5d-45ae-bd0d-34726867b2e5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.318822 May 19 08:49:05.306260 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3877/5202] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:04 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:05.312814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:05.314171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:05.323592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.323997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.324789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.325233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.366737 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5f10f8b-a031-4275-87d0-6b24353f5580 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059117 May 19 08:49:05.367422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3878/5203] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:49:05 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:05.642503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:05.643420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:05.653846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.654723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.657111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.658529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.689800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] HTTP exception thrown: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Request method failure captured: May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 HTTP/1.1 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJhiE5z1mSmdDhoz_h658wNGCzc6AcwUs1me2-3p0Un0lFreX73k4m_Qu8eULEXMsX5oogk-rwBY8_UCrpxZDGtfGeTRLkr7-vHXzZg4LqXmnViCCy10o-wj65hzaqEBQJzRP0woM1Y6R7n8Ph-EdlJDgD3XoqtgcYLnNqxsdkOgtE May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b5544135087c43e9929fee886ac58afd May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5544135087c43e9929fee886ac58afd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5544135087c43e9929fee886ac58afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeTestJSON-1387471750 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b5544135087c43e9929fee886ac58afd May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 982a8a134680453bb66192b6d7cbb477 May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '35ede4f4-ba88-460e-9998-80e614faf431'} May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:49:05.692074 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Returning 404 to user: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:05.696128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8184583a-a44e-4974-8dcb-fb586002afc1 tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 404 len: 111 microversion: 2.1 time: 0.057490 May 19 08:49:05.697282 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3879/5204] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:49:05 2022] DELETE /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:49:05.707344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:05.708168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] [instance: 35ede4f4-ba88-460e-9998-80e614faf431] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:05.714991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.715769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.716993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.717463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.737012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] HTTP exception thrown: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Request method failure captured: May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 HTTP/1.1 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgJhiE5z1mSmdDhoz_h658wNGCzc6AcwUs1me2-3p0Un0lFreX73k4m_Qu8eULEXMsX5oogk-rwBY8_UCrpxZDGtfGeTRLkr7-vHXzZg4LqXmnViCCy10o-wj65hzaqEBQJzRP0woM1Y6R7n8Ph-EdlJDgD3XoqtgcYLnNqxsdkOgtE May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b5544135087c43e9929fee886ac58afd May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5544135087c43e9929fee886ac58afd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5544135087c43e9929fee886ac58afd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5544135087c43e9929fee886ac58afd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeTestJSON-1387471750 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b5544135087c43e9929fee886ac58afd May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1387471750 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 982a8a134680453bb66192b6d7cbb477 May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeTestJSON-1387471750-project May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '35ede4f4-ba88-460e-9998-80e614faf431'} May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:05.738915 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:05.743241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] Returning 404 to user: Instance 35ede4f4-ba88-460e-9998-80e614faf431 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:05.744652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4b8f6e1-8571-4746-896b-6dd4c4a3785e tempest-AttachVolumeTestJSON-1387471750 tempest-AttachVolumeTestJSON-1387471750-project] 10.222.0.78 "GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431" status: 404 len: 111 microversion: 2.1 time: 0.043166 May 19 08:49:05.746127 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3880/5205] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:05 2022] GET /compute/v2.1/servers/35ede4f4-ba88-460e-9998-80e614faf431 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:49:05.752625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:05.753599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:05.760916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.761770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:05.762798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:05.763468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:06.205363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:06.215774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ee15427-0dce-4f81-a719-26c593b8a881 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1695 microversion: 2.1 time: 0.468294 May 19 08:49:06.216706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3881/5206] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:05 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1695 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:06.322719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:06.323933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:06.332082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:06.332814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:06.333946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:06.334536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:06.838549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:06.849467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d88df45f-7f22-4100-b855-df18e389a041 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.530475 May 19 08:49:06.860643 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3882/5207] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:06 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:06.868193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:06.880036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:06.887006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:06.887698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:06.888663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:06.889948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:06.925851 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec799313-02ab-400d-8426-fa71c574dd83 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063558 May 19 08:49:06.926674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3883/5208] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:49:06 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:49:07.004921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:07.006194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:07.013492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.014083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.014995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.015778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.047692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Cannot 'reboot' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action HTTP/1.1 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 28 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: {"reboot": {"type": "HARD"}} May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'reboot' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b9c32265-6611-4a95-92aa-d5d2ca3181cf', 'body': {'reboot': {'type': 'HARD'}}} May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:49:07.049281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.053078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.056706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 409 to user: Cannot 'reboot' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:07.058170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e36a8e63-a1bc-4ac1-8aa5-b06e2ae54147 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action" status: 409 len: 145 microversion: 2.1 time: 0.058581 May 19 08:49:07.063752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3884/5209] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:49:06 2022] POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action => generated 145 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 19 08:49:07.070144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:07.071913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:07.079538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.080272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.081276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.081967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.118554 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Cannot 'rebuild' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action HTTP/1.1 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 65 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: exception: Cannot 'rebuild' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b9c32265-6611-4a95-92aa-d5d2ca3181cf', 'body': {'rebuild': {'imageRef': '666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff'}}} May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf in vm_state rescued. Cannot rebuild while the instance is in this state. May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:49:07.123360 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued May 19 08:49:07.127807 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:07.129184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 409 to user: Cannot 'rebuild' instance b9c32265-6611-4a95-92aa-d5d2ca3181cf while it is in vm_state rescued {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:07.130330 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f181beb-3ac5-4933-b78e-fed94d55f97b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action" status: 409 len: 146 microversion: 2.1 time: 0.065219 May 19 08:49:07.135022 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3885/5210] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:49:07 2022] POST /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf/action => generated 146 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 08:49:07.143331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:07.144686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:07.152594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.153358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.154114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.154804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.196489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:49:07.330489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe6daa48-293e-4b5c-9240-789b10a5d88a tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 204 len: 0 microversion: 2.1 time: 0.191516 May 19 08:49:07.331666 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3886/5211] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:49:07 2022] DELETE /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:49:07.338142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:07.338974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:07.349177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.349920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.350679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.351172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.932593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:07.944066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9524210c-9c78-4e44-be0b-b44e86b60d2c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1694 microversion: 2.1 time: 0.610853 May 19 08:49:07.944670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3887/5212] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:07 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1694 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:07.965592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:07.966438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:07.982411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.983639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:07.985354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:07.986051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:08.472365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:08.485817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a794333b-b412-46f4-bd1b-e9781c41eec8 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1688 microversion: 2.1 time: 0.529869 May 19 08:49:08.487022 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3888/5213] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:07 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1688 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:08.493461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-75f89860-c735-49f4-a4d7-c002141d9684 req-96a37714-fdd1-4281-b3b5-6bbbdc7252fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "name": "network-vif-unplugged", "status": "completed", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:08.512521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-75f89860-c735-49f4-a4d7-c002141d9684 req-96a37714-fdd1-4281-b3b5-6bbbdc7252fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:08.513526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-75f89860-c735-49f4-a4d7-c002141d9684 req-96a37714-fdd1-4281-b3b5-6bbbdc7252fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:08.541638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-75f89860-c735-49f4-a4d7-c002141d9684 req-96a37714-fdd1-4281-b3b5-6bbbdc7252fa service nova] Creating event network-vif-unplugged:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh1-842464-2 May 19 08:49:08.549691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:08.556323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-75f89860-c735-49f4-a4d7-c002141d9684 req-96a37714-fdd1-4281-b3b5-6bbbdc7252fa service nova] Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:49:08.570555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-75f89860-c735-49f4-a4d7-c002141d9684 req-96a37714-fdd1-4281-b3b5-6bbbdc7252fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081314 May 19 08:49:08.571862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3889/5214] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:08.579653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:08.580662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:08.587554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:08.588315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:08.589265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:08.589954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:08.962458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:08.971151 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30a7d57f-b6b2-45c3-81dc-087e0759b366 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.397826 May 19 08:49:08.971756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3890/5215] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:08 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:08.976492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:08.977442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:08.987446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:08.988211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:08.989606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:08.990364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:09.377978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:09.391093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94473b89-7df7-46fb-825c-d78a9118b755 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1694 microversion: 2.1 time: 0.417922 May 19 08:49:09.405943 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3891/5216] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:08 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1694 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:09.505276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:09.506702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:09.514005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:09.514780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:09.516478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:09.517121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:09.788934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:09.802639 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f810a97d-4e02-4811-938e-9ee6bd2faa42 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1688 microversion: 2.1 time: 0.302409 May 19 08:49:09.811368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3892/5217] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:09 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1688 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:09.991514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:09.992144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:09.998549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:09.999226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:10.001054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:10.005745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:10.548484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:10.556792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6267032-b658-48fb-8581-dda46ae9c5ab tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1214 microversion: 2.1 time: 0.572029 May 19 08:49:10.569816 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3893/5218] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:09 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1214 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:10.575563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:10.578566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:10.594621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:10.597035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:10.600482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:10.601764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:11.024206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:11.038781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1156921-136f-437b-9be3-06f17c327244 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1694 microversion: 2.1 time: 0.467480 May 19 08:49:11.043135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3894/5219] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:10 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1694 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:11.054334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1ff4cae2-3a24-4db9-887b-7e5003206874 req-d96b8a22-8258-4902-8814-cd8647cb6d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:11.071831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ff4cae2-3a24-4db9-887b-7e5003206874 req-d96b8a22-8258-4902-8814-cd8647cb6d00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:11.072375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ff4cae2-3a24-4db9-887b-7e5003206874 req-d96b8a22-8258-4902-8814-cd8647cb6d00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:11.089763 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1ff4cae2-3a24-4db9-887b-7e5003206874 req-d96b8a22-8258-4902-8814-cd8647cb6d00 service nova] Creating event network-changed:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh1-842464-2 May 19 08:49:11.098919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-1ff4cae2-3a24-4db9-887b-7e5003206874 req-d96b8a22-8258-4902-8814-cd8647cb6d00 service nova] Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:49:11.112629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1ff4cae2-3a24-4db9-887b-7e5003206874 req-d96b8a22-8258-4902-8814-cd8647cb6d00 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065572 May 19 08:49:11.113581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3895/5220] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:11.120393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:11.121408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:11.131485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:11.132361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:11.133486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:11.134253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:12.146110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:12.166366 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40c9655d-ed49-4d8e-b1ba-9937f3270e93 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1688 microversion: 2.1 time: 1.051053 May 19 08:49:12.167476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3896/5221] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:11 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1688 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:12.180106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:12.182335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:12.195144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:12.196271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:12.197517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:12.198305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:13.125125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:13.146153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38b23b78-c4b4-4272-98a2-bfdd0aa1dfb0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.968022 May 19 08:49:13.146153 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3897/5222] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:12 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:13.155295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:13.156504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:13.169060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:13.170292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:13.175566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:13.176266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:13.615194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:13.618926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d63c1db-778b-46da-8dd0-38a67c853789 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1692 microversion: 2.1 time: 0.476629 May 19 08:49:13.620108 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3898/5223] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:13 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1692 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:13.626587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:13.627545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:13.657420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:13.658245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:13.659537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:13.660462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:13.821895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:13.838215 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-468ac538-7196-433c-bae0-f1430a63d940 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 200 len: 1620 microversion: 2.1 time: 0.215625 May 19 08:49:13.851585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3899/5224] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:13 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 1620 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:13.857060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d1425ac6-fb37-4653-8e51-48f40bcbea77 req-42488864-7ca0-439f-a812-8a183c2afe05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "name": "network-vif-unplugged", "status": "completed", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:13.868459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d1425ac6-fb37-4653-8e51-48f40bcbea77 req-42488864-7ca0-439f-a812-8a183c2afe05 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:13.869225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d1425ac6-fb37-4653-8e51-48f40bcbea77 req-42488864-7ca0-439f-a812-8a183c2afe05 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:13.892230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d1425ac6-fb37-4653-8e51-48f40bcbea77 req-42488864-7ca0-439f-a812-8a183c2afe05 service nova] Creating event network-vif-unplugged:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:49:13.898426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d1425ac6-fb37-4653-8e51-48f40bcbea77 req-42488864-7ca0-439f-a812-8a183c2afe05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045119 May 19 08:49:13.899830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3900/5225] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:14.163269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:14.164791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:14.181629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:14.182084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:14.182888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:14.183328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:14.732849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:14.747856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae8ef1d1-ef13-4a23-8e9a-6da8c063bb36 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.584713 May 19 08:49:14.749375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3901/5226] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:14 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:14.764571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ed35ae61-3bd6-41cf-86bd-323d804fea1f req-98af427e-8763-4ea4-8e58-02a66588f8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e9d206-9a9e-4c2f-b901-3a0c53a9226d", "name": "network-vif-deleted", "tag": "f639693d-8f36-4e75-aa4c-f5931be4fb3f"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:14.781149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ed35ae61-3bd6-41cf-86bd-323d804fea1f req-98af427e-8763-4ea4-8e58-02a66588f8cf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:14.782514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ed35ae61-3bd6-41cf-86bd-323d804fea1f req-98af427e-8763-4ea4-8e58-02a66588f8cf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:14.800124 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ed35ae61-3bd6-41cf-86bd-323d804fea1f req-98af427e-8763-4ea4-8e58-02a66588f8cf service nova] Creating event network-vif-deleted:f639693d-8f36-4e75-aa4c-f5931be4fb3f for instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d on chh1-842464-2 May 19 08:49:14.814141 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ed35ae61-3bd6-41cf-86bd-323d804fea1f req-98af427e-8763-4ea4-8e58-02a66588f8cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060913 May 19 08:49:14.815897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3902/5227] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:14.825073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:14.833020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:14.847123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:14.847953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:14.849229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:14.851447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:15.477160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:15.505442 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-751f7875-b0b2-4383-b5ac-2daa8d59eb30 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1689 microversion: 2.1 time: 0.687920 May 19 08:49:15.512652 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3903/5228] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:14 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1689 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:15.524614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:15.525536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: 76e9d206-9a9e-4c2f-b901-3a0c53a9226d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:15.536152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:15.536919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:15.540110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:15.540726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:15.563195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d could not be found. May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d HTTP/1.1 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d could not be found. May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '76e9d206-9a9e-4c2f-b901-3a0c53a9226d'} May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d could not be found. May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d could not be found. May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:15.572439 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d could not be found. May 19 08:49:15.577664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:15.582027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 404 to user: Instance 76e9d206-9a9e-4c2f-b901-3a0c53a9226d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:15.583720 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51fceadf-4162-4d13-bfb2-8f6600630787 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d" status: 404 len: 111 microversion: 2.1 time: 0.069237 May 19 08:49:15.584472 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3904/5229] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:15 2022] GET /compute/v2.1/servers/76e9d206-9a9e-4c2f-b901-3a0c53a9226d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:49:15.622577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:15.623966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:15.633920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:15.634726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:15.635796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:15.636567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:15.747659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7024b920-2cab-4383-8a43-22b5fb4b66de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action" status: 204 len: 0 microversion: 2.1 time: 0.155860 May 19 08:49:15.751947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3905/5230] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:49:15 2022] POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:49:15.768745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7b90918-daa6-41e3-86d3-fa55db0a5c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '.version_select at 0x7f32104eda60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:15.795877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:15.816147 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7b90918-daa6-41e3-86d3-fa55db0a5c5e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-799578982" status: 202 len: 0 microversion: 2.1 time: 0.062446 May 19 08:49:15.822915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3906/5231] 10.222.0.78 () {58 vars in 1217 bytes} [Thu May 19 08:49:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-799578982 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:49:15.836629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:15.836781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:15.846379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:15.846912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:15.847830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:15.848400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:16.242126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:16.259201 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9da16f5-f56b-4363-8642-d3f60cf5520b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1689 microversion: 2.1 time: 0.434376 May 19 08:49:16.261119 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3907/5232] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:15 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1689 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:16.284038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:16.287008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:16.299208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:16.299666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:16.300467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:16.300904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:16.791521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:16.807642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:16.817364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f99719eb-ec54-4ba6-90ae-66afbf2c5dea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.538510 May 19 08:49:16.818838 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3908/5233] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:16 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:17.292800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:17.299722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:17.353763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:17.357357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:17.363823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:17.364679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:17.826614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:17.836432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efd01360-a40b-43f1-8d97-54e34a44f5b9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1689 microversion: 2.1 time: 0.560513 May 19 08:49:17.854339 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3909/5234] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:17 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1689 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:17.860608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:17.866272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:17.879355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:17.881103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:17.882229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:17.882850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:18.224264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:18.248897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c52266e-39c0-4774-b892-6b2b1c267a5e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.392752 May 19 08:49:18.252123 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3910/5235] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:17 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:18.862627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:18.864672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:18.873271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:18.882303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:18.884947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:18.885727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:19.147159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:19.156106 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96406e4b-bd6a-4eee-9ca7-078cd5632551 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1689 microversion: 2.1 time: 0.298283 May 19 08:49:19.156774 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3911/5236] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:18 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1689 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:19.268497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:19.269144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:19.282599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:19.283076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:19.286859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:19.287369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:19.585485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:19.605592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-112a7185-df7f-42ef-ba9b-ecde367a42ea tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.340694 May 19 08:49:19.606592 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3912/5237] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:19 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:19.842470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0261c295-0f0e-41ec-aead-d9375946f365 req-c7e52546-d634-4928-bfd2-a98c5b1d3eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "name": "network-vif-plugged", "status": "completed", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:19.860607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0261c295-0f0e-41ec-aead-d9375946f365 req-c7e52546-d634-4928-bfd2-a98c5b1d3eae service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:19.861069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0261c295-0f0e-41ec-aead-d9375946f365 req-c7e52546-d634-4928-bfd2-a98c5b1d3eae service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:19.916919 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0261c295-0f0e-41ec-aead-d9375946f365 req-c7e52546-d634-4928-bfd2-a98c5b1d3eae service nova] Creating event network-vif-plugged:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh1-842464-2 May 19 08:49:19.931398 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0261c295-0f0e-41ec-aead-d9375946f365 req-c7e52546-d634-4928-bfd2-a98c5b1d3eae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094241 May 19 08:49:19.939109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3913/5238] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:49:20.175869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:20.176647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:20.190818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:20.191277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:20.192074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:20.192526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:20.429507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:20.440652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88bf1804-b97d-42e4-b50c-8eb24260e853 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1681 microversion: 2.1 time: 0.269685 May 19 08:49:20.441258 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3914/5239] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:20 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:20.623599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:20.624209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:20.633755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:20.634447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:20.635528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:20.636308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:21.244510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:21.256062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-928b3bc1-b169-4e42-be36-22ccbe33a07c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.636284 May 19 08:49:21.256713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3915/5240] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:20 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:21.997029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5e8bfa78-e604-4fa3-9eb8-becdad88035f req-8a4382ab-2296-49d0-8490-303180c58f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316de9bb-b23e-4707-8d04-fc4a36f73ae4", "name": "network-vif-plugged", "status": "completed", "tag": "8d707601-00aa-443c-9b39-528c45fa7d19"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:22.007021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5e8bfa78-e604-4fa3-9eb8-becdad88035f req-8a4382ab-2296-49d0-8490-303180c58f24 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:22.007769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5e8bfa78-e604-4fa3-9eb8-becdad88035f req-8a4382ab-2296-49d0-8490-303180c58f24 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:22.022899 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5e8bfa78-e604-4fa3-9eb8-becdad88035f req-8a4382ab-2296-49d0-8490-303180c58f24 service nova] Creating event network-vif-plugged:8d707601-00aa-443c-9b39-528c45fa7d19 for instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 on chh1-842464-2 May 19 08:49:22.028754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5e8bfa78-e604-4fa3-9eb8-becdad88035f req-8a4382ab-2296-49d0-8490-303180c58f24 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035746 May 19 08:49:22.029788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3916/5241] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:49:22.273950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:22.275745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:22.283370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:22.284031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:22.285512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:22.286302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:22.466487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:22.478578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-278160ce-c1e9-494d-80d9-93aad690c98c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1202 microversion: 2.1 time: 0.207773 May 19 08:49:22.486532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3917/5242] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:22 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:23.496178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:23.508922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:23.526336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:23.528801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:23.529752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:23.530295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:23.773204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:23.790865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ace3c6d-a30d-478b-aeb7-931610fd10b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1389 microversion: 2.1 time: 0.298237 May 19 08:49:23.791471 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3918/5243] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:23 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1389 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:23.811155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:23.811700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:23.825896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:23.826351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:23.827153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:23.827600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:24.042785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:24.059220 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e99f5318-0748-45f0-8555-6c5cf997cd30 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1389 microversion: 2.1 time: 0.252393 May 19 08:49:24.071340 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3919/5244] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:23 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1389 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:24.078316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7410c8e-726e-4793-9cc1-a87ef977236a tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Action: 'create', calling method: .version_select at 0x7f32103709d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1973600021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYtj/heOwMu7uVE86+B7MO6Mn1vbw0GAB69aBvtZuZ+PCyL0IxF394NpY6iUSmnm7L2CoDzjj7+eSCNd7EMHBV3lxmKzlGo9s8Z2yyuLO/wc2kVZIpR7upJjfm+QxnA8A=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:24.103764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f7410c8e-726e-4793-9cc1-a87ef977236a tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Getting quotas for project 92b43f38f6da4dd8a4c8f2605314d946. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:49:24.112066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f7410c8e-726e-4793-9cc1-a87ef977236a tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Getting quotas for user ef3b7494be5a486782d713a8d2d04834 and project 92b43f38f6da4dd8a4c8f2605314d946. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:49:24.146224 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7410c8e-726e-4793-9cc1-a87ef977236a tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.072281 May 19 08:49:24.148361 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3920/5245] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:49:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:24.178441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:24.180069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:24.193162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:24.193162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:24.194556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:24.200212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:24.393920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:24.410308 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ffb45fe-ebe0-4d83-91b9-7111f0a8b0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1389 microversion: 2.1 time: 0.259520 May 19 08:49:24.411452 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3921/5246] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:24 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1389 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:24.431238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:24.432029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:24.448836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:24.462002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:24.462977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:24.464079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:24.519110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:49:24.731208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba9633b8-edbc-462f-900c-73e1bd500254 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 204 len: 0 microversion: 2.1 time: 0.304372 May 19 08:49:24.736655 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3922/5247] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:49:24 2022] DELETE /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:49:24.744708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:24.746106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:24.763873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:24.764544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:24.765368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:24.766365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:25.030955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:25.048979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8aae197f-aa21-45b3-8add-33ef3fa48362 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1395 microversion: 2.1 time: 0.310154 May 19 08:49:25.052764 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3923/5248] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:24 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1395 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:25.982712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-191081974", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "74a2215a-f874-41f2-84a6-8600122ed2ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1973600021", "security_groups": [{"name": "tempest-secgroup-smoke-1301548858"}], "networks": [{"uuid": "608a265a-32f4-46c5-835e-d8dc836f55bc"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:26.118481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] validate_networks() for [('608a265a-32f4-46c5-835e-d8dc836f55bc', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:49:26.752779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:49:26.753202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:49:26.753712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:49:26.754121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:49:26.754535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:49:26.770664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:26.771110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:26.771912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:26.772346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:26.819355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Getting quotas for project 92b43f38f6da4dd8a4c8f2605314d946. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:49:26.831951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Getting quotas for user ef3b7494be5a486782d713a8d2d04834 and project 92b43f38f6da4dd8a4c8f2605314d946. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:49:26.941981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:49:26.945528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74a2215a-f874-41f2-84a6-8600122ed2ce',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:49:27.155324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c342e68e-29af-494f-8a59-5b96d34c1105 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.179662 May 19 08:49:27.158039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3924/5249] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:49:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:49:27.166832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:27.168321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:27.177287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:27.179151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:27.180486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:27.181122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:27.481775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:27.493242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7814c050-61bd-4352-bafe-a2a7bc5310a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1395 microversion: 2.1 time: 0.333772 May 19 08:49:27.499220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3925/5250] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:27 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1395 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:27.514495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4881f87-b634-4a06-9f1b-5714b04f23e8 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:27.517597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4881f87-b634-4a06-9f1b-5714b04f23e8 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:27.685511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4881f87-b634-4a06-9f1b-5714b04f23e8 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:27.698467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4881f87-b634-4a06-9f1b-5714b04f23e8 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1098 microversion: 2.1 time: 0.194936 May 19 08:49:27.699069 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3926/5251] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:27 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1098 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:27.723891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-deaf418b-0d10-4ae4-92e4-0a71ab22d8a6 req-0cc79b15-8dc3-4f04-af91-904066fba1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "316de9bb-b23e-4707-8d04-fc4a36f73ae4", "name": "network-vif-deleted", "tag": "8d707601-00aa-443c-9b39-528c45fa7d19"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:27.739916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-deaf418b-0d10-4ae4-92e4-0a71ab22d8a6 req-0cc79b15-8dc3-4f04-af91-904066fba1cf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:27.740855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-deaf418b-0d10-4ae4-92e4-0a71ab22d8a6 req-0cc79b15-8dc3-4f04-af91-904066fba1cf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:27.779514 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-deaf418b-0d10-4ae4-92e4-0a71ab22d8a6 req-0cc79b15-8dc3-4f04-af91-904066fba1cf service nova] Creating event network-vif-deleted:8d707601-00aa-443c-9b39-528c45fa7d19 for instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 on chh1-842464-2 May 19 08:49:27.805774 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-deaf418b-0d10-4ae4-92e4-0a71ab22d8a6 req-0cc79b15-8dc3-4f04-af91-904066fba1cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102656 May 19 08:49:27.806393 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3927/5252] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:28.511966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:28.512679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:28.530626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:28.531716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:28.532535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:28.532991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:28.555731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:28.741388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:28.766800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac3323cb-cc98-463d-a465-6e5c5a47053b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.258753 May 19 08:49:28.768608 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3928/5253] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:28 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:28.779012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:28.780661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:28.804587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:28.805847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:28.830825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:28.833159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:29.125697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:29.141123 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0adc68d-db8b-4a1f-92d7-30a8472de914 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1196 microversion: 2.1 time: 0.370561 May 19 08:49:29.144141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3929/5254] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:28 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1196 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:29.784271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:29.784903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:29.811810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:29.812817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:29.813623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:29.814073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:30.034575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:30.043139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c057a8ca-52f5-437e-9655-5929ec9dea5a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.262766 May 19 08:49:30.044946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3930/5255] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:29 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:30.161939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:30.162565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:30.169954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:30.180420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:30.183959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:30.184600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:30.330040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:30.346150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6797750-7416-4cf1-bb50-2ea2a836287e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1214 microversion: 2.1 time: 0.188334 May 19 08:49:30.347138 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3931/5256] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:30 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:31.060145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:31.061771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:31.081723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:31.086932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:31.088346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:31.088716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:31.306624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:31.318208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a1ce728-0d15-46dd-aa2d-93dbf1ba4e6c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.262018 May 19 08:49:31.322748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3932/5257] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:31 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:31.369226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:31.370241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:31.380484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:31.389691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:31.391066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:31.391802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:31.752754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:31.771260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-563de74f-b6a8-4f7c-984b-428b1bc8bad3 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.405703 May 19 08:49:31.771707 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3933/5258] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:31 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:32.339051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:32.339591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:32.354248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:32.357638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:32.358535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:32.359067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:32.553915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:32.567610 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c6a70ba-a8b4-4ed1-8dc7-eef337fcb6d4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.232357 May 19 08:49:32.568965 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3934/5259] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:32 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:32.765827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7f936f5f-ecb6-45b1-8d03-ba51f566726f req-538a8ea0-50d4-4955-a3ab-ea880060b755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:32.780671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7f936f5f-ecb6-45b1-8d03-ba51f566726f req-538a8ea0-50d4-4955-a3ab-ea880060b755 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:32.782086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7f936f5f-ecb6-45b1-8d03-ba51f566726f req-538a8ea0-50d4-4955-a3ab-ea880060b755 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:32.810167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7f936f5f-ecb6-45b1-8d03-ba51f566726f req-538a8ea0-50d4-4955-a3ab-ea880060b755 service nova] Creating event network-changed:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:49:32.820979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7f936f5f-ecb6-45b1-8d03-ba51f566726f req-538a8ea0-50d4-4955-a3ab-ea880060b755 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061468 May 19 08:49:32.824610 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3935/5260] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:32.837954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:32.839502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:32.856556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:32.857914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:32.860270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:32.865771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:33.404687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:33.419455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5168fafb-1796-427c-996e-60fa5e7ee416 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.592092 May 19 08:49:33.420676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3936/5261] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:32 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:33.587088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:33.588000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:33.600831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:33.601577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:33.603988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:33.605739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:33.797089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:33.806473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17fc1f25-57e0-4e5c-bcc3-512ae197af33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.225271 May 19 08:49:33.807025 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3937/5262] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:33 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:34.440194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:34.442309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:34.453291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:34.454230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:34.456025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:34.456751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:34.647619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:34.656775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5858aedc-9218-4149-9a7f-72855b9538bd tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.220832 May 19 08:49:34.657478 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3938/5263] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:34 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:34.825716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:34.826511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:34.831995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:34.838463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:34.838975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:34.840147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:34.840614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:34.929141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:34.944031 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27f66b8b-af17-4539-b581-620a49d169e6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.121231 May 19 08:49:34.944922 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3939/5264] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:34 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:35.675057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:35.676572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:35.683426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:35.684034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:35.685020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:35.685628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:35.883631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:35.895553 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e7c9fd6-64a7-4a06-bedf-72989735ee42 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.224998 May 19 08:49:35.896418 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3940/5265] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:35 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:35.973503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:35.975124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:35.988821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:35.991057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:35.993008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:35.995048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:36.067575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:36.077017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea0a345f-67a3-4ec5-86a9-be701423e239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.115248 May 19 08:49:36.081517 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3941/5266] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:35 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:36.918924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:36.919928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:36.924624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:36.936104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:36.936759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:36.938480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:36.939205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:37.114656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:37.123066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b2c94eb-ac0e-461e-82fd-cfa539d6d670 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.208463 May 19 08:49:37.124350 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3942/5267] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:36 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:37.134073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:37.135138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:37.142925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:37.143462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:37.144150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:37.144693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:37.169951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16db4fba-a788-4364-b5c8-83f0e139ff2e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/ips" status: 200 len: 149 microversion: 2.1 time: 0.043091 May 19 08:49:37.170545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3943/5268] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:49:37 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:37.184130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:37.185248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:37.193905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:37.194436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:37.195487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:37.196026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:37.267982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:37.276745 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee7666cf-ba6b-4348-b83e-1aa2ce3e651e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.104971 May 19 08:49:37.277707 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3944/5269] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:37 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:38.142257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:38.142790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:38.144457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:38.152268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:38.152955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:38.153786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:38.154232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:38.352504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:38.367570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5ef21be-a34c-49fd-a47a-bac52ddafb69 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.230148 May 19 08:49:38.368168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3945/5270] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:38 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:38.374706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:38.380778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:38.389188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:38.389907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:38.391231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:38.391701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:38.396132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:38.462981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:38.471963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5027fc98-5d02-44e8-851a-a27e7fdbb038 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.102795 May 19 08:49:38.472557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3946/5271] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:38 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:39.384898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:39.386251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:39.394584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:39.395103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:39.396071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:39.396636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:39.560273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:39.569242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ae96394-e352-4859-b962-51b9ad479497 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.188398 May 19 08:49:39.570239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3947/5272] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:39 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:39.575330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:39.576128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:39.584463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:39.585328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:39.586299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:39.586884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:39.655747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:39.667337 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8058053-d173-49ef-a44e-81e3879f60ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 200 len: 1187 microversion: 2.1 time: 0.095473 May 19 08:49:39.668219 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3948/5273] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:39 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:40.586551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:40.587248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:40.597433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:40.597910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:40.598703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:40.606126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:40.874221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:40.900803 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-607c0a60-4978-4140-b698-394baf9bdf1b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.314221 May 19 08:49:40.900803 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3949/5274] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:40 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:40.915633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:40.916647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:40.925939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:40.925939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:40.926509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:40.926509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:41.054083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9370920c-0df3-4e54-a5c6-748bd8197c91 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action" status: 200 len: 24576 microversion: 2.1 time: 0.153223 May 19 08:49:41.054750 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3950/5275] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:49:40 2022] POST /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170/action => generated 24576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:49:41.060974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:41.065022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 316de9bb-b23e-4707-8d04-fc4a36f73ae4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:41.080325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:41.090005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:41.092658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:41.092965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:41.131110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 could not be found. May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 HTTP/1.1 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 could not be found. May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '316de9bb-b23e-4707-8d04-fc4a36f73ae4'} May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 could not be found. May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 could not be found. May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:41.134860 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 could not be found. May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 316de9bb-b23e-4707-8d04-fc4a36f73ae4 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:41.138685 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3021c24-5080-43a4-b861-0a33eeaf456b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4" status: 404 len: 111 microversion: 2.1 time: 0.080239 May 19 08:49:41.145102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3951/5276] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:41 2022] GET /compute/v2.1/servers/316de9bb-b23e-4707-8d04-fc4a36f73ae4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:49:41.914659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:41.915286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:41.937798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:41.944822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:41.945956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:41.954854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:42.480264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:42.497354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28efa5e6-1698-4e59-bb82-7eb07a01b2ea tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.586089 May 19 08:49:42.507603 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3952/5277] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:41 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:43.514952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:43.515820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:43.528370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:43.528833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:43.529674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:43.534299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:43.860582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:43.870937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31d6f404-acd5-468f-8795-77dfbd96c386 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.360502 May 19 08:49:43.874879 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3953/5278] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:43 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:44.375429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:44.376724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:44.397667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:44.398125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:44.400195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:44.400650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:44.949709 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a72f8566-7c69-4dc1-a3b7-069077857ce1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578798 May 19 08:49:44.952032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3954/5279] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:49:44 2022] POST /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:49:44.981813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:44.983411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:45.002311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:45.003516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:45.004877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:45.006286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:45.232197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:45.245622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-003ad9b6-a572-4669-ba05-247dea8674e4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.290856 May 19 08:49:45.246535 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3955/5280] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:44 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:46.262417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:46.263737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:46.277477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:46.278122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:46.290410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:46.291099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:46.622619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:46.632857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3dbad26-a832-46d8-b453-3200165e4a56 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.374312 May 19 08:49:46.636896 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3956/5281] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:46 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:47.246427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:47.247050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:47.257874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:47.258857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:47.259653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:47.264735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:47.603679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e82d4c0-5f93-44f2-88e7-96a02b841f66 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1832 microversion: 2.1 time: 0.361692 May 19 08:49:47.604578 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3957/5282] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:47 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1832 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:47.654876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:47.655509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:47.666456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:47.668905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:47.670114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:47.671921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:48.474210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:48.492697 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04933ffc-9ae4-456a-ba9f-0e228db14429 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.842042 May 19 08:49:48.493208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3958/5283] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:47 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:49.448901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:49.449592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:49.461416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.464815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:49.465718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.466169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:49.504820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:49:49.662824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-891e3b71-659a-492d-87dd-89377d0c2777 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 204 len: 0 microversion: 2.1 time: 0.217951 May 19 08:49:49.665913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3959/5284] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:49:49 2022] DELETE /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:49:49.674705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f09140a1-030e-40cf-8537-cc3f6d18cdd8 req-c109e025-1286-43a2-bf2c-f36a73db0e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:49.686460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f09140a1-030e-40cf-8537-cc3f6d18cdd8 req-c109e025-1286-43a2-bf2c-f36a73db0e15 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.687608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f09140a1-030e-40cf-8537-cc3f6d18cdd8 req-c109e025-1286-43a2-bf2c-f36a73db0e15 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:49.704101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f09140a1-030e-40cf-8537-cc3f6d18cdd8 req-c109e025-1286-43a2-bf2c-f36a73db0e15 service nova] Creating event network-changed:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh1-842464-2 May 19 08:49:49.710325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f09140a1-030e-40cf-8537-cc3f6d18cdd8 req-c109e025-1286-43a2-bf2c-f36a73db0e15 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042660 May 19 08:49:49.711712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3960/5285] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:49.721060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:49.722283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:49.730980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.731770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:49.735541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.736025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:49.764405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:49:49.957522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:49.965292 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-048533a5-2dd0-485a-83c1-2dddb027d37b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.251754 May 19 08:49:49.966149 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3961/5286] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:49 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:49.983427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:49.984736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:49.992116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.992575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:49.993486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:49.993942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:50.176394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:50.205897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-546b2e95-3941-4cd0-94cf-f3c2b6ff59d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1687 microversion: 2.1 time: 0.226540 May 19 08:49:50.208511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3962/5287] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:49 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:50.984871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:50.985499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:50.998257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:50.998713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:51.001476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:51.002099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:51.723261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:51.738733 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8044e517-04cd-47eb-8c63-da54a68cd006 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.758471 May 19 08:49:51.739468 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3963/5288] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:50 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:49:51.744400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:51.752744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:51.759599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:51.766050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:51.767156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:51.767703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:52.180462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:52.203157 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-011d4e93-a842-4148-8ed4-50041d57865e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 200 len: 1687 microversion: 2.1 time: 0.462170 May 19 08:49:52.214254 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3964/5289] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:51 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 1687 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:52.455919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2977c00e-560f-4593-b82b-d5d85eea305f req-525f65c1-6f9c-4ad3-b29d-a0382e418b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9f2ddf-cc4d-424e-9f45-9a0920dd1170", "name": "network-vif-deleted", "tag": "627f80b9-e0c8-4a29-abc1-51b3e1230fd3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:52.478880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2977c00e-560f-4593-b82b-d5d85eea305f req-525f65c1-6f9c-4ad3-b29d-a0382e418b36 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:52.480028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2977c00e-560f-4593-b82b-d5d85eea305f req-525f65c1-6f9c-4ad3-b29d-a0382e418b36 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:52.527307 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2977c00e-560f-4593-b82b-d5d85eea305f req-525f65c1-6f9c-4ad3-b29d-a0382e418b36 service nova] Creating event network-vif-deleted:627f80b9-e0c8-4a29-abc1-51b3e1230fd3 for instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 on chh1-842464-2 May 19 08:49:52.532656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2977c00e-560f-4593-b82b-d5d85eea305f req-525f65c1-6f9c-4ad3-b29d-a0382e418b36 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081371 May 19 08:49:52.533276 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3965/5290] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:49:52.758408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:52.759492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:52.777133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:52.779632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:52.786713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:52.798872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:53.020515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:53.033043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-417c407f-787a-45c0-a904-faf9c9cbc475 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.279754 May 19 08:49:53.034000 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3966/5291] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:52 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:53.241291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:53.247701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:53.275122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:53.275736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:53.277149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:53.277935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:53.310498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] HTTP exception thrown: Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 could not be found. May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Request method failure captured: May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 HTTP/1.1 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQfatyEMjit-1p2K5H_CnRifSFEi5qTSLtDqv5SD5Mhts9PF9hc-AFLx_2KjIqBun4xz_oldFKcmimb0liieDCXTSui5RQaw-6c8Zft1Hotj3yjm-Nmu6PpzTKBtMIKUueMkLwgR7nvro0Sw3i-I-5V7uaCEL2eqdhMpBwxku1mTBU May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_45be8834713245c5b0dd248ca205ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 81a87eec69894a099a140ec8980a57e0 May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 could not be found. May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9e9f2ddf-cc4d-424e-9f45-9a0920dd1170'} May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 could not be found. May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 could not be found. May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:53.312883 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 could not be found. May 19 08:49:53.318099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:49:53.319656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Returning 404 to user: Instance 9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:49:53.321167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d87a5108-5d79-414d-a21e-aff97ac288a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170" status: 404 len: 111 microversion: 2.1 time: 0.104672 May 19 08:49:53.322266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3967/5292] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:53 2022] GET /compute/v2.1/servers/9e9f2ddf-cc4d-424e-9f45-9a0920dd1170 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:49:54.055346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:54.055906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:54.074066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:54.080929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:54.082114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:54.082710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:54.723858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:54.733368 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-053d2349-5afa-4d6f-8b60-0d4bae80ba89 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.681673 May 19 08:49:54.734387 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3968/5293] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:54 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:55.759759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:55.761536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:55.783511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:55.790595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:55.792186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:55.799791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:56.254111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:56.274100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de26a470-49ac-4072-94b7-55719dc8e6ca tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.524106 May 19 08:49:56.277061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3969/5294] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:55 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:57.291309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:57.291976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:57.305429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:57.306115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:57.307066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:57.307793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:57.656369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:57.665256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c681061b-d6f0-4dbd-90e7-3cf385ac6e14 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.377801 May 19 08:49:57.675902 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3970/5295] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:57 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:49:58.440168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4168c592-5bc7-42aa-a0c7-60c2556d8362 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '.version_select at 0x7f32105d7d30>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:58.476769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4168c592-5bc7-42aa-a0c7-60c2556d8362 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-158291598" status: 202 len: 0 microversion: 2.1 time: 0.041897 May 19 08:49:58.482430 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3971/5296] 10.222.0.78 () {58 vars in 1280 bytes} [Thu May 19 08:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-158291598 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:49:58.511946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47bcecb8-54eb-479a-85c1-6a2b2a705710 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: .version_select at 0x7f32105d9040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1167943301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdQ8p+kHbxAq7gVeFYYDi/WMRzCI4xs7E79br5up/MsPmZTjm/LO4ZKHpOVkcExKFhj8Pxb7194fw4nog/OktE54aQbZjcMLEu4ZCvd+8IzBTAx9Q58GkzwkBcjSNerew=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:49:58.569207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-47bcecb8-54eb-479a-85c1-6a2b2a705710 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:49:58.574050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-47bcecb8-54eb-479a-85c1-6a2b2a705710 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:49:58.639556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47bcecb8-54eb-479a-85c1-6a2b2a705710 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.132317 May 19 08:49:58.640301 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3972/5297] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:49:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:49:58.685269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:49:58.685927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:49:58.697107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:58.697631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:58.698458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:49:58.698962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:49:59.044963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:49:59.059653 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07913ea3-a6d6-4059-9ef8-6a8219dd7162 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.378513 May 19 08:49:59.061708 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3973/5298] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:49:58 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:00.089615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:00.089615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:00.119373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:00.120954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:00.122654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:00.124033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:00.376432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:00.401175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbcec8ac-dbaf-4d30-882c-a22feda1a069 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.325038 May 19 08:50:00.402009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3974/5299] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:00 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:01.418695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:01.419354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:01.444127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:01.447721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:01.450515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:01.453139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:01.738217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:01.750303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eafdf3ff-c5dd-4df0-9e25-a5d7abc7f15e tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.335052 May 19 08:50:01.753915 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3975/5300] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:01 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:02.771561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:02.772180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:02.796202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:02.796940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:02.798349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:02.799072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:03.030479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:03.041145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed91013a-ecd9-4402-8b27-7ab4281f83a2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.273614 May 19 08:50:03.054480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3976/5301] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:02 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:03.598285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:03.598801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:03.609944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:03.610432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:03.611837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:03.615442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:03.701834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:50:04.044413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:04.075209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5ac8b1a-dd0c-4748-8fab-ed9973ca1086 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 204 len: 0 microversion: 2.1 time: 0.481835 May 19 08:50:04.077753 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3977/5302] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:50:03 2022] DELETE /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:50:04.086698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:04.087639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:04.116370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:04.116370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:04.116370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:04.116370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:04.808231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:04.824625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-467de6d8-39c5-4403-8fb9-bd5df4089839 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1282 microversion: 2.1 time: 0.744810 May 19 08:50:04.826376 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3978/5303] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:04 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1282 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:04.856050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:04.857879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:04.875324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:04.878950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:04.881851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:04.883787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:05.728397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:05.731140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:05.747370 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd9a409e-1d26-48fa-8da2-b1d6256fa46d tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1507 microversion: 2.1 time: 0.909352 May 19 08:50:05.777135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3979/5304] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:04 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1507 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:05.845415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:05.846305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:05.876183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:05.876755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:05.877801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:05.878469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:07.262584 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:50:07.262584 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:50:07.628955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:07.640580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8fb8469e-9cc8-477a-964c-e4cca08cbb4d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 1.800446 May 19 08:50:07.646012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3980/5305] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:05 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:07.652342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:07.653251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:07.668476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:07.669618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:07.671085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:07.673043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:07.987676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:08.054375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd017953-1a7b-4b92-8a49-2f1aae11e879 tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 200 len: 1465 microversion: 2.1 time: 0.394149 May 19 08:50:08.059519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3981/5306] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:07 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 1465 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:08.177461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7fef0bf1-a8d8-4175-a025-62293dee25ad req-173c1e10-16b8-4a09-b774-8752dd0c9729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c32265-6611-4a95-92aa-d5d2ca3181cf", "name": "network-vif-deleted", "tag": "6667f33d-f684-4bed-8f29-9b0613d06aec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:08.232675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7fef0bf1-a8d8-4175-a025-62293dee25ad req-173c1e10-16b8-4a09-b774-8752dd0c9729 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:08.233772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7fef0bf1-a8d8-4175-a025-62293dee25ad req-173c1e10-16b8-4a09-b774-8752dd0c9729 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:08.300016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7fef0bf1-a8d8-4175-a025-62293dee25ad req-173c1e10-16b8-4a09-b774-8752dd0c9729 service nova] Creating event network-vif-deleted:6667f33d-f684-4bed-8f29-9b0613d06aec for instance b9c32265-6611-4a95-92aa-d5d2ca3181cf on chh1-842464-2 May 19 08:50:08.320564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7fef0bf1-a8d8-4175-a025-62293dee25ad req-173c1e10-16b8-4a09-b774-8752dd0c9729 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158695 May 19 08:50:08.324269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3982/5307] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:08.674816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:08.675767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:08.682966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:08.716182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:08.719721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:08.725854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:08.727652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:09.182602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:09.194864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-544e38a3-11df-4308-a0ea-aafd102b2bbc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 0.532970 May 19 08:50:09.197657 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3983/5308] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:08 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:09.211238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:09.214137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: b9c32265-6611-4a95-92aa-d5d2ca3181cf] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:09.236591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:09.237337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:09.238300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:09.238903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:09.257222 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf could not be found. May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf HTTP/1.1 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf could not be found. May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b9c32265-6611-4a95-92aa-d5d2ca3181cf'} May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf could not be found. May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf could not be found. May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:09.260397 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf could not be found. May 19 08:50:09.264328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:09.269179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 404 to user: Instance b9c32265-6611-4a95-92aa-d5d2ca3181cf could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:50:09.270797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b98780ec-f7f4-471d-bcfe-0bcde990922b tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf" status: 404 len: 111 microversion: 2.1 time: 0.071757 May 19 08:50:09.275426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3984/5309] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:09 2022] GET /compute/v2.1/servers/b9c32265-6611-4a95-92aa-d5d2ca3181cf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:50:09.282998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:09.283781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:09.300478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:09.302261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:09.310971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:09.312569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:09.392479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:50:09.628789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5269c48-5588-4593-9f3a-44c9210b152e tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 204 len: 0 microversion: 2.1 time: 0.351291 May 19 08:50:09.632622 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3985/5310] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:50:09 2022] DELETE /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:50:09.645510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:09.648451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:09.669030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:09.669646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:09.672801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:09.675748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:10.096460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:10.112583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8541c0ff-00f1-4830-b16d-2fd1e1aef1dc tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1522 microversion: 2.1 time: 0.476831 May 19 08:50:10.121013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3986/5311] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:09 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:10.169684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1317529299", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "ef8eda9f-749b-4f27-9257-0ce269eff743"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1167943301", "security_groups": [{"name": "tempest-secgroup-smoke-1597530839"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:10.358297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] validate_networks() for [('ef8eda9f-749b-4f27-9257-0ce269eff743', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:50:11.287273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:50:11.287900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:50:11.288319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:50:11.288909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:50:11.289555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:50:11.312575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:11.313034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:11.317000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:11.317000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:11.383622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:50:11.413445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:50:11.479034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:50:11.481460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:50:11.642104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e21d050f-3067-4c0d-bbe8-f3b11697a768 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.477012 May 19 08:50:11.668727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3987/5312] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:50:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:50:11.694957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:11.698709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:11.729582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:11.733323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:11.737065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:11.769990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:12.543948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:12.558324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6cbd7fc3-d6b1-4818-8ae6-453ff7218339 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 0.888049 May 19 08:50:12.559621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3988/5313] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:11 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:12.566683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:12.567567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:12.580705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:12.581657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:12.584926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:12.585846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:12.778712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da072a25d5f48ba881df74877fd0325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9a93ccd3c94a318058de400a6a5a11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:12.791772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77156961-1378-4f98-a72e-b92425f2deea tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 200 len: 1480 microversion: 2.1 time: 0.230807 May 19 08:50:12.820967 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3989/5314] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:12 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 1480 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:12.838821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:12.839456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:12.864926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:12.865603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:12.866581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:12.867267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:12.953439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:12.978883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1b0b927-1c17-4c18-9fbf-f3d4ac74900a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1263 microversion: 2.1 time: 0.156607 May 19 08:50:12.979863 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3990/5315] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:12 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:12.987699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fb1777fd-cc91-4af1-b1de-8ad33bccaa7d req-5f502c37-9c5d-4e19-b9cf-c68a01afcf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022eb8a-9ec0-449f-b422-d1cdc42b8a57", "name": "network-vif-deleted", "tag": "77d4b00c-db14-4a58-a6f2-ec4f9e5c668b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:12.997936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fb1777fd-cc91-4af1-b1de-8ad33bccaa7d req-5f502c37-9c5d-4e19-b9cf-c68a01afcf0e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:12.998416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fb1777fd-cc91-4af1-b1de-8ad33bccaa7d req-5f502c37-9c5d-4e19-b9cf-c68a01afcf0e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:13.012884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fb1777fd-cc91-4af1-b1de-8ad33bccaa7d req-5f502c37-9c5d-4e19-b9cf-c68a01afcf0e service nova] Creating event network-vif-deleted:77d4b00c-db14-4a58-a6f2-ec4f9e5c668b for instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 on chh1-842464-2 May 19 08:50:13.019461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fb1777fd-cc91-4af1-b1de-8ad33bccaa7d req-5f502c37-9c5d-4e19-b9cf-c68a01afcf0e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037865 May 19 08:50:13.020919 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3991/5316] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:13.582564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:13.583779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:13.605796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:13.606775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:13.607837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:13.609922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:14.288214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:14.297250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5869f6c-8b9b-4987-8e3f-a7f338d2237d tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 0.722929 May 19 08:50:14.298303 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3992/5317] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:13 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:14.304928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:14.305575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] [instance: f022eb8a-9ec0-449f-b422-d1cdc42b8a57] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:14.323573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:14.324034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:14.324823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:14.325260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:14.379068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] HTTP exception thrown: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 could not be found. May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Request method failure captured: May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 HTTP/1.1 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNJjbgDf_J7kk68vbaxFqgvvLpbMrhAkJTNA4JDY6WjFfchmhjTE9_pc3yhEB0xQ5r8mxk0cH56LKMPvPfTWD36LpG0abEkQonrhFPhJea-RnPhtZICIAXAJzseZfHAS6sCdsTSB9mZNV4wDwjk9lIpLgvWTWguZW95AYenvp9zVlk May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e9a93ccd3c94a318058de400a6a5a11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 6e9a93ccd3c94a318058de400a6a5a11 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2036899246 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3da072a25d5f48ba881df74877fd0325 May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2036899246-project May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 could not be found. May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f022eb8a-9ec0-449f-b422-d1cdc42b8a57'} May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 could not be found. May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 could not be found. May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:14.385745 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 could not be found. May 19 08:50:14.390522 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:14.400359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] Returning 404 to user: Instance f022eb8a-9ec0-449f-b422-d1cdc42b8a57 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:50:14.402039 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae83db2b-f565-4090-9e59-95200b82d2de tempest-ServerRescueNegativeTestJSON-2036899246 tempest-ServerRescueNegativeTestJSON-2036899246-project] 10.222.0.78 "GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57" status: 404 len: 111 microversion: 2.1 time: 0.102781 May 19 08:50:14.403929 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3993/5318] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:14 2022] GET /compute/v2.1/servers/f022eb8a-9ec0-449f-b422-d1cdc42b8a57 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:50:14.431178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:14.437404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:14.455771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:14.456224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:14.457014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:14.471624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:14.715141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:14.723539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-142d7614-9759-4d90-bdf6-2dfa5b9a8835 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1325 microversion: 2.1 time: 0.318308 May 19 08:50:14.724143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3994/5319] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:14 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:15.318873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:15.319581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:15.354034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:15.355607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:15.356689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:15.357418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:15.969475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:15.977750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdb6ee6c-d3bc-4643-93ed-e00ec4243881 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 0.665787 May 19 08:50:15.995083 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3995/5320] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:15 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:16.017073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:16.018191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:16.031773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:16.035741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:16.036726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:16.038466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:16.605782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:16.617376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cfc530c5-8f90-43e2-a837-44dd99d9a141 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 0.615149 May 19 08:50:16.617977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3996/5321] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:15 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:16.997674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:16.999111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:17.020034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:17.025253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:17.026695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:17.027387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:18.159450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:18.207702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f54f1f7-d6db-47f5-8661-e6f2ef31a5f4 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 1.215056 May 19 08:50:18.211621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3997/5322] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:16 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:18.218228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8ce8d581-a843-41be-bbf9-1e52f65504f3 req-f730d36a-fe28-429a-ae43-24640f6274ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "name": "network-vif-plugged", "status": "completed", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:18.247828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8ce8d581-a843-41be-bbf9-1e52f65504f3 req-f730d36a-fe28-429a-ae43-24640f6274ef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:18.250903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8ce8d581-a843-41be-bbf9-1e52f65504f3 req-f730d36a-fe28-429a-ae43-24640f6274ef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:18.288919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:18.293247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8ce8d581-a843-41be-bbf9-1e52f65504f3 req-f730d36a-fe28-429a-ae43-24640f6274ef service nova] Creating event network-vif-plugged:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:50:18.309163 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8ce8d581-a843-41be-bbf9-1e52f65504f3 req-f730d36a-fe28-429a-ae43-24640f6274ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093858 May 19 08:50:18.325582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3998/5323] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:18.366553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:18.367727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:18.389645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:18.395297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:18.397556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:18.402490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:19.816386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:19.855593 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c17404b-2e9f-4306-952f-fcf97a5f3abc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 1.523129 May 19 08:50:19.856787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 3999/5324] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:18 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:19.867932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:19.870602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:19.883806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:19.884954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:19.887474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:19.890831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:20.145731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Invalid volume: volume fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd is already attached to instances: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments HTTP/1.1 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 74 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: {"volumeAttachment": {"volumeId": "fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd"}} May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid volume: volume fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd is already attached to instances: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '6cde4210-1ebd-4f04-ba8b-c6e59efffa8f', 'body': {'volumeAttachment': {'volumeId': 'fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd'}}} May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd is already attached to instances: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:50:20.147862 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd is already attached to instances: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd is already attached to instances: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f May 19 08:50:20.156643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:20.160990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 400 to user: Invalid volume: volume fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd is already attached to instances: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:50:20.168561 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b23c233-af61-464b-b197-f795bbcc07df tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.309549 May 19 08:50:20.171305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4000/5325] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:50:19 2022] POST /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 174 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 08:50:20.194347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:20.194994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:20.209001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:20.214250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:20.215854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:20.216747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:20.833429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:20.859244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67aa4c19-0d60-4f42-972a-a280c5580402 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1270 microversion: 2.1 time: 0.684251 May 19 08:50:20.863099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4001/5326] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:20 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1270 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:20.883431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-455b9b84-aa7f-4ee4-9c72-213ce4a12f58 req-b40a38de-c030-4f28-a4d3-b34befebbc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:20.939026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-455b9b84-aa7f-4ee4-9c72-213ce4a12f58 req-b40a38de-c030-4f28-a4d3-b34befebbc31 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:20.945972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-455b9b84-aa7f-4ee4-9c72-213ce4a12f58 req-b40a38de-c030-4f28-a4d3-b34befebbc31 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:20.995891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-455b9b84-aa7f-4ee4-9c72-213ce4a12f58 req-b40a38de-c030-4f28-a4d3-b34befebbc31 service nova] Creating event network-changed:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:50:21.012778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-455b9b84-aa7f-4ee4-9c72-213ce4a12f58 req-b40a38de-c030-4f28-a4d3-b34befebbc31 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148105 May 19 08:50:21.023955 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4002/5327] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:21.047430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:21.053029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:21.073881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:21.081747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:21.084016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:21.084803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:21.267414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lazy-loading 'services' on Instance uuid 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:50:21.344971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:21.434885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:21.493125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b94e2d2f-b57a-40a9-bec7-72bc68c4d620 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments/fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd" status: 202 len: 0 microversion: 2.1 time: 0.466293 May 19 08:50:21.493804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4003/5328] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:50:21 2022] DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments/fcf70fd6-cd4c-4013-ad6b-e57d6c1a27bd => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:50:21.530496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:21.535609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:21.614771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:21.615350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:21.620641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:21.621169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:22.622545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:22.638544 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e1f9799-286a-4be4-864e-a593934fe6b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 1.141217 May 19 08:50:22.639102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4004/5329] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:21 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:22.653225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:22.654786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:22.678055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:22.681205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:22.684193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:22.685040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:22.881603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9ea87cfa-bba8-4bee-b765-39cc0dc7e6a2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231152 May 19 08:50:22.884385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4005/5330] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:22 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:22.897363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:22.900658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:22.918932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:22.919804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:22.922612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:22.925064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:24.237486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:24.254338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c833a0c9-0f03-4b99-a2fb-2295161108bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1457 microversion: 2.1 time: 1.367477 May 19 08:50:24.271157 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4006/5331] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:22 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1457 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:24.279851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:24.281449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:24.290234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:24.290940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:24.292315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:24.292907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:25.314718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:25.392189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81b8550c-d9a4-4a72-8f59-f989f091e03c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 1.118555 May 19 08:50:25.427924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4007/5332] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:24 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:25.443472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:25.445511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:25.461317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:25.462549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:25.470025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:25.471366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:25.609190 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48156539-6e6b-4ec5-909b-66bd992dbd94 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177357 May 19 08:50:25.616404 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4008/5333] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:25 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:25.633824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:25.635538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:25.659964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:25.666411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:25.669239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:25.674879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:26.208189 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:50:26.209379 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:50:26.457615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:26.486584 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a2eb13f-28b9-4394-86b3-ad1f06f5f32b tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1457 microversion: 2.1 time: 0.867975 May 19 08:50:26.492704 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4009/5334] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:25 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1457 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:26.511213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:26.512519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:26.542686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:26.545128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:26.550762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:26.552154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:26.942170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:26.974792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efd0bc82-4154-44b2-a2a7-95141ad2269e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 0.477323 May 19 08:50:26.979586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4010/5335] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:26 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:26.998815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:27.000973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:27.008782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:27.009248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:27.010278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:27.010806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:27.058954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-496e0317-09ae-46b4-8320-f49eca5c9d10 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064781 May 19 08:50:27.059494 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4011/5336] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:26 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:27.999416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:28.000901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:28.016889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:28.018362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:28.019855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:28.020609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:28.658248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:28.679998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-799d9f63-8e6e-4cfa-a642-44fbcae3ffde tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 0.685004 May 19 08:50:28.695128 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4012/5337] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:27 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:28.715943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:28.718972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:28.757517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:28.758530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:28.762575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:28.763874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:28.906354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d15bf3bc-2b5d-40d7-be6b-99465e9ca268 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209630 May 19 08:50:28.907046 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4013/5338] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:28 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:29.707232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:29.711567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:29.783975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:29.786910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:29.788201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:29.788851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:30.198952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:30.232245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac817c3f-badc-49bc-b26a-2c73e9376b9e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 0.519541 May 19 08:50:30.236544 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4014/5339] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:29 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:30.265993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:30.274221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:30.300912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:30.301971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:30.303500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:30.304531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:30.363654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:30.501500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d89871cb-9fd6-46ea-a3d5-a0d61e9140d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262296 May 19 08:50:30.502273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4015/5340] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:30 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:30.525628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ce72fcda-1d3b-4293-98a8-17879d2ea42e req-440d2fa9-3596-4b1a-83ac-b77077dc053e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "name": "network-vif-plugged", "status": "completed", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:30.566306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:30.575589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ce72fcda-1d3b-4293-98a8-17879d2ea42e req-440d2fa9-3596-4b1a-83ac-b77077dc053e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:30.576040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ce72fcda-1d3b-4293-98a8-17879d2ea42e req-440d2fa9-3596-4b1a-83ac-b77077dc053e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:30.606304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ce72fcda-1d3b-4293-98a8-17879d2ea42e req-440d2fa9-3596-4b1a-83ac-b77077dc053e service nova] Creating event network-vif-plugged:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:50:30.618276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ce72fcda-1d3b-4293-98a8-17879d2ea42e req-440d2fa9-3596-4b1a-83ac-b77077dc053e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099719 May 19 08:50:30.620517 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4016/5341] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:31.280243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:31.282308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:31.300725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:31.301720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:31.307770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:31.308273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:32.056959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:32.071094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d14ff44-fb68-4df8-82f6-52cbb0bbe426 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1393 microversion: 2.1 time: 0.807121 May 19 08:50:32.083098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4017/5342] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:31 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1393 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:32.089214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:32.090415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:32.098425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:32.099168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:32.100156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:32.101031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:32.175410 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38757cff-bd73-44a1-b3b6-da8ee03bb327 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090337 May 19 08:50:32.181707 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4018/5343] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:32 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:32.397785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cd6ebbcd-b18f-4986-9060-cbf53be772f9 req-763c6e20-1761-4230-8432-3aabb4b3919f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:32.458846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cd6ebbcd-b18f-4986-9060-cbf53be772f9 req-763c6e20-1761-4230-8432-3aabb4b3919f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:32.459599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cd6ebbcd-b18f-4986-9060-cbf53be772f9 req-763c6e20-1761-4230-8432-3aabb4b3919f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:32.509756 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cd6ebbcd-b18f-4986-9060-cbf53be772f9 req-763c6e20-1761-4230-8432-3aabb4b3919f service nova] Creating event network-changed:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:50:32.517646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cd6ebbcd-b18f-4986-9060-cbf53be772f9 req-763c6e20-1761-4230-8432-3aabb4b3919f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126783 May 19 08:50:32.520612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4019/5344] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:33.103469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:33.104613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:33.126729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:33.132700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:33.135422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:33.136286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:34.184974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:34.201515 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4765ad47-0982-4508-906d-f18663bf6763 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1566 microversion: 2.1 time: 1.104090 May 19 08:50:34.220982 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4020/5345] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:33 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1566 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:34.232510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:34.236721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:34.250888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:34.251871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:34.252892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:34.265240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:34.370172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2434dc60-fbc0-4568-94df-d2ab51e53252 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146698 May 19 08:50:34.380089 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4021/5346] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:34 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:34.385554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:34.386507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:34.404904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:34.406481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:34.407599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:34.408419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:34.765653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:34.775335 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9cf6b92-600f-43a4-a2fe-3182fcf17e1b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1566 microversion: 2.1 time: 0.393762 May 19 08:50:34.785973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4022/5347] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:34 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1566 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:35.158150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9ae4b1c5-ecf5-480a-b4f1-b307b710d60f req-f8b7c321-2070-4455-875c-fe288f289e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:35.173217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9ae4b1c5-ecf5-480a-b4f1-b307b710d60f req-f8b7c321-2070-4455-875c-fe288f289e24 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:35.173835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9ae4b1c5-ecf5-480a-b4f1-b307b710d60f req-f8b7c321-2070-4455-875c-fe288f289e24 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:35.218702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9ae4b1c5-ecf5-480a-b4f1-b307b710d60f req-f8b7c321-2070-4455-875c-fe288f289e24 service nova] Creating event network-changed:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:50:35.226063 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9ae4b1c5-ecf5-480a-b4f1-b307b710d60f req-f8b7c321-2070-4455-875c-fe288f289e24 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074179 May 19 08:50:35.227854 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4023/5348] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:35.392927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:35.402130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:35.424708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:35.425186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:35.433513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:35.434433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:35.533188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8614e22b-1807-4eb3-9b80-35d0184e4acb tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144778 May 19 08:50:35.539597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4024/5349] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:35 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:36.555279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:36.557538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:36.577893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:36.584065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:36.586930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:36.589797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:36.715247 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76cd8b49-1b6c-4fa3-a118-6c9183b20fb1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164892 May 19 08:50:36.721874 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4025/5350] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:36 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:37.363304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4e5065e6-1898-419f-befc-ffff6a0a8d39 req-b6cb4a4c-dff6-46ce-8701-09560954c583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:37.383687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4e5065e6-1898-419f-befc-ffff6a0a8d39 req-b6cb4a4c-dff6-46ce-8701-09560954c583 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:37.387241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4e5065e6-1898-419f-befc-ffff6a0a8d39 req-b6cb4a4c-dff6-46ce-8701-09560954c583 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:37.449817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4e5065e6-1898-419f-befc-ffff6a0a8d39 req-b6cb4a4c-dff6-46ce-8701-09560954c583 service nova] Creating event network-changed:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:50:37.462084 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4e5065e6-1898-419f-befc-ffff6a0a8d39 req-b6cb4a4c-dff6-46ce-8701-09560954c583 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102050 May 19 08:50:37.466768 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4026/5351] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:37.734160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:37.735227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:37.755648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:37.756140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:37.768647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:37.769237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:37.888901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-481f4fa2-e13c-4197-aa49-676960ea7e28 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160549 May 19 08:50:37.893649 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4027/5352] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:37 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:38.904957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:38.906887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:38.926486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:38.926486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:38.926486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:38.926486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:39.002125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46b09138-7dfa-433f-a56a-063662603860 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101501 May 19 08:50:39.002740 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4028/5353] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:38 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:40.015773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:40.017504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:40.039499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:40.040758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:40.042017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:40.042789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:40.128684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccb4bfd5-5db4-4390-8abb-6a1e9431e7ca tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118716 May 19 08:50:40.129830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4029/5354] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:40 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:41.155023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:41.168720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:41.220954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:41.222191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:41.223647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:41.224446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:41.478440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6396dd68-9d2e-4065-9f0c-d0530d9fceee tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.336519 May 19 08:50:41.482725 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4030/5355] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:41 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:41.864277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:41.864920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:41.887197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:41.887596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:41.888474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:41.888926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:42.292237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:42.310598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9ff11e5-7148-4236-a140-b28b4e49ab1f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1566 microversion: 2.1 time: 0.450462 May 19 08:50:42.318182 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4031/5356] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:41 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1566 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:42.330926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-84987f70-b048-4f62-9109-38dc6d92ce5f req-5d8f7134-3091-4317-a15a-8c11883bfcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:42.363859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-84987f70-b048-4f62-9109-38dc6d92ce5f req-5d8f7134-3091-4317-a15a-8c11883bfcda service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:42.365036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-84987f70-b048-4f62-9109-38dc6d92ce5f req-5d8f7134-3091-4317-a15a-8c11883bfcda service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:42.399721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-84987f70-b048-4f62-9109-38dc6d92ce5f req-5d8f7134-3091-4317-a15a-8c11883bfcda service nova] Creating event network-changed:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:50:42.418210 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-84987f70-b048-4f62-9109-38dc6d92ce5f req-5d8f7134-3091-4317-a15a-8c11883bfcda service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098180 May 19 08:50:42.418889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4032/5357] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:42.493456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:42.494760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:42.511131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:42.513852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:42.515677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:42.516165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:42.606005 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3511f07a-8ef8-4593-95f5-85297aa568d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118203 May 19 08:50:42.617438 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4033/5358] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:42 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:43.629718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:43.631444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:43.662829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:43.663339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:43.678986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:43.679709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:43.806745 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5e646c1-eb4a-47e6-a8b6-4a5790f07ab2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182700 May 19 08:50:43.815470 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4034/5359] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:43 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:44.820171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:44.822246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:44.834987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:44.835827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:44.845361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:44.846668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:44.940484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:50:44.987242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a91bb861-c1ed-45d4-8bf0-3d6eff56c563 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171010 May 19 08:50:44.987976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4035/5360] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:44 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:46.005247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:46.012495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:46.045789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:46.057843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:46.066675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:46.073490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:46.210385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74014798-b58f-4a94-b35f-f18584562848 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210692 May 19 08:50:46.211323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4036/5361] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:45 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:47.243880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:47.247665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:47.258874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:47.259604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:47.260615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:47.262416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:47.323206 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9191e94-b65f-4290-a677-ec30f92a8cea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090430 May 19 08:50:47.327506 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4037/5362] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:50:47 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 08:50:47.428961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:47.432651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:47.445657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:47.446136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:47.447072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:47.447821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:47.544193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:50:47.811910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c4902f9-b778-44e1-978a-a0bb861fa44f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 204 len: 0 microversion: 2.1 time: 0.398250 May 19 08:50:47.813401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4038/5363] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:50:47 2022] DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 08:50:47.837030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:47.841770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:47.865832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:47.866392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:47.873662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:47.874854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:48.176932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:48.210016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b954898-dd5e-47e1-9972-e0cfe589e0e0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1680 microversion: 2.1 time: 0.389950 May 19 08:50:48.211948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4039/5364] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:47 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1680 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:49.250895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:49.253279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:49.268121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:49.268929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:49.270712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:49.275129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:49.886582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:49.920070 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6ea245a-91cc-4358-87a9-e31b230ee584 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1680 microversion: 2.1 time: 0.692935 May 19 08:50:49.922487 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4040/5365] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:49 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1680 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:50.950186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:50.954932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:50.987315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:50.988358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:50.992527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:50.993721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:51.218136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:51.239178 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d36771b-86f0-455d-bb14-9c99dfeadc72 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1613 microversion: 2.1 time: 0.301813 May 19 08:50:51.269048 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4041/5366] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:50 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1613 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:50:52.277479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5998fcc1-9496-42e5-90f7-cba9cfb8f705 req-8f600958-babe-48e1-8b6a-4402aad7e630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cde4210-1ebd-4f04-ba8b-c6e59efffa8f", "name": "network-vif-deleted", "tag": "fcec440b-31ca-4232-862d-b1d408baed06"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:52.312127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5998fcc1-9496-42e5-90f7-cba9cfb8f705 req-8f600958-babe-48e1-8b6a-4402aad7e630 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:52.312933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5998fcc1-9496-42e5-90f7-cba9cfb8f705 req-8f600958-babe-48e1-8b6a-4402aad7e630 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:52.355340 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5998fcc1-9496-42e5-90f7-cba9cfb8f705 req-8f600958-babe-48e1-8b6a-4402aad7e630 service nova] Creating event network-vif-deleted:fcec440b-31ca-4232-862d-b1d408baed06 for instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f on chh2-842464-2 May 19 08:50:52.368476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5998fcc1-9496-42e5-90f7-cba9cfb8f705 req-8f600958-babe-48e1-8b6a-4402aad7e630 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111067 May 19 08:50:52.370851 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4042/5367] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:50:52.387642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:52.389580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:52.462707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:52.464184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:52.472817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:52.473877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:52.702635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:50:52.728309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22035f35-0e31-42b5-b2fb-4f275fba39d0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 200 len: 1326 microversion: 2.1 time: 0.353744 May 19 08:50:52.751569 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4043/5368] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:52 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 1326 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:50:53.766631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:53.769527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:53.806829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:53.807184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:53.808138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:53.812690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:53.866728 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f HTTP/1.1 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6cde4210-1ebd-4f04-ba8b-c6e59efffa8f'} May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:50:53.872184 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:50:53.880374 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:50:53.882669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:50:53.892185 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d412c30f-61cf-4368-aaf1-3d1ab24142a7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 404 len: 111 microversion: 2.1 time: 0.128591 May 19 08:50:53.900374 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4044/5369] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:50:53 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:50:53.930075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0cb57c92-24f2-424e-a48c-92af965b4981 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '.version_select at 0x7f3217a87c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:50:53.989343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0cb57c92-24f2-424e-a48c-92af965b4981 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803139743" status: 202 len: 0 microversion: 2.1 time: 0.085196 May 19 08:50:53.997883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4045/5370] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803139743 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:50:55.545637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61cc4047-bf9f-4b60-8ab8-406743c3aba2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: .version_select at 0x7f3217bc3700>, body: {"keypair": {"name": "tempest-keypair-1518834985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqYPk1I7cHXIUuG0lB6NuW6Ig5SGNXrI+gDsi+WzqiCBlGuCtsb2M4iAnclCAMVACpbAMwm4lTMEGlHTo/Pvhuw3VUvCPx3LRL+49St15jCXmtZ4cL2vBdfJN0OVpEl4A=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:55.568441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-61cc4047-bf9f-4b60-8ab8-406743c3aba2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:50:55.575975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-61cc4047-bf9f-4b60-8ab8-406743c3aba2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:50:55.615271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61cc4047-bf9f-4b60-8ab8-406743c3aba2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075083 May 19 08:50:55.616753 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4046/5371] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:50:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:50:58.480780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:58.485237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:50:58.497577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:58.498666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:58.500823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:50:58.501719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:50:58.640757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-338e0785-0b7f-41a8-b0ec-a16e8f853143 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action" status: 200 len: 24564 microversion: 2.1 time: 0.188705 May 19 08:50:58.642941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4047/5372] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:50:58 2022] POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action => generated 24564 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:50:58.989460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1568351035", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "05c219cb-d37a-447f-853c-897fd14c1619"}], "security_groups": [{"name": "tempest-securitygroup--1271230519"}], "key_name": "tempest-keypair-1518834985", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:50:59.180820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] validate_networks() for [('05c219cb-d37a-447f-853c-897fd14c1619', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:50:59.997027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:50:59.998256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:50:59.999570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:51:00.000335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:51:00.001149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:51:00.016231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:00.017110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:00.027240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:00.027816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:00.076249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:51:00.089409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Getting quotas for user f05ad3b9305e422fb86b4a25223616b3 and project 21dbcde9216e4f5fb132f4881500b302. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:51:00.130131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:51:00.144717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:51:00.303278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c54abea-967a-4aab-abb8-b58c82393228 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.317942 May 19 08:51:00.304996 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4048/5373] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:50:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:51:00.339200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e24b7895-6494-440e-b7fb-9f3783cf2a3a tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:00.343702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e24b7895-6494-440e-b7fb-9f3783cf2a3a tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:00.376261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:00.527584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e24b7895-6494-440e-b7fb-9f3783cf2a3a tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:00.545477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e24b7895-6494-440e-b7fb-9f3783cf2a3a tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1242 microversion: 2.1 time: 0.215391 May 19 08:51:00.548358 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4049/5374] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:00 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1242 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:01.568083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:01.568781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:01.604732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:01.605267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:01.609400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:01.609904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:01.833767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:01.866291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5e10f01-32f4-4c60-b238-87725c8c480b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1238 microversion: 2.1 time: 0.301912 May 19 08:51:01.867837 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4050/5375] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:01 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1238 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:51:02.267199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:02.267913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:02.280312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:02.281167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:02.282251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:02.282962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:02.331494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:51:02.505291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba4c1ae9-9128-4eda-8a07-d13e19ff30e7 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 204 len: 0 microversion: 2.1 time: 0.242662 May 19 08:51:02.507250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4051/5376] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:51:02 2022] DELETE /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:51:02.515080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-01f2e2e2-a4ee-41f6-90e9-dce2f34b4ac3 req-624bd549-bea3-411a-b841-fc62e13575cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:02.557139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-01f2e2e2-a4ee-41f6-90e9-dce2f34b4ac3 req-624bd549-bea3-411a-b841-fc62e13575cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:02.557686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-01f2e2e2-a4ee-41f6-90e9-dce2f34b4ac3 req-624bd549-bea3-411a-b841-fc62e13575cc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:02.598755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-01f2e2e2-a4ee-41f6-90e9-dce2f34b4ac3 req-624bd549-bea3-411a-b841-fc62e13575cc service nova] Creating event network-changed:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:51:02.614999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-01f2e2e2-a4ee-41f6-90e9-dce2f34b4ac3 req-624bd549-bea3-411a-b841-fc62e13575cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105547 May 19 08:51:02.617256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4052/5377] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:02.631530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:02.635783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:02.653458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:02.654454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:02.657749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:02.659170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:03.138914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:03.170525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3636ea4b-8aaa-492d-8d27-fa99328388e9 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1582 microversion: 2.1 time: 0.551713 May 19 08:51:03.174312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4053/5378] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:02 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1582 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:03.186122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1321571586", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b122a11a-12bd-4b6f-9918-6f25a926e68f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:03.376510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:51:04.490069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:51:04.490754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:51:04.490975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:51:04.491694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:51:04.492266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:51:04.507592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:04.510411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:04.512640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:04.519386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:04.564502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:51:04.576077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:51:04.615735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:51:04.620343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b122a11a-12bd-4b6f-9918-6f25a926e68f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:51:04.815499 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ce532ee-a124-4ed3-8643-4689bde02de2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637295 May 19 08:51:04.824084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4054/5379] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:51:04.841108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:04.842030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:04.851830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:04.852444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:04.853408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:04.853861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:04.878178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:04.965485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:04.980306 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c3947a2-911f-4326-b19e-fd8e910c6ec3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1300 microversion: 2.1 time: 0.154970 May 19 08:51:04.981102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4055/5380] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:04 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:04.988246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:04.995338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:05.012932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:05.013908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:05.018239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:05.020454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:05.947008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:05.962907 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d82bbc9a-37f6-421d-9154-c7270e453e96 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1582 microversion: 2.1 time: 0.978398 May 19 08:51:05.964335 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4056/5381] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:04 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1582 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:05.984212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:05.984212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:06.003667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:06.005602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:06.007724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:06.009738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:06.335076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:06.350475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e06023c3-e3c2-4037-86cf-da58a59c86fb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1109 microversion: 2.1 time: 0.384395 May 19 08:51:06.354680 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4057/5382] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:05 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1109 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:06.363953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:06.365177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:06.417889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:06.418353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:06.419157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:06.419600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:07.588182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:07.622344 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a2f0cb9f-0621-4596-965a-fcc6f450e271 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1368 microversion: 2.1 time: 1.247868 May 19 08:51:07.632587 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4058/5383] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:06 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1368 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:07.662435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2268c516-75af-420b-a0f4-854801852f03 req-3d749d1f-20ae-4336-a9db-22ade5f99e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb3477f-4461-489c-9b2b-8c65dccb440f", "name": "network-vif-deleted", "tag": "2955be86-6320-4d57-8ee3-300a4dfea6a2"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:07.708773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2268c516-75af-420b-a0f4-854801852f03 req-3d749d1f-20ae-4336-a9db-22ade5f99e6d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:07.711069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2268c516-75af-420b-a0f4-854801852f03 req-3d749d1f-20ae-4336-a9db-22ade5f99e6d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:07.767857 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2268c516-75af-420b-a0f4-854801852f03 req-3d749d1f-20ae-4336-a9db-22ade5f99e6d service nova] Creating event network-vif-deleted:2955be86-6320-4d57-8ee3-300a4dfea6a2 for instance dfb3477f-4461-489c-9b2b-8c65dccb440f on chh2-842464-2 May 19 08:51:07.786193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2268c516-75af-420b-a0f4-854801852f03 req-3d749d1f-20ae-4336-a9db-22ade5f99e6d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141750 May 19 08:51:07.786857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4059/5384] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:07.807371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:07.816305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:07.837869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:07.838335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:07.847665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:07.848188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:08.985716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:09.002878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4636a407-cd6c-490b-8fa1-0c229c99c5b2 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 1.214775 May 19 08:51:09.005532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4060/5385] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:07 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:09.024814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:09.026061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:09.055436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:09.057987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:09.064217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:09.064715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:09.214732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:09.231076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89d37e4f-7462-42dd-960d-ae8aef5c6585 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1127 microversion: 2.1 time: 0.222356 May 19 08:51:09.234913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4061/5386] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:09 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1127 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:09.251785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:09.254775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:09.271430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:09.272084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:09.276392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:09.278725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:10.083875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:10.096367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e67d6ef1-b4ce-4101-a76a-da6a52df8f4c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1368 microversion: 2.1 time: 0.858932 May 19 08:51:10.097911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4062/5387] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:09 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1368 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:10.106311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:10.107687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:10.119263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:10.120487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:10.122163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:10.123343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:11.369967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef38d35f-4ccc-4c07-9b8a-36554b20e47b tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1836 microversion: 2.1 time: 1.270398 May 19 08:51:11.376294 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4063/5388] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:10 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1836 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:11.396490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:11.404366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:11.428591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:11.429063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:11.429905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:11.430349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:11.660345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:11.670055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a903a3bd-77b1-48e3-8775-3f2942d0995f tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 0.288447 May 19 08:51:11.673683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4064/5389] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:11 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:11.690395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:11.699363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:11.713147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:11.717885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:11.719085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:11.724150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:12.002319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:12.015812 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6fd86140-cae1-404b-ba1f-031fc747c470 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1127 microversion: 2.1 time: 0.328081 May 19 08:51:12.020508 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4065/5390] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:11 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1127 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:12.028866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:12.033752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:12.049257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:12.051953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:12.054229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:12.056368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:12.699225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:12.714799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7946e62-436d-436c-8e9c-a374fc1838f0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1368 microversion: 2.1 time: 0.690944 May 19 08:51:12.721145 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4066/5391] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:12 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1368 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:12.731972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:12.732927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:12.767634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:12.768707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:12.777931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:12.778890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:13.521627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:13.534106 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f8628f6-8bc5-4d25-ac6a-ab48a627ed4d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1685 microversion: 2.1 time: 0.811421 May 19 08:51:13.536569 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4067/5392] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:12 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1685 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:14.178511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f1e6b986-6db9-4b5d-a98c-ec27735d59df req-6fe9f276-5d49-468b-aa99-451a225ed4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695f996f-261f-4ea2-bb62-c2f110cac751", "tag": "26c9e22f-044e-4694-a501-833ee37da63a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:14.197079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1e6b986-6db9-4b5d-a98c-ec27735d59df req-6fe9f276-5d49-468b-aa99-451a225ed4cd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:14.197836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f1e6b986-6db9-4b5d-a98c-ec27735d59df req-6fe9f276-5d49-468b-aa99-451a225ed4cd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:14.269889 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f1e6b986-6db9-4b5d-a98c-ec27735d59df req-6fe9f276-5d49-468b-aa99-451a225ed4cd service nova] Creating event network-changed:26c9e22f-044e-4694-a501-833ee37da63a for instance 695f996f-261f-4ea2-bb62-c2f110cac751 on chh2-842464-2 May 19 08:51:14.295195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f1e6b986-6db9-4b5d-a98c-ec27735d59df req-6fe9f276-5d49-468b-aa99-451a225ed4cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.753633 May 19 08:51:14.297195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4068/5393] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:14.317614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:14.318385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:14.344204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:14.344661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:14.345483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:14.346097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:14.536192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:14.602641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=18 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:14.638167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:14.652890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c67256ae-d9a0-46bc-8391-6a29bc0d7bdc tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 0.349150 May 19 08:51:14.653552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4069/5394] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:14 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:14.675718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:14.677888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:14.689680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:14.693171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:14.695023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:14.695727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:15.284772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:15.309802 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3605f34c-fd96-4e2f-b009-e4d1a7c8f24e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.655111 May 19 08:51:15.310412 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4070/5395] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:14 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:15.350538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:15.352155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:15.375265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:15.378372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:15.380493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:15.384263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:15.502902 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5941dd5-6e42-4dd7-b62e-dd120bd3362d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action" status: 200 len: 32631 microversion: 2.1 time: 0.177311 May 19 08:51:15.503696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4071/5396] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:51:15 2022] POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action => generated 32631 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:51:15.518422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:15.519463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:15.528012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:15.528790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:15.529865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:15.530639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:16.579141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:16.619286 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7615e534-6ead-47c8-a01a-5a376ef55c54 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1368 microversion: 2.1 time: 1.105392 May 19 08:51:16.625150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4072/5397] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:15 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1368 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:16.642046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:16.642643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:16.653285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:16.653778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:16.654843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:16.656317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:16.751481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '64015fd8e03a44e7a6d30d6119a9cddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4cc15c286a4af3ad041909f0fdc38a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:16.753652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] flavor_id is None. Assuming migration. {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4142}} May 19 08:51:16.754576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 08:51:16.766172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:17.097802 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07e31d36-5d5a-46fe-89c1-bf793073d538 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action" status: 202 len: 0 microversion: 2.1 time: 0.471027 May 19 08:51:17.101697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4073/5398] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:51:16 2022] POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:51:17.128074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:17.129077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:17.148627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:17.149264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:17.150193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:17.150739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:17.470097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:17.488101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7dd8b68-e933-42c2-903a-4571e0d006bb tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 0.384584 May 19 08:51:17.501848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4074/5399] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:17 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:17.513978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:17.515829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:17.543818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:17.545551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:17.547905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:17.559100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:18.192306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:18.224500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e8e20d4-0ca2-4443-8018-8f422bf10d9d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.708762 May 19 08:51:18.225442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4075/5400] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:17 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:18.250472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-67820915-2d14-4fd2-8c20-3406182b4787 req-ed8d6686-d22c-40c1-a1c0-a722d054ccf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e371c50-6012-4e91-a93f-4f76c5eea2f5", "tag": "b12b4ae3-6abb-45fc-a7eb-8d47967869e0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:18.289560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-67820915-2d14-4fd2-8c20-3406182b4787 req-ed8d6686-d22c-40c1-a1c0-a722d054ccf4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:18.291477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-67820915-2d14-4fd2-8c20-3406182b4787 req-ed8d6686-d22c-40c1-a1c0-a722d054ccf4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:18.338383 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-67820915-2d14-4fd2-8c20-3406182b4787 req-ed8d6686-d22c-40c1-a1c0-a722d054ccf4 service nova] Creating event network-changed:b12b4ae3-6abb-45fc-a7eb-8d47967869e0 for instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 on chh1-842464-2 May 19 08:51:18.352714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-67820915-2d14-4fd2-8c20-3406182b4787 req-ed8d6686-d22c-40c1-a1c0-a722d054ccf4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118628 May 19 08:51:18.355998 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4076/5401] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:18.382900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:18.384140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:18.416328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:18.419431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:18.420424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:18.422001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:20.235978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:20.248556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f27e48bd-1947-437c-99b5-e502058339a7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1694 microversion: 2.1 time: 1.888282 May 19 08:51:20.251958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4077/5402] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:18 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1694 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:20.266387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:20.268670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:20.298475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:20.304653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:20.315441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:20.317059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:21.587076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:21.667170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bfd3063b-b68b-48ee-8386-7b5d3193c36f tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1368 microversion: 2.1 time: 1.396424 May 19 08:51:21.689582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4078/5403] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:20 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1368 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:21.721281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:21.730257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:21.741845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:21.742545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:21.743663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:21.744442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:22.062467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:22.092618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88202950-b98d-4e50-b556-11896c6abaac tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 0.400135 May 19 08:51:22.126040 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4079/5404] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:21 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:22.140984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:22.143982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:22.165981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:22.167050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:22.173295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:22.179037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:22.816169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:22.848240 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b38aebea-6f6d-4681-9aeb-1e5d35ca0923 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.719927 May 19 08:51:22.851476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4080/5405] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:22 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:22.859428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-54474bb6-65f5-492a-9353-36c62a543e74 req-32129c89-2ee4-4e97-9423-a2a9abedbba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695f996f-261f-4ea2-bb62-c2f110cac751", "name": "network-vif-plugged", "status": "completed", "tag": "26c9e22f-044e-4694-a501-833ee37da63a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:22.890529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-54474bb6-65f5-492a-9353-36c62a543e74 req-32129c89-2ee4-4e97-9423-a2a9abedbba6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:22.891842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-54474bb6-65f5-492a-9353-36c62a543e74 req-32129c89-2ee4-4e97-9423-a2a9abedbba6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:22.915374 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-54474bb6-65f5-492a-9353-36c62a543e74 req-32129c89-2ee4-4e97-9423-a2a9abedbba6 service nova] Creating event network-vif-plugged:26c9e22f-044e-4694-a501-833ee37da63a for instance 695f996f-261f-4ea2-bb62-c2f110cac751 on chh2-842464-2 May 19 08:51:22.924233 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-54474bb6-65f5-492a-9353-36c62a543e74 req-32129c89-2ee4-4e97-9423-a2a9abedbba6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070619 May 19 08:51:22.924975 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4081/5406] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:22.935790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:22.938543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:22.948248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:22.949445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:22.951983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:22.952668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:23.753127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:23.777722 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbfa90f9-cfc9-43ff-b4d2-2deaecaa9974 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1694 microversion: 2.1 time: 0.850900 May 19 08:51:23.778320 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4082/5407] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:22 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1694 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:23.812037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:23.839296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:23.866798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:23.867871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:23.868893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:23.869988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:24.507173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:24.526977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8282a0c2-d16e-4300-b40d-01b08d32dc23 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1368 microversion: 2.1 time: 0.741411 May 19 08:51:24.549750 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4083/5408] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:23 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1368 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:24.568040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:24.569870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:24.588875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:24.590040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:24.591471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:24.593184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:24.710551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:24.731853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62f62025-0389-4906-ac7d-2ecd9f4a7d55 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 0.178561 May 19 08:51:24.747305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4084/5409] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:24 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:24.760828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:24.766600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:24.777416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:24.779258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:24.781987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:24.782723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:25.180825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:25.195175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73979a62-33ed-4aab-91d3-a4284f008241 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.444569 May 19 08:51:25.197955 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4085/5410] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:24 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:25.237222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:25.242970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:25.263230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:25.263819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:25.266392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:25.267035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:25.571230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:25.588734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c09507e-2561-45cb-bde2-5580717d2d4f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 0.387938 May 19 08:51:25.604744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4086/5411] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:25 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:25.666056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:25.672109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:25.698390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:25.703104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:25.704015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:25.706097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:25.707985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.192564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:26.207496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3797eac0-1c65-4cf6-9187-d87c26b02153 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1557 microversion: 2.1 time: 0.600774 May 19 08:51:26.208449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4087/5412] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:25 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1557 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:26.228353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:26.229278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:26.237059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:26.237840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.238944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:26.239586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.436158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3b7494be5a486782d713a8d2d04834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b43f38f6da4dd8a4c8f2605314d946', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:26.474219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-147e84b3-42f4-410d-ba63-0f48acca2c82 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 200 len: 1229 microversion: 2.1 time: 0.249993 May 19 08:51:26.492014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4088/5413] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:26 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 1229 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:26.506828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:26.512925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:26.545379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:26.547310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.554213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:26.555149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.874067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:26.888537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bffcf574-ff67-4a26-bd79-ae8daab525b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.394322 May 19 08:51:26.891495 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4089/5414] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:26 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:26.908669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:26.909474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:26.919716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:26.922873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.924063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:26.924818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:26.932974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:27.083499 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6e837a1-7e99-4d0b-921a-e69f1c57fad1 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187872 May 19 08:51:27.084648 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4090/5415] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:51:26 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:27.094257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:27.095166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:27.120876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:27.129782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:27.133889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:27.135955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:28.849880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:28.867741 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9fc3e54-5aac-4687-a99d-9f1a626047d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 1.780717 May 19 08:51:28.867741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4091/5416] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:27 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:28.875781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:28.876829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] [instance: dfb3477f-4461-489c-9b2b-8c65dccb440f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:28.897527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:28.898309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:28.899316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:28.899909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:28.949824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] HTTP exception thrown: Instance dfb3477f-4461-489c-9b2b-8c65dccb440f could not be found. May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Request method failure captured: May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f HTTP/1.1 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgNWkNE5p9tE3dM7gtKe3gTGscrI9XvDCliigmDdsQaT5NaUun2NBB40JVU23LADugcPXGg_rRSL1UHHQ6YcVhbcn63-HKVKXaoQet-ViyoU0FdY5Taw7a6hNyXsyXMFohM_UlJtOMNjfIosMtuldcTRMg-NhpCkBt6jWsxUBUwQJKc May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 92b43f38f6da4dd8a4c8f2605314d946 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBackupRestore-700159264 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/92b43f38f6da4dd8a4c8f2605314d946"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92b43f38f6da4dd8a4c8f2605314d946"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_92b43f38f6da4dd8a4c8f2605314d946"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/92b43f38f6da4dd8a4c8f2605314d946"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBackupRestore-700159264 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 92b43f38f6da4dd8a4c8f2605314d946 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBackupRestore-700159264 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBackupRestore-700159264-project May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ef3b7494be5a486782d713a8d2d04834 May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBackupRestore-700159264-project May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dfb3477f-4461-489c-9b2b-8c65dccb440f could not be found. May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dfb3477f-4461-489c-9b2b-8c65dccb440f'} May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb3477f-4461-489c-9b2b-8c65dccb440f could not be found. May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb3477f-4461-489c-9b2b-8c65dccb440f could not be found. May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:51:28.956051 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb3477f-4461-489c-9b2b-8c65dccb440f could not be found. May 19 08:51:28.960765 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:51:28.968168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Returning 404 to user: Instance dfb3477f-4461-489c-9b2b-8c65dccb440f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:51:28.972497 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f2d92c2-81c1-4e87-a360-20b68cc86605 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f" status: 404 len: 111 microversion: 2.1 time: 0.101830 May 19 08:51:28.979990 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4092/5417] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:28 2022] GET /compute/v2.1/servers/dfb3477f-4461-489c-9b2b-8c65dccb440f => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:51:29.000608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:29.001841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:29.040888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:29.041771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:29.042684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:29.046972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:29.593344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:29.605552 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aaa7ab1d-811f-4c44-87e6-7df2c0890cf3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.623881 May 19 08:51:29.612051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4093/5418] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:28 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:29.619380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-faa2f457-5a67-4145-98ae-19474f6e7dc8 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] Calling method '.version_select at 0x7f3211f8c3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:29.669407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-faa2f457-5a67-4145-98ae-19474f6e7dc8 tempest-TestVolumeBackupRestore-700159264 tempest-TestVolumeBackupRestore-700159264-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1973600021" status: 202 len: 0 microversion: 2.1 time: 0.053394 May 19 08:51:29.671104 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4094/5419] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 08:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1973600021 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:51:29.903019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:29.910208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:29.976376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:29.976832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:29.982167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:29.985277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:30.771380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:30.802656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2827264d-0c0f-4726-9b85-ad0fd91e5d00 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 0.917886 May 19 08:51:30.803834 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4095/5420] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:29 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:30.810591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:30.816325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:30.829650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:30.842383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:30.843728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:30.851084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:31.598805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:31.608823 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83e88c7d-463c-4394-8b55-f8410febcf3a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.803318 May 19 08:51:31.609477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4096/5421] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:30 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:31.635708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6d98b5c2-2d47-45b4-9d60-8eb699b3a352 req-459d4f32-8eb7-48f8-af64-22f156b607fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695f996f-261f-4ea2-bb62-c2f110cac751", "tag": "26c9e22f-044e-4694-a501-833ee37da63a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:31.674229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6d98b5c2-2d47-45b4-9d60-8eb699b3a352 req-459d4f32-8eb7-48f8-af64-22f156b607fb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:31.674888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6d98b5c2-2d47-45b4-9d60-8eb699b3a352 req-459d4f32-8eb7-48f8-af64-22f156b607fb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:31.702608 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6d98b5c2-2d47-45b4-9d60-8eb699b3a352 req-459d4f32-8eb7-48f8-af64-22f156b607fb service nova] Creating event network-changed:26c9e22f-044e-4694-a501-833ee37da63a for instance 695f996f-261f-4ea2-bb62-c2f110cac751 on chh2-842464-2 May 19 08:51:31.708612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6d98b5c2-2d47-45b4-9d60-8eb699b3a352 req-459d4f32-8eb7-48f8-af64-22f156b607fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097900 May 19 08:51:31.709782 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4097/5422] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:31.824369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:31.827585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:31.857167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:31.860574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:31.861489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:31.861942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:32.537796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:32.550273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-502e18fb-cd75-4fd8-9086-dfb785c7aebd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 0.731405 May 19 08:51:32.557759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4098/5423] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:31 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:32.629132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:32.630031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:32.661830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:32.662293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:32.663284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:32.663908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:33.590473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:33.622717 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b74e5000-f51b-4f7d-957b-2603bcabfda6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.000577 May 19 08:51:33.627037 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4099/5424] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:32 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:33.673024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:33.681843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:33.725209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:33.725819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:33.730686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:33.731153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:34.138538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:34.154096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e7e1f1b-3040-4274-b2a5-0ff6fc2b21d7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 0.509549 May 19 08:51:34.154700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4100/5425] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:33 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:34.643973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:34.650526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:34.662365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:34.663061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:34.664316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:34.665116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:35.075401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:35.086833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e14d360-dc56-4e78-ab8e-425c7b419f8c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.447069 May 19 08:51:35.088671 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4101/5426] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:34 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:35.180367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:35.181515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:35.196239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:35.198060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:35.199174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:35.200184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:35.854666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:35.871518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a53da8d-83b9-463d-b76d-542a585aa7f2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 0.701157 May 19 08:51:35.874132 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4102/5427] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:35 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:36.107457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:36.112338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:36.138779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:36.142761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:36.145267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:36.147995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:37.073619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:37.088950 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4554d17-a4fb-4b7c-9f6b-71456e044209 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.987114 May 19 08:51:37.091474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4103/5428] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:36 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:51:37.109201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:37.114214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:37.134164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:37.139132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:37.140293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:37.140932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:37.928172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:37.937413 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38ab7465-efa6-4695-a5b9-451bb5e76cdd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 0.841248 May 19 08:51:37.957882 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4104/5429] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:37 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:38.110385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:38.111825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:38.135830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:38.142551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:38.143663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:38.146995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:38.661103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:38.675667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78bf656c-6847-4807-8991-f8e78d69c634 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.566065 May 19 08:51:38.677966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4105/5430] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:38 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:51:38.965708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:38.970011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:39.011195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:39.012355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:39.015474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:39.023841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:40.083075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:40.110974 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58eb59c3-9f6f-4ab0-a185-71a7dd6d12ca tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1699 microversion: 2.1 time: 1.154137 May 19 08:51:40.146151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4106/5431] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:38 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1699 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:40.160977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:40.169341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:40.199796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:40.200914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:40.202612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:40.207717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:40.631147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:40.663779 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40046e05-a10b-4897-83d7-92d22f91f503 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.512278 May 19 08:51:40.665555 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4107/5432] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:40 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:41.162330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:41.166717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:41.205704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:41.208192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:41.209838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:41.210825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:41.828012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:41.846284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39cd2bfb-a87b-433b-a73d-75476fe4723c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1698 microversion: 2.1 time: 0.691913 May 19 08:51:41.851042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4108/5433] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:41 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1698 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:41.858665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:41.867435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:41.895392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:41.897040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:41.899248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:41.902319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:41.974019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:42.447257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:42.461654 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-167c7b3f-b816-477d-a71c-1490e7ea562d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.609223 May 19 08:51:42.465758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4109/5434] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:41 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:42.875389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:42.876193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:42.896431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:42.899544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:42.900557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:42.902651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:45.558458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:45.574485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6f48703-c0c4-418c-9a64-1e9c8bead7e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1698 microversion: 2.1 time: 2.705256 May 19 08:51:45.579038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4110/5435] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:42 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1698 bytes in 2711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:51:45.599845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:45.601031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:45.629767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:45.633626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:45.634482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:45.634938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:46.578855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:46.591703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d8d5171-b8e7-48f2-82d7-eac79319be93 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.010345 May 19 08:51:46.595759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4111/5436] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:45 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:46.614302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6218f07c-d44a-4af6-a494-67aa211a5b47 req-7d543b85-0a52-4aa6-b902-c24685da0b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "name": "network-vif-unplugged", "status": "completed", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:46.635338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6218f07c-d44a-4af6-a494-67aa211a5b47 req-7d543b85-0a52-4aa6-b902-c24685da0b00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:46.635620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6218f07c-d44a-4af6-a494-67aa211a5b47 req-7d543b85-0a52-4aa6-b902-c24685da0b00 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:46.686314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6218f07c-d44a-4af6-a494-67aa211a5b47 req-7d543b85-0a52-4aa6-b902-c24685da0b00 service nova] Creating event network-vif-unplugged:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh2-842464-2 May 19 08:51:46.723913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-6218f07c-d44a-4af6-a494-67aa211a5b47 req-7d543b85-0a52-4aa6-b902-c24685da0b00 service nova] Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:51:46.767603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6218f07c-d44a-4af6-a494-67aa211a5b47 req-7d543b85-0a52-4aa6-b902-c24685da0b00 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164917 May 19 08:51:46.769765 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4112/5437] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:46.780985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:46.784166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:46.798288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:46.799811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:46.801422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:46.802410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:47.534750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:47.554587 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-517ba5d8-75a8-4bdd-a715-28f0110a5db9 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1698 microversion: 2.1 time: 0.782833 May 19 08:51:47.569351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4113/5438] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:46 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1698 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:47.628666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:47.629616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:47.638442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:47.638888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:47.640616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:47.641564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:49.112387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:49.148692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8abd3a0e-586a-4416-b5bd-c1aff1ae06c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.520569 May 19 08:51:49.149763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4114/5439] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:47 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:49.173881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:49.175178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:49.209728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:49.210730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:49.212230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:49.214817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:50.087850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:50.117236 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4de7cc19-6c85-4987-a3d7-1d16c49635f7 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1698 microversion: 2.1 time: 0.963194 May 19 08:51:50.123605 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4115/5440] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:49 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1698 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:50.148216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-988e1cc3-6c49-4e32-ab71-857d581a525f req-51748e13-db33-4b9d-a3be-4d985b150b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:50.199738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-988e1cc3-6c49-4e32-ab71-857d581a525f req-51748e13-db33-4b9d-a3be-4d985b150b02 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:50.203887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-988e1cc3-6c49-4e32-ab71-857d581a525f req-51748e13-db33-4b9d-a3be-4d985b150b02 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:50.250789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-988e1cc3-6c49-4e32-ab71-857d581a525f req-51748e13-db33-4b9d-a3be-4d985b150b02 service nova] Creating event network-changed:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh2-842464-2 May 19 08:51:50.267241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-988e1cc3-6c49-4e32-ab71-857d581a525f req-51748e13-db33-4b9d-a3be-4d985b150b02 service nova] Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:51:50.296304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-988e1cc3-6c49-4e32-ab71-857d581a525f req-51748e13-db33-4b9d-a3be-4d985b150b02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167444 May 19 08:51:50.297120 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4116/5441] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:50.310515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:50.314495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:50.337767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:50.338739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:50.343532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:50.344300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:51.494187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:51.508731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a39d9ece-d6f5-4d84-af81-83797fb7572a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.210006 May 19 08:51:51.513651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4117/5442] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:50 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:51.536174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:51.540215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:51.566194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:51.569444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:51.570313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:51.570774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:52.870211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:52.887322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8141028-f45b-48a3-b524-905d2f1c8906 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1698 microversion: 2.1 time: 1.370120 May 19 08:51:52.894560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4118/5443] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:51 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1698 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:52.918726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:52.923430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:52.949124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:52.955703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:52.957041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:52.957535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:53.980279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:53.995786 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69ebd22a-8360-4c34-bf17-1a208c949b16 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.096962 May 19 08:51:53.996659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4119/5444] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:52 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:54.004979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:54.005886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:54.017228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:54.018261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:54.019429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:54.020055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:54.851891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:54.888989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d7a73f9-a16e-486a-b1a6-0bc23d2df99a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1693 microversion: 2.1 time: 0.890287 May 19 08:51:54.890135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4120/5445] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:53 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1693 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:54.955444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:54.956501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:55.017539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:55.018434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:55.026565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:55.028049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:55.742280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-90bfe7c7-e9fd-4627-8e35-31ea164921ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action" status: 202 len: 0 microversion: 2.1 time: 0.800293 May 19 08:51:55.743553 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4121/5446] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:51:54 2022] POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:51:55.797140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:55.798862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:55.809503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:55.848078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:55.852669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:55.853440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:55.860037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:56.933467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:56.952426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86779bbc-ba3f-4452-afe3-a2ae2e5692ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.206530 May 19 08:51:56.959988 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4122/5447] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:55 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:56.978314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:56.984933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:57.008012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:57.016897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:57.018309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:57.018994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:57.568658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:57.586489 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c8748a0-b4e8-4dce-ad39-acc8d72cd5d8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1692 microversion: 2.1 time: 0.624738 May 19 08:51:57.587127 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4123/5448] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:56 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1692 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:57.751643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-053ec744-1dcf-424f-a519-de24ee7ae363 req-34e66bab-7b9e-41c7-8706-3054fc6261c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "name": "network-vif-plugged", "status": "completed", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:51:57.802596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-053ec744-1dcf-424f-a519-de24ee7ae363 req-34e66bab-7b9e-41c7-8706-3054fc6261c4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:57.803201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-053ec744-1dcf-424f-a519-de24ee7ae363 req-34e66bab-7b9e-41c7-8706-3054fc6261c4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:57.852404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-053ec744-1dcf-424f-a519-de24ee7ae363 req-34e66bab-7b9e-41c7-8706-3054fc6261c4 service nova] Creating event network-vif-plugged:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh2-842464-2 May 19 08:51:57.878465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-053ec744-1dcf-424f-a519-de24ee7ae363 req-34e66bab-7b9e-41c7-8706-3054fc6261c4 service nova] Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:51:57.922964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-053ec744-1dcf-424f-a519-de24ee7ae363 req-34e66bab-7b9e-41c7-8706-3054fc6261c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181990 May 19 08:51:57.929985 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4124/5449] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:51:57.972744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:57.974122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:58.004246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:58.008106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:58.009032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:58.009653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:58.019545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:51:59.011513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:59.022440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2c10c53-d723-4130-a8ce-1e17a6db7611 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.055652 May 19 08:51:59.043781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4125/5450] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:57 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:51:59.058548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:59.061800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:59.075799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:59.079684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:59.080849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:59.083594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:59.574787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:51:59.589612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2c15d97-829f-478b-88ea-13f5ef662c8b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1692 microversion: 2.1 time: 0.542706 May 19 08:51:59.593585 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4126/5451] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:51:59 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1692 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:51:59.850526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:51:59.850526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:51:59.856278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:59.856871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:59.859298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:51:59.859845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:51:59.931271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-909fedb7-af2f-45fe-a8f2-1b968fa889da tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/ips" status: 200 len: 149 microversion: 2.1 time: 0.078516 May 19 08:51:59.939803 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4127/5452] 10.222.0.78 () {58 vars in 1247 bytes} [Thu May 19 08:51:59 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:00.051420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:00.052221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:00.077740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:00.081439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:00.082391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:00.082888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:01.302080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:01.317693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb75ccb4-103d-425c-819b-8ed955ba279c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.269898 May 19 08:52:01.329642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4128/5453] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:00 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:01.345108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:01.349110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:01.357019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:01.357981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:01.360067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:01.360873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:02.052091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:02.062546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f42088e-b7a4-4117-9a0f-27cb35409207 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1692 microversion: 2.1 time: 0.731434 May 19 08:52:02.079181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4129/5454] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:01 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1692 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:02.343586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:02.345676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:02.360854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:02.366013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:02.367685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:02.372667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:03.627931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:03.651958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0262c39-4f0c-44f6-afbe-0a05ef7c9370 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 1.319977 May 19 08:52:03.652893 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4130/5455] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:02 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:03.681909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:03.682678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:03.709059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:03.709673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:03.710545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:03.711349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:04.170769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:04.187099 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db2d0f27-0c5a-4380-a6f3-27e8660590a1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1692 microversion: 2.1 time: 0.532094 May 19 08:52:04.199410 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4131/5456] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:03 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1692 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:04.224586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a763519-2e9c-4567-8761-df5e0a040424"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:04.226631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:04.261757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:04.263135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:04.269277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:04.278326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:05.262791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71b8ee2a-df3c-4935-9c8e-cb89dab3fbf8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "POST /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.061371 May 19 08:52:05.263621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4132/5457] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 08:52:04 2022] POST /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 194 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:05.287064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-85e78099-3eea-481b-8f31-c2d8ac669227 req-107e79d3-ee8f-484a-9d62-9a319c2e936c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "name": "network-vif-unplugged", "status": "completed", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:05.328046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-85e78099-3eea-481b-8f31-c2d8ac669227 req-107e79d3-ee8f-484a-9d62-9a319c2e936c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:05.330533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-85e78099-3eea-481b-8f31-c2d8ac669227 req-107e79d3-ee8f-484a-9d62-9a319c2e936c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:05.368810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-85e78099-3eea-481b-8f31-c2d8ac669227 req-107e79d3-ee8f-484a-9d62-9a319c2e936c service nova] Creating event network-vif-unplugged:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:52:05.390766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-85e78099-3eea-481b-8f31-c2d8ac669227 req-107e79d3-ee8f-484a-9d62-9a319c2e936c service nova] Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 08:52:05.421402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-85e78099-3eea-481b-8f31-c2d8ac669227 req-107e79d3-ee8f-484a-9d62-9a319c2e936c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155252 May 19 08:52:05.424621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4133/5458] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:05.438254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:05.439440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:05.446956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:05.447746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:05.449060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:05.449803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:05.897773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:05.910436 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c80ceb4-43be-476c-b61a-2dbd3524dba0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.484209 May 19 08:52:05.911946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4134/5459] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:05 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:05.924441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:05.925394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:05.933654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:05.934334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:05.935319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:05.936569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:06.363309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:06.372104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a8fffa1-a69e-4260-b1ba-9db3605d556a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1692 microversion: 2.1 time: 0.457015 May 19 08:52:06.376506 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4135/5460] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:05 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1692 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:06.932661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:06.933632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:06.943391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:06.944092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:06.945167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:06.946080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:07.173751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:07.185087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4972e89d-3219-442a-99b5-7364107fe8c5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1169 microversion: 2.1 time: 0.258279 May 19 08:52:07.186997 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4136/5461] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:06 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1169 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:07.395237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:07.397226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:07.405245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:07.406205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:07.407159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:07.408706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:08.057725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:08.074067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d52b918-9a39-462a-b1ab-01c99fc67736 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1692 microversion: 2.1 time: 0.684029 May 19 08:52:08.081706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4137/5462] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:07 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1692 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:08.088733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8b295e67-4486-4f84-9494-ad54cc4d4d70 req-79f43669-120e-4e91-ba9a-ea7d0e7bc68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:08.111710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b295e67-4486-4f84-9494-ad54cc4d4d70 req-79f43669-120e-4e91-ba9a-ea7d0e7bc68f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:08.112173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b295e67-4486-4f84-9494-ad54cc4d4d70 req-79f43669-120e-4e91-ba9a-ea7d0e7bc68f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:08.137601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8b295e67-4486-4f84-9494-ad54cc4d4d70 req-79f43669-120e-4e91-ba9a-ea7d0e7bc68f service nova] Creating event network-changed:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:52:08.156157 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8b295e67-4486-4f84-9494-ad54cc4d4d70 req-79f43669-120e-4e91-ba9a-ea7d0e7bc68f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073063 May 19 08:52:08.160028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4138/5463] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:08.205102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:08.210479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:08.223749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:08.224510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:08.225733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:08.226347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:09.316619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:09.329198 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c12efc0-adf9-4c4e-bc95-1fee31895aa8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 1.128849 May 19 08:52:09.332667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4139/5464] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:08 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:09.348189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:09.349266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:09.356087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:09.369059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:09.371082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:09.374299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:10.184227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:10.210193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8cc4986c-22b6-45a5-bb0e-28dc262c1e5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1685 microversion: 2.1 time: 0.865923 May 19 08:52:10.215713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4140/5465] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:09 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1685 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:10.350429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:10.351087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:10.365754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:10.366395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:10.367251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:10.367701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:11.304481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:11.313987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:11.320975 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-421d3b5b-0b81-43cd-8477-b87f9c1fd99e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 0.975022 May 19 08:52:11.323448 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4141/5466] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:10 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:12.342744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:12.344266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:12.351833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:12.352602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:12.353654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:12.354354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:12.587076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:12.601016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3f9e69f-f051-4c87-9dc6-ad4357e7d020 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 0.264479 May 19 08:52:12.604321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4142/5467] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:12 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:13.621809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:13.622521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:13.642232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:13.642695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:13.643501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:13.643949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:14.246281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:14.281488 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae78a6a8-41c0-4ddb-854d-690a34feb6bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 0.663548 May 19 08:52:14.285920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4143/5468] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:13 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:14.808802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a461e3fe-563d-450f-b785-1d9d931cf0a7 req-965e426e-57f2-4a4a-b060-a6734860c207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "name": "network-vif-plugged", "status": "completed", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:14.831950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a461e3fe-563d-450f-b785-1d9d931cf0a7 req-965e426e-57f2-4a4a-b060-a6734860c207 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:14.839412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a461e3fe-563d-450f-b785-1d9d931cf0a7 req-965e426e-57f2-4a4a-b060-a6734860c207 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:14.880242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a461e3fe-563d-450f-b785-1d9d931cf0a7 req-965e426e-57f2-4a4a-b060-a6734860c207 service nova] Creating event network-vif-plugged:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:52:14.899951 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a461e3fe-563d-450f-b785-1d9d931cf0a7 req-965e426e-57f2-4a4a-b060-a6734860c207 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.612443 May 19 08:52:14.902793 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4144/5469] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:15.308079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:15.310072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:15.329396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:15.332074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:15.333213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:15.336693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:15.799886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:15.818986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-568521a2-e749-4cf4-8d1f-f02a9418387e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 0.520036 May 19 08:52:15.820002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4145/5470] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:15 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:16.836097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:16.837531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:16.852409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:16.854980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:16.862815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:16.866221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:17.483236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:17.498996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53bfdf7f-e1f4-4c27-84b2-b2b468512091 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 0.666657 May 19 08:52:17.512520 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4146/5471] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:16 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:18.528089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:18.528839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:18.543922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:18.544636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:18.546187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:18.546907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:19.572053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:19.588452 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18ea5ea5-aec6-4d91-8169-e8292dd28f3f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 1.064071 May 19 08:52:19.589506 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4147/5472] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:18 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:19.594473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5f4ca916-bd45-420b-804b-e43af6df14bd req-fa5fee1a-1213-4199-b47c-b8908719ac86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e371c50-6012-4e91-a93f-4f76c5eea2f5", "name": "network-vif-plugged", "status": "completed", "tag": "b12b4ae3-6abb-45fc-a7eb-8d47967869e0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:19.630699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5f4ca916-bd45-420b-804b-e43af6df14bd req-fa5fee1a-1213-4199-b47c-b8908719ac86 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:19.640039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5f4ca916-bd45-420b-804b-e43af6df14bd req-fa5fee1a-1213-4199-b47c-b8908719ac86 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:19.657654 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5f4ca916-bd45-420b-804b-e43af6df14bd req-fa5fee1a-1213-4199-b47c-b8908719ac86 service nova] Creating event network-vif-plugged:b12b4ae3-6abb-45fc-a7eb-8d47967869e0 for instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 on chh1-842464-2 May 19 08:52:19.676550 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5f4ca916-bd45-420b-804b-e43af6df14bd req-fa5fee1a-1213-4199-b47c-b8908719ac86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085519 May 19 08:52:19.677882 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4148/5473] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:20.610209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:20.610979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:20.626943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:20.630670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:20.634296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:20.635761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:20.980597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:20.989460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adc91d05-0d91-482b-b478-df35c1027e13 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1203 microversion: 2.1 time: 0.385872 May 19 08:52:20.990090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4149/5474] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:20 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1203 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:22.007578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:22.008846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:22.019339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:22.035624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:22.036942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:22.037578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:22.318254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:22.329005 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61d7e7d2-d167-4e6c-9cdc-e971e4c063c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1390 microversion: 2.1 time: 0.325457 May 19 08:52:22.330358 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4150/5475] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:22 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:22.352040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:22.353089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:22.364782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:22.369850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:22.373630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:22.374267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:23.149128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:23.166155 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9957e21f-74bd-42ea-be3f-4a774a1f7b83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1390 microversion: 2.1 time: 0.817900 May 19 08:52:23.167572 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4151/5476] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:22 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1390 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:23.185938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:23.186946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:23.193977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:23.194486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:23.195520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:23.196653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:23.405424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:23.416983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b31f8a3b-c848-4b45-a5d2-2cb8282ebd8f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1390 microversion: 2.1 time: 0.235900 May 19 08:52:23.417614 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4152/5477] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:23 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:23.513491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:23.515119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:23.522883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:23.523497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:23.524628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:23.525299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:23.579862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:52:23.730414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-652dfb8d-4d43-40d3-a898-88cc48041767 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 204 len: 0 microversion: 2.1 time: 0.220415 May 19 08:52:23.731621 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4153/5478] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:52:23 2022] DELETE /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:52:23.744147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:23.745598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:23.756437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:23.759263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:23.760637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:23.761455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:24.051356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:24.064747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7a9b1cdd-a43f-421c-8170-6cf6cc991b1e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1396 microversion: 2.1 time: 0.327518 May 19 08:52:24.066344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4154/5479] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:23 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1396 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:25.089819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:25.090999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:25.128924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:25.145840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:25.147450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:25.150222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:25.736100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:25.780655 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00885e40-e14e-4bd5-9eec-95aa9f37b154 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1396 microversion: 2.1 time: 0.700020 May 19 08:52:25.782582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4155/5480] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:25 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1396 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:26.816383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:26.818812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:26.840697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:26.850838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:26.851801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:26.853344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:26.856061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:27.068731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:27.107799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b67a8716-35a9-43d2-bf8d-c87cc5dc8c2b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1354 microversion: 2.1 time: 0.290622 May 19 08:52:27.114422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4156/5481] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:26 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1354 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:27.135000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1d2783d4-1d5d-4f64-a91c-a3992c36029a req-9ccdf844-fc72-4586-90f8-a12129c05986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e371c50-6012-4e91-a93f-4f76c5eea2f5", "name": "network-vif-deleted", "tag": "b12b4ae3-6abb-45fc-a7eb-8d47967869e0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:27.177346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1d2783d4-1d5d-4f64-a91c-a3992c36029a req-9ccdf844-fc72-4586-90f8-a12129c05986 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:27.178064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1d2783d4-1d5d-4f64-a91c-a3992c36029a req-9ccdf844-fc72-4586-90f8-a12129c05986 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:27.218908 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1d2783d4-1d5d-4f64-a91c-a3992c36029a req-9ccdf844-fc72-4586-90f8-a12129c05986 service nova] Creating event network-vif-deleted:b12b4ae3-6abb-45fc-a7eb-8d47967869e0 for instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 on chh1-842464-2 May 19 08:52:27.230557 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1d2783d4-1d5d-4f64-a91c-a3992c36029a req-9ccdf844-fc72-4586-90f8-a12129c05986 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111737 May 19 08:52:27.231693 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4157/5482] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:28.137125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:28.137941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:28.172076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:28.172819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:28.174049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:28.175838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:28.299184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:28.303486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:28.317730 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d09b111-dceb-41bf-ab99-cbcab3bb8c90 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.188836 May 19 08:52:28.329287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4158/5483] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:28 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:29.341215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:29.344247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:29.380212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:29.381025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:29.382249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:29.385457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:29.512938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:29.523820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bfca792-745f-4642-96c9-132842450d6f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.191076 May 19 08:52:29.528423 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4159/5484] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:29 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:30.090300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:30.090803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:30.103306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:30.103771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:30.109571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:30.110269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:30.303083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lazy-loading 'services' on Instance uuid 695f996f-261f-4ea2-bb62-c2f110cac751 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:52:30.458181 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0d084bb-db6a-4142-9a82-7c2392698f18 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments/1a763519-2e9c-4567-8761-df5e0a040424" status: 202 len: 0 microversion: 2.1 time: 0.371880 May 19 08:52:30.462038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4160/5485] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 08:52:30 2022] DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments/1a763519-2e9c-4567-8761-df5e0a040424 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:52:30.467962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:30.469073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:30.492361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:30.492823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:30.493649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:30.494085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:30.567734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15e2e6c4-f709-4741-94bc-c4c4ac1c8654 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104369 May 19 08:52:30.580060 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4161/5486] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:30 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:30.589423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:30.594168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:30.609397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:30.609863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:30.612984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:30.613471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:30.827740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:30.849475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30e593cc-660c-44d7-aaf8-7e363c2773a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.263771 May 19 08:52:30.860769 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4162/5487] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:30 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:31.600805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:31.609219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:31.626951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:31.627815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:31.628782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:31.629417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:31.687166 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b575e66b-9cb1-4b25-b388-1d096833fdd0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099401 May 19 08:52:31.688482 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4163/5488] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:31 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:31.868524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:31.869541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:31.887369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:31.889609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:31.892391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:31.895623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:32.016081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:32.026739 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-016b5d59-3ca5-4895-95cd-a2c986e0dc9f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.163699 May 19 08:52:32.035942 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4164/5489] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:31 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:32.973142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:32.975832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:32.987529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:32.988407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:32.990500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:32.991774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:33.083123 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47988734-e36e-42a8-ae97-179f871751fc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action" status: 200 len: 63159 microversion: 2.1 time: 0.549337 May 19 08:52:33.086329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4165/5490] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:52:32 2022] POST /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85/action => generated 63159 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:52:33.097388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:33.099694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:33.108457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:33.109285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:33.110424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:33.111117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:33.179795 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4de0ab74-ab60-4731-8cf8-b362bc18feb2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090751 May 19 08:52:33.181554 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4166/5491] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:33 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:33.189801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:33.191204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:33.200613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:33.201613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:33.203699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:33.204527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:33.355634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:33.375528 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c2b358d-655d-435f-9c26-7e1a7b32c52d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.191231 May 19 08:52:33.387173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4167/5492] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:33 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:34.193370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:34.195010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:34.209250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:34.209752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:34.210565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:34.211008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:34.358053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba810620-1f06-45e9-8248-de4735bda6ef tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168696 May 19 08:52:34.364432 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4168/5493] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:34 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:52:34.394621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:34.395260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:34.408216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:34.412224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:34.422738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:34.424533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:34.566462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:34.579828 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34611ec1-3c5d-4a73-ad76-0b3ec5d51239 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.189435 May 19 08:52:34.581206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4169/5494] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:34 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:35.371041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:35.374087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:35.386406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:35.391660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:35.394677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:35.398665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:35.485074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c98dcae6-a88c-43a0-96b9-12b3aa7ca9ea tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117899 May 19 08:52:35.485954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4170/5495] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:35 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:52:35.601913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:35.614450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:35.645936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:35.647765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:35.648670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:35.653452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:36.141575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:36.152041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01bfdbe1-b4f8-45b6-b1db-62c86dbfc99a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.558207 May 19 08:52:36.152673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4171/5496] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:35 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:36.500521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:36.501535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:36.522160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:36.522691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:36.523513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:36.525115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:36.590540 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de106d60-7e31-4325-be06-60ea34991b9c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097980 May 19 08:52:36.592337 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4172/5497] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:36 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:37.171690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:37.172683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:37.180098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:37.180888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:37.182030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:37.182639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:37.290306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:37.299963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38914df9-b565-4af6-900c-e772ccc72000 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.133224 May 19 08:52:37.312591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4173/5498] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:37 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:37.576958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d99f58b-b472-4a96-b650-48db7f20077b tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Action: 'create', calling method: .version_select at 0x7f3211e88f70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-834002276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDozhMFnjVLZufW5d7oAP+Itr9sT4Tiw3JFor9Ws6aVoHKy6I8J/28kMIfZkFuPJOC5gvkFszeYPXC6J/CslUDafXfmyDLtCcnN1spqsxUGAIwzlziiI5UsHbEat5Cgqcg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:37.594276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9d99f58b-b472-4a96-b650-48db7f20077b tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Getting quotas for project b20df985328b4e8dbe635151a8d38059. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:52:37.613123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9d99f58b-b472-4a96-b650-48db7f20077b tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Getting quotas for user 2225404e630f4a07bef2f35632a2c8cd and project b20df985328b4e8dbe635151a8d38059. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:52:37.650534 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d99f58b-b472-4a96-b650-48db7f20077b tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.336400 May 19 08:52:37.651463 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4174/5499] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:52:37 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:37.658456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:37.659496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:37.667005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:37.667744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:37.668706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:37.669524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:37.710408 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ddf81b88-02cb-456c-a3ec-d4be70a6b672 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057522 May 19 08:52:37.711583 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4175/5500] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:37 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:38.320893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:38.321678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:38.336150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:38.336636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:38.340091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:38.341414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:38.355754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:38.508333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:38.523986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8444215-6bd9-4312-ac9e-e99d5167099b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.208605 May 19 08:52:38.530213 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4176/5501] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:38 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:38.723515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:38.725835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:38.736950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:38.737527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:38.742048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:38.743083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:38.834974 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6ac9242-9fb8-47fc-b671-b355b7322bc7 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115817 May 19 08:52:38.836623 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4177/5502] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:38 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:39.582541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:39.584174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:39.626348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:39.627196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:39.628369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:39.629534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:40.083534 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f77be25a-e8f0-4714-8abf-12670de5958f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1836 microversion: 2.1 time: 0.708887 May 19 08:52:40.097114 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4178/5503] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:39 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1836 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:40.097114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:40.097114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:40.118093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:40.118811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:40.126046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:40.126608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:40.403224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:40.417752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01421726-2e60-4870-bf30-049578f7b36b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.329197 May 19 08:52:40.418668 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4179/5504] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:40 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:40.444825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:40.446531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:40.465843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:40.467140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:40.468187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:40.471175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:40.555218 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b84928f0-ae99-47a8-a93f-c1d7b3de8f56 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122642 May 19 08:52:40.557124 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4180/5505] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:40 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:41.438211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:41.438845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:41.455637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:41.459210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:41.461557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:41.477642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:41.756075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:41.773875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a47f4edf-4cba-4ebb-9dd2-d2b7813f3f12 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.341188 May 19 08:52:41.774512 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4181/5506] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:41 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:41.782198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:41.800265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:41.826176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:41.827390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:41.830560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:41.832640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:41.941385 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2414362-7d32-46ee-aec7-c219674c265b tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165459 May 19 08:52:41.945841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4182/5507] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:41 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:42.803872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:42.806423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:42.833507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:42.834565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:42.835672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:42.842174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:43.068407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:43.088656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9b63a26-2e8a-45ad-862d-de519b8eb059 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 200 len: 1188 microversion: 2.1 time: 0.284091 May 19 08:52:43.089846 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4183/5508] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:42 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 1188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:43.105445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:43.106895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:43.120933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:43.121710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:43.124699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:43.125528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:43.231305 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-beb124d1-b924-4dd6-98df-0d9e42dce779 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136304 May 19 08:52:43.238453 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4184/5509] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:43 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:44.108004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:44.108904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:44.130406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.131956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.137864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.138350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.171943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 HTTP/1.1 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5e371c50-6012-4e91-a93f-4f76c5eea2f5'} May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:52:44.177580 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:52:44.181721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efe0592d-eec6-4042-be8f-a2558279e414 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 404 len: 111 microversion: 2.1 time: 0.076988 May 19 08:52:44.189811 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4185/5510] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:44 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:52:44.245347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:44.246337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:44.261629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.262091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.262890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.263332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.364555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-194dd2a2-cdd9-4d6a-afd5-5c5da34f8ad0 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124221 May 19 08:52:44.365151 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4186/5511] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:44 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:44.436387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:44.437261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:44.459406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.465661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.470730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.471452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.537083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:52:44.756522 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf39a8b8-3520-4a1a-bee8-ee3c653e7ac1 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 204 len: 0 microversion: 2.1 time: 0.324021 May 19 08:52:44.762499 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4187/5512] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:52:44 2022] DELETE /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:52:44.777968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1d83a4e7-f654-468a-949c-c7041224fa71 req-f9e63338-8858-4e0b-8956-22cb4732d194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:44.811178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1d83a4e7-f654-468a-949c-c7041224fa71 req-f9e63338-8858-4e0b-8956-22cb4732d194 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.811653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1d83a4e7-f654-468a-949c-c7041224fa71 req-f9e63338-8858-4e0b-8956-22cb4732d194 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.848644 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1d83a4e7-f654-468a-949c-c7041224fa71 req-f9e63338-8858-4e0b-8956-22cb4732d194 service nova] Creating event network-changed:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:52:44.867048 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1d83a4e7-f654-468a-949c-c7041224fa71 req-f9e63338-8858-4e0b-8956-22cb4732d194 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099787 May 19 08:52:44.877498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4188/5513] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:44.884439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:44.885660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:44.901133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.902345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:44.910612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:44.911540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:45.449145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:45.464461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e833742-27df-4466-b320-35bc973e7a56 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1691 microversion: 2.1 time: 0.584117 May 19 08:52:45.471368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4189/5514] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:44 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1691 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:52:45.478851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:45.486389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:45.499844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:45.507684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:45.510654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:45.511347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:45.601981 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d38bcda3-4432-47f2-9fdc-905b562c54f3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127220 May 19 08:52:45.606043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4190/5515] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:45 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:46.490272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:46.490905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:46.501675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:46.502340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:46.504079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:46.504845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:47.031435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:47.057139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdb3647e-cba9-4922-b18e-061bf99e0ea8 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1691 microversion: 2.1 time: 0.570509 May 19 08:52:47.059676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4191/5516] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:46 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1691 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:47.087065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:47.089223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:47.106509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:47.113721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:47.123832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:47.125220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:47.158312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:47.186572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-429f9a67-c916-468e-843d-3e403be5bb19 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123895 May 19 08:52:47.198481 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4192/5517] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:47 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:48.079559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:48.081096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:48.094936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:48.103538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:48.105202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:48.106391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:48.107027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:49.139508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:52:49.152856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4514cf8-84c0-47d2-ab74-e9272d59b4b3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 200 len: 1691 microversion: 2.1 time: 1.078098 May 19 08:52:49.153742 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4193/5518] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:48 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 1691 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:52:49.162461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:49.164160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:49.191979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:49.192691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:49.193751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:49.194355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:49.284073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d5ad40f-7797-4c62-9707-81740a8d3c1d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128549 May 19 08:52:49.286502 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4194/5519] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:49 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:49.420779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-14d911f3-ecf9-4d8b-bfe5-23fbe0da3444 req-59dc794f-a1c4-4fad-9cda-543443a71069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5366cab-3c8b-42ab-a485-391cfdf5be85", "name": "network-vif-deleted", "tag": "6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:49.446418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-14d911f3-ecf9-4d8b-bfe5-23fbe0da3444 req-59dc794f-a1c4-4fad-9cda-543443a71069 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:49.447116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-14d911f3-ecf9-4d8b-bfe5-23fbe0da3444 req-59dc794f-a1c4-4fad-9cda-543443a71069 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:49.503851 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-14d911f3-ecf9-4d8b-bfe5-23fbe0da3444 req-59dc794f-a1c4-4fad-9cda-543443a71069 service nova] Creating event network-vif-deleted:6cc2859b-7a0d-4da2-9ff9-45f9b6b338ec for instance b5366cab-3c8b-42ab-a485-391cfdf5be85 on chh1-842464-2 May 19 08:52:49.513180 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-14d911f3-ecf9-4d8b-bfe5-23fbe0da3444 req-59dc794f-a1c4-4fad-9cda-543443a71069 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095697 May 19 08:52:49.518892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4195/5520] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:50.173243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:50.189715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: b5366cab-3c8b-42ab-a485-391cfdf5be85] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:50.219528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:50.219990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:50.225739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:50.227191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:50.266264 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] HTTP exception thrown: Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 could not be found. May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Request method failure captured: May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 HTTP/1.1 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQfatyEMjit-1p2K5H_CnRifSFEi5qTSLtDqv5SD5Mhts9PF9hc-AFLx_2KjIqBun4xz_oldFKcmimb0liieDCXTSui5RQaw-6c8Zft1Hotj3yjm-Nmu6PpzTKBtMIKUueMkLwgR7nvro0Sw3i-I-5V7uaCEL2eqdhMpBwxku1mTBU May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_45be8834713245c5b0dd248ca205ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 81a87eec69894a099a140ec8980a57e0 May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 could not be found. May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b5366cab-3c8b-42ab-a485-391cfdf5be85'} May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 could not be found. May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 could not be found. May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:50.267999 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 could not be found. May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:52:50.273611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Returning 404 to user: Instance b5366cab-3c8b-42ab-a485-391cfdf5be85 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:52:50.276456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-457dc29d-5658-49e4-84a4-be70476cd30c tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85" status: 404 len: 111 microversion: 2.1 time: 0.107959 May 19 08:52:50.278232 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4196/5521] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:52:50 2022] GET /compute/v2.1/servers/b5366cab-3c8b-42ab-a485-391cfdf5be85 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:52:50.296973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:50.297996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:50.311361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:50.311836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:50.312658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:50.313111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:50.416744 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-013a5984-5ac4-4ae3-ae5b-a3e6baad9486 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124616 May 19 08:52:50.418368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4197/5522] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:50 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:52:51.430612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:51.433395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:51.448219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:52:51.450118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:51.453498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:51.454524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:51.457630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:51.548251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5206ee01-d2a3-4bfc-a1d1-a8465944bd4e tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121749 May 19 08:52:51.548836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4198/5523] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:51 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:52.560076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:52.566641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:52.588669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:52.589440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:52.590408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:52.591017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:52.680877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-301c8985-9218-4d4c-94c3-0e7f038b0775 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124770 May 19 08:52:52.681556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4199/5524] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:52 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:52:53.693190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:53.694197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:53.703664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:53.704661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:53.705777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:53.706397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:53.756108 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80295a52-0bdc-43a5-81cd-6ee1d4a47f55 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067170 May 19 08:52:53.757332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4200/5525] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:53 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:54.769350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:54.771166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:54.785618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:54.789131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:54.790698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:54.791389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:54.874367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb4f940a-c09a-4786-a084-2c77e7fe3c50 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108529 May 19 08:52:54.875725 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4201/5526] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:54 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:55.887998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:55.890750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:55.901211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:55.903739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:55.905899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:55.906767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:55.948048 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7a3de78-13fd-4452-883f-cc5f5eeb6298 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065294 May 19 08:52:55.949073 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4202/5527] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:55 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:52:56.962162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:56.963961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:56.978024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:56.978490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:56.979289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:56.986474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:57.053883 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f951b637-b692-468b-99cc-5b161c74151c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097300 May 19 08:52:57.059710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4203/5528] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:56 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:52:58.078269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:52:58.079938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:52:58.097340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:58.098433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:58.104014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:52:58.104724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:52:58.193130 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6563477-13fc-4f8c-bc65-b9f9a0f9d8aa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124540 May 19 08:52:58.197074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4204/5529] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:52:58 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:52:58.384065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-987266293-access_point-1868028267", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "f7f3706b-0f94-46c2-ba28-6517d76872fe"}], "key_name": "tempest-TestSecurityGroupsBasicOps-834002276", "security_groups": [{"name": "tempest-secgroup_access--1258361178"}, {"name": "tempest-secgroup_general--1389364361"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:52:59.853745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] validate_networks() for [('f7f3706b-0f94-46c2-ba28-6517d76872fe', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:53:02.301683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:53:02.302321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:53:02.302599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:53:02.303011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:53:02.303427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:53:02.321771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:02.322822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:02.324031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:02.324895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:02.360087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Getting quotas for project b20df985328b4e8dbe635151a8d38059. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:53:02.369513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Getting quotas for user 2225404e630f4a07bef2f35632a2c8cd and project b20df985328b4e8dbe635151a8d38059. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:53:02.391755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:53:02.395122 chdv-842464-2 devstack@n-api.service[119072]: WARNING nova.utils [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-987266293-access_point-1868028267 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-987266293-acc May 19 08:53:02.396377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:53:02.496143 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3488df75-feec-4e92-8aaf-1819c49dd0ce tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 4.115943 May 19 08:53:02.497249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4205/5530] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:52:58 2022] POST /compute/v2.1/servers => generated 458 bytes in 4120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:53:02.505237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:02.506274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:02.527007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:02.531384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:02.532306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:02.532761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:02.647628 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3997e49-beb3-4ed2-9320-faa0135e9962 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.148599 May 19 08:53:02.652431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4206/5531] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 08:53:02 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 08:53:02.662102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b5ea225-85be-4e6e-a0cc-a737b90ac04a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:02.663054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b5ea225-85be-4e6e-a0cc-a737b90ac04a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:02.877531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b5ea225-85be-4e6e-a0cc-a737b90ac04a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:02.884681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b5ea225-85be-4e6e-a0cc-a737b90ac04a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1293 microversion: 2.1 time: 0.229153 May 19 08:53:02.885293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4207/5532] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:02 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:02.894419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:02.896477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:02.912054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:02.912519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:02.923475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:02.924059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:03.007199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:53:03.213119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24e7c61c-1dec-456e-bf71-edf00c19ccc3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 204 len: 0 microversion: 2.1 time: 0.322151 May 19 08:53:03.217356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4208/5533] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:53:02 2022] DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:53:03.225836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:03.226599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:03.279254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:03.281571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:03.283472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:03.284104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:03.706708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:03.718813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d55a7e54-7045-4740-9fd4-0662db710b2c tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1682 microversion: 2.1 time: 0.498529 May 19 08:53:03.719426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4209/5534] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:03 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1682 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:03.902223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:03.902991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:03.917958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:03.918618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:03.920257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:03.920882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:03.954371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:04.121713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:04.142736 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70893c19-9da6-447d-9d88-300dcc8647a8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1345 microversion: 2.1 time: 0.244171 May 19 08:53:04.158751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4210/5535] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:03 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1345 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:04.739627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:04.740258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:04.746890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:04.747351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:04.748717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:04.749166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:05.117836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:05.128396 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-596c2df2-7cc7-4ded-ab0c-38248c1f37fa tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1682 microversion: 2.1 time: 0.396044 May 19 08:53:05.129010 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4211/5536] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:04 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1682 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:05.167224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:05.167770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:05.183833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:05.184512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:05.185456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:05.188590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:05.379586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:05.393684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-887c8081-6d41-4dc3-a5f1-b43af60294d3 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1351 microversion: 2.1 time: 0.230396 May 19 08:53:05.394969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4212/5537] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:05 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1351 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:05.407636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39bb541-db81-428a-a218-faaccb3e979e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '.version_select at 0x7f3211df73a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:05.436946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c39bb541-db81-428a-a218-faaccb3e979e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167943301" status: 202 len: 0 microversion: 2.1 time: 0.038657 May 19 08:53:05.438009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4213/5538] 10.222.0.78 () {58 vars in 1283 bytes} [Thu May 19 08:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1167943301 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:53:05.478844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6654148b-dd02-401e-bdac-068279440307 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: .version_select at 0x7f3217ae9280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1781171656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLdfnvEHLTOKmk+OJvJdqyh5hUe0Eb6WDL1dhgcvik8bPWos8k/2xBKS3zCei0GRw8xTFpvaTP5eY0kH1XCy8MCD1i4AqUHSMutBojrfCJbtCUgM3SVh2tpOJ4L/GFHaw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:05.498712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6654148b-dd02-401e-bdac-068279440307 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:53:05.508746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6654148b-dd02-401e-bdac-068279440307 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:53:05.546280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6654148b-dd02-401e-bdac-068279440307 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070879 May 19 08:53:05.549261 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4214/5539] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:53:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:06.160662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:06.161152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:06.187503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:06.190107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:06.194918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:06.198060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:07.150103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:07.160246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7de0219-f974-4119-8a14-16034e9937d2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1682 microversion: 2.1 time: 1.006713 May 19 08:53:07.161107 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4215/5540] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:06 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1682 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:07.171464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:07.174283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:07.191302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:07.192203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:07.194608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:07.195263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:07.450352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:07.469601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-498056cb-04dc-409e-adb0-1c227806d942 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1351 microversion: 2.1 time: 0.304376 May 19 08:53:07.473481 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4216/5541] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:07 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1351 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:07.955127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-477fa597-6f1a-4725-842b-adb1371a8674 req-82e57a03-4de1-42b7-b0bb-cbf00c0c8743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695f996f-261f-4ea2-bb62-c2f110cac751", "name": "network-vif-deleted", "tag": "26c9e22f-044e-4694-a501-833ee37da63a"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:07.978082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-477fa597-6f1a-4725-842b-adb1371a8674 req-82e57a03-4de1-42b7-b0bb-cbf00c0c8743 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:07.984351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-477fa597-6f1a-4725-842b-adb1371a8674 req-82e57a03-4de1-42b7-b0bb-cbf00c0c8743 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:08.012483 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-477fa597-6f1a-4725-842b-adb1371a8674 req-82e57a03-4de1-42b7-b0bb-cbf00c0c8743 service nova] Creating event network-vif-deleted:26c9e22f-044e-4694-a501-833ee37da63a for instance 695f996f-261f-4ea2-bb62-c2f110cac751 on chh2-842464-2 May 19 08:53:08.025781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-477fa597-6f1a-4725-842b-adb1371a8674 req-82e57a03-4de1-42b7-b0bb-cbf00c0c8743 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230627 May 19 08:53:08.029933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4217/5542] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:08.179676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:08.182973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:08.201612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:08.202042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:08.202860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:08.203288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:08.302481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:08.302934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:08.307262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lazy-loading 'fault' on Instance uuid 695f996f-261f-4ea2-bb62-c2f110cac751 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:53:08.513095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05ad3b9305e422fb86b4a25223616b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21dbcde9216e4f5fb132f4881500b302', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:08.527107 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4eb7261-5982-4d7f-87b0-74aa19622344 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 200 len: 1332 microversion: 2.1 time: 0.352005 May 19 08:53:08.543101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4218/5543] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:08 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 1332 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:08.557728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:08.558206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:08.583049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:08.583500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:08.584487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:08.584982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.082736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:09.110202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-402b9ec5-a5d6-4eca-9bf5-d04752d0598a tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 0.565821 May 19 08:53:09.110977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4219/5544] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:08 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:09.457713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:09.459309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:09.475832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:09.478532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.480384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:09.482939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.534450 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 HTTP/1.1 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5e371c50-6012-4e91-a93f-4f76c5eea2f5'} May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:09.541842 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.546105 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.553906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:09.555299 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-307c8aac-b0b5-49e5-a65c-697a6c26d299 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 404 len: 111 microversion: 2.1 time: 0.442535 May 19 08:53:09.556109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4220/5545] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:53:09 2022] DELETE /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 111 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:09.568578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:09.570179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:09.585854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:09.588863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.590219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:09.590804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.631065 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 HTTP/1.1 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '695f996f-261f-4ea2-bb62-c2f110cac751'} May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:09.634899 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:09.640438 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.644850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:09.644850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-983ae450-d28e-4008-9fd6-67b54de31e0d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 404 len: 111 microversion: 2.1 time: 0.085165 May 19 08:53:09.648754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4221/5546] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:09 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:09.658837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:09.665461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 5e371c50-6012-4e91-a93f-4f76c5eea2f5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:09.679626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:09.683274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.684331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:09.684795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:09.726532 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 HTTP/1.1 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5e371c50-6012-4e91-a93f-4f76c5eea2f5'} May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:09.728913 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. May 19 08:53:09.735804 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:09.738246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 5e371c50-6012-4e91-a93f-4f76c5eea2f5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:09.740003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-354530d9-9aa9-406a-a533-af1c8881f95d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5" status: 404 len: 111 microversion: 2.1 time: 0.089345 May 19 08:53:09.741734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4222/5547] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:09 2022] GET /compute/v2.1/servers/5e371c50-6012-4e91-a93f-4f76c5eea2f5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:09.770700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83eac273-c621-4da2-8da1-b811dd86678d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '.version_select at 0x7f3211d20040>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:09.823085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83eac273-c621-4da2-8da1-b811dd86678d tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518834985" status: 202 len: 0 microversion: 2.1 time: 0.078568 May 19 08:53:09.825208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4223/5548] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 08:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518834985 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:53:10.129007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:10.130229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:10.148795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:10.149692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:10.158161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:10.160293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:11.751545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:11.783200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fc66413-0d09-470b-945c-2ed88ffab041 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 1.659286 May 19 08:53:11.813373 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4224/5549] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:10 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:12.806070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:12.806744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:12.826659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:12.829989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:12.830792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:12.831860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:12.832556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:13.305746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:13.331384 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b5c9493-bf03-4064-8ff9-3bac30e227a4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 0.530398 May 19 08:53:13.344894 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4225/5550] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:12 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:13.352392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7ede94c0-7afe-4c02-a0a1-bd578d3f0464 req-3ad003de-fef3-4790-a0b8-50c1789fc12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42b4025-81c9-42e2-91b9-ed082d77397f", "tag": "c19a50e4-cf47-4020-9b05-eb088b16d754"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:13.368631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7ede94c0-7afe-4c02-a0a1-bd578d3f0464 req-3ad003de-fef3-4790-a0b8-50c1789fc12a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:13.369491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7ede94c0-7afe-4c02-a0a1-bd578d3f0464 req-3ad003de-fef3-4790-a0b8-50c1789fc12a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:13.394255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7ede94c0-7afe-4c02-a0a1-bd578d3f0464 req-3ad003de-fef3-4790-a0b8-50c1789fc12a service nova] Creating event network-changed:c19a50e4-cf47-4020-9b05-eb088b16d754 for instance d42b4025-81c9-42e2-91b9-ed082d77397f on chh1-842464-2 May 19 08:53:13.403494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7ede94c0-7afe-4c02-a0a1-bd578d3f0464 req-3ad003de-fef3-4790-a0b8-50c1789fc12a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056717 May 19 08:53:13.405141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4226/5551] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:14.353849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:14.354656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:14.371868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:14.376418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:14.378114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:14.378995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:14.770994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:14.823989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ac7f497-0d2c-4f71-a639-9095abd45652 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 0.477058 May 19 08:53:14.825037 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4227/5552] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:14 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:15.842713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:15.843438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:15.846511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:15.849452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:15.866784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:15.867737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:15.869194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:15.872395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:16.357413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:16.369529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-812aec1c-bbfd-438e-8deb-8b143133dae8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 0.529399 May 19 08:53:16.371561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4228/5553] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:15 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:17.388095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:17.389918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:17.402608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:17.405976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:17.407123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:17.410459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:18.600635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:18.618322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3f2ce77-9d79-4701-ac1b-19afe7429fd8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 1.231374 May 19 08:53:18.631540 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4229/5554] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:17 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:19.639471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:19.640984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:19.653056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:19.664168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:19.666343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:19.678786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:20.637507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:20.679854 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0991cb5-612e-49d7-8985-692166b9cfe0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 1.046009 May 19 08:53:20.686862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4230/5555] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:19 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:21.703437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:21.704891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:21.722875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:21.723751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:21.725395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:21.726507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:22.231220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:22.256638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-630c8340-489c-4fd5-bc18-c6c9f8308c4c tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 0.557663 May 19 08:53:22.257869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4231/5556] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:21 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:23.277267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:23.278014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:23.300000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:23.301677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:23.303023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:23.317729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:24.230863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:24.251252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cd0256e-427f-4923-b42a-098380607677 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 0.978276 May 19 08:53:24.279493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4232/5557] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:23 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:24.302395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a75396dc-6f94-459a-83ab-a41d6e673dde req-b8c87889-1791-4c02-8b7b-635eaa8ed0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42b4025-81c9-42e2-91b9-ed082d77397f", "name": "network-vif-plugged", "status": "completed", "tag": "c19a50e4-cf47-4020-9b05-eb088b16d754"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:24.347095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a75396dc-6f94-459a-83ab-a41d6e673dde req-b8c87889-1791-4c02-8b7b-635eaa8ed0e8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:24.347553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a75396dc-6f94-459a-83ab-a41d6e673dde req-b8c87889-1791-4c02-8b7b-635eaa8ed0e8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:24.363579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:24.404779 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a75396dc-6f94-459a-83ab-a41d6e673dde req-b8c87889-1791-4c02-8b7b-635eaa8ed0e8 service nova] Creating event network-vif-plugged:c19a50e4-cf47-4020-9b05-eb088b16d754 for instance d42b4025-81c9-42e2-91b9-ed082d77397f on chh1-842464-2 May 19 08:53:24.439925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a75396dc-6f94-459a-83ab-a41d6e673dde req-b8c87889-1791-4c02-8b7b-635eaa8ed0e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150343 May 19 08:53:24.444398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4233/5558] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:25.282600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:25.283248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:25.300159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:25.300869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:25.301734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:25.302556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:26.381629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:26.397811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9a06a35a-5abc-4571-a06e-54816f6b3ead tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1471 microversion: 2.1 time: 1.120975 May 19 08:53:26.412287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4234/5559] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:25 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1471 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:26.866767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:26.867278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:26.880621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:26.880966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:26.885870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:26.886567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:26.931704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 HTTP/1.1 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '695f996f-261f-4ea2-bb62-c2f110cac751'} May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:26.935618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:26.940359 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:26.946263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:26.948730 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94548f09-1ca0-4d54-b81c-cd4e9eaf55b4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 404 len: 111 microversion: 2.1 time: 0.086432 May 19 08:53:26.954042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4235/5560] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:53:26 2022] DELETE /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:53:26.964615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:26.978302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 695f996f-261f-4ea2-bb62-c2f110cac751] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:26.995521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:26.996487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:26.997604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:26.998492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:27.037853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 HTTP/1.1 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '695f996f-261f-4ea2-bb62-c2f110cac751'} May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:27.042639 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. May 19 08:53:27.048144 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:27.050551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance 695f996f-261f-4ea2-bb62-c2f110cac751 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:27.053135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9211914-e152-4218-bd82-9cd1ff6e76d8 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751" status: 404 len: 111 microversion: 2.1 time: 0.095273 May 19 08:53:27.057670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4236/5561] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:26 2022] GET /compute/v2.1/servers/695f996f-261f-4ea2-bb62-c2f110cac751 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:27.276333 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:53:27.276939 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:53:27.417041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:27.418596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:27.451762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:27.452217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:27.453014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:27.464901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:28.364736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:28.377132 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8669c76-1d43-4f27-a6c8-fd766ff4175d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1642 microversion: 2.1 time: 0.965520 May 19 08:53:28.382101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4237/5562] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:27 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1642 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:28.425551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:28.429221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:28.489754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:28.496346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:28.498662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:28.505160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:28.962088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:28.978324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49d5564f-5ae7-4946-8439-f4b963c6cb16 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1642 microversion: 2.1 time: 0.576586 May 19 08:53:28.992397 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4238/5563] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:28 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1642 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:28.998373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1429569506", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4c7f7a99-046e-4afd-b275-1a8a72daed3f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1781171656", "security_groups": [{"name": "tempest-secgroup-smoke-646255032"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:29.298648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] validate_networks() for [('4c7f7a99-046e-4afd-b275-1a8a72daed3f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:53:31.328730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:53:31.332749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:53:31.334992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:53:31.336030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:53:31.336795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:53:31.359128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:31.360111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:31.361670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:31.362571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:31.403342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:53:31.419334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:53:31.458448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:53:31.461832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:53:31.555996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a57dd6b-b287-4385-baf8-1057cb0af3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.568750 May 19 08:53:31.557268 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4239/5564] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:53:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 2574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:53:31.584137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:31.585153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:31.604512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:31.605387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:31.614793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:31.622215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:32.563987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88538868-4384-45ca-af48-b823602f9560 tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1793 microversion: 2.1 time: 1.004297 May 19 08:53:32.564921 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4240/5565] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:31 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1793 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:32.573062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b32444d4-e889-4cae-be08-9db203c1556b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:32.573719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b32444d4-e889-4cae-be08-9db203c1556b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:32.865673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b32444d4-e889-4cae-be08-9db203c1556b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:32.877975 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b32444d4-e889-4cae-be08-9db203c1556b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1267 microversion: 2.1 time: 0.311905 May 19 08:53:32.884256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4241/5566] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:32 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:33.902641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:33.905228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:33.924242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:33.924704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:33.925576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:33.926031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:34.140424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:34.151162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ceee0a4e-0155-40d7-a308-4a202562a773 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1337 microversion: 2.1 time: 0.254831 May 19 08:53:34.156090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4242/5567] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:33 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1337 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:35.174085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:35.177798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:35.195159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:35.195615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:35.204535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:35.205003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:35.468454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:35.499938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77acc2c7-fac4-48f3-a843-ec88fe1cde5b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1325 microversion: 2.1 time: 0.331671 May 19 08:53:35.501814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4243/5568] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:35 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:36.518165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:36.519036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:36.532798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:36.533255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:36.538545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:36.539256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:36.985299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:36.993915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9edc872a-b342-4baf-9b60-1ac2e5d340f6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1325 microversion: 2.1 time: 0.481215 May 19 08:53:37.004724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4244/5569] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:36 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1325 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:38.022913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:38.024036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:38.047444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:38.058909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:38.063709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:38.065219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:39.080548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:39.094187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ec22973-9492-4232-8dd3-b5ea4b7ffc49 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 1.075701 May 19 08:53:39.096875 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4245/5570] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:38 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:40.094101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c834ad22-b60c-4f5c-9e31-a2c49dab2235 req-ddea8555-d9f6-44ba-be18-7f1e108689d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:40.133237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c834ad22-b60c-4f5c-9e31-a2c49dab2235 req-ddea8555-d9f6-44ba-be18-7f1e108689d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:40.135300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c834ad22-b60c-4f5c-9e31-a2c49dab2235 req-ddea8555-d9f6-44ba-be18-7f1e108689d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:40.190162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c834ad22-b60c-4f5c-9e31-a2c49dab2235 req-ddea8555-d9f6-44ba-be18-7f1e108689d3 service nova] Creating event network-changed:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh2-842464-2 May 19 08:53:40.206792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c834ad22-b60c-4f5c-9e31-a2c49dab2235 req-ddea8555-d9f6-44ba-be18-7f1e108689d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128502 May 19 08:53:40.207430 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4246/5571] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:40.229509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:40.233375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:40.254798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:40.256488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:40.259534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:40.261559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.379179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:41.484031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:41.494326 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85b1625a-ba50-42c5-957b-dcd38feb1963 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 1.284499 May 19 08:53:41.498468 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4247/5572] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:40 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:41.509786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c509bbaf-55ac-43be-9ab4-19147f5007bc req-732db7e4-5398-4e3f-9eeb-cc474c645151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42b4025-81c9-42e2-91b9-ed082d77397f", "tag": "c19a50e4-cf47-4020-9b05-eb088b16d754"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:41.550975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c509bbaf-55ac-43be-9ab4-19147f5007bc req-732db7e4-5398-4e3f-9eeb-cc474c645151 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.562291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c509bbaf-55ac-43be-9ab4-19147f5007bc req-732db7e4-5398-4e3f-9eeb-cc474c645151 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.589925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c509bbaf-55ac-43be-9ab4-19147f5007bc req-732db7e4-5398-4e3f-9eeb-cc474c645151 service nova] Creating event network-changed:c19a50e4-cf47-4020-9b05-eb088b16d754 for instance d42b4025-81c9-42e2-91b9-ed082d77397f on chh1-842464-2 May 19 08:53:41.604256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c509bbaf-55ac-43be-9ab4-19147f5007bc req-732db7e4-5398-4e3f-9eeb-cc474c645151 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103223 May 19 08:53:41.612928 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4248/5573] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:41.626276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:41.634418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:41.655153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.655883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.656899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.657556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.717829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f HTTP/1.1 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6cde4210-1ebd-4f04-ba8b-c6e59efffa8f'} May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:41.719943 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.725050 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.727180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:41.728632 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8cf9bbf-d516-4b36-9dec-a2880ea051a4 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 404 len: 111 microversion: 2.1 time: 0.114062 May 19 08:53:41.729794 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4249/5574] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:53:41 2022] DELETE /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:41.744254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:41.745500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:41.768398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.769166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.774504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.775254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.835974 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f HTTP/1.1 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6cde4210-1ebd-4f04-ba8b-c6e59efffa8f'} May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:41.842102 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. May 19 08:53:41.847093 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.849640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance 6cde4210-1ebd-4f04-ba8b-c6e59efffa8f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:41.851054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98b2eaba-7902-462a-931c-e191398adbbd tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f" status: 404 len: 111 microversion: 2.1 time: 0.115484 May 19 08:53:41.858900 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4250/5575] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:41 2022] GET /compute/v2.1/servers/6cde4210-1ebd-4f04-ba8b-c6e59efffa8f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:53:41.885294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:41.886174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:41.901879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.902628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.904622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.905373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.939104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad HTTP/1.1 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad'} May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:41.949536 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:41.955394 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:41.958703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:41.960369 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-297f291e-7c13-4945-8780-131fcd9e8412 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 404 len: 111 microversion: 2.1 time: 0.081743 May 19 08:53:41.961905 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4251/5576] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:53:41 2022] DELETE /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:41.971812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:41.972875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:41.980063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.980874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.982511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:41.983473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:41.999325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad HTTP/1.1 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad'} May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:42.001178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. May 19 08:53:42.006063 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:42.007596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:42.008691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-86ef2a02-ca37-49c9-b752-7bba04df7bed tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad" status: 404 len: 111 microversion: 2.1 time: 0.043157 May 19 08:53:42.009945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4252/5577] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:41 2022] GET /compute/v2.1/servers/b5ae43cf-9dd3-4ee4-b90c-8c23b486d7ad => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:42.515702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:42.516329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:42.574980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:42.575553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:42.576447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:42.576909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:42.871000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:43.308878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:43.327197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03b40c3b-39a0-4c3e-b9aa-3b73facf4999 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 0.816146 May 19 08:53:43.336979 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4253/5578] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:42 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:44.359204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:44.364979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:44.383660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:44.389939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:44.392483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:44.393366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:45.507528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:45.520461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72a8be33-23e7-41a6-bd48-3fae1a20afbf tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 1.169749 May 19 08:53:45.525071 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4254/5579] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:44 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:46.234916 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:53:46.235465 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:53:46.543673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:46.544409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:46.548276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:46.575230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:46.577414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:46.578303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:46.578754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:47.099978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:47.113877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e84a212-21a6-4a72-8f66-a2668d733815 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 0.575534 May 19 08:53:47.114490 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4255/5580] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:46 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:48.133914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:48.134570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:48.152552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:48.154357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:48.155313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:48.155774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:48.526629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:48.536048 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48e7cf63-4609-4867-bc8e-f8b3a6cbe606 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 0.408230 May 19 08:53:48.536664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4256/5581] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:48 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:49.555251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:49.564565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:49.578607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:49.579068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:49.582772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:49.583313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:49.668735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:53:50.097258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:50.110588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-124124af-1ccd-4b53-9498-31ba302b44de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 0.560111 May 19 08:53:50.114155 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4257/5582] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:49 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:51.130850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:51.131510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:51.142426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:51.142910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:51.143724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:51.144172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:51.746216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:51.762769 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c325b16d-e637-4a0f-b83f-678586adae6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 0.636288 May 19 08:53:51.771756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4258/5583] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:51 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:51.776806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f554339b-b3a1-4674-b07e-cc1c2bb5dce5 req-13c6cb44-9f20-41f1-bcea-27fa5731b2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "name": "network-vif-plugged", "status": "completed", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:53:51.822739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f554339b-b3a1-4674-b07e-cc1c2bb5dce5 req-13c6cb44-9f20-41f1-bcea-27fa5731b2b1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:51.824113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f554339b-b3a1-4674-b07e-cc1c2bb5dce5 req-13c6cb44-9f20-41f1-bcea-27fa5731b2b1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:51.898087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f554339b-b3a1-4674-b07e-cc1c2bb5dce5 req-13c6cb44-9f20-41f1-bcea-27fa5731b2b1 service nova] Creating event network-vif-plugged:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh2-842464-2 May 19 08:53:51.913666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f554339b-b3a1-4674-b07e-cc1c2bb5dce5 req-13c6cb44-9f20-41f1-bcea-27fa5731b2b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140410 May 19 08:53:51.914607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4259/5584] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:53:52.785552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:52.787758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:52.836236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:52.836871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:52.839576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:52.842675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:53.481003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:53.492966 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-217a70b9-379e-46e7-9c8b-2fdc76d692de tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1392 microversion: 2.1 time: 0.714709 May 19 08:53:53.498332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4260/5585] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:52 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1392 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:53:54.520042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:54.521671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:54.535296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:54.537772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:54.546035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:54.546500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.077108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:55.102434 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f84cd133-3822-4623-955e-1208fe89f3c0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1563 microversion: 2.1 time: 0.591860 May 19 08:53:55.105218 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4261/5586] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:54 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1563 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:55.112551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:55.115098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:55.133061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:55.133809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.134817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:55.135556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.155142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f HTTP/1.1 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b0d1e95a-431d-4672-9e95-72e0956a248f'} May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:55.162490 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.167334 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.169350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:55.170481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca2b7a49-3698-4f44-88f0-07e7ad9e66b2 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 404 len: 111 microversion: 2.1 time: 0.063999 May 19 08:53:55.171066 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4262/5587] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:53:55 2022] DELETE /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:53:55.182442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:55.183329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:55.198528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:55.201871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.202950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:55.204723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.840125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:53:55.853060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22d20304-a544-4620-9142-44ca28c874ba tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1563 microversion: 2.1 time: 0.678334 May 19 08:53:55.857656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4263/5588] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:55 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1563 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:53:55.882405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:53:55.885120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] [instance: b0d1e95a-431d-4672-9e95-72e0956a248f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:53:55.906709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:55.907372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.908395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:53:55.908958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:53:55.945017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] HTTP exception thrown: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Request method failure captured: May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f HTTP/1.1 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgOLO1op0Q17TvCoUFngrENOwhfl88H6iC8jcEk39DO-MQc7vvhNfvctvfj3h5GgfC73NyNOuENtFrwuHBZWpp3_Kio9qPHjMF7DTlWP8ab5WGnVlCHfrKu67TpI354h81PO81omHKFZEaVHtG2jpae1A5dGmzk3JpjY_pXBR9Rcw1s May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/21dbcde9216e4f5fb132f4881500b302"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 21dbcde9216e4f5fb132f4881500b302 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-631129374 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f05ad3b9305e422fb86b4a25223616b3 May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-AttachVolumeNegativeTest-631129374-project May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b0d1e95a-431d-4672-9e95-72e0956a248f'} May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:53:55.950686 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. May 19 08:53:55.954723 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:53:55.958789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] Returning 404 to user: Instance b0d1e95a-431d-4672-9e95-72e0956a248f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:53:55.960291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e019f9c-cc47-44f6-8739-fd3d9c756bd3 tempest-AttachVolumeNegativeTest-631129374 tempest-AttachVolumeNegativeTest-631129374-project] 10.222.0.78 "GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f" status: 404 len: 111 microversion: 2.1 time: 0.101215 May 19 08:53:55.961182 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4264/5589] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:53:55 2022] GET /compute/v2.1/servers/b0d1e95a-431d-4672-9e95-72e0956a248f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:54:03.220441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:03.221188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:03.247458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:03.249756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:03.250729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:03.253685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:03.678122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:03.701510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d5e52eb-76c7-4e12-a079-bdef350c03d6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1563 microversion: 2.1 time: 0.484957 May 19 08:54:03.706314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4265/5590] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:03 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1563 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:03.715215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-933a440b-a30e-4389-9608-9d5e0f591a03 req-75c5a808-9a4d-40b8-9acf-97893713cb95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:03.747331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-933a440b-a30e-4389-9608-9d5e0f591a03 req-75c5a808-9a4d-40b8-9acf-97893713cb95 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:03.748082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-933a440b-a30e-4389-9608-9d5e0f591a03 req-75c5a808-9a4d-40b8-9acf-97893713cb95 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:03.767612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-933a440b-a30e-4389-9608-9d5e0f591a03 req-75c5a808-9a4d-40b8-9acf-97893713cb95 service nova] Creating event network-changed:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh2-842464-2 May 19 08:54:03.775301 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-933a440b-a30e-4389-9608-9d5e0f591a03 req-75c5a808-9a4d-40b8-9acf-97893713cb95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066928 May 19 08:54:03.782178 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4266/5591] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:07.555314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1042880671", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dc8a78e7-fee4-4ad2-81b0-0418604faee3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:07.660037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:54:08.959930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:54:08.963348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:54:08.964161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:54:08.966674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:54:08.967644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:54:08.984600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:08.986433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:08.987479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:08.988909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:09.033389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:54:09.041911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:54:09.147683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:54:09.150766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc8a78e7-fee4-4ad2-81b0-0418604faee3',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:54:09.440928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f90d14c-801e-40fe-8664-51a8d374333e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900830 May 19 08:54:09.447157 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4267/5592] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:54:09.462624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-32ec5606-b45f-4ce7-9c63-a3149ce2794a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:09.467591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-32ec5606-b45f-4ce7-9c63-a3149ce2794a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:09.576762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-32ec5606-b45f-4ce7-9c63-a3149ce2794a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:09.601560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-32ec5606-b45f-4ce7-9c63-a3149ce2794a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1071 microversion: 2.1 time: 0.146372 May 19 08:54:09.602190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4268/5593] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:09 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1071 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:10.621029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:10.621709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:10.644504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:10.644996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:10.647360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:10.648636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:10.801811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:10.823642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e94ed1a-13fa-4c5e-b1a5-6e03a20dab9c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1169 microversion: 2.1 time: 0.204983 May 19 08:54:10.834893 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4269/5594] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:10 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:11.852565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:11.853249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:11.866453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:11.866915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:11.867729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:11.868252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:12.220927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:12.244516 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5452c76d-a002-4170-8d74-1df3a3b76432 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1187 microversion: 2.1 time: 0.395849 May 19 08:54:12.264107 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4270/5595] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:11 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1187 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:13.266486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:13.268704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:13.298785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:13.299971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:13.301529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:13.302220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:13.540017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:13.553367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-799e2c70-55c6-4fec-b98b-42e969ee8fd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1187 microversion: 2.1 time: 0.292244 May 19 08:54:13.554702 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4271/5596] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:13 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1187 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:14.573400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:14.574253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:14.603988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:14.604645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:14.606388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:14.609525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:15.057110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:15.073995 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89701c80-20eb-4c98-8577-70f8edc51e1c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1187 microversion: 2.1 time: 0.503976 May 19 08:54:15.075376 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4272/5597] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:14 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1187 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:16.093013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:16.093737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:16.110935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:16.115990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:16.116876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:16.119082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:17.175680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:17.194841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44848288-a23b-4765-b449-065f2d68d3ba tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 1.106837 May 19 08:54:17.196250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4273/5598] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:16 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:18.215531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:18.225966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:18.255886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:18.269615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:18.270476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:18.273382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:18.274125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:19.008217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:19.597865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:20.010888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:20.027104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=77 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:20.040954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84699712-8f15-45e6-87bd-01b7bad1f697 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 1.826851 May 19 08:54:20.041843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4274/5599] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:18 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:20.076716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:20.080329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:20.107470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:20.107959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:20.108816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:20.109253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:20.226835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5f4cda2-0836-48cc-9818-02fbcb2924a3 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action" status: 200 len: 24568 microversion: 2.1 time: 0.179781 May 19 08:54:20.235593 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4275/5600] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:54:20 2022] POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action => generated 24568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:54:20.461095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b48f7b15-892a-4ccc-80c8-534fe9f1250d req-007c4ac4-891d-4b22-a240-5ac7de3afb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0240667-b85f-4f1b-b2b3-44ae1f4da820", "tag": "f26955ae-b300-4230-b9d5-1260061491f3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:20.505779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b48f7b15-892a-4ccc-80c8-534fe9f1250d req-007c4ac4-891d-4b22-a240-5ac7de3afb03 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:20.506304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b48f7b15-892a-4ccc-80c8-534fe9f1250d req-007c4ac4-891d-4b22-a240-5ac7de3afb03 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:20.563055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b48f7b15-892a-4ccc-80c8-534fe9f1250d req-007c4ac4-891d-4b22-a240-5ac7de3afb03 service nova] Creating event network-changed:f26955ae-b300-4230-b9d5-1260061491f3 for instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 on chh1-842464-2 May 19 08:54:20.581844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b48f7b15-892a-4ccc-80c8-534fe9f1250d req-007c4ac4-891d-4b22-a240-5ac7de3afb03 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122194 May 19 08:54:20.595111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4276/5601] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:21.077657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:21.079017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:21.106233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:21.108228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:21.123749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:21.124653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:22.327972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:22.336204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25ff9139-002a-468d-9a28-d6b590f7c853 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 1.279034 May 19 08:54:22.348405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4277/5602] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:21 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:22.936838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1850682547", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4be23cf0-45ac-438d-a0e4-ff076af3db17"}], "key_name": "tempest-TestSecurityGroupsBasicOps-834002276", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d42b4025-81c9-42e2-91b9-ed082d77397f"]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:23.047911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] validate_networks() for [('4be23cf0-45ac-438d-a0e4-ff076af3db17', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:54:24.688065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:54:24.689798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:54:24.690472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:54:24.691098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:54:24.691695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:54:24.730308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:24.730740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:24.751167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:24.751638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:24.819182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Getting quotas for project b20df985328b4e8dbe635151a8d38059. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:54:24.838134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Getting quotas for user 2225404e630f4a07bef2f35632a2c8cd and project b20df985328b4e8dbe635151a8d38059. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:54:24.887836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:54:24.893430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:54:24.995746 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e06ff49e-d5f9-4172-b09f-3e67ec9040f2 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.067970 May 19 08:54:25.004817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4278/5603] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:54:22 2022] POST /compute/v2.1/servers => generated 361 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:54:25.031340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:25.035828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:25.050651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:25.051519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:25.052799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:25.053703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:25.798446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:25.860664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0f0ded1-9312-413c-bc49-1327d9bcd95f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 0.845066 May 19 08:54:25.867069 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4279/5604] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:25 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:25.897617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abcda078-6964-44ca-b60e-d28109d31c59 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:25.901046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-abcda078-6964-44ca-b60e-d28109d31c59 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:26.152814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-abcda078-6964-44ca-b60e-d28109d31c59 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:26.164583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abcda078-6964-44ca-b60e-d28109d31c59 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1241 microversion: 2.1 time: 0.291499 May 19 08:54:26.165264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4280/5605] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:25 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1241 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:26.878744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:26.881077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:26.913257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:26.914000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:26.923421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:26.925363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:28.406200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:28.420455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c5118a2-ef77-4a28-986a-0cc9a7bb3c3c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 1.542720 May 19 08:54:28.421263 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4281/5606] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:26 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:28.446179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:28.446982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:28.460849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:28.465104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:28.466289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:28.467013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:28.631002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:28.646597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82aec8b0-7f19-4a23-9dd2-4b729dd8d509 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.214888 May 19 08:54:28.662211 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4282/5607] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:28 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:29.438542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:29.440026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:29.448267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:29.449130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:29.450693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:29.451683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:29.799534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:29.811226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5de3da11-ad63-4f5b-8d31-1baf27b261da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 0.377213 May 19 08:54:29.812759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4283/5608] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:29 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:29.827666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:29.828837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:29.835878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:29.836744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:29.837825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:29.838508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:30.187026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:30.210066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa71eac6-cc7c-4453-9d07-80c7a25c6e34 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.395567 May 19 08:54:30.210687 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4284/5609] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:29 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:30.828852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:30.830240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:30.847311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:30.848145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:30.852544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:30.853222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:31.260990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:31.273265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-64f0cfed-5640-4ddb-bc7e-7d02d2ef8b88 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 0.449003 May 19 08:54:31.278834 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4285/5610] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:30 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:31.291578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:31.292360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:31.306478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:31.311864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:31.312914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:31.313505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:31.523831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:31.546996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1b27036-14d7-46d3-aea4-0111c17deaea tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.266565 May 19 08:54:31.548036 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4286/5611] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:31 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:31.553331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:31.558523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:31.569436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:31.571369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:31.581699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:31.582289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:32.061936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:32.083444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c184c5ea-559e-4758-a407-779cdb48a68f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1681 microversion: 2.1 time: 0.533682 May 19 08:54:32.102275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4287/5612] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:31 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1681 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:32.258456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:32.263083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:32.280566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:32.281018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:32.281845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:32.282288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:32.402524 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ceb4bce1-e8ed-4b01-a2d3-665fdd630e96 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action" status: 200 len: 32635 microversion: 2.1 time: 0.155345 May 19 08:54:32.410945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4288/5613] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:54:32 2022] POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action => generated 32635 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:54:32.420620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:32.421863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:32.431399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:32.432140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:32.433601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:32.434978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:32.882803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:32.909786 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27d1cc10-01e5-4978-a75f-4dad6aec196a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1229 microversion: 2.1 time: 0.494401 May 19 08:54:32.913027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4289/5614] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:32 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1229 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:32.946980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-52a217ea-b883-411a-a21c-4e384072e091 req-ffea6895-c662-4d3d-9ea8-c9ddbf6ff637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2fef25-1fa5-49a8-bd20-c69d5afeb88b", "tag": "5acfd267-1888-4bbc-971f-b7bbbcec2775"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:32.963351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-52a217ea-b883-411a-a21c-4e384072e091 req-ffea6895-c662-4d3d-9ea8-c9ddbf6ff637 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:32.963976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-52a217ea-b883-411a-a21c-4e384072e091 req-ffea6895-c662-4d3d-9ea8-c9ddbf6ff637 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:32.977921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-52a217ea-b883-411a-a21c-4e384072e091 req-ffea6895-c662-4d3d-9ea8-c9ddbf6ff637 service nova] Creating event network-changed:5acfd267-1888-4bbc-971f-b7bbbcec2775 for instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b on chh2-842464-2 May 19 08:54:32.984146 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-52a217ea-b883-411a-a21c-4e384072e091 req-ffea6895-c662-4d3d-9ea8-c9ddbf6ff637 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069767 May 19 08:54:32.985010 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4290/5615] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:32.991172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:32.992244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:33.000431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:33.000996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:33.001966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:33.002523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:33.374036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-107d705e-84a6-44c1-b880-6d98b5f7bb14 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1832 microversion: 2.1 time: 0.383231 May 19 08:54:33.377437 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4291/5616] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:32 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1832 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:33.386410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:33.388800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:33.410009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:33.410009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:33.410009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:33.410009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:33.590184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:33.600861 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1af60ea-e377-460c-97cd-6365e3e5896e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.218238 May 19 08:54:33.603019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4292/5617] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:33 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:33.612679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:33.615674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:33.641010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:33.641537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:33.642355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:33.646634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:33.683770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lazy-loading 'flavor' on Instance uuid 6c7cc717-291b-43b5-8944-46cdbf779991 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:54:33.715256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Going to try to live migrate instance to another host {{(pid=119072) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 19 08:54:33.839502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:34.779468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:36.157618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:37.134987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b64cc65-f899-4784-9e4c-987ec3b6a444 tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action" status: 202 len: 0 microversion: 2.1 time: 3.528723 May 19 08:54:37.135725 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4293/5618] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:54:33 2022] POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action => generated 0 bytes in 3532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:54:37.142250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:37.142906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:37.152663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:37.166119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:37.171389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:37.173868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:37.591736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:37.612167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0bd5de4-0802-46d1-881b-01c3cadaa51f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1217 microversion: 2.1 time: 0.474922 May 19 08:54:37.616467 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4294/5619] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:37 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1217 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:37.633603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:37.634524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:37.650034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:37.650841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:37.652947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:37.654815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:37.895973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:37.926138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac794cab-62fb-4649-acb8-53637b37cb01 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.281268 May 19 08:54:37.931418 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4295/5620] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:37 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:37.941600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:37.943088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:37.955477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:37.956369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:37.958348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:37.958975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:38.306505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:38.318797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0532e39-f741-43e9-a6af-df93137f1b8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.382806 May 19 08:54:38.321087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4296/5621] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:37 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:38.633746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:38.634400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:38.653378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:38.653836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:38.654703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:38.655150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:39.034148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:39.066145 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf2bd0ed-4232-4cde-b7cb-25f5398493d6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1217 microversion: 2.1 time: 0.438072 May 19 08:54:39.083353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4297/5622] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:38 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1217 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:39.090535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:39.092272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:39.104754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:39.105396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:39.107526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:39.108091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:39.358237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:39.370537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3271f50d-d0a8-46cd-9faf-ca4936e90bf5 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.284609 May 19 08:54:39.371451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4298/5623] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:39 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:39.390511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:39.391353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:39.399586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:39.400376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:39.401526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:39.402189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:39.861850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:39.895130 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e099ac82-c877-4dbb-ace2-1c380cc92610 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.510247 May 19 08:54:39.896264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4299/5624] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:39 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:40.100184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:40.103906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:40.111414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:40.112128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:40.117152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:40.117910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:40.723333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:40.742675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f355f321-6fdc-4538-998f-2679f653f0e9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1217 microversion: 2.1 time: 0.648259 May 19 08:54:40.743351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4300/5625] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:40 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1217 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:40.758899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:40.759683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:40.787357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:40.789196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:40.790208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:40.798936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:41.200530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:41.229622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b395c2be-4b78-49c3-bc0f-ae25f8b6b18d tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.478911 May 19 08:54:41.237720 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4301/5626] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:40 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:41.279798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-979c8a0d-9693-41b3-815e-4c65b11b97c6 req-783ce570-0ea3-4ab4-82d0-17314803f1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "name": "network-vif-unplugged", "status": "completed", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:41.331499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-979c8a0d-9693-41b3-815e-4c65b11b97c6 req-783ce570-0ea3-4ab4-82d0-17314803f1a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:41.333284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-979c8a0d-9693-41b3-815e-4c65b11b97c6 req-783ce570-0ea3-4ab4-82d0-17314803f1a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:41.442568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-979c8a0d-9693-41b3-815e-4c65b11b97c6 req-783ce570-0ea3-4ab4-82d0-17314803f1a2 service nova] Creating event network-vif-unplugged:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh2-842464-2 May 19 08:54:41.486432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-979c8a0d-9693-41b3-815e-4c65b11b97c6 req-783ce570-0ea3-4ab4-82d0-17314803f1a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.239230 May 19 08:54:41.487900 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4302/5627] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:41.513928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:41.517604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:41.532933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:41.535283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:41.539203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:41.540389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:42.203841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:42.225375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae81bcfd-5295-4b5c-b544-56f390be2fc2 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.733831 May 19 08:54:42.227611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4303/5628] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:41 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:42.244414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d8b73055-bd93-47fd-a213-dda6ebcf1377 req-6d2abcfb-7ef0-4543-9b6e-e7ce5c26be76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2fef25-1fa5-49a8-bd20-c69d5afeb88b", "name": "network-vif-plugged", "status": "completed", "tag": "5acfd267-1888-4bbc-971f-b7bbbcec2775"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:42.270998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d8b73055-bd93-47fd-a213-dda6ebcf1377 req-6d2abcfb-7ef0-4543-9b6e-e7ce5c26be76 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:42.272026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d8b73055-bd93-47fd-a213-dda6ebcf1377 req-6d2abcfb-7ef0-4543-9b6e-e7ce5c26be76 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:42.305457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d8b73055-bd93-47fd-a213-dda6ebcf1377 req-6d2abcfb-7ef0-4543-9b6e-e7ce5c26be76 service nova] Creating event network-vif-plugged:5acfd267-1888-4bbc-971f-b7bbbcec2775 for instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b on chh2-842464-2 May 19 08:54:42.318827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d8b73055-bd93-47fd-a213-dda6ebcf1377 req-6d2abcfb-7ef0-4543-9b6e-e7ce5c26be76 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087445 May 19 08:54:42.328537 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4304/5629] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:42.347081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:42.349262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:42.364725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:42.365599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:42.367037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:42.367670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:42.726364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:42.750314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-589527f7-418b-4d79-b18f-16c47ac018ad tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1217 microversion: 2.1 time: 0.418148 May 19 08:54:42.760222 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4305/5630] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:42 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1217 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:42.773632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:42.774702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:42.798911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:42.801128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:42.804569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:42.805209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:43.028623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:43.037940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e06eac98-35d9-4e19-bf71-a63b89f0b2b0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1299 microversion: 2.1 time: 0.276049 May 19 08:54:43.038884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4306/5631] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:42 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:43.244404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:43.245791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:43.255463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:43.265074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:43.268970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:43.273969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:43.595771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:43.608884 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ef6cc70-70ec-4aec-8e79-e55938b38d9d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.363658 May 19 08:54:43.611941 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4307/5632] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:43 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:43.619393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-40c5e35a-8eb0-4204-9bd0-908043a34f58 req-326d20a3-4a7c-4abc-aab0-88e1b491de02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:43.641973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-40c5e35a-8eb0-4204-9bd0-908043a34f58 req-326d20a3-4a7c-4abc-aab0-88e1b491de02 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:43.642585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-40c5e35a-8eb0-4204-9bd0-908043a34f58 req-326d20a3-4a7c-4abc-aab0-88e1b491de02 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:43.666846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-40c5e35a-8eb0-4204-9bd0-908043a34f58 req-326d20a3-4a7c-4abc-aab0-88e1b491de02 service nova] Creating event network-changed:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh2-842464-2 May 19 08:54:43.679929 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-40c5e35a-8eb0-4204-9bd0-908043a34f58 req-326d20a3-4a7c-4abc-aab0-88e1b491de02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065389 May 19 08:54:43.681500 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4308/5633] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:43.776825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:43.777626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:43.802959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:43.803426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:43.806052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:43.806520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:44.539121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:44.556510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4bdfd323-1ac4-4296-a707-40c6ba9f55f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1217 microversion: 2.1 time: 0.792460 May 19 08:54:44.557635 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4309/5634] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:43 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1217 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:44.562619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:44.563521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:44.578722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:44.579549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:44.580638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:44.581847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:45.141142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:45.152947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df508982-9f6b-4f7b-87e1-4ba827e52d74 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1472 microversion: 2.1 time: 0.594102 May 19 08:54:45.154375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4310/5635] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:44 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1472 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:45.166253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:45.166880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:45.182475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:45.185750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:45.188048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:45.189635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:45.713246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:45.730494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbd9ff5a-e1ca-4862-80da-c7b588aff87f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.572028 May 19 08:54:45.745556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4311/5636] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:45 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:45.758501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:45.759758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:45.768852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:45.771227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:45.772330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:45.772998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:45.782640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:45.999695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:46.022578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d932cbcf-5af1-4f2c-85f6-407998ed7973 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1472 microversion: 2.1 time: 0.272313 May 19 08:54:46.023181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4312/5637] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:45 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:46.044694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0d4b4902-206e-49f3-9df2-e842f87b5a9b req-0d8528c4-496b-4f44-b95b-d9bc91298ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0240667-b85f-4f1b-b2b3-44ae1f4da820", "name": "network-vif-plugged", "status": "completed", "tag": "f26955ae-b300-4230-b9d5-1260061491f3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:46.077588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0d4b4902-206e-49f3-9df2-e842f87b5a9b req-0d8528c4-496b-4f44-b95b-d9bc91298ea5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.082015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0d4b4902-206e-49f3-9df2-e842f87b5a9b req-0d8528c4-496b-4f44-b95b-d9bc91298ea5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:46.120992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0d4b4902-206e-49f3-9df2-e842f87b5a9b req-0d8528c4-496b-4f44-b95b-d9bc91298ea5 service nova] Creating event network-vif-plugged:f26955ae-b300-4230-b9d5-1260061491f3 for instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 on chh1-842464-2 May 19 08:54:46.131042 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0d4b4902-206e-49f3-9df2-e842f87b5a9b req-0d8528c4-496b-4f44-b95b-d9bc91298ea5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104686 May 19 08:54:46.132714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4313/5638] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:46.143748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:46.144663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:46.156665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:46.162313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.162771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:46.163880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.164435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:46.583239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:46.592569 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d79acee-5a01-433d-b21f-1a0532f73c0a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1217 microversion: 2.1 time: 0.457578 May 19 08:54:46.607390 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4314/5639] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:46 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1217 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:46.620318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:46.620952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:46.631501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.632271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:46.633080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.633724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:46.826659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb1d07fc-3865-4a70-baf3-6e4a13b15abd tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1623 microversion: 2.1 time: 0.215107 May 19 08:54:46.827444 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4315/5640] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:46 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1623 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:46.844179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:46.845039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:46.852598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.853056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:46.853916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:46.854355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:47.174243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:47.188907 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-00b56b18-b036-4808-851e-57b4eb89c9bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.350140 May 19 08:54:47.190325 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4316/5641] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:46 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:47.205803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:47.207046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:47.226430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:47.238135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:47.253942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:47.254442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:47.841016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a45169f5-7daa-4b05-96f3-79e09621b85e tempest-TestSecurityGroupsBasicOps-621711521 tempest-TestSecurityGroupsBasicOps-621711521-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1912 microversion: 2.1 time: 0.647296 May 19 08:54:47.845493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4317/5642] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:47 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1912 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:47.867177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:47.868029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:47.883949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:47.886743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:47.888155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:47.888602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:48.316027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:48.342844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fc99291-fafa-44d2-8cb1-5ec0127b0b0e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1405 microversion: 2.1 time: 0.490369 May 19 08:54:48.344841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4318/5643] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:47 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:48.354172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:48.355495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:48.373620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:48.375245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:48.377157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:48.378112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:48.478130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:54:48.672121 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27fb375b-ed58-43eb-a555-6af4cce5e8e8 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 204 len: 0 microversion: 2.1 time: 0.323895 May 19 08:54:48.673172 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4319/5644] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:54:48 2022] DELETE /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:54:48.681359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:48.683546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:48.694792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:48.695755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:48.696857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:48.698167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:49.104369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:49.116304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4fd51f0-c511-4b98-87a6-67784dc72613 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.441051 May 19 08:54:49.119731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4320/5645] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:48 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:49.128792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:49.131901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:49.148420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:49.149318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:49.154795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:49.155340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:49.669228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:49.703979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd50551e-90f8-4d20-b626-45aae2d4bfd9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1405 microversion: 2.1 time: 0.582698 May 19 08:54:49.710701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4321/5646] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:49 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1405 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:49.732682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9be67569-2511-40e8-95ae-ad560045f3e6 req-0d11b274-3bc2-4f2a-85ba-c507249d07b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "name": "network-vif-unplugged", "status": "completed", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:49.769042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9be67569-2511-40e8-95ae-ad560045f3e6 req-0d11b274-3bc2-4f2a-85ba-c507249d07b0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:49.769579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9be67569-2511-40e8-95ae-ad560045f3e6 req-0d11b274-3bc2-4f2a-85ba-c507249d07b0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:49.812913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9be67569-2511-40e8-95ae-ad560045f3e6 req-0d11b274-3bc2-4f2a-85ba-c507249d07b0 service nova] Creating event network-vif-unplugged:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh2-842464-2 May 19 08:54:49.825622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9be67569-2511-40e8-95ae-ad560045f3e6 req-0d11b274-3bc2-4f2a-85ba-c507249d07b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110030 May 19 08:54:49.826310 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4322/5647] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:49.844786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:49.846986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:49.865588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:49.866171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:49.867055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:49.867499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:50.039338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:50.058821 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad0937cc-ec76-45d5-8944-05ec7c2e9523 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 200 len: 1478 microversion: 2.1 time: 0.227446 May 19 08:54:50.063492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4323/5648] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:49 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:50.078152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-181604567"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:50.094777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:50.109850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:50.110492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:50.111147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:50.111777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:50.264669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Attempting to quiesce instance before volume snapshot. May 19 08:54:50.322724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 19 08:54:50.502277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Creating snapshot from volume dc8a78e7-fee4-4ad2-81b0-0418604faee3. {{(pid=119072) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 19 08:54:52.744650 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05fb09c2-fa8a-4e97-b4b0-dd6f83996f18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820/action" status: 202 len: 0 microversion: 2.1 time: 2.679906 May 19 08:54:52.757837 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4324/5649] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:54:50 2022] POST /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820/action => generated 0 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 19 08:54:52.768810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:52.769613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:52.786091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:52.786559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:52.787397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:52.787921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:53.358970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:53.375716 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b36a0ab5-6988-408f-a9ed-e4d6eeb8bb3a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1691 microversion: 2.1 time: 0.615869 May 19 08:54:53.375835 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4325/5650] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:52 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1691 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:53.399828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:53.402472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: ca2fef25-1fa5-49a8-bd20-c69d5afeb88b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:53.432336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:53.432811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:53.433658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:53.434139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:53.453150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:54:53.505641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] HTTP exception thrown: Instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b could not be found. May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Request method failure captured: May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b HTTP/1.1 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgVS70uzSKG-X4twi_Ie6GfeQqC_bRiGlzdx8wmlN0GKlvI_dnF9UWahCuv3Vo7I11CV822Qp3HNyWN_iQu8PujeFj5q7OK-5jOMJEQogwiHO8wcOVNQcT1nskrGRjmyLtnGEtyxgBtn00BVRUwla4_i8sov-HzpsmwjsTfqIHtMX0Q May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b20df985328b4e8dbe635151a8d38059 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-987266293 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b20df985328b4e8dbe635151a8d38059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b20df985328b4e8dbe635151a8d38059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b20df985328b4e8dbe635151a8d38059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b20df985328b4e8dbe635151a8d38059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestSecurityGroupsBasicOps-987266293 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b20df985328b4e8dbe635151a8d38059 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-987266293 May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestSecurityGroupsBasicOps-987266293-project May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2225404e630f4a07bef2f35632a2c8cd May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestSecurityGroupsBasicOps-987266293-project May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b could not be found. May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ca2fef25-1fa5-49a8-bd20-c69d5afeb88b'} May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b could not be found. May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b could not be found. May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:54:53.531838 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b could not be found. May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Returning 404 to user: Instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:54:53.536389 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2c26217-9468-4cae-bd9e-7cc610e782e6 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b" status: 404 len: 111 microversion: 2.1 time: 0.157503 May 19 08:54:53.545664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4326/5651] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:53 2022] GET /compute/v2.1/servers/ca2fef25-1fa5-49a8-bd20-c69d5afeb88b => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:54:53.552513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-959ba661-d1a8-4e0d-ad5b-c9eb8319f27f req-9ad9d611-d696-443f-b1ce-63654c2aecf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2fef25-1fa5-49a8-bd20-c69d5afeb88b", "name": "network-vif-deleted", "tag": "5acfd267-1888-4bbc-971f-b7bbbcec2775"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:53.579245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-959ba661-d1a8-4e0d-ad5b-c9eb8319f27f req-9ad9d611-d696-443f-b1ce-63654c2aecf7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:53.579703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-959ba661-d1a8-4e0d-ad5b-c9eb8319f27f req-9ad9d611-d696-443f-b1ce-63654c2aecf7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:53.597467 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-959ba661-d1a8-4e0d-ad5b-c9eb8319f27f req-9ad9d611-d696-443f-b1ce-63654c2aecf7 service nova] Creating event network-vif-deleted:5acfd267-1888-4bbc-971f-b7bbbcec2775 for instance ca2fef25-1fa5-49a8-bd20-c69d5afeb88b on chh2-842464-2 May 19 08:54:53.603696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-959ba661-d1a8-4e0d-ad5b-c9eb8319f27f req-9ad9d611-d696-443f-b1ce-63654c2aecf7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056543 May 19 08:54:53.604885 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4327/5652] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:54:54.394123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:54.395024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:54.414609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:54.417145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:54.418307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:54.419747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:54.771429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:54.800743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b17be6d-6032-4197-b85e-d2c3fc3e67ff tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1681 microversion: 2.1 time: 0.411071 May 19 08:54:54.801885 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4328/5653] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:54 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1681 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:54.844551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:54.846208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:54.885117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:54.892598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:54.905014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:54.906353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:55.318677 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4baab267-683b-4e37-be9e-71362a01125f tempest-TestNetworkAdvancedServerOps-123873800 tempest-TestNetworkAdvancedServerOps-123873800-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1832 microversion: 2.1 time: 0.497191 May 19 08:54:55.324839 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4329/5654] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:54 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1832 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:55.340871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:55.341680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:55.351240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:55.351642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:55.352804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:55.353263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:55.536545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:55.550144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e86d826-ab3b-4503-8693-dc546593e231 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1681 microversion: 2.1 time: 0.213602 May 19 08:54:55.555452 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4330/5655] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:55 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:54:55.698637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:55.699767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:55.708805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:55.709448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:55.712520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:55.712520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:55.776947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a350a0ac-d448-4193-bb89-e4cefc0360d5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action" status: 200 len: 38602 microversion: 2.1 time: 0.081950 May 19 08:54:55.777687 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4331/5656] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:54:55 2022] POST /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991/action => generated 38602 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:54:56.289446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-431435321", "imageRef": "70de46cf-0890-4bcb-bb57-e3d7af4eadbd", "flavorRef": "452", "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:54:56.416214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:54:58.240727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:54:58.241286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:54:58.242069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:54:58.242764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:54:58.243344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:54:58.270654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:58.271962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:58.277918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:54:58.279573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:54:58.320197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:54:58.328246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:54:58.366630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:54:58.378969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='19db33c7-4015-4aad-b438-556c9ae796c4',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:54:58.562463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1376a49-56f4-44db-b840-5c7b67ca4266 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.274843 May 19 08:54:58.566388 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4332/5657] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 08:54:58.578083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55b0844c-bcfa-437e-bb96-9d18365418ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:58.581498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55b0844c-bcfa-437e-bb96-9d18365418ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:54:58.888633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55b0844c-bcfa-437e-bb96-9d18365418ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:54:58.925086 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55b0844c-bcfa-437e-bb96-9d18365418ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1229 microversion: 2.1 time: 0.351921 May 19 08:54:58.926638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4333/5658] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:58 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1229 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:54:59.966470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:54:59.973114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:00.034943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.037083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:00.041324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.056806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:00.269901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:00.295307 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d8eb711-d7fb-49c4-b080-41331dd8504c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1225 microversion: 2.1 time: 0.352137 May 19 08:55:00.307945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4334/5659] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:54:59 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1225 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:00.327248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:00.331652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:00.347479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.348414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:00.349565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.350240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:00.410501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:55:00.733622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38c004fb-8e24-47c8-bf21-1ea76f72f5da tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 204 len: 0 microversion: 2.1 time: 0.408260 May 19 08:55:00.737338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4335/5660] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:55:00 2022] DELETE /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:55:00.759064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-666c8b78-0073-48fd-b26f-f4aa4cd678a2 req-6c3e5930-49d8-4bb7-8403-4858a6e513b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:00.786107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-666c8b78-0073-48fd-b26f-f4aa4cd678a2 req-6c3e5930-49d8-4bb7-8403-4858a6e513b5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.787054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-666c8b78-0073-48fd-b26f-f4aa4cd678a2 req-6c3e5930-49d8-4bb7-8403-4858a6e513b5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:00.834910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-666c8b78-0073-48fd-b26f-f4aa4cd678a2 req-6c3e5930-49d8-4bb7-8403-4858a6e513b5 service nova] Creating event network-changed:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh1-842464-2 May 19 08:55:00.853801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-666c8b78-0073-48fd-b26f-f4aa4cd678a2 req-6c3e5930-49d8-4bb7-8403-4858a6e513b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101984 May 19 08:55:00.855607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4336/5661] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:55:00.873500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:00.874266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:00.941480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.942155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:00.945291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:00.946063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:03.989903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:04.004661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-322f90b7-6562-4a9a-8d22-e6c7675550fd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1687 microversion: 2.1 time: 3.144682 May 19 08:55:04.005209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4337/5662] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:00 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1687 bytes in 3149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:04.020512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:04.021341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:04.034686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:04.035161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:04.041163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:04.041816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:05.783004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:05.804565 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef854bee-66bf-4d0f-a47d-76664487be1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.796468 May 19 08:55:05.808759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4338/5663] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:04 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:05.822482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:05.824213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:05.835484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:05.836662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:05.838997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:05.839753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:06.583616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:06.622983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bcccace-ccb0-4718-8312-1ae559c6d17a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 200 len: 1687 microversion: 2.1 time: 0.807755 May 19 08:55:06.639638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4339/5664] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:05 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 1687 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:06.829597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:06.830499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:06.851306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:06.851793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:06.855347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:06.855828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:07.549700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:07.573631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e30ab912-562a-476e-869d-bfa758bda7e8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.751884 May 19 08:55:07.577674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4340/5665] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:06 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:07.595873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1ab00b16-f204-41ad-b758-0f1b15bb8f06 req-1edc5bfc-6811-4a5e-a623-b18eb6cac7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7cc717-291b-43b5-8944-46cdbf779991", "name": "network-vif-deleted", "tag": "99d29611-1609-4410-a603-d20cb7bfa7ac"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:07.680961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ab00b16-f204-41ad-b758-0f1b15bb8f06 req-1edc5bfc-6811-4a5e-a623-b18eb6cac7b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:07.681480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ab00b16-f204-41ad-b758-0f1b15bb8f06 req-1edc5bfc-6811-4a5e-a623-b18eb6cac7b2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:07.750441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1ab00b16-f204-41ad-b758-0f1b15bb8f06 req-1edc5bfc-6811-4a5e-a623-b18eb6cac7b2 service nova] Creating event network-vif-deleted:99d29611-1609-4410-a603-d20cb7bfa7ac for instance 6c7cc717-291b-43b5-8944-46cdbf779991 on chh1-842464-2 May 19 08:55:07.757831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1ab00b16-f204-41ad-b758-0f1b15bb8f06 req-1edc5bfc-6811-4a5e-a623-b18eb6cac7b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178050 May 19 08:55:07.759062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4341/5666] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:55:07.782234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:07.784461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: 6c7cc717-291b-43b5-8944-46cdbf779991] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:07.796553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:07.801876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:07.803246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:07.806879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:07.870023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] HTTP exception thrown: Instance 6c7cc717-291b-43b5-8944-46cdbf779991 could not be found. May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Request method failure captured: May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 HTTP/1.1 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQfatyEMjit-1p2K5H_CnRifSFEi5qTSLtDqv5SD5Mhts9PF9hc-AFLx_2KjIqBun4xz_oldFKcmimb0liieDCXTSui5RQaw-6c8Zft1Hotj3yjm-Nmu6PpzTKBtMIKUueMkLwgR7nvro0Sw3i-I-5V7uaCEL2eqdhMpBwxku1mTBU May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_45be8834713245c5b0dd248ca205ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 81a87eec69894a099a140ec8980a57e0 May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 6c7cc717-291b-43b5-8944-46cdbf779991 could not be found. May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '6c7cc717-291b-43b5-8944-46cdbf779991'} May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7cc717-291b-43b5-8944-46cdbf779991 could not be found. May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7cc717-291b-43b5-8944-46cdbf779991 could not be found. May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:07.910727 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7cc717-291b-43b5-8944-46cdbf779991 could not be found. May 19 08:55:07.924708 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:07.941723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Returning 404 to user: Instance 6c7cc717-291b-43b5-8944-46cdbf779991 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:55:07.947502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e9a9258-4134-443c-8931-82ee10b7dceb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991" status: 404 len: 111 microversion: 2.1 time: 0.185890 May 19 08:55:07.949002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4342/5667] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:07 2022] GET /compute/v2.1/servers/6c7cc717-291b-43b5-8944-46cdbf779991 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:55:08.598140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:08.598827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:08.612079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:08.620758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:08.621274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:08.648681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:08.649369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:08.900129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:09.284242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:09.301817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41cfae10-807c-4fcf-9063-f397a118c1b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.703881 May 19 08:55:09.320577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4343/5668] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:08 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:09.844454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7ecdf795-9dd8-45a0-8bde-d79d9c2db014 req-61cf4ef7-5cbc-4f5b-94db-d67bae151229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03170946-98c9-437b-904a-49f47fa724a5", "tag": "75a23869-0f89-4f63-923d-8bb21967245b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:09.867168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7ecdf795-9dd8-45a0-8bde-d79d9c2db014 req-61cf4ef7-5cbc-4f5b-94db-d67bae151229 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:09.868704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7ecdf795-9dd8-45a0-8bde-d79d9c2db014 req-61cf4ef7-5cbc-4f5b-94db-d67bae151229 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:09.900964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7ecdf795-9dd8-45a0-8bde-d79d9c2db014 req-61cf4ef7-5cbc-4f5b-94db-d67bae151229 service nova] Creating event network-changed:75a23869-0f89-4f63-923d-8bb21967245b for instance 03170946-98c9-437b-904a-49f47fa724a5 on chh2-842464-2 May 19 08:55:09.920475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7ecdf795-9dd8-45a0-8bde-d79d9c2db014 req-61cf4ef7-5cbc-4f5b-94db-d67bae151229 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077790 May 19 08:55:09.922059 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4344/5669] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:55:09.951639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:09.953283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:09.974343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:09.975533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:09.979638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:09.984360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:10.106291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:55:10.279498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:10.378317 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9f727102-dcc4-4c55-8207-14e6083fa90e tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 204 len: 0 microversion: 2.1 time: 0.432269 May 19 08:55:10.381557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4345/5670] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:55:09 2022] DELETE /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:55:10.394539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-12ca0400-ba62-42a2-9f9f-15f5776966f0 req-7b5ab57e-77a1-4269-9a42-dbdfd8f2d6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d42b4025-81c9-42e2-91b9-ed082d77397f", "tag": "c19a50e4-cf47-4020-9b05-eb088b16d754"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:10.440032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-12ca0400-ba62-42a2-9f9f-15f5776966f0 req-7b5ab57e-77a1-4269-9a42-dbdfd8f2d6b5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:10.440522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-12ca0400-ba62-42a2-9f9f-15f5776966f0 req-7b5ab57e-77a1-4269-9a42-dbdfd8f2d6b5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:10.492221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-12ca0400-ba62-42a2-9f9f-15f5776966f0 req-7b5ab57e-77a1-4269-9a42-dbdfd8f2d6b5 service nova] Creating event network-changed:c19a50e4-cf47-4020-9b05-eb088b16d754 for instance d42b4025-81c9-42e2-91b9-ed082d77397f on chh1-842464-2 May 19 08:55:10.509154 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-12ca0400-ba62-42a2-9f9f-15f5776966f0 req-7b5ab57e-77a1-4269-9a42-dbdfd8f2d6b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125982 May 19 08:55:10.531451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4346/5671] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:55:10.536884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:10.562080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:10.572129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:10.600649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:10.606627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:10.609891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:10.613264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:11.266493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:11.302318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-488ef1f4-1107-45ed-931b-bc658df553c0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.767145 May 19 08:55:11.306192 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4347/5672] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:10 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:11.334042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:11.339547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:11.372283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:11.378631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:11.384992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:11.386261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:13.304447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2225404e630f4a07bef2f35632a2c8cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b20df985328b4e8dbe635151a8d38059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:13.316362 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-35f58bde-5748-4e7f-b336-7e5f15530fd4 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 200 len: 1767 microversion: 2.1 time: 2.007282 May 19 08:55:13.316963 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4348/5673] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:11 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 1767 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:13.327323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:13.327323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:13.353237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:13.353942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:13.354757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:13.355209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:15.276135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:15.304947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-350834d9-1156-4f9e-ab91-ac667bb33c23 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.985330 May 19 08:55:15.308784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4349/5674] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:13 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:15.343170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-620a70ab-943b-4170-b91c-a04356031e02 req-e44b6f87-d48f-4404-99bc-1172d0921ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d42b4025-81c9-42e2-91b9-ed082d77397f", "name": "network-vif-deleted", "tag": "c19a50e4-cf47-4020-9b05-eb088b16d754"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:15.382951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-620a70ab-943b-4170-b91c-a04356031e02 req-e44b6f87-d48f-4404-99bc-1172d0921ce1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:15.385218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-620a70ab-943b-4170-b91c-a04356031e02 req-e44b6f87-d48f-4404-99bc-1172d0921ce1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:15.438093 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-620a70ab-943b-4170-b91c-a04356031e02 req-e44b6f87-d48f-4404-99bc-1172d0921ce1 service nova] Creating event network-vif-deleted:c19a50e4-cf47-4020-9b05-eb088b16d754 for instance d42b4025-81c9-42e2-91b9-ed082d77397f on chh1-842464-2 May 19 08:55:15.455942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-620a70ab-943b-4170-b91c-a04356031e02 req-e44b6f87-d48f-4404-99bc-1172d0921ce1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144744 May 19 08:55:15.459309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4350/5675] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:55:15.493406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:15.496796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] [instance: d42b4025-81c9-42e2-91b9-ed082d77397f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:15.528260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:15.536264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:15.539525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:15.540247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:15.587206 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] HTTP exception thrown: Instance d42b4025-81c9-42e2-91b9-ed082d77397f could not be found. May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Request method failure captured: May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f HTTP/1.1 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgVS70uzSKG-X4twi_Ie6GfeQqC_bRiGlzdx8wmlN0GKlvI_dnF9UWahCuv3Vo7I11CV822Qp3HNyWN_iQu8PujeFj5q7OK-5jOMJEQogwiHO8wcOVNQcT1nskrGRjmyLtnGEtyxgBtn00BVRUwla4_i8sov-HzpsmwjsTfqIHtMX0Q May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b20df985328b4e8dbe635151a8d38059 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-987266293 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b20df985328b4e8dbe635151a8d38059"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b20df985328b4e8dbe635151a8d38059"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b20df985328b4e8dbe635151a8d38059"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b20df985328b4e8dbe635151a8d38059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestSecurityGroupsBasicOps-987266293 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b20df985328b4e8dbe635151a8d38059 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-987266293 May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestSecurityGroupsBasicOps-987266293-project May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 2225404e630f4a07bef2f35632a2c8cd May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestSecurityGroupsBasicOps-987266293-project May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance d42b4025-81c9-42e2-91b9-ed082d77397f could not be found. May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'd42b4025-81c9-42e2-91b9-ed082d77397f'} May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d42b4025-81c9-42e2-91b9-ed082d77397f could not be found. May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d42b4025-81c9-42e2-91b9-ed082d77397f could not be found. May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:55:15.598567 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d42b4025-81c9-42e2-91b9-ed082d77397f could not be found. May 19 08:55:15.605454 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:55:15.608410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Returning 404 to user: Instance d42b4025-81c9-42e2-91b9-ed082d77397f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:55:15.609750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6e137ad-38d2-4876-b188-49dbb2edf252 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f" status: 404 len: 111 microversion: 2.1 time: 0.149146 May 19 08:55:15.610759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4351/5676] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:15 2022] GET /compute/v2.1/servers/d42b4025-81c9-42e2-91b9-ed082d77397f => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:55:16.326828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:16.327619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:16.343315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:16.344229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:16.345285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:16.346024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:17.693126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:17.714687 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1df19a6a-5baa-4b1e-bd4b-305b9a775639 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.391760 May 19 08:55:17.726569 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4352/5677] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:16 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:18.735619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:18.736342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:18.751867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:18.755158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:18.757774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:18.760961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:19.549122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:19.564168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2633201-93a4-4f17-8959-9b9df1493de0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.834260 May 19 08:55:19.573622 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4353/5678] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:18 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:20.592365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:20.593044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:20.610547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:20.611333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:20.612374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:20.613025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:22.832134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:22.859492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e9ab44d-ef1d-4f5a-86cd-ae055f78dfe1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 2.271940 May 19 08:55:22.860559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4354/5679] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:20 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:22.867939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-722d7f11-3440-44c4-bf6a-7ea0294f4c2e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '.version_select at 0x7f3217b2d790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:22.977568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-722d7f11-3440-44c4-bf6a-7ea0294f4c2e tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781171656" status: 202 len: 0 microversion: 2.1 time: 0.103737 May 19 08:55:22.983027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4355/5680] 10.222.0.78 () {58 vars in 1283 bytes} [Thu May 19 08:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1781171656 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:55:23.029044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34c43a57-fb1d-48f8-84f2-40082515619f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: .version_select at 0x7f32104765e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-72837566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUTyxWicW+iMw/cbATWhZhCWU33lY1pSMTniAJ6d8wewHs9DK4V2MgghVU9sTzSV4bHhGShgIrc9BRtjWdfsEMT56QhdjDv6NfkLVeICPmEanPBAlu2h1FVIODkn9fpIg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:23.124875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-34c43a57-fb1d-48f8-84f2-40082515619f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:55:23.137872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-34c43a57-fb1d-48f8-84f2-40082515619f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:55:23.203375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34c43a57-fb1d-48f8-84f2-40082515619f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.175037 May 19 08:55:23.212654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4356/5681] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:55:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:55:23.878273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:23.880670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:23.897807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:23.900834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:23.902674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:23.906074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:24.765708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:24.797813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc4d72d2-0478-4331-b280-f1d458020e5d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.923636 May 19 08:55:24.809121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4357/5682] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:23 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:25.816264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:25.817813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:25.847363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:25.847853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:25.848725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:25.849229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:26.961340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:26.982820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3cc47be2-16a8-45e9-b8a3-0a0075b911f2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.170819 May 19 08:55:26.989565 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4358/5683] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:25 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:28.009822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:28.010699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:28.030360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:28.030982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:28.033011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:28.034228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:28.954540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:28.968165 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-baa372cd-2c47-4e7a-8dce-9d673e1962ca tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.963839 May 19 08:55:28.980209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4359/5684] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:28 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:28.980209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff1cab68-886b-4f2a-ad55-c76f784483d0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] Calling method '.version_select at 0x7f3211ebcb80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:29.026698 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff1cab68-886b-4f2a-ad55-c76f784483d0 tempest-TestSecurityGroupsBasicOps-987266293 tempest-TestSecurityGroupsBasicOps-987266293-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-834002276" status: 202 len: 0 microversion: 2.1 time: 0.054408 May 19 08:55:29.027654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4360/5685] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 08:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-834002276 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:55:30.002824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:30.003943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:30.037431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:30.038101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:30.038822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:30.039290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:31.143204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:31.161070 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16765b26-6a6c-4b2b-aca0-b61c95967774 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.159141 May 19 08:55:31.162616 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4361/5686] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:29 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:32.183153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:32.183779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:32.200403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:32.201661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:32.201661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:32.211339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:32.695735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:32.713008 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c88855de-e714-4fdf-a52c-b2b8f8599f83 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.530963 May 19 08:55:32.717167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4362/5687] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:32 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:33.735197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:33.749457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:33.754950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:33.785564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:33.786493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:33.791329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:33.791814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:34.826542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:34.837619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6fdad60-cf15-4b86-8251-758138fb865d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.107831 May 19 08:55:34.838414 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4363/5688] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:33 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:35.854931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:35.856535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:35.878464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:35.879177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:35.887506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:35.888298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:36.934048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:36.946478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-22558e96-0577-4470-b68f-9bb671a620b5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.095920 May 19 08:55:36.947090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4364/5689] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:35 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:37.964791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:37.966787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:37.980421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:37.983825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:37.985660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:37.989283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:38.684903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:38.694921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c602f41-f7f7-4ec5-a245-68ea6699adf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.735000 May 19 08:55:38.706033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4365/5690] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:37 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:39.715136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:39.715908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:39.752666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:39.760730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:39.762664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:39.764444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:40.434579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:40.443047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:40.451126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de234d9d-2b1c-4023-93fa-2b415e3fc39b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.740754 May 19 08:55:40.457209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4366/5691] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:39 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:41.471820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:41.473144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:41.477798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:55:41.486740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:41.487206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:41.498592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:41.506211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:42.383110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:42.394500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6df0f338-e1eb-4c64-a531-686c72de1fc9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.926845 May 19 08:55:42.395262 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4367/5692] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:41 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:43.428746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:43.429528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:43.455861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:43.464244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:43.465753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:43.468304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:44.477413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:44.493932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1cd368ec-57d8-4097-9517-d8007b4bd49d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 1.061731 May 19 08:55:44.499000 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4368/5693] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:43 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:45.512270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:45.513014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:45.542530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:45.543126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:45.543955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:45.544473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:46.406434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:46.430142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-680921e5-2acb-4227-9b98-e0313d4b9029 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.921694 May 19 08:55:46.431402 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4369/5694] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:45 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:47.208094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1233578088", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "5fb6d063-dd1c-41e7-ad84-121c267cfa7f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-72837566", "security_groups": [{"name": "tempest-secgroup-smoke-1664680560"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:47.537821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] validate_networks() for [('5fb6d063-dd1c-41e7-ad84-121c267cfa7f', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:55:49.641097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:55:49.641713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:55:49.642188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:55:49.642616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:55:49.643043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:55:49.666919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:49.667473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:49.668469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:49.669038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:49.770731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:55:49.789250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Getting quotas for user 81a87eec69894a099a140ec8980a57e0 and project 45be8834713245c5b0dd248ca205ae62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:55:49.829296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:55:49.838161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:55:49.942879 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43c3d318-2869-4c5a-a1c4-1e1959bae8a4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.738535 May 19 08:55:49.943976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4370/5695] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:55:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:55:49.952306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:49.953720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:49.969424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:49.970185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:49.971423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:49.973887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:50.767241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:50.777262 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ad886fd-72b9-489e-af95-206dfa9a7d17 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.831780 May 19 08:55:50.797672 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4371/5696] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:49 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:50.830110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d47da58-9738-4610-bd90-27c038de4cda tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:50.837082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d47da58-9738-4610-bd90-27c038de4cda tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:51.064889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d47da58-9738-4610-bd90-27c038de4cda tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:51.072631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d47da58-9738-4610-bd90-27c038de4cda tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1265 microversion: 2.1 time: 0.261677 May 19 08:55:51.078686 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4372/5697] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:50 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:51.815451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:51.817183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:51.845604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:51.846164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:51.847204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:51.857446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:52.420531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:52.428666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20dcc4cb-ce4e-4525-881f-03a4d172e050 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.617702 May 19 08:55:52.437198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4373/5698] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:51 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:52.466593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:52.483657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:52.512002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:52.515728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:52.540826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:52.541890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:52.926351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:52.936389 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-612f11af-56b7-40f2-9b00-928dec214724 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1325 microversion: 2.1 time: 0.495059 May 19 08:55:52.937138 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4374/5699] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:52 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1325 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:53.457695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:53.458567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:53.467264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:53.468685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:53.471430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:53.484277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:54.108943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:54.123483 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88ef64e5-6e21-467c-acea-616b24056c67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1341 microversion: 2.1 time: 0.669276 May 19 08:55:54.129951 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4375/5700] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:53 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1341 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:54.138758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:54.139763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:54.152500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:54.153386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:54.156583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:54.159074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:54.512740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:54.522053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8212ba4b-cc54-4ab8-af12-6e4692e15ec4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1323 microversion: 2.1 time: 0.393051 May 19 08:55:54.526372 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4376/5701] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:54 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:55.141019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:55.143179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:55.172553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:55.173596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:55.181220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:55.186818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:56.114469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:56.149000 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbe92052-e240-4102-b625-e4c34632fdfe tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1387 microversion: 2.1 time: 1.011211 May 19 08:55:56.152393 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4377/5702] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:55 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1387 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:56.175803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:56.181761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:56.196121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:56.198869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:56.200820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:56.211166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:57.057701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:57.105515 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f5fd7db-2218-49ed-abc4-e1f593a32030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.947803 May 19 08:55:57.127009 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4378/5703] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:56 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:57.197511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:57.200786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:57.219587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:57.222266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:57.226322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:57.227595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:58.074886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:58.095877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b4dd478-3c4d-4c61-82eb-45166addd849 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.909808 May 19 08:55:58.109105 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4379/5704] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:57 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:55:58.141238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:58.141930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:58.155159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:58.155526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:58.156350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:58.156807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:58.641441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:55:58.656327 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-197e481f-930d-4867-a0f7-76f66b97cc6b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.519663 May 19 08:55:58.671187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4380/5705] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:58 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:55:58.949205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fc675e35-525b-44ec-a51d-5e3ee60ee701 req-8f5d0dfd-1975-4561-8634-0aa02173beeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01247c5-3bac-4eb2-8887-bcc1ac7572b9", "tag": "6dafd5a4-fa76-4aa0-986b-28c1404859fb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:55:58.976224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fc675e35-525b-44ec-a51d-5e3ee60ee701 req-8f5d0dfd-1975-4561-8634-0aa02173beeb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:58.976919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fc675e35-525b-44ec-a51d-5e3ee60ee701 req-8f5d0dfd-1975-4561-8634-0aa02173beeb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:59.039704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fc675e35-525b-44ec-a51d-5e3ee60ee701 req-8f5d0dfd-1975-4561-8634-0aa02173beeb service nova] Creating event network-changed:6dafd5a4-fa76-4aa0-986b-28c1404859fb for instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 on chh1-842464-2 May 19 08:55:59.058876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fc675e35-525b-44ec-a51d-5e3ee60ee701 req-8f5d0dfd-1975-4561-8634-0aa02173beeb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114213 May 19 08:55:59.062477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4381/5706] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:55:59.122000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:55:59.123008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:55:59.141400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:59.143657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:59.147189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:55:59.149217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:55:59.726447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:00.064843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:00.076353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79d0ebfb-3311-4fe8-b33f-903742e08512 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.963344 May 19 08:56:00.082239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4382/5707] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:55:59 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:00.088286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:00.107681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:00.136841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:00.137865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:00.141539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:00.142399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:01.001004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:01.030110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b7ae0e5-60dd-4c3f-9061-2fbcd581011b tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.945658 May 19 08:56:01.040727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4383/5708] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:00 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:01.112506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:01.121519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:01.125713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:01.147532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:01.148274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:01.149769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:01.160363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:01.576785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:01.597927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8536a25-7d3f-4544-b5e7-ef70d9e7c499 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.500568 May 19 08:56:01.602295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4384/5709] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:01 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:02.063395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:02.064101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:02.080753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:02.081477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:02.084302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:02.086220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:02.657617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:02.659980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:02.676574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-add1b71e-75f8-4689-b9f5-4860d6f44d5f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.624048 May 19 08:56:02.693959 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4385/5710] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:02 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:02.703083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:02.709925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:02.735375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:02.742813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:02.746532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:02.747266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:03.295091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:03.310431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9893c5f-0245-47f0-94cb-425b5607e0e3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.614362 May 19 08:56:03.310597 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4386/5711] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:02 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:03.702783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:03.703708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:03.739335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:03.740114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:03.741170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:03.741810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:04.275066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:04.284020 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-563bdc4d-3833-4205-be99-8171f9bba2ea tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.585489 May 19 08:56:04.288833 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4387/5712] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:03 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:04.339444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:04.342022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:04.363720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:04.364232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:04.365053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:04.365533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:05.546812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:05.562824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0719f87-6cd9-4e91-af14-354bc9e8c4c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 1.228690 May 19 08:56:05.566175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4388/5713] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:04 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:05.579073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:05.580069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:05.601454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:05.601932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:05.603492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:05.603958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:06.229248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:06.246942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-598cb29e-24b7-4558-b414-34e951de669a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.677354 May 19 08:56:06.250084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4389/5714] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:05 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:06.585271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:06.586039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:06.595748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:06.596312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:06.597272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:06.598435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:06.816429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:06.832088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88e4ad02-6108-43da-a5cc-82ae3a28f8c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.251600 May 19 08:56:06.832713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4390/5715] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:06 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:07.268741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:07.270488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:07.279807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:07.280738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:07.281927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:07.282636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:07.531333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:07.540783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3b65fbac-9655-48f8-9cf3-e39a52dfd030 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.276315 May 19 08:56:07.547327 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4391/5716] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:07 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:07.822434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b9726ba0-7f19-451d-b370-938d2c7cf64b req-660e7201-d362-4137-acb2-6447e8436919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01247c5-3bac-4eb2-8887-bcc1ac7572b9", "name": "network-vif-plugged", "status": "completed", "tag": "6dafd5a4-fa76-4aa0-986b-28c1404859fb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:07.880171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b9726ba0-7f19-451d-b370-938d2c7cf64b req-660e7201-d362-4137-acb2-6447e8436919 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:07.883697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b9726ba0-7f19-451d-b370-938d2c7cf64b req-660e7201-d362-4137-acb2-6447e8436919 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:07.924094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b9726ba0-7f19-451d-b370-938d2c7cf64b req-660e7201-d362-4137-acb2-6447e8436919 service nova] Creating event network-vif-plugged:6dafd5a4-fa76-4aa0-986b-28c1404859fb for instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 on chh1-842464-2 May 19 08:56:07.930218 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b9726ba0-7f19-451d-b370-938d2c7cf64b req-660e7201-d362-4137-acb2-6447e8436919 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115412 May 19 08:56:07.960336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4392/5717] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:56:07.983278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:07.985596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:08.008159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:08.009283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:08.011326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:08.011789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:08.324696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:08.348076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8189ad86-76a7-41eb-9ff4-facf09e91618 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.383659 May 19 08:56:08.349683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4393/5718] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:07 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:08.563266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:08.564294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:08.575429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:08.576403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:08.578734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:08.579938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:08.857231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:08.871375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7afded8f-993c-4e95-9d21-d84e1a53c3e6 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1391 microversion: 2.1 time: 0.316131 May 19 08:56:08.872976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4394/5719] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:08 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:09.367203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:09.368984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:09.383208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:09.385473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:09.386547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:09.387186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:09.739578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:09.749119 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad773e4f-797d-45b9-9209-ddad7697c28b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.386426 May 19 08:56:09.750152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4395/5720] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:09 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:09.896961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:09.897648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:09.906327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:09.906459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:09.907253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:09.908045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:10.164098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:10.185953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8f5eaa3-97ea-4aad-a6ed-3ebaca1300a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1563 microversion: 2.1 time: 0.294910 May 19 08:56:10.200791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4396/5721] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:09 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1563 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:10.219330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6583f3d1-5bce-4aba-ac24-9a97504821e6 req-beb28c5d-d32a-4bf4-be62-c0ccaa3c7a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03170946-98c9-437b-904a-49f47fa724a5", "name": "network-vif-plugged", "status": "completed", "tag": "75a23869-0f89-4f63-923d-8bb21967245b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:10.254387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6583f3d1-5bce-4aba-ac24-9a97504821e6 req-beb28c5d-d32a-4bf4-be62-c0ccaa3c7a1d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:10.254930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6583f3d1-5bce-4aba-ac24-9a97504821e6 req-beb28c5d-d32a-4bf4-be62-c0ccaa3c7a1d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:10.318735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6583f3d1-5bce-4aba-ac24-9a97504821e6 req-beb28c5d-d32a-4bf4-be62-c0ccaa3c7a1d service nova] Creating event network-vif-plugged:75a23869-0f89-4f63-923d-8bb21967245b for instance 03170946-98c9-437b-904a-49f47fa724a5 on chh2-842464-2 May 19 08:56:10.328808 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6583f3d1-5bce-4aba-ac24-9a97504821e6 req-beb28c5d-d32a-4bf4-be62-c0ccaa3c7a1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128069 May 19 08:56:10.330269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4397/5722] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:56:10.344423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:10.347213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:10.364537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:10.369157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:10.370991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:10.371594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:10.753456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:10.763559 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f0d0178-2574-4fdf-9c1a-f35dfd2ad863 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1563 microversion: 2.1 time: 0.430377 May 19 08:56:10.764162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4398/5723] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:10 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1563 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:10.769854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:10.770494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:10.778845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:10.779650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:10.780476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:10.780931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:10.972418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:10.988395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e564101-980c-41de-a157-8a79570999cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1375 microversion: 2.1 time: 0.222898 May 19 08:56:10.989058 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4399/5724] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:10 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:12.010070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:12.010827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:12.014629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:12.021943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.022567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.023543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.024859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.284972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:12.295300 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d387b00e-3b93-40bb-b6ac-5846dfc5f511 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1563 microversion: 2.1 time: 0.292177 May 19 08:56:12.307243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4400/5725] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:12 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1563 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:12.314827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:12.315530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:12.323811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.324557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.325428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.325920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.533675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:12.543819 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3649e086-23b8-40d5-a078-9623e815e34b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1563 microversion: 2.1 time: 0.233321 May 19 08:56:12.551980 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4401/5726] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:12 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:12.665102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:12.667048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:12.682277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.686603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.689771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.694478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.738627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:56:12.789124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:12.880336 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d56c4359-aaff-4ba5-9970-64d32d15b688 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 204 len: 0 microversion: 2.1 time: 0.220869 May 19 08:56:12.881683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4402/5727] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:56:12 2022] DELETE /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:56:12.893747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:12.894884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:12.902622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.903088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:12.904545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:12.914011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:13.237735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:13.249455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c2ecf87-0818-40dc-8c18-d5d759f0be1b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1569 microversion: 2.1 time: 0.361571 May 19 08:56:13.260331 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4403/5728] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:12 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1569 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:13.516122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:13.517176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:13.536181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:13.536815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:13.537841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:13.538414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:13.765174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:13.776921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc90f1ca-878c-41c8-a6b0-9f193ad470b5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1563 microversion: 2.1 time: 0.265333 May 19 08:56:13.779012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4404/5729] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:13 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:13.788402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aed069ff-9182-4616-a640-04e66ce1b3dd req-bdb0a5b6-8c23-4855-9d8e-cda6f15c4d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01247c5-3bac-4eb2-8887-bcc1ac7572b9", "tag": "6dafd5a4-fa76-4aa0-986b-28c1404859fb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:13.829494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aed069ff-9182-4616-a640-04e66ce1b3dd req-bdb0a5b6-8c23-4855-9d8e-cda6f15c4d3e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:13.832169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aed069ff-9182-4616-a640-04e66ce1b3dd req-bdb0a5b6-8c23-4855-9d8e-cda6f15c4d3e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:13.857286 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aed069ff-9182-4616-a640-04e66ce1b3dd req-bdb0a5b6-8c23-4855-9d8e-cda6f15c4d3e service nova] Creating event network-changed:6dafd5a4-fa76-4aa0-986b-28c1404859fb for instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 on chh1-842464-2 May 19 08:56:13.863570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aed069ff-9182-4616-a640-04e66ce1b3dd req-bdb0a5b6-8c23-4855-9d8e-cda6f15c4d3e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082904 May 19 08:56:13.865455 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4405/5730] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:56:14.270248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:14.270982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:14.283686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:14.284340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:14.285438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:14.286315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:15.128312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:15.146108 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d498fce-dbc8-4dbf-8ec1-1f37965f282d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1569 microversion: 2.1 time: 0.880066 May 19 08:56:15.157728 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4406/5731] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:14 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1569 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:16.165560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:16.166844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:16.188934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:16.194797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:16.204167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:16.205466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:16.433126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:16.454125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6baf206-9574-4140-b184-f1afea86516c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1527 microversion: 2.1 time: 0.293243 May 19 08:56:16.456208 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4407/5732] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:16 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:16.787192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d74a7c2a-e517-43d1-be21-fd7d88fa6f31 req-190b9012-6c39-4642-a5c2-f5783df91c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03170946-98c9-437b-904a-49f47fa724a5", "name": "network-vif-deleted", "tag": "75a23869-0f89-4f63-923d-8bb21967245b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:16.815291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d74a7c2a-e517-43d1-be21-fd7d88fa6f31 req-190b9012-6c39-4642-a5c2-f5783df91c1a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:16.820196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d74a7c2a-e517-43d1-be21-fd7d88fa6f31 req-190b9012-6c39-4642-a5c2-f5783df91c1a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:16.849414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d74a7c2a-e517-43d1-be21-fd7d88fa6f31 req-190b9012-6c39-4642-a5c2-f5783df91c1a service nova] Creating event network-vif-deleted:75a23869-0f89-4f63-923d-8bb21967245b for instance 03170946-98c9-437b-904a-49f47fa724a5 on chh2-842464-2 May 19 08:56:16.855740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d74a7c2a-e517-43d1-be21-fd7d88fa6f31 req-190b9012-6c39-4642-a5c2-f5783df91c1a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397576 May 19 08:56:16.856690 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4408/5733] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:56:17.474311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:17.475303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:17.489691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:17.491867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:17.493150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:17.496484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:17.623147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:17.635222 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5049b575-e213-4f58-871f-319ff2499fc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.166458 May 19 08:56:17.636552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4409/5734] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:17 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:18.654483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:18.656003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:18.663684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:18.664936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:18.666206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:18.666789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:18.819160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:18.848444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06e52560-0284-48ac-accb-14ca90732e70 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.198115 May 19 08:56:18.853094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4410/5735] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:18 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:19.869529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:19.871108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:19.883782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:19.885011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:19.886992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:19.887875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:20.005230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:20.019980 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e29b93e-c519-4844-9789-ee32354b61c4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.155327 May 19 08:56:20.022511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4411/5736] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:19 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:21.040838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:21.042344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:21.062035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:21.062926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:21.064069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:21.064783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:21.157728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:21.173747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b391518-23e1-4981-b3bb-b37acfeb9da8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.135850 May 19 08:56:21.175441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4412/5737] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:21 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:22.192188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:22.193611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:22.215553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:22.216025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:22.216835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:22.217287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:22.360692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:22.376344 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e3970f38-6f1f-47d1-8b76-bb3e5648caf7 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.185837 May 19 08:56:22.378190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4413/5738] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:22 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:23.401362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:23.402963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:23.414307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:23.415536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:23.416790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:23.417703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:23.656808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:23.669057 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-25aa2119-1e6f-4e3d-be13-ce2a6441cc67 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.276354 May 19 08:56:23.671186 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4414/5739] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:23 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:24.688448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:24.690615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:24.700228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:24.701233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:24.702307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:24.702988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:24.834410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:24.844909 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a14c08fd-3a27-4a68-95c4-d7250e2408c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.161504 May 19 08:56:24.847297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4415/5740] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:24 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:25.875881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:25.878701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:25.919516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:25.920570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:25.936345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:25.937275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:26.137724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:26.146433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0700014f-9ec5-4b38-b2bc-ad0b8f0ac40f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.285782 May 19 08:56:26.158676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4416/5741] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:25 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:27.180873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:27.182338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:27.197208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:27.197725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:27.198597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:27.199686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:27.411010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:27.434054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07720138-5281-4d53-8ae0-e93bfc5a0b97 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.257474 May 19 08:56:27.440181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4417/5742] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:27 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:28.467158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:28.470691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:28.508155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:28.509451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:28.512516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:28.513520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:28.662356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:28.673433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa915c98-9cf4-4169-b4a1-68d0fce17bbf tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 200 len: 1360 microversion: 2.1 time: 0.217916 May 19 08:56:28.686228 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4418/5743] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:28 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:29.693698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:29.695780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:29.707202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:29.711350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:29.717469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:29.718352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:29.755547 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 HTTP/1.1 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '03170946-98c9-437b-904a-49f47fa724a5'} May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:56:29.761674 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:56:29.766382 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:29.769154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:56:29.770362 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c7ab489-e9a3-42f1-a0be-3098c424c406 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 404 len: 111 microversion: 2.1 time: 0.081455 May 19 08:56:29.775616 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4419/5744] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:29 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:56:30.514052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Calling method '.version_select at 0x7f321050a3a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:30.514946 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:56:30.514946 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:56:30.516295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:30.516912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:30.534147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:30.534887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:30.548779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:30.549842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:30.553892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:30.560278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-638993f2-5ed7-48ab-afe0-1848b061f639 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407 tempest-PortsAdminExtendedAttrsIpV6TestJSON-890460407-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327207 May 19 08:56:30.561463 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4420/5745] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:56:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:56:34.251192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:34.252929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:34.269957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:34.272492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:34.273469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:34.275733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:34.364537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c867c10-746c-474e-be32-1ccb6abb6e5d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9/action" status: 200 len: 24568 microversion: 2.1 time: 0.117703 May 19 08:56:34.367039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4421/5746] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:56:34 2022] POST /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9/action => generated 24568 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:56:43.170348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:43.171624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:43.187885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:43.189949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:43.191159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:43.192216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:43.192895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:43.345856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:56:43.555403 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db8f0866-15d0-4705-834b-05dc56c6cfa5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 204 len: 0 microversion: 2.1 time: 0.390832 May 19 08:56:43.560892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4422/5747] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:56:43 2022] DELETE /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:56:43.574208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:43.576684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:43.585179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:43.586077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:43.587214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:43.587911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:43.879214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:43.888815 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-280c6291-1d10-45f6-a482-0674bd99f0d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1411 microversion: 2.1 time: 0.324810 May 19 08:56:43.895719 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4423/5748] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:43 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1411 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:44.920394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:44.923196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:44.941062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:44.942180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:44.944992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:44.945990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:45.248489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:45.259029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1daeb2e-2d60-4d57-9328-575df1c53098 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1411 microversion: 2.1 time: 0.349068 May 19 08:56:45.265420 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4424/5749] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:44 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1411 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:45.398180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:45.400703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:45.411917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:45.416062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:45.419659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:45.421536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:45.542762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:56:45.543493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:56:45.544167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:56:45.545762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:56:45.546490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:56:45.640517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:45.650363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:45.650817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:45.652194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:45.652940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:45.704421 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ac0555bd-27ff-4f28-84bf-3caea4338e8f tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9/action" status: 202 len: 1137 microversion: 2.1 time: 0.311280 May 19 08:56:45.705917 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4425/5750] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:56:45 2022] POST /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9/action => generated 1137 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 19 08:56:45.721609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:45.722844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:45.731503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:45.736044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:45.736044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:45.736044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:46.003814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:46.034824 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34a8552c-9707-400e-b19c-d7891c58162d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.318127 May 19 08:56:46.035429 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4426/5751] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:45 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:46.174771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-00e86cba-7e4c-434f-99de-898ffcc6bed9 req-46d3f35d-61d9-4dbe-8f6f-fa51f70df02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0240667-b85f-4f1b-b2b3-44ae1f4da820", "name": "network-vif-deleted", "tag": "f26955ae-b300-4230-b9d5-1260061491f3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:56:46.191490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00e86cba-7e4c-434f-99de-898ffcc6bed9 req-46d3f35d-61d9-4dbe-8f6f-fa51f70df02b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:46.191947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-00e86cba-7e4c-434f-99de-898ffcc6bed9 req-46d3f35d-61d9-4dbe-8f6f-fa51f70df02b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:46.207206 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-00e86cba-7e4c-434f-99de-898ffcc6bed9 req-46d3f35d-61d9-4dbe-8f6f-fa51f70df02b service nova] Creating event network-vif-deleted:f26955ae-b300-4230-b9d5-1260061491f3 for instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 on chh1-842464-2 May 19 08:56:46.212660 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-00e86cba-7e4c-434f-99de-898ffcc6bed9 req-46d3f35d-61d9-4dbe-8f6f-fa51f70df02b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042384 May 19 08:56:46.213694 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4427/5752] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:56:46.282611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:46.283516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:46.296504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:46.297057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:46.298671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:46.300278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:46.941978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:46.953172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe6b1eb8-53ca-4584-9623-3f431c9623f9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.677034 May 19 08:56:46.964038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4428/5753] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:46 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:47.210474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Calling method '.version_select at 0x7f321043a5e0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:47.213146 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 08:56:47.213146 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 08:56:47.215646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:47.217198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:47.239170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:47.239742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:47.259800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:47.260678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:47.270162 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e1dbc9a-49cb-4d2e-8561-85b3cddb663c tempest-PortsAdminExtendedAttrsTestJSON-1636233242 tempest-PortsAdminExtendedAttrsTestJSON-1636233242-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.302834 May 19 08:56:47.271245 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4429/5754] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 08:56:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:56:47.279490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:47.280611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:47.287164 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:56:47.288438 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:56:47.295515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:47.296584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:47.297728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:47.298436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:47.535763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:47.545723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8385c6f4-a9a5-4ef6-8081-60c11665f5dc tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.272320 May 19 08:56:47.557735 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4430/5755] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:47 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:47.971105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:47.971732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:47.988220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:48.002140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:48.003307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:48.003923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:48.174495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:48.186265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9820846d-dd68-46cf-910b-b27a0bbde41d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.218896 May 19 08:56:48.198097 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4431/5756] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:47 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:48.569035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:48.570752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:48.577282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:48.579352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:48.580520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:48.581181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:48.953326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:48.995700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a7731ae-fbe1-47a6-8c88-cf04604c244a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.430441 May 19 08:56:49.003025 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4432/5757] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:48 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:49.204616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:49.206079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:49.213368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:49.214208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:49.215277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:49.215965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:49.385893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:49.399182 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b80df9e6-c65e-4aa0-807d-1f869d0314bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.198837 May 19 08:56:49.400559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4433/5758] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:49 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:50.043091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:50.051590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:50.075123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:50.081507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:50.090808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:50.092431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:50.302232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:50.306644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:56:50.321384 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec085c45-2923-4830-8079-235aac289fac tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.288233 May 19 08:56:50.330161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4434/5759] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:50 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:50.417354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:50.418376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:50.425592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:50.426498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:50.428458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:50.428986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:50.518736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:50.529494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-09efa7bc-6238-494b-97c0-236ecc27c964 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.117279 May 19 08:56:50.530152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4435/5760] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:50 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:51.342491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:51.344034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:51.352797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:51.353701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:51.355107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:51.355795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:51.826902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:51.841738 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9b52298-09a1-4d75-83aa-c01b489c2beb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.504875 May 19 08:56:51.861255 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4436/5761] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:51 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:51.875049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:51.875740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:51.899452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:51.900312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:51.901994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:51.907708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:52.086189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:52.097667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6777142e-e2cf-416f-ae5d-90ff315d605f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.233643 May 19 08:56:52.109356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4437/5762] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:51 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:52.886279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:52.887926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:52.910954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:52.912504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:52.913912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:52.914645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:53.184716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:53.199012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c73e924a-9fb8-4cd3-a214-08289bbb3806 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.320898 May 19 08:56:53.199637 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4438/5763] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:52 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:53.216739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:53.217800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:53.232980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:53.233421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:53.234211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:53.234671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:53.362363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:53.377288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd18b8e6-ba0c-478d-9a09-674b82271694 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.164190 May 19 08:56:53.387159 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4439/5764] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:53 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:54.219906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:54.221148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:54.230782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:54.231466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:54.232433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:54.233046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:54.499196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:54.517943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c755d12-6230-4631-89d5-f5edf46f540d tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.304566 May 19 08:56:54.529472 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4440/5765] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:54 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:54.536243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:54.538039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:54.545849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:54.546695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:54.547875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:54.548699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:54.626557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:54.636131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ea98f46-a4b9-4862-9798-26e5d7ebcd63 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.105043 May 19 08:56:54.647191 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4441/5766] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:54 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:55.536313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:55.537859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:55.546640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:55.547466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:55.548506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:55.549187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:55.725681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:55.734949 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d173bab9-f015-473b-82e7-4d04744f6c7a tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.202560 May 19 08:56:55.736288 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4442/5767] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:55 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:55.742317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:55.743459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:55.752429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:55.754274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:55.757048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:55.758514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:55.885360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:55.894573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-803d1e78-fd1d-432d-bfe2-b6ab558c4656 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.156754 May 19 08:56:55.895188 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4443/5768] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:55 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:56.757213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:56.760459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:56.778457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:56.784851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:56.786602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:56.787788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:57.082367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:57.092625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-280b2962-00ac-4938-b6c3-5532442929d4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.341962 May 19 08:56:57.094607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4444/5769] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:56 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:57.103057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:57.104509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:57.121702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:57.127429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:57.129760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:57.130692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:57.299177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:57.312888 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d41881a4-a882-4671-8e5c-d25d1ff79950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.216026 May 19 08:56:57.313936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4445/5770] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:57 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:58.117452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:58.118179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:58.134874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:58.135348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:58.136179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:58.136660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:58.412439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:58.426589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cfff563-a21e-489b-9a41-d28277bd37bd tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.313249 May 19 08:56:58.429947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4446/5771] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:58 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:58.442121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:58.446863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:58.463978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:58.464522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:58.465491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:58.466629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:58.605138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:58.614837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec6946c7-e1b6-4900-b386-520a3da441eb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 200 len: 1202 microversion: 2.1 time: 0.183467 May 19 08:56:58.616841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4447/5772] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:58 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 1202 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:56:59.451461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:59.452560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:59.505974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:59.509775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:59.513465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:59.514800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:59.897213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:56:59.908170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-843ecf11-4e28-43ae-b7df-c527428a4243 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.463933 May 19 08:56:59.920469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4448/5773] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:59 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:56:59.925569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:56:59.934032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:56:59.947439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:59.948245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:59.949674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:56:59.953986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:56:59.986058 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 HTTP/1.1 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f0240667-b85f-4f1b-b2b3-44ae1f4da820'} May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:56:59.988669 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:56:59.994249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:57:00.000102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51d109dc-5e81-40b1-b372-9eb0a92a29ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 404 len: 111 microversion: 2.1 time: 0.077808 May 19 08:57:00.000923 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4449/5774] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:56:59 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:57:00.930353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:00.932703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:00.959015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:00.963192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:00.964786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:00.966925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:01.285032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:01.300333 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1be2f31-99f9-48a1-aafe-457a4407f0ed tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.377541 May 19 08:57:01.300966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4450/5775] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:00 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:02.320096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:02.320941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:02.347211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:02.347759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:02.352452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:02.352935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:02.656529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:02.671323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b914a9dd-c09c-4b42-a867-a18f3024afaa tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1690 microversion: 2.1 time: 0.355414 May 19 08:57:02.672550 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4451/5776] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:02 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1690 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:03.690873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:03.692088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:03.706786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:03.725561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:03.726773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:03.727457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:03.737713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:57:04.026086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:04.035262 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff501605-e93d-450e-a566-83061eec26f5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1696 microversion: 2.1 time: 0.348850 May 19 08:57:04.045751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4452/5777] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:03 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1696 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:05.055605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:05.056468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:05.076109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:05.080626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:05.082016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:05.086827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:05.529958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:05.543497 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-909ff81c-083e-46ed-b512-e65845bbf8a0 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1681 microversion: 2.1 time: 0.492698 May 19 08:57:05.558344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4453/5778] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:05 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1681 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:57:06.244314 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 08:57:06.244863 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 08:57:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 08:57:06.756607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:06.757446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:06.773204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:06.774365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:06.775184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:06.775859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:06.802290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 HTTP/1.1 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '03170946-98c9-437b-904a-49f47fa724a5'} May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:57:06.804621 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.815964 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.818211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:57:06.819309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3633e79a-3bd0-4ced-a774-e70b3a7fe290 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 404 len: 111 microversion: 2.1 time: 0.070480 May 19 08:57:06.820387 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4454/5779] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:57:06 2022] DELETE /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:57:06.832442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:06.834751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: 03170946-98c9-437b-904a-49f47fa724a5] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:06.845050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:06.851801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:06.852932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:06.853587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:06.875567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 HTTP/1.1 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '03170946-98c9-437b-904a-49f47fa724a5'} May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:06.878521 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. May 19 08:57:06.883974 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:06.885552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance 03170946-98c9-437b-904a-49f47fa724a5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:57:06.886665 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-880475f1-c079-486d-b4ff-664edeb0c23f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5" status: 404 len: 111 microversion: 2.1 time: 0.061875 May 19 08:57:06.887818 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4455/5780] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:06 2022] GET /compute/v2.1/servers/03170946-98c9-437b-904a-49f47fa724a5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:57:07.394676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c56de174-fd96-4a91-8b3a-26434591faee req-96a33617-e9b7-4cc2-acab-754e7074de1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01247c5-3bac-4eb2-8887-bcc1ac7572b9", "name": "network-vif-plugged", "status": "completed", "tag": "6dafd5a4-fa76-4aa0-986b-28c1404859fb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:57:07.412094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c56de174-fd96-4a91-8b3a-26434591faee req-96a33617-e9b7-4cc2-acab-754e7074de1f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:07.412591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c56de174-fd96-4a91-8b3a-26434591faee req-96a33617-e9b7-4cc2-acab-754e7074de1f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:07.476128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c56de174-fd96-4a91-8b3a-26434591faee req-96a33617-e9b7-4cc2-acab-754e7074de1f service nova] Creating event network-vif-plugged:6dafd5a4-fa76-4aa0-986b-28c1404859fb for instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 on chh1-842464-2 May 19 08:57:07.491101 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c56de174-fd96-4a91-8b3a-26434591faee req-96a33617-e9b7-4cc2-acab-754e7074de1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099144 May 19 08:57:07.492907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4456/5781] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:57:08.119515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:08.120617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:08.136408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:08.138918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:08.144050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:08.144769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:08.190745 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 HTTP/1.1 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f0240667-b85f-4f1b-b2b3-44ae1f4da820'} May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:57:08.196526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.201884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:57:08.203633 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-725ef8d8-e1c5-418b-a954-0915322e0847 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 404 len: 111 microversion: 2.1 time: 0.091710 May 19 08:57:08.207408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4457/5782] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:57:08 2022] DELETE /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 08:57:08.225088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:08.225755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: f0240667-b85f-4f1b-b2b3-44ae1f4da820] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:08.246507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:08.251028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:08.256328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:08.256899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:08.296524 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 HTTP/1.1 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f0240667-b85f-4f1b-b2b3-44ae1f4da820'} May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:08.298112 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. May 19 08:57:08.303414 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:08.307232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance f0240667-b85f-4f1b-b2b3-44ae1f4da820 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:57:08.308117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b67068d7-123f-46aa-80d3-80e49ea3c8bc tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820" status: 404 len: 111 microversion: 2.1 time: 0.096309 May 19 08:57:08.308695 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4458/5783] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:08 2022] GET /compute/v2.1/servers/f0240667-b85f-4f1b-b2b3-44ae1f4da820 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:57:08.443999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c146113-2c78-400d-9f8d-cbf441fa8795 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: .version_select at 0x7f32104edee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1808659732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj5XZ6t3nbPnk+O7b0+Ku1hpYMU4GOsFIT6mgi0MN+H4VyWeNyXwgP7BmlGyiS200zapKje+3nXHqHgf2oYEm7yfc0YyzLmjemsxAZiYD8HQH9mHBcgmera/T1DzP/I4w=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:57:08.467304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7c146113-2c78-400d-9f8d-cbf441fa8795 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:57:08.480954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7c146113-2c78-400d-9f8d-cbf441fa8795 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:57:08.526581 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c146113-2c78-400d-9f8d-cbf441fa8795 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.087955 May 19 08:57:08.529239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4459/5784] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 08:57:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:57:29.909151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:57:29.910262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:29.928624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=21 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:57:29.935121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:57:29.936420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:57:29.941272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:29.942925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:29.946619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:29.947462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:30.069461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc39b4e8-e57f-419e-a7c4-26730516e256 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "POST /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9/action" status: 200 len: 24576 microversion: 2.1 time: 0.167197 May 19 08:57:30.070801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4460/5785] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:57:29 2022] POST /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9/action => generated 24576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 08:57:47.265428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:47.266141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:47.288656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:57:47.294968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:57:47.301784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:47.310802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:47.312433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:47.313154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:47.424241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:57:47.669443 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5bcfec2-1a6f-45d7-8e5c-c389c82a51bb tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 204 len: 0 microversion: 2.1 time: 0.407419 May 19 08:57:47.671921 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4461/5786] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:57:47 2022] DELETE /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:57:47.682683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-17288781-a110-44d3-be9b-7a0bb3dbbd7e req-6c3086b9-1188-4a92-80bf-9c9677ffe209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01247c5-3bac-4eb2-8887-bcc1ac7572b9", "tag": "6dafd5a4-fa76-4aa0-986b-28c1404859fb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:57:47.708320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-17288781-a110-44d3-be9b-7a0bb3dbbd7e req-6c3086b9-1188-4a92-80bf-9c9677ffe209 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:47.709108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-17288781-a110-44d3-be9b-7a0bb3dbbd7e req-6c3086b9-1188-4a92-80bf-9c9677ffe209 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:47.757799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-17288781-a110-44d3-be9b-7a0bb3dbbd7e req-6c3086b9-1188-4a92-80bf-9c9677ffe209 service nova] Creating event network-changed:6dafd5a4-fa76-4aa0-986b-28c1404859fb for instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 on chh1-842464-2 May 19 08:57:47.823761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-17288781-a110-44d3-be9b-7a0bb3dbbd7e req-6c3086b9-1188-4a92-80bf-9c9677ffe209 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128920 May 19 08:57:47.834881 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4462/5787] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:57:47.867741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:47.873161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:47.909841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:47.911053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:47.911545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:47.912002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:49.077155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:49.091631 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0babff3-921f-4f2b-94c1-8e97f3e94bd5 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1687 microversion: 2.1 time: 1.252069 May 19 08:57:49.105543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4463/5788] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:47 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1687 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:50.124335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:50.126010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:50.148353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:50.150784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:50.153706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:50.160839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:50.905525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:50.914643 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d961226-36b2-478c-b310-30eec9a902ef tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1687 microversion: 2.1 time: 0.807122 May 19 08:57:50.918717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4464/5789] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:50 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1687 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:57:51.939654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:51.941631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:51.950159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:51.950855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:51.951873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:51.952708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:52.109054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81a87eec69894a099a140ec8980a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45be8834713245c5b0dd248ca205ae62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:52.122895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70eb79ac-fb13-4254-a1fa-b9b71d599521 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 200 len: 1619 microversion: 2.1 time: 0.190366 May 19 08:57:52.123652 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4465/5790] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:51 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 1619 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:57:52.131393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1376ec38-03e0-4178-bfce-886e60eb1f97 req-b9bf5fe9-cda8-4713-ad52-2145bf6ea76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01247c5-3bac-4eb2-8887-bcc1ac7572b9", "name": "network-vif-deleted", "tag": "6dafd5a4-fa76-4aa0-986b-28c1404859fb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:57:52.155051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1376ec38-03e0-4178-bfce-886e60eb1f97 req-b9bf5fe9-cda8-4713-ad52-2145bf6ea76b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:52.162121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1376ec38-03e0-4178-bfce-886e60eb1f97 req-b9bf5fe9-cda8-4713-ad52-2145bf6ea76b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:52.212077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1376ec38-03e0-4178-bfce-886e60eb1f97 req-b9bf5fe9-cda8-4713-ad52-2145bf6ea76b service nova] Creating event network-vif-deleted:6dafd5a4-fa76-4aa0-986b-28c1404859fb for instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 on chh1-842464-2 May 19 08:57:52.227757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1376ec38-03e0-4178-bfce-886e60eb1f97 req-b9bf5fe9-cda8-4713-ad52-2145bf6ea76b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101964 May 19 08:57:52.229623 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4466/5791] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:57:53.077077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1084762245", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1808659732", "security_groups": [{"name": "tempest-secgroup-smoke-1123601492"}], "block_device_mapping_v2": [{"uuid": "ca43e888-e0b0-45e3-8ea0-0f3d3d71baa8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:57:53.345560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:57:54.662493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:57:54.663184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:57:54.663433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:57:54.663871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:57:54.666152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:57:54.694107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:54.695137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:54.701222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:54.702121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:54.792842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:57:54.809920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:57:54.928095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:57:54.930413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca43e888-e0b0-45e3-8ea0-0f3d3d71baa8',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:57:55.141147 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1167c791-69ec-4989-9d42-a767822cd2cd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.067734 May 19 08:57:55.141867 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4467/5792] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:57:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:57:55.151971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:55.152643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] [instance: f01247c5-3bac-4eb2-8887-bcc1ac7572b9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:55.180136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:55.180926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:55.182218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:55.183238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:55.246089 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] HTTP exception thrown: Instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 could not be found. May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Request method failure captured: May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 HTTP/1.1 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQfatyEMjit-1p2K5H_CnRifSFEi5qTSLtDqv5SD5Mhts9PF9hc-AFLx_2KjIqBun4xz_oldFKcmimb0liieDCXTSui5RQaw-6c8Zft1Hotj3yjm-Nmu6PpzTKBtMIKUueMkLwgR7nvro0Sw3i-I-5V7uaCEL2eqdhMpBwxku1mTBU May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_45be8834713245c5b0dd248ca205ae62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/45be8834713245c5b0dd248ca205ae62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 45be8834713245c5b0dd248ca205ae62 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1915102469 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 81a87eec69894a099a140ec8980a57e0 May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1915102469-project May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 could not be found. May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f01247c5-3bac-4eb2-8887-bcc1ac7572b9'} May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 could not be found. May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 could not be found. May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:55.258724 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 could not be found. May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Returning 404 to user: Instance f01247c5-3bac-4eb2-8887-bcc1ac7572b9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-447741e3-4938-4424-8fee-8f81674286b4 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9" status: 404 len: 111 microversion: 2.1 time: 0.117615 May 19 08:57:55.264591 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4468/5793] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:55 2022] GET /compute/v2.1/servers/f01247c5-3bac-4eb2-8887-bcc1ac7572b9 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 08:57:55.274074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a225b3f-48c0-43fb-84bd-29c78106cc01 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:55.276855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a225b3f-48c0-43fb-84bd-29c78106cc01 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:55.418226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a225b3f-48c0-43fb-84bd-29c78106cc01 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:55.447316 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a225b3f-48c0-43fb-84bd-29c78106cc01 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1095 microversion: 2.1 time: 0.184861 May 19 08:57:55.447778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4469/5794] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:55 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1095 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:56.480166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:56.481430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:56.494571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:56.495765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:56.500384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:56.501068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:56.645289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:56.662200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5d76a70-2bf8-40b1-a47d-bd71324fad1f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1193 microversion: 2.1 time: 0.186931 May 19 08:57:56.662200 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4470/5795] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:56 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1193 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:57.692071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:57.695884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:57.718200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:57.721655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:57.725639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:57.727245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:58.395607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:58.421347 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69c0255c-e3e0-4690-86a0-12af74eaa918 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1211 microversion: 2.1 time: 0.739797 May 19 08:57:58.422288 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4471/5796] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:57 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1211 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:57:59.442645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:57:59.443396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:57:59.460130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:59.460522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:59.461356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:57:59.461797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:57:59.801153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:57:59.834231 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47147d89-abde-4d5c-a972-f36ddbfb6e96 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1211 microversion: 2.1 time: 0.399018 May 19 08:57:59.834836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4472/5797] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:57:59 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1211 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:00.857974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:00.858647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:00.879745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:00.891833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:00.892920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:00.893451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:01.466252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:01.482539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e88acae-927f-499d-893b-a699b4ba7e75 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.628634 May 19 08:58:01.490098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4473/5798] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:00 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:02.508298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:02.509050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:02.517021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:02.538705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:02.539829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:02.540523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:03.184930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:03.205634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3fa5b3a8-70e1-4179-b6a7-40a98636d6d3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.701586 May 19 08:58:03.217665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4474/5799] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:02 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:04.239561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:04.241179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:04.274151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:04.276621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:04.279509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:04.283550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:04.741285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:05.427974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:05.600313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:05.616177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-446495bf-8058-44a8-97c5-3e5127ff655d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 1.379440 May 19 08:58:05.619897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4475/5800] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:04 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:06.653408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:06.654027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:06.667487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:06.667962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:06.672064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:06.676498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:07.639121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:07.663328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-022bccb3-564a-4de3-902b-44a160b592a1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 1.008446 May 19 08:58:07.664492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4476/5801] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:06 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:07.691684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ad0adc7a-7b61-413e-addc-d19fcdb61dfc req-43a50a85-e697-4d3b-846f-9264f2b84a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba987d1-9e5c-400a-a36d-922fe26ca859", "tag": "2512c5b9-af90-48d6-a662-799e95fad9bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:07.728028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ad0adc7a-7b61-413e-addc-d19fcdb61dfc req-43a50a85-e697-4d3b-846f-9264f2b84a3c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:07.728428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ad0adc7a-7b61-413e-addc-d19fcdb61dfc req-43a50a85-e697-4d3b-846f-9264f2b84a3c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:07.756866 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ad0adc7a-7b61-413e-addc-d19fcdb61dfc req-43a50a85-e697-4d3b-846f-9264f2b84a3c service nova] Creating event network-changed:2512c5b9-af90-48d6-a662-799e95fad9bd for instance dba987d1-9e5c-400a-a36d-922fe26ca859 on chh2-842464-2 May 19 08:58:07.765465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ad0adc7a-7b61-413e-addc-d19fcdb61dfc req-43a50a85-e697-4d3b-846f-9264f2b84a3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096887 May 19 08:58:07.769787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4477/5802] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:58:08.682824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:08.683681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:08.696207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:08.696686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:08.702108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:08.702782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:09.236714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:09.248706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dcdf615e-d0c4-418c-856d-2389e65ae343 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.571347 May 19 08:58:09.249343 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4478/5803] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:08 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:09.276654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de09c05f-27d6-48dc-a6a6-a1c123cde886 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] Calling method '.version_select at 0x7f321043aee0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:09.325665 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de09c05f-27d6-48dc-a6a6-a1c123cde886 tempest-TestNetworkAdvancedServerOps-1915102469 tempest-TestNetworkAdvancedServerOps-1915102469-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-72837566" status: 202 len: 0 microversion: 2.1 time: 0.062014 May 19 08:58:09.326274 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4479/5804] 10.222.0.78 () {58 vars in 1277 bytes} [Thu May 19 08:58:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-72837566 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 08:58:11.011212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:11.012658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:11.034010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:11.034010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:11.034385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:11.034943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:11.408421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:11.419996 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5100fb96-94af-4ce2-9ed6-a66a63d002c2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 1.154295 May 19 08:58:11.422458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4480/5805] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:10 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:12.441216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:12.442174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:12.456287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:12.456705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:12.457551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:12.461561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:12.518918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:13.311532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:13.332923 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62ca282f-9313-4396-9b6c-23f71920f9c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.897100 May 19 08:58:13.334633 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4481/5806] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:12 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:14.351864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:14.352554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:14.366174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:14.367152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:14.368195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:14.371476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:14.889935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:14.913064 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-73c4c9e6-b9dd-4f38-a8dc-90c7660324a0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.564753 May 19 08:58:14.915005 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4482/5807] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:14 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:15.933822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:15.934547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:15.943800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:15.944674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:15.946281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:15.947039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:16.240908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:16.256755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-47c96ac7-072c-4d8d-a822-23b427869e77 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.328188 May 19 08:58:16.262302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4483/5808] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:15 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:17.281395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:17.282779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:17.299920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:17.303312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:17.305278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:17.306205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:17.674101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:17.692474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b89684e9-2718-44fa-b599-4ca9322f36a9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.415908 May 19 08:58:17.698742 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4484/5809] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:17 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:18.718255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:18.720747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:18.727791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:18.749038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:18.752254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:18.753259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:18.760555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:19.097930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:19.109257 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08545e31-999a-4fce-9c91-13ce49958fb1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1279 microversion: 2.1 time: 0.396515 May 19 08:58:19.110759 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4485/5810] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:18 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:20.133360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:20.134300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:20.149927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:20.152343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:20.154259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:20.155761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:20.446379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:20.462772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19c371f0-e880-4ccb-9d5c-c78885598af2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.334563 May 19 08:58:20.463494 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4486/5811] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:20 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:21.495141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:21.495141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:21.504772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:21.505405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:21.506381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:21.506957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:21.729509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:21.740521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e96fe6c2-aff2-4bac-8360-6b066a94d862 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.258596 May 19 08:58:21.750037 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4487/5812] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:21 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:22.760681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:22.763222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:22.786271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:22.790259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:22.791475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:22.792175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:23.292113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:23.313701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-252ee7fd-3240-47dd-8a37-0318abce12ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.553607 May 19 08:58:23.323884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4488/5813] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:22 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:24.334436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:24.335211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:24.343521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:24.346802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:24.348813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:24.349580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:24.541799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:24.553845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c523a4cd-3d73-4f6b-809a-718c6e8a0abb tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.226419 May 19 08:58:24.554448 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4489/5814] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:24 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:25.574966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:25.577628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:25.587315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:25.588349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:25.589621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:25.590308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:26.295268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:26.307120 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa6997f1-715e-4dab-b0cd-bdb1093f48d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.739165 May 19 08:58:26.321027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4490/5815] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:25 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:26.506602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1441769963", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b0efe1a1-60df-4830-875a-87361de391dd"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:36.301341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=58 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:36.516016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:38.363431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] validate_networks() for [('b0efe1a1-60df-4830-875a-87361de391dd', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 08:58:38.996782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 08:58:38.997225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 08:58:38.997754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 08:58:38.998184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 08:58:38.998611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 08:58:39.011045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:39.011857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:39.012898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:39.013580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:39.037205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Getting quotas for project a67698e2ff8f43129023e01aaa3982cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 08:58:39.044562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Getting quotas for user ae4cf6a1be2a4449a15d5c9e829208a5 and project a67698e2ff8f43129023e01aaa3982cd. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 08:58:39.066513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 08:58:39.070422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 08:58:39.193988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ae1fd9a-7881-449d-b0cb-b0565cb8651a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.869348 May 19 08:58:39.196463 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4491/5816] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 08:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 12874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 08:58:39.210890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:39.213664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:39.227915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:39.229634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:39.233682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:39.234881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:39.425534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:39.435184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e6eff48-44b2-477c-b03b-b1863ac3dc46 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.236266 May 19 08:58:39.436989 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4492/5817] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:39 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:39.552805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dacddf20-be0a-46c2-95da-7da23a157171 req-6d02ac1f-79ea-498d-8ba1-7564eb15a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba987d1-9e5c-400a-a36d-922fe26ca859", "name": "network-vif-plugged", "status": "completed", "tag": "2512c5b9-af90-48d6-a662-799e95fad9bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:39.569626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dacddf20-be0a-46c2-95da-7da23a157171 req-6d02ac1f-79ea-498d-8ba1-7564eb15a5fc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:39.570216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dacddf20-be0a-46c2-95da-7da23a157171 req-6d02ac1f-79ea-498d-8ba1-7564eb15a5fc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:39.599116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dacddf20-be0a-46c2-95da-7da23a157171 req-6d02ac1f-79ea-498d-8ba1-7564eb15a5fc service nova] Creating event network-vif-plugged:2512c5b9-af90-48d6-a662-799e95fad9bd for instance dba987d1-9e5c-400a-a36d-922fe26ca859 on chh2-842464-2 May 19 08:58:39.614384 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dacddf20-be0a-46c2-95da-7da23a157171 req-6d02ac1f-79ea-498d-8ba1-7564eb15a5fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170759 May 19 08:58:39.615798 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4493/5818] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:58:39.630229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7656e19-7b92-4c03-bc95-eddbbb658aca tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:39.632675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7656e19-7b92-4c03-bc95-eddbbb658aca tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:39.791926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7656e19-7b92-4c03-bc95-eddbbb658aca tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:39.808945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7656e19-7b92-4c03-bc95-eddbbb658aca tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1215 microversion: 2.1 time: 0.184424 May 19 08:58:39.809659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4494/5819] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:39 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:40.456470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:40.457105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:40.487468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:40.487870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:40.488671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:40.489126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:40.698097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:40.710205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5472c7fa-9a7f-479e-ad19-848ef765189b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1267 microversion: 2.1 time: 0.257427 May 19 08:58:40.710850 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4495/5820] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:40 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:40.828424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:40.829224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:40.841729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:40.844969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:40.845919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:40.848978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:40.995746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:41.017555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b877e2e-af67-4761-809e-6d8483915a83 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1267 microversion: 2.1 time: 0.194432 May 19 08:58:41.025818 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4496/5821] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:40 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:41.732631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:41.734902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:41.761451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:41.764025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:41.771056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:41.777294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:42.084505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:42.094782 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbfa0cf7-0d1a-49ab-9bf2-685ac8472b2d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1455 microversion: 2.1 time: 0.366908 May 19 08:58:42.099943 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4497/5822] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:41 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1455 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:42.105487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:42.106357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:42.115892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:42.116802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:42.118611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:42.120067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:42.528708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:42.556295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-57f83c0e-1cb6-46f9-9280-71ca80e8c0ad tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.454947 May 19 08:58:42.557098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4498/5823] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:42 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:42.581415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:42.582022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:42.602657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:42.603133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:42.603956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:42.604419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:43.010552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:43.041354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbf2f39b-c8b8-4a85-8ee0-e87e413aed74 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1455 microversion: 2.1 time: 0.469539 May 19 08:58:43.042512 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4499/5824] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:42 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1455 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:43.576378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:43.576933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:43.599101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:43.599574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:43.601017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:43.601542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:43.952083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:43.963058 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-739897f8-beab-4596-a1b1-d08e3a6a34fb tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.391050 May 19 08:58:43.970608 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4500/5825] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:43 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:44.075013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8cd9a772-326c-4cf8-90d2-afe781a2f1ca req-8ae695e8-913d-4cf7-b609-527d8cf9bf42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95042c39-715d-4099-8475-6ebbd70012a4", "tag": "2bb65675-f074-49fe-b491-1275ec6173cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:44.091213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8cd9a772-326c-4cf8-90d2-afe781a2f1ca req-8ae695e8-913d-4cf7-b609-527d8cf9bf42 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:44.094156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8cd9a772-326c-4cf8-90d2-afe781a2f1ca req-8ae695e8-913d-4cf7-b609-527d8cf9bf42 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:44.132001 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8cd9a772-326c-4cf8-90d2-afe781a2f1ca req-8ae695e8-913d-4cf7-b609-527d8cf9bf42 service nova] Creating event network-changed:2bb65675-f074-49fe-b491-1275ec6173cb for instance 95042c39-715d-4099-8475-6ebbd70012a4 on chh1-842464-2 May 19 08:58:44.139898 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8cd9a772-326c-4cf8-90d2-afe781a2f1ca req-8ae695e8-913d-4cf7-b609-527d8cf9bf42 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068663 May 19 08:58:44.141139 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4501/5826] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:58:44.996825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:44.996825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:45.007586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:45.008079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:45.008908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:45.017568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:45.380024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:45.389495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4d6ce67-ab34-4c14-9506-3e7937b5f2f9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.405227 May 19 08:58:45.392952 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4502/5827] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:44 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:46.411298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:46.412297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:46.429160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:46.441296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:46.442211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:46.442681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:46.928533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:46.942640 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92f4b47a-f00b-401b-a274-085026381875 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.537733 May 19 08:58:46.945836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4503/5828] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:46 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:47.974479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:47.978570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:47.999726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:47.999726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:47.999726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:48.000086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:48.411210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:48.422486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ecb6cec4-1590-4c09-a69c-edeff1f901c1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.458935 May 19 08:58:48.423131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4504/5829] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:47 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:48.590857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b7459516-4288-44bf-bbff-47f2fdc8ac12 req-2f0f4ba8-f7e6-46d0-bdda-051066379ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba987d1-9e5c-400a-a36d-922fe26ca859", "tag": "2512c5b9-af90-48d6-a662-799e95fad9bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:48.623837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b7459516-4288-44bf-bbff-47f2fdc8ac12 req-2f0f4ba8-f7e6-46d0-bdda-051066379ab2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:48.630076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b7459516-4288-44bf-bbff-47f2fdc8ac12 req-2f0f4ba8-f7e6-46d0-bdda-051066379ab2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:48.648962 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b7459516-4288-44bf-bbff-47f2fdc8ac12 req-2f0f4ba8-f7e6-46d0-bdda-051066379ab2 service nova] Creating event network-changed:2512c5b9-af90-48d6-a662-799e95fad9bd for instance dba987d1-9e5c-400a-a36d-922fe26ca859 on chh2-842464-2 May 19 08:58:48.695270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b7459516-4288-44bf-bbff-47f2fdc8ac12 req-2f0f4ba8-f7e6-46d0-bdda-051066379ab2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108102 May 19 08:58:48.701091 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4505/5830] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 08:58:49.440336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:49.441037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:49.444604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:49.463954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:49.465830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:49.470007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:49.470481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:49.802669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:49.974424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:49.996479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41391997-c802-4586-aa04-6bf5a0ee343f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.560192 May 19 08:58:50.005926 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4506/5831] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:49 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:50.005926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a28e63d1-da1a-4681-9e72-0b71f4b2ca7c req-817421d7-962c-4e1c-8158-465179be77ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95042c39-715d-4099-8475-6ebbd70012a4", "name": "network-vif-plugged", "status": "completed", "tag": "2bb65675-f074-49fe-b491-1275ec6173cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:50.027533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a28e63d1-da1a-4681-9e72-0b71f4b2ca7c req-817421d7-962c-4e1c-8158-465179be77ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:50.030017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a28e63d1-da1a-4681-9e72-0b71f4b2ca7c req-817421d7-962c-4e1c-8158-465179be77ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:50.066234 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a28e63d1-da1a-4681-9e72-0b71f4b2ca7c req-817421d7-962c-4e1c-8158-465179be77ee service nova] Creating event network-vif-plugged:2bb65675-f074-49fe-b491-1275ec6173cb for instance 95042c39-715d-4099-8475-6ebbd70012a4 on chh1-842464-2 May 19 08:58:50.073406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a28e63d1-da1a-4681-9e72-0b71f4b2ca7c req-817421d7-962c-4e1c-8158-465179be77ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072545 May 19 08:58:50.074714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4507/5832] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:58:51.017110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:51.018555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:51.025831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:51.026568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:51.027533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:51.028135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:51.192754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:51.202940 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbed0958-dc6a-4aa0-a40e-17b6c916d853 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1315 microversion: 2.1 time: 0.192329 May 19 08:58:51.204233 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4508/5833] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:51 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:52.231273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:52.241785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:52.254772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:52.255584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:52.256995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:52.258268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:52.507864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:52.518662 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c351aa71-4f87-49f0-8759-198a22635b7a tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1501 microversion: 2.1 time: 0.301825 May 19 08:58:52.519266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4509/5834] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:52 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:52.537013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:52.538128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:52.545206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:52.546851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:52.547325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:52.547891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:52.807851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:52.829355 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11999911-d370-49b4-b3c2-37ca6d12a036 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1501 microversion: 2.1 time: 0.296088 May 19 08:58:52.830279 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4510/5835] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:52 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1501 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:52.849819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:52.850378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:52.857190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:52.857692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:52.858553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:52.859020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:52.897101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lazy-loading 'flavor' on Instance uuid 95042c39-715d-4099-8475-6ebbd70012a4 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:58:52.901065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:58:52.984460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9c515d0-dea8-43e9-9d48-5b578c7ff024 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action" status: 202 len: 0 microversion: 2.1 time: 0.138745 May 19 08:58:52.985734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4511/5836] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:58:52 2022] POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:58:52.995503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:52.996562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:53.007333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:53.008023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:53.009156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:53.009659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:53.214891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:53.232313 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8919c46-936c-463e-890a-f28abe2a991f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1509 microversion: 2.1 time: 0.242031 May 19 08:58:53.234935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4512/5837] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:52 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:54.253785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:54.254866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:54.264438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:54.265697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:54.266772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:54.267393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:54.487061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:54.497688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f21cde19-4ccc-433e-956b-8ae3bd89eb0b tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1492 microversion: 2.1 time: 0.249134 May 19 08:58:54.498493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4513/5838] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:54 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1492 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:54.518488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:54.519035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:54.527198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:54.528043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:54.529035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:54.529548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:54.658268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80b696f9-7aac-474d-a819-cbe53ab5d054 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action" status: 202 len: 0 microversion: 2.1 time: 0.145394 May 19 08:58:54.659721 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4514/5839] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:58:54 2022] POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:58:54.670218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:54.670996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:54.682634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:54.683072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:54.684069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:54.684991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:55.039158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:55.048882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a02ec77-7a7d-4159-ad6e-6c689962c79e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1498 microversion: 2.1 time: 0.383799 May 19 08:58:55.050651 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4515/5840] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:54 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1498 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:56.078108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:56.079930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:56.088243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:56.089030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:56.090186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:56.091025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:56.314498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:56.328816 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c39d5ddf-1ea7-4838-9dae-63d916a0aef1 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1498 microversion: 2.1 time: 0.255981 May 19 08:58:56.330059 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4516/5841] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:56 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1498 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:57.360030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:57.373386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:57.382676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:57.383383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:57.384305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:57.385001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:57.549195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:57.557743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a3c062a7-78fc-44f4-be46-792c48e2475f tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1501 microversion: 2.1 time: 0.203029 May 19 08:58:57.559007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4517/5842] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:57 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1501 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:57.582771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:57.583318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:57.590454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:57.590914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:57.591722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:57.592172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:57.622713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lazy-loading 'flavor' on Instance uuid 95042c39-715d-4099-8475-6ebbd70012a4 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 08:58:57.723918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1620102d-e6f4-4f40-a31c-7ff11c8dd29d tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action" status: 202 len: 0 microversion: 2.1 time: 0.144933 May 19 08:58:57.725112 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4518/5843] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:58:57 2022] POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:58:57.741201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:57.742062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:57.752878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:57.753955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:57.755768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:57.756532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:58.007342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:58.018298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d56ef008-faab-4ac9-abb7-90e4e9ec848e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1509 microversion: 2.1 time: 0.281886 May 19 08:58:58.021269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4519/5844] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:57 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:58:59.040007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:59.041437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:59.050081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:59.050567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:59.051357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:59.051811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:59.271592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:59.296926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2ae0de8-b0d5-4b33-aa9e-2b64e3deb88e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1492 microversion: 2.1 time: 0.262159 May 19 08:58:59.307741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4520/5845] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:59 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1492 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:58:59.321685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:58:59.322246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:59.338058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:59.339324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:59.343276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:59.343778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:59.449834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de75f58b-958e-4d57-a315-69b267f36f93 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action" status: 202 len: 0 microversion: 2.1 time: 0.133212 May 19 08:58:59.462821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4521/5846] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 08:58:59 2022] POST /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 08:58:59.476895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:58:59.477759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:58:59.486083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:59.486633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:59.487552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:58:59.488184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:58:59.839684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:58:59.867844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19802902-477f-4a00-ac26-697b58d8ac85 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1498 microversion: 2.1 time: 0.396038 May 19 08:58:59.868594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4522/5847] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:58:59 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1498 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:59:00.888840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:00.890526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:00.898665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:00.899146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:00.900567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:00.901448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:00.911846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:59:01.167281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:59:01.210109 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e86692c7-1b88-4ee1-afd9-dd0b8094ecd9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1498 microversion: 2.1 time: 0.324769 May 19 08:59:01.211536 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4523/5848] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:59:00 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1498 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:59:02.228796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:02.229600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:02.242524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:02.250686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:02.250686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:02.250686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:02.423668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:59:02.433251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-911760c1-3353-49e3-9c26-14b1debe0636 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1501 microversion: 2.1 time: 0.208851 May 19 08:59:02.434157 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4524/5849] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:59:02 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1501 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:59:02.451152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:02.452208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:02.481329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:02.481798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:02.482633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:02.483905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:02.517507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 08:59:02.645490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcf01c44-e565-415d-8910-266e5d643066 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 204 len: 0 microversion: 2.1 time: 0.198266 May 19 08:59:02.649252 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4525/5850] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 08:59:02 2022] DELETE /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 08:59:02.666071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:02.669078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:02.682315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:02.682964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:02.684233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:02.684808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:03.059603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:59:03.072144 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d817fff1-d362-4483-914e-5029a0344191 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1507 microversion: 2.1 time: 0.419272 May 19 08:59:03.072814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4526/5851] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:59:02 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:59:04.092731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:04.093765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:04.109474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:04.110730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:04.115115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:04.115703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:04.384558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:59:04.413446 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27d88304-61c7-4fe1-9598-046378c8557e tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1507 microversion: 2.1 time: 0.325900 May 19 08:59:04.424036 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4527/5852] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:59:04 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 08:59:05.433922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:05.434733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:05.455216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:05.457086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:05.460613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:05.463321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:05.642842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4cf6a1be2a4449a15d5c9e829208a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67698e2ff8f43129023e01aaa3982cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 08:59:05.653628 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e70642d-2ae7-4b76-b541-97ea2d4918e5 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 200 len: 1300 microversion: 2.1 time: 0.225039 May 19 08:59:05.655576 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4528/5853] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:59:05 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 1300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 08:59:05.661023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-50c23547-13cc-4472-9bb0-ab603254d9a6 req-8fab9f26-73a2-443c-9925-54530c2d63d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95042c39-715d-4099-8475-6ebbd70012a4", "name": "network-vif-deleted", "tag": "2bb65675-f074-49fe-b491-1275ec6173cb"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 08:59:05.671976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-50c23547-13cc-4472-9bb0-ab603254d9a6 req-8fab9f26-73a2-443c-9925-54530c2d63d8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:05.672681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-50c23547-13cc-4472-9bb0-ab603254d9a6 req-8fab9f26-73a2-443c-9925-54530c2d63d8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:05.687901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-50c23547-13cc-4472-9bb0-ab603254d9a6 req-8fab9f26-73a2-443c-9925-54530c2d63d8 service nova] Creating event network-vif-deleted:2bb65675-f074-49fe-b491-1275ec6173cb for instance 95042c39-715d-4099-8475-6ebbd70012a4 on chh1-842464-2 May 19 08:59:05.694012 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-50c23547-13cc-4472-9bb0-ab603254d9a6 req-8fab9f26-73a2-443c-9925-54530c2d63d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036887 May 19 08:59:05.694892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4529/5854] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 08:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 08:59:06.677398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 08:59:06.678152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] [instance: 95042c39-715d-4099-8475-6ebbd70012a4] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 08:59:06.680310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 08:59:06.711205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:06.712106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:06.713122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 08:59:06.713876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 08:59:06.746061 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] HTTP exception thrown: Instance 95042c39-715d-4099-8475-6ebbd70012a4 could not be found. May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Request method failure captured: May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 HTTP/1.1 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgavhHlxOcugr8U5bC-x86cvrj11EXRIJ7JxkYvIO7E0S7XfgqAmCZpZG5F_11l7p0sKUDSY3-ULEjs6u3TVD2mSH5vITmN1_5kZzdhmVmh_2wdFzYpHEVHr88JB6CC67BSqlyeIlWb1OQ3o9426npjiKVsYeyQ43OSHfuH0X9o1r94 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a67698e2ff8f43129023e01aaa3982cd May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestServerAdvancedOps-1552022157 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a67698e2ff8f43129023e01aaa3982cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a67698e2ff8f43129023e01aaa3982cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a67698e2ff8f43129023e01aaa3982cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a67698e2ff8f43129023e01aaa3982cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestServerAdvancedOps-1552022157 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a67698e2ff8f43129023e01aaa3982cd May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestServerAdvancedOps-1552022157 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestServerAdvancedOps-1552022157-project May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ae4cf6a1be2a4449a15d5c9e829208a5 May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestServerAdvancedOps-1552022157-project May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 95042c39-715d-4099-8475-6ebbd70012a4 could not be found. May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '95042c39-715d-4099-8475-6ebbd70012a4'} May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95042c39-715d-4099-8475-6ebbd70012a4 could not be found. May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95042c39-715d-4099-8475-6ebbd70012a4 could not be found. May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 08:59:06.750715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95042c39-715d-4099-8475-6ebbd70012a4 could not be found. May 19 08:59:06.754696 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 08:59:06.756154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] Returning 404 to user: Instance 95042c39-715d-4099-8475-6ebbd70012a4 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 08:59:06.757252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b4b6be2-e2da-4ee6-b5b9-b2bbcb4e42c9 tempest-TestServerAdvancedOps-1552022157 tempest-TestServerAdvancedOps-1552022157-project] 10.222.0.78 "GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4" status: 404 len: 111 microversion: 2.1 time: 0.087872 May 19 08:59:06.762527 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4530/5855] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 08:59:06 2022] GET /compute/v2.1/servers/95042c39-715d-4099-8475-6ebbd70012a4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:00:07.296805 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:00:07.297494 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:00:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:00:08.036100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:00:08.037013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:00:08.042191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2069725748", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:00:08.109112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:00:08.440355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:00:08.440872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:00:08.441261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:00:08.441711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:00:08.442142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:00:08.453237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:08.453736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:08.454703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:08.455275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:08.477932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Getting quotas for project a2fcc89725fe4df8a0c478348bd6dcad. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:00:08.484135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Getting quotas for user 223132e91fc044f0a61836763b722ce3 and project a2fcc89725fe4df8a0c478348bd6dcad. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:00:08.500521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:00:08.502942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:00:08.553187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4e346cc-0944-40c6-b338-9ffd7c4a7f76 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519380 May 19 09:00:08.553904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4531/5856] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:00:08.566967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d8286bc-9890-45db-87b3-98b8aabb3ea3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:08.567762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d8286bc-9890-45db-87b3-98b8aabb3ea3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:08.659210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d8286bc-9890-45db-87b3-98b8aabb3ea3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:08.672434 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d8286bc-9890-45db-87b3-98b8aabb3ea3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1214 microversion: 2.1 time: 0.109491 May 19 09:00:08.673250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4532/5857] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:08 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:09.690916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:09.692346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:09.706606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:09.706606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:09.707461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:09.707951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:09.781859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:09.791337 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-611af784-e997-4960-88ea-95f737c0049f tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1266 microversion: 2.1 time: 0.105120 May 19 09:00:09.803020 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4533/5858] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:09 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:10.820089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:10.821597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:10.832443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:10.833080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:10.834582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:10.834582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:11.124753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:11.138968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7643f87-6ef4-4d55-a761-71cd212bb885 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.329795 May 19 09:00:11.140085 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4534/5859] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:10 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:12.161064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:12.161889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:12.182749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:12.183233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:12.185030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:12.185840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:12.460460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:12.476592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60071f45-3460-4005-89af-669c3bdd3097 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.321931 May 19 09:00:12.477274 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4535/5860] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:12 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:12.490055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6cf5a428-4153-42bb-b60e-0b5146abb3f2 req-4452808f-18b5-42c2-b8de-a7f446808305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ccf3ba-d4a3-45eb-a726-371cc8db98ae", "tag": "db6c9b0f-08b1-4ed2-80ad-a414412c6ce3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:00:12.500233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6cf5a428-4153-42bb-b60e-0b5146abb3f2 req-4452808f-18b5-42c2-b8de-a7f446808305 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:12.508888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6cf5a428-4153-42bb-b60e-0b5146abb3f2 req-4452808f-18b5-42c2-b8de-a7f446808305 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:12.526492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6cf5a428-4153-42bb-b60e-0b5146abb3f2 req-4452808f-18b5-42c2-b8de-a7f446808305 service nova] Creating event network-changed:db6c9b0f-08b1-4ed2-80ad-a414412c6ce3 for instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae on chh1-842464-2 May 19 09:00:12.532907 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6cf5a428-4153-42bb-b60e-0b5146abb3f2 req-4452808f-18b5-42c2-b8de-a7f446808305 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046722 May 19 09:00:12.534440 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4536/5861] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:00:13.504988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:13.505822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:13.512886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:13.513401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:13.514213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:13.514969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:13.722715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:13.742666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc2acb86-bef7-4b77-b189-c7c3a0bc6df6 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.242739 May 19 09:00:13.743370 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4537/5862] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:13 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:14.766292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:14.769191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:14.781671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:14.783535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:14.784767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:14.785551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:14.952893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:14.963441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-147f6a27-d5b4-4f31-836d-f66034b94ae1 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.206462 May 19 09:00:14.964213 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4538/5863] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:14 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:15.981203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:15.982602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:15.993657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:15.997355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:15.998508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:16.000310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:16.201483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:16.218388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2fd374fe-cacb-4889-b608-cbe3e8a7253b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.237792 May 19 09:00:16.219604 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4539/5864] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:15 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:17.236964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:17.237679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:17.247838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:17.248563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:17.249594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:17.250236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:17.415470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:17.426891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6f1382c-235f-45bd-b5e1-a71ea8a33cc3 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.194820 May 19 09:00:17.437913 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4540/5865] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:17 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:18.098097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dc94ab16-a628-46fd-a613-d479ccab94f9 req-7729d73b-19c0-439b-8e7f-43bf9d346260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ccf3ba-d4a3-45eb-a726-371cc8db98ae", "name": "network-vif-plugged", "status": "completed", "tag": "db6c9b0f-08b1-4ed2-80ad-a414412c6ce3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:00:18.115817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc94ab16-a628-46fd-a613-d479ccab94f9 req-7729d73b-19c0-439b-8e7f-43bf9d346260 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:18.121690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc94ab16-a628-46fd-a613-d479ccab94f9 req-7729d73b-19c0-439b-8e7f-43bf9d346260 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:18.153563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dc94ab16-a628-46fd-a613-d479ccab94f9 req-7729d73b-19c0-439b-8e7f-43bf9d346260 service nova] Creating event network-vif-plugged:db6c9b0f-08b1-4ed2-80ad-a414412c6ce3 for instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae on chh1-842464-2 May 19 09:00:18.166617 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dc94ab16-a628-46fd-a613-d479ccab94f9 req-7729d73b-19c0-439b-8e7f-43bf9d346260 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075220 May 19 09:00:18.167520 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4541/5866] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:00:18.447260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:18.449227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:18.458517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:18.458986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:18.459802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:18.460418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:18.477090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:00:18.629018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:18.639757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5afd429-a8a4-4ba6-8635-e1859ed0283e tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1314 microversion: 2.1 time: 0.199017 May 19 09:00:18.640366 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4542/5867] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:18 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:19.656892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:19.657890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:19.660367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:00:19.667919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:19.668766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:19.669973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:19.670440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:19.844732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:19.853848 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c2afca1-ca19-4156-8fe0-567a0834a1bc tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1464 microversion: 2.1 time: 0.200847 May 19 09:00:19.855148 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4543/5868] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:19 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:19.873578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63cc79f9-af7f-4559-8a2c-4429de2d9190", "device": "/dev/sdb"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:00:19.875152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:19.883105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:19.883664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:19.884738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:19.885260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:20.190847 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84781875-4a86-4939-a38c-ba3d01e2826b tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "POST /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322546 May 19 09:00:20.191474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4544/5869] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 09:00:19 2022] POST /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:00:26.253783 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:00:26.254853 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:00:43.664781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:43.665383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:43.672461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:00:43.673434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:00:43.675470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:43.676276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:43.677145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:43.691113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:43.744632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:00:43.877975 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc9c7fd0-facb-4867-94b8-6dadcbcadbd1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 204 len: 0 microversion: 2.1 time: 0.216868 May 19 09:00:43.879045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4545/5870] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:00:43 2022] DELETE /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:00:43.890015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:43.890730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:43.904826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:43.905293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:43.906269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:43.906817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:44.333218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:44.370262 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0b903c6-c711-4217-86c2-48bb839311a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1580 microversion: 2.1 time: 0.477384 May 19 09:00:44.371498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4546/5871] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:43 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1580 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:45.389792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:45.391571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:45.401843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:45.402588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:45.403612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:45.404256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:45.716421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:45.727833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8d6e8ce-f972-4711-8033-351e3925009a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1580 microversion: 2.1 time: 0.343234 May 19 09:00:45.731901 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4547/5872] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:45 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1580 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:46.755436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:46.755436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:46.768548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:46.770728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:46.773352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:46.775433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:47.038517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:47.069219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-acdb3e4a-c4d1-485f-b513-d2a5e5e52192 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1512 microversion: 2.1 time: 0.319766 May 19 09:00:47.069888 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4548/5873] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:46 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:47.155402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7e5d0bbe-5fa3-4201-b0e5-9cda49c1eb07 req-7184e3a5-2684-4153-910b-98038e945026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba987d1-9e5c-400a-a36d-922fe26ca859", "name": "network-vif-deleted", "tag": "2512c5b9-af90-48d6-a662-799e95fad9bd"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:00:47.166108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7e5d0bbe-5fa3-4201-b0e5-9cda49c1eb07 req-7184e3a5-2684-4153-910b-98038e945026 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:47.167192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7e5d0bbe-5fa3-4201-b0e5-9cda49c1eb07 req-7184e3a5-2684-4153-910b-98038e945026 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:47.182029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7e5d0bbe-5fa3-4201-b0e5-9cda49c1eb07 req-7184e3a5-2684-4153-910b-98038e945026 service nova] Creating event network-vif-deleted:2512c5b9-af90-48d6-a662-799e95fad9bd for instance dba987d1-9e5c-400a-a36d-922fe26ca859 on chh2-842464-2 May 19 09:00:47.200404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7e5d0bbe-5fa3-4201-b0e5-9cda49c1eb07 req-7184e3a5-2684-4153-910b-98038e945026 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057822 May 19 09:00:47.204302 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4549/5874] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 09:00:48.090181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:48.091647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:48.109061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:48.114412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:48.116732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:48.117448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:48.355187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:48.380048 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01153168-bc5e-4bc1-a1c3-1d48fb0536b9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.293495 May 19 09:00:48.382002 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4550/5875] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:48 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:49.401563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:49.403366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:49.429486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:49.430817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:49.436505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:49.437169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:49.587269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:49.624770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-01c2d298-f1c0-4217-9649-2b4c7daffc15 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.228570 May 19 09:00:49.640170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4551/5876] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:49 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:50.648122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:50.649098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:50.666900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:50.667450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:50.670694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:50.671675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:50.832800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:50.857928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c665dd87-9ee0-429d-9046-648925606fc8 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.213298 May 19 09:00:50.858745 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4552/5877] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:50 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:51.891499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:51.892825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:51.908583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:51.909853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:51.911049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:51.911882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:52.088127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:52.120754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e01d2bc7-6ad7-4e96-ae45-e47f6cc4a6ed tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.243448 May 19 09:00:52.124896 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4553/5878] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:51 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:53.151877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:53.152562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:53.176384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:53.177085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:53.180522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:53.182045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:53.282181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:53.291023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e98cabb5-39bb-4735-851f-a5856713b033 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.144521 May 19 09:00:53.300540 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4554/5879] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:53 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:54.309364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:54.311566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:54.326465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:54.327143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:54.328107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:54.328715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:54.414892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:54.436100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24fbc022-76f0-429d-9d29-07833a4a29c3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.131630 May 19 09:00:54.449460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4555/5880] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:54 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:55.454933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:55.455677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:55.476515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:55.482719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:55.483565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:55.484018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:55.575779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:55.585954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d92aa1cd-ee0a-4e17-ba49-c57bc20243bd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.135318 May 19 09:00:55.596812 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4556/5881] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:55 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:56.604964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:56.606597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:56.621166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:56.621890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:56.622864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:56.623452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:56.709507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:56.720098 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a431c936-aeda-480b-829e-7678b21b0439 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.119852 May 19 09:00:56.733014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4557/5882] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:56 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:00:57.740331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:57.742450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:57.754672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:57.761486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:57.763010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:57.763564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:57.896314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:57.912764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c5d1faf-9396-419c-9532-4c99a3a9a74f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.175711 May 19 09:00:57.915953 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4558/5883] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:57 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:00:58.941816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:00:58.942492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:00:58.994289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:58.994754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:58.995560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:00:58.996006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:00:59.108366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:00:59.127088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bf01f5f-aef1-4b7a-afe9-de0f528c366a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.197735 May 19 09:00:59.127714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4559/5884] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:00:58 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:00.145195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:00.145816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:00.177261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:00.177754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:00.178613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:00.179077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:00.241523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:00.311251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:00.322463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2b3167b-e1b2-4606-af3a-aefda9cdcbd5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 200 len: 1226 microversion: 2.1 time: 0.182184 May 19 09:01:00.323286 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4560/5885] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:00 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 1226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:01.340839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:01.342198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:01.361501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:01.362256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:01.363264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:01.363735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:01.393256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 HTTP/1.1 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dba987d1-9e5c-400a-a36d-922fe26ca859'} May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:01:01.395572 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:01:01.400480 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:01:01.401862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:01:01.403002 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-233a45f8-7716-462b-b8a6-348580b81b1a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 404 len: 111 microversion: 2.1 time: 0.066762 May 19 09:01:01.404084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4561/5886] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:01 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:01:01.636605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1232515733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1808659732", "security_groups": [{"name": "tempest-secgroup-smoke-1123601492"}], "block_device_mapping_v2": [{"uuid": "ca43e888-e0b0-45e3-8ea0-0f3d3d71baa8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:01.786462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:01:02.418071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:01:02.419440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:01:02.420148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:01:02.420787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:01:02.422594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:01:02.434641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:02.435448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:02.436484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:02.437173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:02.476582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:01:02.498401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:01:02.587561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:01:02.589733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca43e888-e0b0-45e3-8ea0-0f3d3d71baa8',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:01:02.799811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b9fd6b8-e976-46b5-8467-f9dd7286fa53 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.167391 May 19 09:01:02.806013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4562/5887] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:01:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:01:02.812091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-270d4fbb-a45d-48cd-b592-4f5039f8d725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:02.813012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-270d4fbb-a45d-48cd-b592-4f5039f8d725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:02.933007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-270d4fbb-a45d-48cd-b592-4f5039f8d725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:02.942918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-270d4fbb-a45d-48cd-b592-4f5039f8d725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1095 microversion: 2.1 time: 0.135370 May 19 09:01:02.944805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4563/5888] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:02 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1095 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:03.962977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:03.963930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:03.981355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:03.981952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:03.982875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:03.983545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:04.061814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:04.086303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff5e2951-3486-4c61-a750-ed67a2c7bd59 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1193 microversion: 2.1 time: 0.127493 May 19 09:01:04.087612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4564/5889] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:03 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1193 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:05.104575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:05.105181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:05.118438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:05.119026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:05.119890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:05.120358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:05.269982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:05.287541 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbd49f6a-9c0c-4ec6-bbe1-87e4928aa725 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1211 microversion: 2.1 time: 0.187240 May 19 09:01:05.288148 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4565/5890] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:05 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:06.304956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:06.311362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:06.329428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:06.330166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:06.337449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:06.338177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:06.990372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:07.000252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ae700fd-b77a-4140-b0d1-4e332d0b2971 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.698978 May 19 09:01:07.010681 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4566/5891] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:06 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:07.590332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ecae9b3b-7747-4506-93e2-d460b02652f4 req-0af32e8c-414c-4699-b2b7-e2fe3dee1fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a21d49-63e9-4c4b-9d89-0d8d539eb404", "tag": "62e99169-ad1f-4d8f-a073-05fcb9ca4ead"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:07.622290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ecae9b3b-7747-4506-93e2-d460b02652f4 req-0af32e8c-414c-4699-b2b7-e2fe3dee1fe8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:07.622762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ecae9b3b-7747-4506-93e2-d460b02652f4 req-0af32e8c-414c-4699-b2b7-e2fe3dee1fe8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:07.661847 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ecae9b3b-7747-4506-93e2-d460b02652f4 req-0af32e8c-414c-4699-b2b7-e2fe3dee1fe8 service nova] Creating event network-changed:62e99169-ad1f-4d8f-a073-05fcb9ca4ead for instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 on chh2-842464-2 May 19 09:01:07.674778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ecae9b3b-7747-4506-93e2-d460b02652f4 req-0af32e8c-414c-4699-b2b7-e2fe3dee1fe8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089007 May 19 09:01:07.684218 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4567/5892] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:01:08.029177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:08.030375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:08.048287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:08.049061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:08.051264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:08.051966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:08.602987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:08.639146 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b377374-5068-4d79-b662-ee092db32914 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.615372 May 19 09:01:08.656445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4568/5893] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:08 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:09.668778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:09.672291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:09.686454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:09.687792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:09.689850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:09.692164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:09.885882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:09.895137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95c1562d-3818-4d3c-bfab-5e0e45d0ef31 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.235753 May 19 09:01:09.907017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4569/5894] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:09 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:10.916001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:10.917780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:10.928719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:10.929565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:10.932185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:10.932680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:11.146146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:11.157915 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3fde5316-9fc7-4762-9f1d-200f0ece3c65 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.247291 May 19 09:01:11.159284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4570/5895] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:10 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:12.176151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:12.176809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:12.191937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:12.192417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:12.193491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:12.194068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:12.457233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:12.511302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:12.526249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6bd8547-86d3-4ab0-b25d-b7961648682f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.353728 May 19 09:01:12.528929 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4571/5896] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:12 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:13.544892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:13.546027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:13.562760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:13.565402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:13.568332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:13.569702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:13.578905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:14.388290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:14.397199 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41e5c704-7ff9-475d-8edf-a15af017609c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.856035 May 19 09:01:14.398165 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4572/5897] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:13 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:15.415077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:15.416629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:15.423605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:15.425560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:15.426420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:15.427515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:15.428254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:15.775446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:15.791864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3158859-d799-43ce-939e-609d6ba520da tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.380988 May 19 09:01:15.793744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4573/5898] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:15 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:16.810923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:16.812575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:16.826118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:16.826864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:16.827826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:16.828426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:17.200444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:17.209658 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f80f0bb1-a953-4b4d-82b0-3e9646810e4c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.402805 May 19 09:01:17.210752 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4574/5899] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:16 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:18.228421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:18.229124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:18.246135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:18.246659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:18.247522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:18.247979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:18.528111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:18.542087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52bff51f-40b3-4f59-9c4f-cb024a848a72 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.317479 May 19 09:01:18.542725 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4575/5900] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:18 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:19.559836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:19.560476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:19.572216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:19.582176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:19.583437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:19.584048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:20.068296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:20.084400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e8ea319-37df-4b02-addb-8dc4c16e45d2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.528153 May 19 09:01:20.087477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4576/5901] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:19 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:21.103458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:21.104857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:21.134513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:21.136205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:21.137095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:21.144082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:21.833558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:21.873976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0734dc90-9378-40ba-860e-b0f749ca89b4 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.744190 May 19 09:01:21.875295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4577/5902] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:21 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:22.893794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:22.894556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:22.911171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:22.911763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:22.912692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:22.913218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:23.388834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:23.401180 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1465924d-bc92-482c-965d-618539fce52a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.512979 May 19 09:01:23.409136 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4578/5903] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:22 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:24.395770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3555d708-bc3c-4f9f-b4c1-21e183a4a40b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'create', calling method: .version_select at 0x7f32102fbaf0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1357764535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkl2nIZCTUaD0IAY+0m0a9J/WYUFWAxFz9vVEARawq6GSBCLNuM4y+q6i30owPYbhJcbxBhI/QTzP97d5ZR0jVo4rJ8+qaB+/o0/NNqeCXJJ5+K6L+5fpXQ++TEernVKA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:24.418566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3555d708-bc3c-4f9f-b4c1-21e183a4a40b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for project 76f10af0529347f889780b97a0116150. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:01:24.428456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3555d708-bc3c-4f9f-b4c1-21e183a4a40b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for user 34ddb36c721e46a7bb9f7cf32a7dc662 and project 76f10af0529347f889780b97a0116150. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:01:24.467306 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3555d708-bc3c-4f9f-b4c1-21e183a4a40b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.075629 May 19 09:01:24.468811 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4579/5904] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:01:24 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:01:24.474617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:24.475660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:24.484457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:24.485205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:24.486680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:24.487398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:24.793658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:24.805369 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85024105-91c7-4a3c-86d6-cef0a449789a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.334035 May 19 09:01:24.807381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4580/5905] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:24 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:25.825980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:25.826614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:25.843607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:25.844318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:25.845298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:25.845948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:25.868473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:26.127881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:26.138065 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c4ddf2c-8d04-4d9f-8eed-d95e1c348a18 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.315982 May 19 09:01:26.150549 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4581/5906] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:25 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:26.625510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-518529514", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "8fd4780d-c332-4a88-af82-40eee4926096"}], "key_name": "tempest-TestNetworkBasicOps-1357764535", "security_groups": [{"name": "tempest-secgroup-smoke-772811109"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:26.781879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] validate_networks() for [('8fd4780d-c332-4a88-af82-40eee4926096', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:01:27.563771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:01:27.564954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:01:27.565811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:01:27.566505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:01:27.567408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:01:27.597937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:27.598787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:27.599904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:27.600601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:27.641544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for project 76f10af0529347f889780b97a0116150. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:01:27.654290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for user 34ddb36c721e46a7bb9f7cf32a7dc662 and project 76f10af0529347f889780b97a0116150. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:01:27.686369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:01:27.689453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:01:27.774459 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a0ba043-b919-4864-985c-2fb9403cb924 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.152995 May 19 09:01:27.775506 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4582/5907] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:01:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:01:27.780705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:27.781233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:27.804062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:27.806189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:27.806577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:27.807835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:28.069238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:28.082366 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe4c80c4-dc4b-4a60-b43c-3d0b9e992966 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.305579 May 19 09:01:28.087638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4583/5908] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:27 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:28.096478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bb548fa-4557-4e50-96e2-ffcd282998f4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:28.097939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bb548fa-4557-4e50-96e2-ffcd282998f4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:28.241973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bb548fa-4557-4e50-96e2-ffcd282998f4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:28.251590 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bb548fa-4557-4e50-96e2-ffcd282998f4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1248 microversion: 2.1 time: 0.162435 May 19 09:01:28.263178 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4584/5909] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:28 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1248 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:29.114267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:29.116160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:29.140967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:29.156451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:29.157709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:29.159810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:29.474883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:29.494396 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39e5da73-82a6-42b3-bec0-596b88190aa3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.389723 May 19 09:01:29.502553 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4585/5910] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:29 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:29.517839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:29.519703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:29.548377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:29.549512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:29.553277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:29.554081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:29.758961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:29.792075 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef49797d-cdd8-45f5-ab5a-8085b16e2a0e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1306 microversion: 2.1 time: 0.287950 May 19 09:01:29.793599 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4586/5911] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:29 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1306 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:30.516127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:30.516762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:30.530372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:30.530974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:30.531805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:30.532259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:30.953031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:30.969193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-445ca729-cfcc-45dd-bd86-c5f736ad8be3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1279 microversion: 2.1 time: 0.457627 May 19 09:01:30.991586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4587/5912] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:30 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1279 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:31.001174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:31.002714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:31.011742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:31.012587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:31.013690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:31.014365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:31.321932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:31.341504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e6c26e2-1cee-42b4-8dd7-8739d213d25f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1373 microversion: 2.1 time: 0.346949 May 19 09:01:31.342446 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4588/5913] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:30 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1373 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:31.897127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0dafb2df-ec1e-45e5-bd5a-6003db473c38 req-d681e155-d264-49d7-a16b-18fea5d445eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f980ae-11b0-4211-8c58-8ad4eae9df67", "tag": "a0f64bbd-f462-401f-acc2-08d6eb2d5b57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:31.923461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0dafb2df-ec1e-45e5-bd5a-6003db473c38 req-d681e155-d264-49d7-a16b-18fea5d445eb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:31.924171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0dafb2df-ec1e-45e5-bd5a-6003db473c38 req-d681e155-d264-49d7-a16b-18fea5d445eb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:31.940342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0dafb2df-ec1e-45e5-bd5a-6003db473c38 req-d681e155-d264-49d7-a16b-18fea5d445eb service nova] Creating event network-changed:a0f64bbd-f462-401f-acc2-08d6eb2d5b57 for instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 on chh1-842464-2 May 19 09:01:31.945738 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0dafb2df-ec1e-45e5-bd5a-6003db473c38 req-d681e155-d264-49d7-a16b-18fea5d445eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327280 May 19 09:01:31.947711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4589/5914] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:01:31.996228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:31.997043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:32.014704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:32.015466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:32.016517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:32.017786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:32.283052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:32.297005 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36e011d6-50c1-4b84-ae01-33b281fccff3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.306242 May 19 09:01:32.310552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4590/5915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:31 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:32.359088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:32.359723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:32.368092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:32.368949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:32.370408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:32.371095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:32.903149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:32.912581 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3babb3e3-35e2-4c4c-a825-eb157c9b0a98 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1373 microversion: 2.1 time: 0.557790 May 19 09:01:32.914156 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4591/5916] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:32 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1373 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:33.318194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:33.319129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:33.326475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:33.327168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:33.328301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:33.329026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:33.602865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:33.611901 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e890e19-5843-4f71-9e0a-4875efa65dc6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.298136 May 19 09:01:33.623389 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4592/5917] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:33 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:33.942036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:33.942737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:33.961451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:33.962255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:33.963169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:33.963716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:34.113897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:34.138752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1dcde846-d401-44e0-8e69-348b7c25c854 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1373 microversion: 2.1 time: 0.212144 May 19 09:01:34.139570 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4593/5918] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:33 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:34.631055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:34.631422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:34.639396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:34.639948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:34.640818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:34.641369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:34.845237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:34.854752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49f4aaf4-1edd-4a01-a158-63c69d8c249c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.228447 May 19 09:01:34.865427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4594/5919] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:34 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:35.158152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:35.159915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:35.173652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:35.174448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:35.175321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:35.176267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:35.358078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:35.365700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce4abe3e-d31a-4d4a-ba37-c7c726670a4d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1373 microversion: 2.1 time: 0.213165 May 19 09:01:35.366273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4595/5920] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:35 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1373 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:35.873282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:35.873888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:35.880730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:35.881191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:35.882623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:35.883099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:36.059103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:36.068435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-321d9a35-6e8c-40f3-9c4c-eb2e214a6d58 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.199698 May 19 09:01:36.069409 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4596/5921] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:35 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:36.390837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:36.391642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:36.410191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:36.410811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:36.411728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:36.412287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:36.727411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:36.750133 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6149e302-5e49-4c2e-81f6-009de6355b42 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1373 microversion: 2.1 time: 0.362374 May 19 09:01:36.751214 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4597/5922] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:36 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1373 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:36.756499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-69ebe9f7-bf03-41e2-b9c6-866d639d963d req-4b52f4a8-4c0a-423f-8bfe-ac95ccd60f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f980ae-11b0-4211-8c58-8ad4eae9df67", "name": "network-vif-plugged", "status": "completed", "tag": "a0f64bbd-f462-401f-acc2-08d6eb2d5b57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:36.766057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-69ebe9f7-bf03-41e2-b9c6-866d639d963d req-4b52f4a8-4c0a-423f-8bfe-ac95ccd60f65 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:36.766836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-69ebe9f7-bf03-41e2-b9c6-866d639d963d req-4b52f4a8-4c0a-423f-8bfe-ac95ccd60f65 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:36.779502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-69ebe9f7-bf03-41e2-b9c6-866d639d963d req-4b52f4a8-4c0a-423f-8bfe-ac95ccd60f65 service nova] Creating event network-vif-plugged:a0f64bbd-f462-401f-acc2-08d6eb2d5b57 for instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 on chh1-842464-2 May 19 09:01:36.785203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-69ebe9f7-bf03-41e2-b9c6-866d639d963d req-4b52f4a8-4c0a-423f-8bfe-ac95ccd60f65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 May 19 09:01:36.797739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4598/5923] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:01:37.087332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:37.088180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:37.095532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:37.096080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:37.096946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:37.097500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:37.279396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:37.287652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5ef6a77-4cd6-4812-8945-b9cf387da80c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.204681 May 19 09:01:37.288839 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4599/5924] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:37 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:37.768375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:37.772393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:37.775776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:37.781918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:37.782461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:37.783543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:37.784075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:37.957346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:37.972173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:37.982958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50fbd767-a587-4693-9a7d-17772def9b4c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1373 microversion: 2.1 time: 0.218651 May 19 09:01:37.983567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4600/5925] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:37 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:38.304155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:38.305026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:38.307629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:38.314317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:38.314925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:38.315973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:38.316525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:38.471228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:38.479994 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a829452-c2c6-44fe-8973-5dbb74d99ed0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.179681 May 19 09:01:38.480667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4601/5926] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:38 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:39.000267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:39.001799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:39.010819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:39.011549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:39.012724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:39.013407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:39.182478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:39.191792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abddaa47-eff2-4261-8239-69e108cff61d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1544 microversion: 2.1 time: 0.195330 May 19 09:01:39.192415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4602/5927] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:38 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1544 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:39.209182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:39.209890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:39.216670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:39.217143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:39.217973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:39.218682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:39.710149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:39.720261 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89afe464-9274-4e3c-ace3-ab524ce61c10 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1544 microversion: 2.1 time: 0.515069 May 19 09:01:39.721109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4603/5928] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:39 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1544 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:39.728407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:39.729050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:39.740446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:39.740999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:39.742285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:39.742904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:39.952468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:39.961639 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-901f7d21-c54a-4994-a7de-78ca08ef73af tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.237706 May 19 09:01:39.962582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4604/5929] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:39 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:40.980237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:40.981016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:40.994063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:40.995437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:40.998751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:41.001421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:41.203703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:41.215170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20c1efc4-6345-480d-84e8-4486b93fede2 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.239194 May 19 09:01:41.225720 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4605/5930] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:40 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:01:42.135756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-41ab6c92-acb7-404e-b48d-bf951aca7d8f req-239e5913-1cad-4d6b-9b5a-f3dee09738b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a21d49-63e9-4c4b-9d89-0d8d539eb404", "name": "network-vif-plugged", "status": "completed", "tag": "62e99169-ad1f-4d8f-a073-05fcb9ca4ead"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:42.185772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-41ab6c92-acb7-404e-b48d-bf951aca7d8f req-239e5913-1cad-4d6b-9b5a-f3dee09738b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:42.187929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-41ab6c92-acb7-404e-b48d-bf951aca7d8f req-239e5913-1cad-4d6b-9b5a-f3dee09738b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:42.224580 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-41ab6c92-acb7-404e-b48d-bf951aca7d8f req-239e5913-1cad-4d6b-9b5a-f3dee09738b7 service nova] Creating event network-vif-plugged:62e99169-ad1f-4d8f-a073-05fcb9ca4ead for instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 on chh2-842464-2 May 19 09:01:42.265706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-41ab6c92-acb7-404e-b48d-bf951aca7d8f req-239e5913-1cad-4d6b-9b5a-f3dee09738b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136212 May 19 09:01:42.277333 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4606/5931] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:01:42.440220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ad628625-f01b-402d-9763-ca58eededee8 req-5853a059-06c4-459f-9db6-0fcdc3a0ee02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f980ae-11b0-4211-8c58-8ad4eae9df67", "tag": "a0f64bbd-f462-401f-acc2-08d6eb2d5b57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:42.459740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ad628625-f01b-402d-9763-ca58eededee8 req-5853a059-06c4-459f-9db6-0fcdc3a0ee02 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:42.461070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ad628625-f01b-402d-9763-ca58eededee8 req-5853a059-06c4-459f-9db6-0fcdc3a0ee02 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:42.478455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ad628625-f01b-402d-9763-ca58eededee8 req-5853a059-06c4-459f-9db6-0fcdc3a0ee02 service nova] Creating event network-changed:a0f64bbd-f462-401f-acc2-08d6eb2d5b57 for instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 on chh1-842464-2 May 19 09:01:42.489230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ad628625-f01b-402d-9763-ca58eededee8 req-5853a059-06c4-459f-9db6-0fcdc3a0ee02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210081 May 19 09:01:42.490497 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4607/5932] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:01:42.505010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:42.506028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:42.517157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:42.518011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:42.519238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:42.519887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:42.887579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:42.896718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17e4ba37-cdb4-436c-8683-b5ea9d38ff64 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1267 microversion: 2.1 time: 0.396298 May 19 09:01:42.900341 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4608/5933] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:42 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1267 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:43.923307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:43.925112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:43.943155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:01:43.963054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:43.963515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:43.964307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:43.964897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:44.203827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:44.213623 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c762c53-abd3-42eb-90ef-e9988b1a9e21 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1455 microversion: 2.1 time: 0.294695 May 19 09:01:44.214441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4609/5934] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:43 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1455 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:44.231667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:01:44.232389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:01:44.239117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:44.240171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:44.242011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:44.242529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:44.431337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:01:44.442280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e8385d4-e6dc-4406-b1ed-d2f24649b801 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1455 microversion: 2.1 time: 0.214737 May 19 09:01:44.443129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4610/5935] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:01:44 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1455 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:01:46.613042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a3b93311-f627-48a2-8647-d34aeec17add req-3625e768-2df5-41cd-b584-13db3d1e7cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a21d49-63e9-4c4b-9d89-0d8d539eb404", "tag": "62e99169-ad1f-4d8f-a073-05fcb9ca4ead"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:01:46.651169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a3b93311-f627-48a2-8647-d34aeec17add req-3625e768-2df5-41cd-b584-13db3d1e7cce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:01:46.651661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a3b93311-f627-48a2-8647-d34aeec17add req-3625e768-2df5-41cd-b584-13db3d1e7cce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:01:46.665953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a3b93311-f627-48a2-8647-d34aeec17add req-3625e768-2df5-41cd-b584-13db3d1e7cce service nova] Creating event network-changed:62e99169-ad1f-4d8f-a073-05fcb9ca4ead for instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 on chh2-842464-2 May 19 09:01:46.671757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a3b93311-f627-48a2-8647-d34aeec17add req-3625e768-2df5-41cd-b584-13db3d1e7cce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062301 May 19 09:01:46.672298 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4611/5936] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:02.924910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:02.925984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:02.932914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=5 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:02.934206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=54 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:02.936902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:02.937539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:02.938786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:02.939277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:02.999692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c662f0e-3c82-42f6-8e79-3242b16e8ebb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67/action" status: 200 len: 24568 microversion: 2.1 time: 0.078864 May 19 09:02:03.007011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4612/5937] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:02:02 2022] POST /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67/action => generated 24568 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 09:02:07.016350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1781604747", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b1a925e0-159d-439a-816e-851d37eedc1d"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:07.083910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] validate_networks() for [('b1a925e0-159d-439a-816e-851d37eedc1d', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:02:07.521169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:02:07.522292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:02:07.525571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:02:07.526001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:02:07.526632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:02:07.539265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:07.539735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:07.540550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:07.541005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:07.559825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Getting quotas for project ca2214b6715b4cdcabcc3102b6c58835. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:02:07.565523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Getting quotas for user 8db971a5fd31403fad13c7afd7556c1e and project ca2214b6715b4cdcabcc3102b6c58835. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:02:07.579252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:02:07.581841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:02:07.638423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-205875d8-07df-4fff-ab83-7f4b94996e63 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626866 May 19 09:02:07.638656 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4613/5938] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:02:07.649865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd36eb6a-e0c8-4289-9c99-352a86229737 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:07.650416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd36eb6a-e0c8-4289-9c99-352a86229737 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:07.717614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd36eb6a-e0c8-4289-9c99-352a86229737 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:07.725054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd36eb6a-e0c8-4289-9c99-352a86229737 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1214 microversion: 2.1 time: 0.079867 May 19 09:02:07.734934 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4614/5939] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:07 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:08.743314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:08.744365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:08.751127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:08.751754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:08.760201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:08.760746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:08.891763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:08.905613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5197a536-5c79-4060-aad4-d1b373967220 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1274 microversion: 2.1 time: 0.166998 May 19 09:02:08.907220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4615/5940] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:08 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:09.924614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:09.925488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:09.934354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:09.934968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:09.935850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:09.936556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:10.179845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:10.188933 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-325cae6f-ff67-416b-be63-31c13c33b155 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.268696 May 19 09:02:10.189563 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4616/5941] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:09 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:10.564114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-19018847-46c1-4693-bef6-2a2bec35f828 req-63ea333e-2e2a-44cc-a7ba-38c37eaf76b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c93e87-22d4-4676-94bb-c20fc007592c", "tag": "e452fbef-a8ae-4614-9c9d-b30f5bdbaae0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:10.580517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-19018847-46c1-4693-bef6-2a2bec35f828 req-63ea333e-2e2a-44cc-a7ba-38c37eaf76b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:10.581434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-19018847-46c1-4693-bef6-2a2bec35f828 req-63ea333e-2e2a-44cc-a7ba-38c37eaf76b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:10.593743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-19018847-46c1-4693-bef6-2a2bec35f828 req-63ea333e-2e2a-44cc-a7ba-38c37eaf76b7 service nova] Creating event network-changed:e452fbef-a8ae-4614-9c9d-b30f5bdbaae0 for instance 46c93e87-22d4-4676-94bb-c20fc007592c on chh2-842464-2 May 19 09:02:10.598908 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-19018847-46c1-4693-bef6-2a2bec35f828 req-63ea333e-2e2a-44cc-a7ba-38c37eaf76b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038317 May 19 09:02:10.600350 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4617/5942] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:11.209690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:11.210531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:11.217178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:11.217663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:11.218719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:11.219204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:11.381833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:11.389801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7a37881-eb8f-4f07-8c2d-9ad3d18f0c98 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.185941 May 19 09:02:11.390399 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4618/5943] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:11 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:12.407244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:12.408296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:12.420773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:12.421299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:12.422222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:12.422864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:12.569549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:12.581930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6b861d5-e0ee-4e02-bec0-5a6739d47ed0 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.178793 May 19 09:02:12.589558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4619/5944] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:12 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:13.602738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:13.603620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:13.611369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:13.611838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:13.612789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:13.613252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:13.808970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:13.821626 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c1e6114-00d4-4b12-ad6b-f31d540903b5 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.223808 May 19 09:02:13.822989 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4620/5945] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:13 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:14.840380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:14.841700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:14.850136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:14.850535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:14.851497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:14.852035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:15.010155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:15.019092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8c10e53-4d6b-4502-b883-53a143c878b4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.183308 May 19 09:02:15.025569 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4621/5946] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:14 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:16.037449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:16.038379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:16.046589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:16.047155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:16.048101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:16.048639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:16.291920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:16.300216 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7e21eea-af57-4b91-8ca6-167bd3c05f13 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.267257 May 19 09:02:16.300897 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4622/5947] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:16 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:16.306708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a3ac7fa9-7fa2-45b4-a735-0ed4667dce82 req-11bc9327-bede-4d06-9145-b06bee50f9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c93e87-22d4-4676-94bb-c20fc007592c", "name": "network-vif-plugged", "status": "completed", "tag": "e452fbef-a8ae-4614-9c9d-b30f5bdbaae0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:16.320788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a3ac7fa9-7fa2-45b4-a735-0ed4667dce82 req-11bc9327-bede-4d06-9145-b06bee50f9ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:16.321500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a3ac7fa9-7fa2-45b4-a735-0ed4667dce82 req-11bc9327-bede-4d06-9145-b06bee50f9ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:16.349850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a3ac7fa9-7fa2-45b4-a735-0ed4667dce82 req-11bc9327-bede-4d06-9145-b06bee50f9ee service nova] Creating event network-vif-plugged:e452fbef-a8ae-4614-9c9d-b30f5bdbaae0 for instance 46c93e87-22d4-4676-94bb-c20fc007592c on chh2-842464-2 May 19 09:02:16.362329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a3ac7fa9-7fa2-45b4-a735-0ed4667dce82 req-11bc9327-bede-4d06-9145-b06bee50f9ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059677 May 19 09:02:16.362977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4623/5948] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:17.320814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:17.322575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:17.330424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:17.331217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:17.332229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:17.332892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:17.541107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:17.547992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:17.552153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e735d8a-1892-4fd1-b801-d03c4c1f7645 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1314 microversion: 2.1 time: 0.238086 May 19 09:02:17.553102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4624/5949] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:17 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:17.909260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:17.909821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:17.912934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:17.920084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:17.921248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:17.922296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:17.922905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:18.075966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lazy-loading 'services' on Instance uuid 69ccf3ba-d4a3-45eb-a726-371cc8db98ae {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:02:18.197663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69393332-3dbf-40ba-9fdf-0ed39c1b5bb4 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae/os-volume_attachments/63cc79f9-af7f-4559-8a2c-4429de2d9190" status: 202 len: 0 microversion: 2.1 time: 0.299313 May 19 09:02:18.215350 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4625/5950] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:02:17 2022] DELETE /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae/os-volume_attachments/63cc79f9-af7f-4559-8a2c-4429de2d9190 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:02:18.233130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b17c1e97-262d-4332-87d4-4151ebbc2da2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'create', calling method: .version_select at 0x7f32103b5af0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2046943854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeHwfEhNzCMGJBUJGgwUD7FRdAPtSUcnUeP/n6p1zIObDTBj3yCKRcaWRBrkw7gCafpBsR4ue9/PPxWBQZqVmJStCfZlbO/78snmRq5KJIudIrVVb6pmBk06VKNS0dW8g=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:18.306238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b17c1e97-262d-4332-87d4-4151ebbc2da2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for project 76f10af0529347f889780b97a0116150. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:02:18.326110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-b17c1e97-262d-4332-87d4-4151ebbc2da2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for user 34ddb36c721e46a7bb9f7cf32a7dc662 and project 76f10af0529347f889780b97a0116150. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:02:18.366259 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b17c1e97-262d-4332-87d4-4151ebbc2da2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.146321 May 19 09:02:18.367540 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4626/5951] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:02:18 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:18.569191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:18.570074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:18.579358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:18.579829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:18.580629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:18.581085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:18.843050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:18.853958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e51364eb-f94c-40eb-a9cd-d9f9687b269a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1498 microversion: 2.1 time: 0.288893 May 19 09:02:18.856374 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4627/5952] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:18 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1498 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:19.788471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:19.799745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:19.826836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:19.828157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:19.829954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:19.830445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:19.864100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:02:19.989028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b98fb543-52a3-4ab8-b34a-0b74c66847e2 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "DELETE /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 204 len: 0 microversion: 2.1 time: 0.205394 May 19 09:02:19.990103 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4628/5953] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:02:19 2022] DELETE /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:02:20.008896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:20.010055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:20.023865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:20.024328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:20.025146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:20.026044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:20.198739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:20.206877 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-564af9ef-0e9c-458d-b805-566675955c46 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1504 microversion: 2.1 time: 0.207505 May 19 09:02:20.207568 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4629/5954] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:19 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:20.222237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1416379278", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "21e6bdcd-04eb-4ff9-8db6-6d0f549b5f69"}], "key_name": "tempest-TestNetworkBasicOps-2046943854", "security_groups": [{"name": "tempest-secgroup-smoke-1157480717"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:20.341584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] validate_networks() for [('21e6bdcd-04eb-4ff9-8db6-6d0f549b5f69', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:02:20.865984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:02:20.867394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:02:20.868116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:02:20.868768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:02:20.869441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:02:20.884985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:20.886136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:20.887337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:20.887796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:20.911017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for project 76f10af0529347f889780b97a0116150. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:02:20.919115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for user 34ddb36c721e46a7bb9f7cf32a7dc662 and project 76f10af0529347f889780b97a0116150. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:02:20.936445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:02:20.938995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:02:20.996050 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67f48c36-de6e-4a30-946c-ddffe2ad7e9e tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777889 May 19 09:02:20.996816 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4630/5955] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:02:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:02:21.008729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77dcec5b-b1b7-4d68-ad76-ec70c122a45c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:21.009410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77dcec5b-b1b7-4d68-ad76-ec70c122a45c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:21.073053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77dcec5b-b1b7-4d68-ad76-ec70c122a45c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:21.082340 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77dcec5b-b1b7-4d68-ad76-ec70c122a45c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1249 microversion: 2.1 time: 0.079130 May 19 09:02:21.082940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4631/5956] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:21 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:21.224580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:21.225703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:21.235205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:21.235674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:21.236580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:21.237034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:21.242594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:21.499104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:21.508671 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c06317b9-d7bb-4a11-a473-269745e125e4 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1504 microversion: 2.1 time: 0.288174 May 19 09:02:21.513700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4632/5957] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:21 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:22.017154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-942bfd3c-a558-4baf-93fb-0e0f7f3ba1f2 req-1907a4bd-0e5c-4945-9e81-20a04d4be998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c93e87-22d4-4676-94bb-c20fc007592c", "name": "network-vif-deleted", "tag": "e452fbef-a8ae-4614-9c9d-b30f5bdbaae0"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:22.028689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-942bfd3c-a558-4baf-93fb-0e0f7f3ba1f2 req-1907a4bd-0e5c-4945-9e81-20a04d4be998 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:22.029139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-942bfd3c-a558-4baf-93fb-0e0f7f3ba1f2 req-1907a4bd-0e5c-4945-9e81-20a04d4be998 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:22.045131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-942bfd3c-a558-4baf-93fb-0e0f7f3ba1f2 req-1907a4bd-0e5c-4945-9e81-20a04d4be998 service nova] Creating event network-vif-deleted:e452fbef-a8ae-4614-9c9d-b30f5bdbaae0 for instance 46c93e87-22d4-4676-94bb-c20fc007592c on chh2-842464-2 May 19 09:02:22.050733 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-942bfd3c-a558-4baf-93fb-0e0f7f3ba1f2 req-1907a4bd-0e5c-4945-9e81-20a04d4be998 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037928 May 19 09:02:22.051365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4633/5958] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:22.102818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:22.103638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:22.118708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:22.119299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:22.120189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:22.123048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:22.276294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:22.288743 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ebf63f4-435c-447c-8ed4-2ce736b0c445 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1301 microversion: 2.1 time: 0.190631 May 19 09:02:22.289758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4634/5959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:22 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1301 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:22.534519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:22.535688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:22.547523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:22.548848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:22.550047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:22.550603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:22.590710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:22.600148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:22.600741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:22.601479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lazy-loading 'fault' on Instance uuid 46c93e87-22d4-4676-94bb-c20fc007592c {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:02:22.677508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:22.694348 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ebdc506c-184a-4e11-8c57-9fc175b3a283 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 200 len: 1304 microversion: 2.1 time: 0.166227 May 19 09:02:22.703433 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4635/5960] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:22 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 1304 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:23.308254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:23.309389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:23.317125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:23.317634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:23.319124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:23.319666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:23.414966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:23.425103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d9377a8-e487-4a98-8b30-cfe90932d938 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1307 microversion: 2.1 time: 0.121258 May 19 09:02:23.438001 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4636/5961] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:23 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:23.718318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:23.719795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 46c93e87-22d4-4676-94bb-c20fc007592c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:23.731330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:23.732366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:23.733700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:23.734790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:23.761662 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] HTTP exception thrown: Instance 46c93e87-22d4-4676-94bb-c20fc007592c could not be found. May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Request method failure captured: May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c HTTP/1.1 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgeMjAdMPOUsxbK77HQ9kT7ezbZIuXZxPLYuMaHzrmQr1h7X3jkRKqEy31keU_dZMxNQwoCgUhLoK6Hd_EI3fSM1zZemtb-NCvfUcbA2NViVKrM2oC7BCB3FG5QC9VE1Sf7kJmJJf_CHV44-cRM27N8AVIS1hDNr00belE0llvQvPwU May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ca2214b6715b4cdcabcc3102b6c58835 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesActionsTest-782731387 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesActionsTest-782731387 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ca2214b6715b4cdcabcc3102b6c58835 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesActionsTest-782731387 May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesActionsTest-782731387-project May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8db971a5fd31403fad13c7afd7556c1e May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesActionsTest-782731387-project May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 46c93e87-22d4-4676-94bb-c20fc007592c could not be found. May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '46c93e87-22d4-4676-94bb-c20fc007592c'} May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c93e87-22d4-4676-94bb-c20fc007592c could not be found. May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c93e87-22d4-4676-94bb-c20fc007592c could not be found. May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:02:23.764078 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c93e87-22d4-4676-94bb-c20fc007592c could not be found. May 19 09:02:23.770201 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:23.773324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Returning 404 to user: Instance 46c93e87-22d4-4676-94bb-c20fc007592c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:02:23.774973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b454099f-bf46-463a-8d63-88e095cefe59 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c" status: 404 len: 111 microversion: 2.1 time: 0.066075 May 19 09:02:23.788746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4637/5962] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:23 2022] GET /compute/v2.1/servers/46c93e87-22d4-4676-94bb-c20fc007592c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:02:23.854639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-387417451", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b1a925e0-159d-439a-816e-851d37eedc1d"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:23.947347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] validate_networks() for [('b1a925e0-159d-439a-816e-851d37eedc1d', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:02:24.618731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:02:24.619412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:02:24.619684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:02:24.620260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:02:24.620993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:02:24.639187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:24.640188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:24.641608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:24.642456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:24.667922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Getting quotas for project ca2214b6715b4cdcabcc3102b6c58835. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:02:24.674888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Getting quotas for user 8db971a5fd31403fad13c7afd7556c1e and project ca2214b6715b4cdcabcc3102b6c58835. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:02:24.700143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:02:24.704981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:02:24.792782 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9f5fd75-10f4-47c0-a32b-3529a0fd54a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953187 May 19 09:02:24.801485 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4638/5963] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:02:24.811086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:24.812151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:24.821836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:24.822304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:24.823120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:24.823585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:25.181051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:25.195983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7422f7e-3a61-4694-8fd4-b129d452a39b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.393075 May 19 09:02:25.197143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4639/5964] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:24 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:25.206387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9a3baa8-20a4-4b86-bc64-85cd7f93c3a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:25.210562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e9a3baa8-20a4-4b86-bc64-85cd7f93c3a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:25.302181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e9a3baa8-20a4-4b86-bc64-85cd7f93c3a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:25.310920 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9a3baa8-20a4-4b86-bc64-85cd7f93c3a7 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1213 microversion: 2.1 time: 0.110201 May 19 09:02:25.311878 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4640/5965] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:25 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:25.330112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4473e03c-26d0-4950-8868-58e27dad013a req-4493f281-014a-4009-b032-bf6aa8a3131c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3e514e-672d-4d54-9dbe-eedfe8dc5094", "tag": "1ef37677-8f2d-4945-a4ab-662549f33337"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:25.344802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4473e03c-26d0-4950-8868-58e27dad013a req-4493f281-014a-4009-b032-bf6aa8a3131c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:25.345290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4473e03c-26d0-4950-8868-58e27dad013a req-4493f281-014a-4009-b032-bf6aa8a3131c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:25.358618 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4473e03c-26d0-4950-8868-58e27dad013a req-4493f281-014a-4009-b032-bf6aa8a3131c service nova] Creating event network-changed:1ef37677-8f2d-4945-a4ab-662549f33337 for instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 on chh1-842464-2 May 19 09:02:25.366034 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4473e03c-26d0-4950-8868-58e27dad013a req-4493f281-014a-4009-b032-bf6aa8a3131c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041277 May 19 09:02:25.366923 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4641/5966] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:26.215315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:26.216910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:26.225663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:26.226511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:26.228301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:26.228967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:26.506350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:26.517131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b5700f8-98e7-46d6-be55-5298fb57e261 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.306164 May 19 09:02:26.517860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4642/5967] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:26 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:26.523497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:26.524629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:26.532586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:26.533442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:26.534661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:26.535088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:26.682426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:26.691798 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4e9cf6e-86bf-448a-8cc8-e1d54a2e8cab tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1271 microversion: 2.1 time: 0.172563 May 19 09:02:26.692640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4643/5968] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:26 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:27.535945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:27.538166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:27.548126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:27.548835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:27.549862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:27.550500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:27.827562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:27.836702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04643b2b-b9ed-4129-9666-d609a4d35a14 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.305321 May 19 09:02:27.837687 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4644/5969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:27 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:27.843044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:27.844369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:27.860863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:27.861633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:27.862456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:27.863010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:28.088755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:28.097977 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46dd5b88-8d5a-4e0c-b3a3-0beba5a09424 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.258950 May 19 09:02:28.099524 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4645/5970] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:27 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:28.429952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fa4d2796-650e-4163-a234-c9bf1a1675b6 req-7513a3fe-2dda-494a-bb1c-10d9cddd71d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f8d6304-a6b6-445d-9d75-1aa6c616df90", "tag": "fb3da8c1-3d8a-443d-be3e-578208b82d54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:28.441330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fa4d2796-650e-4163-a234-c9bf1a1675b6 req-7513a3fe-2dda-494a-bb1c-10d9cddd71d0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:28.441914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fa4d2796-650e-4163-a234-c9bf1a1675b6 req-7513a3fe-2dda-494a-bb1c-10d9cddd71d0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:28.456573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fa4d2796-650e-4163-a234-c9bf1a1675b6 req-7513a3fe-2dda-494a-bb1c-10d9cddd71d0 service nova] Creating event network-changed:fb3da8c1-3d8a-443d-be3e-578208b82d54 for instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 on chh2-842464-2 May 19 09:02:28.462713 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fa4d2796-650e-4163-a234-c9bf1a1675b6 req-7513a3fe-2dda-494a-bb1c-10d9cddd71d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038294 May 19 09:02:28.463584 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4646/5971] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:02:28.856163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:28.857711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:28.865710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:28.866582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:28.867977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:28.868635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:29.055990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:29.064260 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7bbedadc-d900-4481-b25e-8e009e81464b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.213356 May 19 09:02:29.064857 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4647/5972] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:28 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:29.127363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:29.128113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:29.135866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:29.136423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:29.137285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:29.137778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:29.305564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:29.315028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62ef2e3e-2b71-4bb8-b771-22662ff85e4d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.191623 May 19 09:02:29.316618 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4648/5973] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:29 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:30.082629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:30.084518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:30.092201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.092919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.093763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.094216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.324357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:30.332711 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dad885a4-2040-4ff3-a1fc-1a73b32c0ee3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.253757 May 19 09:02:30.333477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4649/5974] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:30 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:30.338419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:30.339016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:30.346037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.346521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.347401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.347857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.378326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:02:30.476807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4364d0ac-7e27-4dea-b2be-41f2ab52dae8 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 204 len: 0 microversion: 2.1 time: 0.141994 May 19 09:02:30.477558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4650/5975] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:02:30 2022] DELETE /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:02:30.484871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:30.485608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:30.491875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.492366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.493152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.493626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.497825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:30.648749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:30.656864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-981fa213-9eb0-472f-a9f6-1f162658a68a tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.177795 May 19 09:02:30.657814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4651/5976] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:30 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:30.672611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:30.673243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:30.680874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.681372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.682164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.682620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.843638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:30.852746 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdae1f08-6c13-43f0-ab68-de41c3f97472 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1470 microversion: 2.1 time: 0.184680 May 19 09:02:30.853357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4652/5977] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:30 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:30.863944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-44539023-12e1-48bb-9e0b-86192488a99b req-c2c8737a-406f-4615-8eab-959853a98e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3e514e-672d-4d54-9dbe-eedfe8dc5094", "name": "network-vif-plugged", "status": "completed", "tag": "1ef37677-8f2d-4945-a4ab-662549f33337"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:30.872803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-44539023-12e1-48bb-9e0b-86192488a99b req-c2c8737a-406f-4615-8eab-959853a98e97 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:30.873256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-44539023-12e1-48bb-9e0b-86192488a99b req-c2c8737a-406f-4615-8eab-959853a98e97 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:30.885992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-44539023-12e1-48bb-9e0b-86192488a99b req-c2c8737a-406f-4615-8eab-959853a98e97 service nova] Creating event network-vif-plugged:1ef37677-8f2d-4945-a4ab-662549f33337 for instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 on chh1-842464-2 May 19 09:02:30.890954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-44539023-12e1-48bb-9e0b-86192488a99b req-c2c8737a-406f-4615-8eab-959853a98e97 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036478 May 19 09:02:30.891553 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4653/5978] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:31.352075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:31.352792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:31.359129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:31.359598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:31.360383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:31.360837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:31.505478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:31.513543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ca8415e-78f9-4d12-9f6b-1998256bc386 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.166622 May 19 09:02:31.514123 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4654/5979] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:31 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:31.680463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:31.681183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:31.688172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:31.688641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:31.689454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:31.689903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:31.885773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:31.893703 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de4c6a99-ac0f-4ee8-bb25-a1af5e5bc722 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.218028 May 19 09:02:31.894289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4655/5980] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:31 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:31.899413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:31.900033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:31.910148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:31.910148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:31.910148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:31.910148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:32.051067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:32.059790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c88ce82f-0757-4e27-977c-052be1ef924d tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1470 microversion: 2.1 time: 0.164480 May 19 09:02:32.060441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4656/5981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:31 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:32.531505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:32.532412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:32.544710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:32.545441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:32.546496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:32.546960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.114350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:33.126227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd86fb42-eb93-449d-bd3f-04387c9f8da0 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1375 microversion: 2.1 time: 0.598629 May 19 09:02:33.127318 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4657/5982] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:32 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1375 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:33.142760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:33.143394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:33.153517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:33.153994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.155165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:33.155485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.311430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:33.329400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f143dcf8-47e6-462f-8745-9426adea749e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.200866 May 19 09:02:33.330004 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4658/5983] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:33 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:33.335053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-29bdb35d-6dee-49a5-8031-82bf45e1fa1a req-635d9297-0447-4131-b02c-899fb39013fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ccf3ba-d4a3-45eb-a726-371cc8db98ae", "name": "network-vif-deleted", "tag": "db6c9b0f-08b1-4ed2-80ad-a414412c6ce3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:33.343444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29bdb35d-6dee-49a5-8031-82bf45e1fa1a req-635d9297-0447-4131-b02c-899fb39013fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:33.343894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-29bdb35d-6dee-49a5-8031-82bf45e1fa1a req-635d9297-0447-4131-b02c-899fb39013fa service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.356732 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-29bdb35d-6dee-49a5-8031-82bf45e1fa1a req-635d9297-0447-4131-b02c-899fb39013fa service nova] Creating event network-vif-deleted:db6c9b0f-08b1-4ed2-80ad-a414412c6ce3 for instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae on chh1-842464-2 May 19 09:02:33.362892 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-29bdb35d-6dee-49a5-8031-82bf45e1fa1a req-635d9297-0447-4131-b02c-899fb39013fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 May 19 09:02:33.363863 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4659/5984] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:33.371645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:33.372697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:33.380394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:33.380505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.381277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:33.381749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.420519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:33.420982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:33.421586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lazy-loading 'fault' on Instance uuid 69ccf3ba-d4a3-45eb-a726-371cc8db98ae {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:02:33.466565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223132e91fc044f0a61836763b722ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fcc89725fe4df8a0c478348bd6dcad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:33.478759 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05d776f3-4314-48d6-b27d-7614160c0324 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 200 len: 1304 microversion: 2.1 time: 0.112869 May 19 09:02:33.479368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4660/5985] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:33 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:34.144033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:34.144705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:34.153120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.153673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.154500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.154958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.314157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:34.324016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-327dc0ba-221c-4708-9c30-46979d05093d tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1548 microversion: 2.1 time: 0.183813 May 19 09:02:34.324827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4661/5986] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:34 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1548 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:34.330555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-317cc75f-e8d8-4f65-92a8-40eb395367e3 req-2cdb28f2-d3a5-43f6-8e5d-36fb8bf8ea9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8d6304-a6b6-445d-9d75-1aa6c616df90", "name": "network-vif-plugged", "status": "completed", "tag": "fb3da8c1-3d8a-443d-be3e-578208b82d54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:34.340888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-317cc75f-e8d8-4f65-92a8-40eb395367e3 req-2cdb28f2-d3a5-43f6-8e5d-36fb8bf8ea9f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.341460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-317cc75f-e8d8-4f65-92a8-40eb395367e3 req-2cdb28f2-d3a5-43f6-8e5d-36fb8bf8ea9f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.354010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-317cc75f-e8d8-4f65-92a8-40eb395367e3 req-2cdb28f2-d3a5-43f6-8e5d-36fb8bf8ea9f service nova] Creating event network-vif-plugged:fb3da8c1-3d8a-443d-be3e-578208b82d54 for instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 on chh2-842464-2 May 19 09:02:34.365527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-317cc75f-e8d8-4f65-92a8-40eb395367e3 req-2cdb28f2-d3a5-43f6-8e5d-36fb8bf8ea9f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038802 May 19 09:02:34.366161 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4662/5987] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:34.371336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:34.372208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:34.379379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.379379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.380545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.380998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.595285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:34.608248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43846d6f-077c-4931-b99f-63a3439128f9 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1548 microversion: 2.1 time: 0.240496 May 19 09:02:34.608800 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4663/5988] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:34 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:34.615404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:34.615739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:34.623000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.623882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.624916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.625283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.653697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:34.790046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:34.800473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ceff6ebe-51b8-4898-8448-802e52778a92 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.190340 May 19 09:02:34.801361 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4664/5989] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:34 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:34.808001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:34.808702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] [instance: 69ccf3ba-d4a3-45eb-a726-371cc8db98ae] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:34.816568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.817428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.818430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:34.819008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:34.836386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] HTTP exception thrown: Instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae could not be found. May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Request method failure captured: May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae HTTP/1.1 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgcVInHDlY4a79NCztPyO3y7bjkYsSVvBt-3uFUiJnNaEPXX8EwSiWTYo_9smWkEU6U8ur7-xMWn847xUgILeMGYkPR68NtgthgjJLPqMPEefJ9Olfz1diSJro5kb5sQHGdjlfq5nwqYqwCI4Z0YlAoT7_tJ7q9tR2hj-wMfid9s8M8 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a2fcc89725fe4df8a0c478348bd6dcad May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesBackupsTest-1832409042 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2fcc89725fe4df8a0c478348bd6dcad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2fcc89725fe4df8a0c478348bd6dcad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2fcc89725fe4df8a0c478348bd6dcad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2fcc89725fe4df8a0c478348bd6dcad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesBackupsTest-1832409042 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a2fcc89725fe4df8a0c478348bd6dcad May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesBackupsTest-1832409042 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesBackupsTest-1832409042-project May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 223132e91fc044f0a61836763b722ce3 May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesBackupsTest-1832409042-project May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae could not be found. May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '69ccf3ba-d4a3-45eb-a726-371cc8db98ae'} May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae could not be found. May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae could not be found. May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:02:34.838618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae could not be found. May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] Returning 404 to user: Instance 69ccf3ba-d4a3-45eb-a726-371cc8db98ae could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edf67a96-fa22-416d-91f6-698f7eab65c9 tempest-VolumesBackupsTest-1832409042 tempest-VolumesBackupsTest-1832409042-project] 10.222.0.78 "GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae" status: 404 len: 111 microversion: 2.1 time: 0.037256 May 19 09:02:34.843178 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4665/5990] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:34 2022] GET /compute/v2.1/servers/69ccf3ba-d4a3-45eb-a726-371cc8db98ae => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:02:35.821020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:35.822522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:35.826407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=20 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:35.833280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:35.834094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:35.835853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:35.835853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:36.121712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:36.130355 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad4af18e-ccf3-476b-8f18-1fcdd30a4d81 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1313 microversion: 2.1 time: 0.313599 May 19 09:02:36.140321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4666/5991] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:35 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:37.148822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:37.153195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:37.166056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:37.166908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:37.168590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:37.169578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:37.363310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:37.377077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-347da4c1-849c-4743-9d49-e2d74a71054e tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1496 microversion: 2.1 time: 0.233389 May 19 09:02:37.388808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4667/5992] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:37 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1496 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:37.963244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:37.963767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:37.971664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:37.972123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:37.972919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:37.973435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:38.006094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:02:38.065872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:38.106947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adf11011-d855-4519-b5bc-2582cb02947d tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 204 len: 0 microversion: 2.1 time: 0.154887 May 19 09:02:38.107922 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4668/5993] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:02:37 2022] DELETE /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:02:38.117545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:38.126524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:38.141666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:38.142501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:38.143893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:38.144719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:38.317252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:38.327337 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4dd532d-bae3-4ddb-88eb-2e4f345243cf tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1502 microversion: 2.1 time: 0.214440 May 19 09:02:38.328443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4669/5994] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:38 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:39.345339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:39.346800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:39.351903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:02:39.357215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:39.357973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:39.358970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:39.359712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:39.522417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:39.531629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8443147f-559d-4587-920d-7c5e0f541097 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1502 microversion: 2.1 time: 0.190785 May 19 09:02:39.532496 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4670/5995] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:39 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1502 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:02:40.358219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-79c0bb03-cab0-46f0-8642-c28a3e5655fe req-b2759739-4802-4974-ab11-fd55d5391347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f8d6304-a6b6-445d-9d75-1aa6c616df90", "name": "network-vif-deleted", "tag": "fb3da8c1-3d8a-443d-be3e-578208b82d54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:02:40.391340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-79c0bb03-cab0-46f0-8642-c28a3e5655fe req-b2759739-4802-4974-ab11-fd55d5391347 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:40.394545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-79c0bb03-cab0-46f0-8642-c28a3e5655fe req-b2759739-4802-4974-ab11-fd55d5391347 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:40.422267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-79c0bb03-cab0-46f0-8642-c28a3e5655fe req-b2759739-4802-4974-ab11-fd55d5391347 service nova] Creating event network-vif-deleted:fb3da8c1-3d8a-443d-be3e-578208b82d54 for instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 on chh2-842464-2 May 19 09:02:40.437444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-79c0bb03-cab0-46f0-8642-c28a3e5655fe req-b2759739-4802-4974-ab11-fd55d5391347 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087358 May 19 09:02:40.438084 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4671/5996] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:02:40.552062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:40.552455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:40.564260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:40.569397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:40.570791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:40.571466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:40.617449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:40.618184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:40.618831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lazy-loading 'fault' on Instance uuid 9f8d6304-a6b6-445d-9d75-1aa6c616df90 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:02:40.718121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db971a5fd31403fad13c7afd7556c1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca2214b6715b4cdcabcc3102b6c58835', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:02:40.732164 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-366cc269-34d3-4bfc-aaa7-cc03af74f4b8 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 200 len: 1303 microversion: 2.1 time: 0.184614 May 19 09:02:40.743344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4672/5997] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:40 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:02:41.751502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:02:41.753260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] [instance: 9f8d6304-a6b6-445d-9d75-1aa6c616df90] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:02:41.764048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:41.765362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:41.766705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:02:41.767704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:02:41.784040 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] HTTP exception thrown: Instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 could not be found. May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Request method failure captured: May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 HTTP/1.1 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgeMjAdMPOUsxbK77HQ9kT7ezbZIuXZxPLYuMaHzrmQr1h7X3jkRKqEy31keU_dZMxNQwoCgUhLoK6Hd_EI3fSM1zZemtb-NCvfUcbA2NViVKrM2oC7BCB3FG5QC9VE1Sf7kJmJJf_CHV44-cRM27N8AVIS1hDNr00belE0llvQvPwU May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: ca2214b6715b4cdcabcc3102b6c58835 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-VolumesActionsTest-782731387 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ca2214b6715b4cdcabcc3102b6c58835"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-VolumesActionsTest-782731387 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: ca2214b6715b4cdcabcc3102b6c58835 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-VolumesActionsTest-782731387 May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-VolumesActionsTest-782731387-project May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8db971a5fd31403fad13c7afd7556c1e May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-VolumesActionsTest-782731387-project May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 could not be found. May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9f8d6304-a6b6-445d-9d75-1aa6c616df90'} May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 could not be found. May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 could not be found. May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:02:41.786415 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 could not be found. May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] Returning 404 to user: Instance 9f8d6304-a6b6-445d-9d75-1aa6c616df90 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3b6d1db-c9c3-476d-9f8b-f19f42cb6916 tempest-VolumesActionsTest-782731387 tempest-VolumesActionsTest-782731387-project] 10.222.0.78 "GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90" status: 404 len: 111 microversion: 2.1 time: 0.041336 May 19 09:02:41.807758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4673/5998] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:02:41 2022] GET /compute/v2.1/servers/9f8d6304-a6b6-445d-9d75-1aa6c616df90 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:03:01.770538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:01.771256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:01.775218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:01.787855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:01.807303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:01.811038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:01.812219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:01.812904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:01.873110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:03:02.052726 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1a5622d-4569-4fac-a067-ce56db12c5d2 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 204 len: 0 microversion: 2.1 time: 0.290787 May 19 09:03:02.057170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4674/5999] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:03:01 2022] DELETE /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:03:02.064576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:02.068237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:02.079825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:02.080317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:02.083318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:02.084044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:02.321387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:02.331423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51b251f9-36c6-452e-b9ea-1f8124db5e79 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1554 microversion: 2.1 time: 0.272169 May 19 09:03:02.333533 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4675/6000] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:02 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1554 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:03.351606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:03.352287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:03.370272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:03.370751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:03.371625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:03.372086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:03.665926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:03.682137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e2986ee-57e3-418a-8b25-a07e3c8558c8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1554 microversion: 2.1 time: 0.331601 May 19 09:03:03.682813 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4676/6001] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:03 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1554 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:04.246890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-82bd3288-824a-48cb-96b1-0879eee2fb27 req-53f89569-5c2f-4a3c-9c40-450edae34015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3e514e-672d-4d54-9dbe-eedfe8dc5094", "name": "network-vif-deleted", "tag": "1ef37677-8f2d-4945-a4ab-662549f33337"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:04.260205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-82bd3288-824a-48cb-96b1-0879eee2fb27 req-53f89569-5c2f-4a3c-9c40-450edae34015 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:04.260674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-82bd3288-824a-48cb-96b1-0879eee2fb27 req-53f89569-5c2f-4a3c-9c40-450edae34015 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:04.293661 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-82bd3288-824a-48cb-96b1-0879eee2fb27 req-53f89569-5c2f-4a3c-9c40-450edae34015 service nova] Creating event network-vif-deleted:1ef37677-8f2d-4945-a4ab-662549f33337 for instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 on chh1-842464-2 May 19 09:03:04.299475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-82bd3288-824a-48cb-96b1-0879eee2fb27 req-53f89569-5c2f-4a3c-9c40-450edae34015 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056150 May 19 09:03:04.304522 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4677/6002] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:03:04.711227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:04.715079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:04.749183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:04.750466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:04.761855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:04.763197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:04.884298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:04.884962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:04.886248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lazy-loading 'fault' on Instance uuid 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:03:04.998443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:05.011282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a1f6458-4903-4f6d-98f5-67eb2fe50849 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 200 len: 1339 microversion: 2.1 time: 0.314057 May 19 09:03:05.023615 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4678/6003] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:04 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:06.032811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:06.034069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 1c3e514e-672d-4d54-9dbe-eedfe8dc5094] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:06.048996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:06.053182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:06.055459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:06.056517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:06.084404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] HTTP exception thrown: Instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 could not be found. May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Request method failure captured: May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 HTTP/1.1 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgdZ6Y4c6J8Qm5JE6Ok0xaMqt56v3qQmvh4zvKNAa1BTbh79wynMuVkX9Xbq0IAqvxfUOWJt1HyFAAIgQXP_er4xTGjFh5o7V6PNSjECv35AVqSHiVzXOwYa_v-_gk9AyBIhHFqTHur845sEfonzW0z6ZBFjFhKGfdwx-yTPU0qhU30 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 76f10af0529347f889780b97a0116150 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkBasicOps-1495837335 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/76f10af0529347f889780b97a0116150"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76f10af0529347f889780b97a0116150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_76f10af0529347f889780b97a0116150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76f10af0529347f889780b97a0116150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkBasicOps-1495837335 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 76f10af0529347f889780b97a0116150 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkBasicOps-1495837335 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkBasicOps-1495837335-project May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 34ddb36c721e46a7bb9f7cf32a7dc662 May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkBasicOps-1495837335-project May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 could not be found. May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '1c3e514e-672d-4d54-9dbe-eedfe8dc5094'} May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 could not be found. May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 could not be found. May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:03:06.087533 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 could not be found. May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Returning 404 to user: Instance 1c3e514e-672d-4d54-9dbe-eedfe8dc5094 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:03:06.091992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a6908cf-209f-45a4-b07b-beade51d5f2c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094" status: 404 len: 111 microversion: 2.1 time: 0.064559 May 19 09:03:06.098177 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4679/6004] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:06 2022] GET /compute/v2.1/servers/1c3e514e-672d-4d54-9dbe-eedfe8dc5094 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:03:06.374863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4454e992-cb3b-40a8-b6a1-15cf8555b7d3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '.version_select at 0x7f321043adc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:06.431926 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4454e992-cb3b-40a8-b6a1-15cf8555b7d3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2046943854" status: 202 len: 0 microversion: 2.1 time: 0.067677 May 19 09:03:06.436456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4680/6005] 10.222.0.78 () {58 vars in 1256 bytes} [Thu May 19 09:03:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2046943854 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:03:09.549094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:09.549804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:09.576814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:09.583923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:09.583923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:09.583923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:09.632211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:03:09.747778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ffdf066-14cf-4c2b-b899-b2e02cf6d910 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 204 len: 0 microversion: 2.1 time: 0.202293 May 19 09:03:09.749827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4681/6006] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:03:09 2022] DELETE /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:03:09.760008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4d5667a8-a753-426e-9cbf-37732e6e0b05 req-7cd0a56a-93f1-45df-bf66-09c8be573eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f980ae-11b0-4211-8c58-8ad4eae9df67", "tag": "a0f64bbd-f462-401f-acc2-08d6eb2d5b57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:09.769867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4d5667a8-a753-426e-9cbf-37732e6e0b05 req-7cd0a56a-93f1-45df-bf66-09c8be573eac service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:09.770627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4d5667a8-a753-426e-9cbf-37732e6e0b05 req-7cd0a56a-93f1-45df-bf66-09c8be573eac service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:09.783704 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4d5667a8-a753-426e-9cbf-37732e6e0b05 req-7cd0a56a-93f1-45df-bf66-09c8be573eac service nova] Creating event network-changed:a0f64bbd-f462-401f-acc2-08d6eb2d5b57 for instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 on chh1-842464-2 May 19 09:03:09.789796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4d5667a8-a753-426e-9cbf-37732e6e0b05 req-7cd0a56a-93f1-45df-bf66-09c8be573eac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038072 May 19 09:03:09.791086 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4682/6007] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:03:09.798215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:09.799817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:09.807951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:09.809085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:09.810167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:09.810787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:09.998362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:10.008585 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cc8e517-a103-408e-bdd4-52aa3b05f61a tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1669 microversion: 2.1 time: 0.215791 May 19 09:03:10.009817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4683/6008] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:09 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:11.028909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:11.030852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:11.058413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:11.058821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:11.059605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:11.060202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:11.564577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:11.578392 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e0c991c8-8814-419d-bb9e-0017e6935c85 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 200 len: 1669 microversion: 2.1 time: 0.553858 May 19 09:03:11.579000 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4684/6009] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:11 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 1669 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:12.110206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e0ce3784-efa7-437d-b94f-74555aea91e7 req-82d5286b-169b-4335-be55-a70a7a9f2ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f980ae-11b0-4211-8c58-8ad4eae9df67", "name": "network-vif-deleted", "tag": "a0f64bbd-f462-401f-acc2-08d6eb2d5b57"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:12.122603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e0ce3784-efa7-437d-b94f-74555aea91e7 req-82d5286b-169b-4335-be55-a70a7a9f2ec8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:12.123115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e0ce3784-efa7-437d-b94f-74555aea91e7 req-82d5286b-169b-4335-be55-a70a7a9f2ec8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:12.144133 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e0ce3784-efa7-437d-b94f-74555aea91e7 req-82d5286b-169b-4335-be55-a70a7a9f2ec8 service nova] Creating event network-vif-deleted:a0f64bbd-f462-401f-acc2-08d6eb2d5b57 for instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 on chh1-842464-2 May 19 09:03:12.150815 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e0ce3784-efa7-437d-b94f-74555aea91e7 req-82d5286b-169b-4335-be55-a70a7a9f2ec8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044669 May 19 09:03:12.154654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4685/6010] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:03:12.598366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:12.599541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: 24f980ae-11b0-4211-8c58-8ad4eae9df67] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:12.620911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:12.625053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:12.626041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:12.626621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:12.662174 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] HTTP exception thrown: Instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 could not be found. May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Request method failure captured: May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 HTTP/1.1 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgdZ6Y4c6J8Qm5JE6Ok0xaMqt56v3qQmvh4zvKNAa1BTbh79wynMuVkX9Xbq0IAqvxfUOWJt1HyFAAIgQXP_er4xTGjFh5o7V6PNSjECv35AVqSHiVzXOwYa_v-_gk9AyBIhHFqTHur845sEfonzW0z6ZBFjFhKGfdwx-yTPU0qhU30 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 76f10af0529347f889780b97a0116150 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkBasicOps-1495837335 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/76f10af0529347f889780b97a0116150"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76f10af0529347f889780b97a0116150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_76f10af0529347f889780b97a0116150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76f10af0529347f889780b97a0116150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkBasicOps-1495837335 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 76f10af0529347f889780b97a0116150 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkBasicOps-1495837335 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkBasicOps-1495837335-project May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 34ddb36c721e46a7bb9f7cf32a7dc662 May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkBasicOps-1495837335-project May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 could not be found. May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '24f980ae-11b0-4211-8c58-8ad4eae9df67'} May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 could not be found. May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 could not be found. May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:03:12.664328 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 could not be found. May 19 09:03:12.671065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:03:12.679629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Returning 404 to user: Instance 24f980ae-11b0-4211-8c58-8ad4eae9df67 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:03:12.680788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df1ee6ba-31fc-4404-af5d-e55522c759ee tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67" status: 404 len: 111 microversion: 2.1 time: 0.087516 May 19 09:03:12.681441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4686/6011] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:12 2022] GET /compute/v2.1/servers/24f980ae-11b0-4211-8c58-8ad4eae9df67 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:03:12.900104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e17060ba-9d17-4660-ad8a-fe313a75ced1 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '.version_select at 0x7f3217b04a60>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:12.942068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e17060ba-9d17-4660-ad8a-fe313a75ced1 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1357764535" status: 202 len: 0 microversion: 2.1 time: 0.034557 May 19 09:03:12.943511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4687/6012] 10.222.0.78 () {58 vars in 1256 bytes} [Thu May 19 09:03:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1357764535 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:03:27.070745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-736006f2-9ec5-4a11-a651-bddf8f0ea29c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'create', calling method: .version_select at 0x7f3210593040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-384864262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6BGaDkcIrITNSfb0MZOOfojGQmiuf03I8A497rYw2coeObf/4NeUpptXBIC3vxtsZCtWxZEZVidg04YMZL6Wg1DGAqZFqRNZa4n/bxYrK+GMiUBdMLfxJiwHYHV2Jshw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:27.094244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:27.095022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:27.223561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-736006f2-9ec5-4a11-a651-bddf8f0ea29c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for project 76f10af0529347f889780b97a0116150. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:03:27.241738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-736006f2-9ec5-4a11-a651-bddf8f0ea29c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for user 34ddb36c721e46a7bb9f7cf32a7dc662 and project 76f10af0529347f889780b97a0116150. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:03:27.314643 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:03:27.315331 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:03:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:03:27.332375 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-736006f2-9ec5-4a11-a651-bddf8f0ea29c tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.265632 May 19 09:03:27.333345 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4688/6013] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:03:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:03:29.649178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1317204956", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "3408c1c5-40e2-495b-8f87-dd1cab19f537"}], "key_name": "tempest-TestNetworkBasicOps-384864262", "security_groups": [{"name": "tempest-secgroup-smoke-1230912893"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:29.796379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] validate_networks() for [('3408c1c5-40e2-495b-8f87-dd1cab19f537', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:03:30.597080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:03:30.597554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:03:30.598040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:03:30.598475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:03:30.598974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:03:30.614445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:30.614906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:30.615715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:30.617856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:30.658256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for project 76f10af0529347f889780b97a0116150. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:03:30.693689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Getting quotas for user 34ddb36c721e46a7bb9f7cf32a7dc662 and project 76f10af0529347f889780b97a0116150. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:03:30.738638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:03:30.744070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:03:30.852254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4b089a3-a9dd-4863-b683-8c5b68f9f7eb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.207402 May 19 09:03:30.852925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4689/6014] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:03:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:03:30.869671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8899c50-8b58-4f63-9bb0-3018ef8b454f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:30.882281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d8899c50-8b58-4f63-9bb0-3018ef8b454f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:31.103347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8899c50-8b58-4f63-9bb0-3018ef8b454f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:31.111759 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8899c50-8b58-4f63-9bb0-3018ef8b454f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1248 microversion: 2.1 time: 0.248111 May 19 09:03:31.125392 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4690/6015] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:30 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1248 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:32.130165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:32.132483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:32.145866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:32.146632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:32.152844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:32.153704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:32.254312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:32.277811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9508954-7b79-4f3c-b302-06ce65dbde07 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1252 microversion: 2.1 time: 0.150623 May 19 09:03:32.297276 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4691/6016] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:32 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1252 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:33.319720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:33.326375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:33.360940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:33.361439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:33.362540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:33.363117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:33.606224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:33.616442 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3839e156-31ca-4683-86b1-2aafbb6efda6 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1318 microversion: 2.1 time: 0.313120 May 19 09:03:33.620278 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4692/6017] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:33 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:34.682812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:34.686305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:34.711500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:34.714709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:34.716808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:34.727722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:35.339804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:35.357134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7773af79-d32d-49d8-b6ee-969ddee73d28 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.703643 May 19 09:03:35.357134 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4693/6018] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:34 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:36.199482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a2148830-4d66-42ec-ab1b-6ec4df4a884e req-06b49bb3-1b12-40df-83a5-71fa6fdeafa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8950389-4e28-425f-8576-1905470fda62", "tag": "3ed121fd-2b55-402f-8050-802794d399a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:36.229456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2148830-4d66-42ec-ab1b-6ec4df4a884e req-06b49bb3-1b12-40df-83a5-71fa6fdeafa7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:36.237878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2148830-4d66-42ec-ab1b-6ec4df4a884e req-06b49bb3-1b12-40df-83a5-71fa6fdeafa7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:36.255724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a2148830-4d66-42ec-ab1b-6ec4df4a884e req-06b49bb3-1b12-40df-83a5-71fa6fdeafa7 service nova] Creating event network-changed:3ed121fd-2b55-402f-8050-802794d399a7 for instance e8950389-4e28-425f-8576-1905470fda62 on chh1-842464-2 May 19 09:03:36.278734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a2148830-4d66-42ec-ab1b-6ec4df4a884e req-06b49bb3-1b12-40df-83a5-71fa6fdeafa7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086141 May 19 09:03:36.287527 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4694/6019] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:03:36.377323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:36.378425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:36.392093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:36.396582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:36.399432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:36.403944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:37.175784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:37.188586 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f42c83cc-1802-4bd5-b0e3-eda83dff1ca3 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.817542 May 19 09:03:37.190559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4695/6020] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:36 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:38.235643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:38.243492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:38.300542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:38.301031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:38.301877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:38.302507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:38.604564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:38.620007 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f81e5b82-4c3b-4bfe-be67-7b7fe855a07f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.395080 May 19 09:03:38.620841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4696/6021] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:38 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:39.643965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:39.645750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:39.666110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:39.667618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:39.670782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:39.672791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:39.967502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:39.979800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f208795b-07b5-4340-8986-8eb186d2c7fb tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.340477 May 19 09:03:39.994241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4697/6022] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:39 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:40.739039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1609190913", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1808659732", "security_groups": [{"name": "tempest-secgroup-smoke-1123601492"}], "block_device_mapping_v2": [{"uuid": "5f71e719-d056-42e4-898c-1a4ad749cfae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "54e9fb48-ff02-4b02-bf02-986383403172"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:40.748355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:40.898610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] validate_networks() for [('54e9fb48-ff02-4b02-bf02-986383403172', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:03:41.116307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:41.771285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:03:41.772650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:03:41.775071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:03:41.775424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:03:41.776294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:03:41.787722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:41.788537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:41.789632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:41.790317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:41.817092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:03:41.826025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Getting quotas for user f8f60dda89434a2bb3d25947158dad23 and project 7c5562659c3440c09b97b174cb803562. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:03:41.926423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:03:41.929094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f71e719-d056-42e4-898c-1a4ad749cfae',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:03:42.130354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a4336f7-2847-4e22-ad20-df7ae41ddf4d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.395401 May 19 09:03:42.136850 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4698/6023] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:03:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:03:42.143731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:42.144704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:42.153992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:42.154787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:42.156224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:42.157630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:42.453643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:42.470922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55a07b95-9546-4f22-9c96-850fdba36810 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.332267 May 19 09:03:42.484419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4699/6024] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:42 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:42.499054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8af54c52-92f6-408f-bb0e-e0c6cf994fe0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:42.500252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8af54c52-92f6-408f-bb0e-e0c6cf994fe0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:42.602010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8af54c52-92f6-408f-bb0e-e0c6cf994fe0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:42.632326 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8af54c52-92f6-408f-bb0e-e0c6cf994fe0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1095 microversion: 2.1 time: 0.155587 May 19 09:03:42.644696 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4700/6025] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:42 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1095 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:43.665215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8ea20a2b-e813-4f20-8932-1b9ad9be36f9 req-508ca6c2-9da5-4958-b77f-26d945ebc170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8950389-4e28-425f-8576-1905470fda62", "name": "network-vif-plugged", "status": "completed", "tag": "3ed121fd-2b55-402f-8050-802794d399a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:43.700886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8ea20a2b-e813-4f20-8932-1b9ad9be36f9 req-508ca6c2-9da5-4958-b77f-26d945ebc170 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:43.701555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8ea20a2b-e813-4f20-8932-1b9ad9be36f9 req-508ca6c2-9da5-4958-b77f-26d945ebc170 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:43.747937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8ea20a2b-e813-4f20-8932-1b9ad9be36f9 req-508ca6c2-9da5-4958-b77f-26d945ebc170 service nova] Creating event network-vif-plugged:3ed121fd-2b55-402f-8050-802794d399a7 for instance e8950389-4e28-425f-8576-1905470fda62 on chh1-842464-2 May 19 09:03:43.769477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8ea20a2b-e813-4f20-8932-1b9ad9be36f9 req-508ca6c2-9da5-4958-b77f-26d945ebc170 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.395056 May 19 09:03:43.770301 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4701/6026] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:03:43.816409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:43.819158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:43.839301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:43.840069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:43.841442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:43.842447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:44.233731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:44.244708 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53522c59-c852-4717-852c-5f21f9dd4fa7 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.468641 May 19 09:03:44.253144 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4702/6027] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:43 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:44.258445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:44.259074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:44.277257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:44.277896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:44.279369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:44.279840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:44.389923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:44.411083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e86bcd88-946a-4662-92ad-27194c3412c9 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1211 microversion: 2.1 time: 0.156477 May 19 09:03:44.411798 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4703/6028] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:44 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:45.271153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:45.271958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:45.290820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:45.298053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:45.300444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:45.303853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:46.084398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:46.112762 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2084e4bd-b720-40d7-940e-d4e040a272a5 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1374 microversion: 2.1 time: 0.846449 May 19 09:03:46.120315 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4704/6029] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:45 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1374 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:46.125798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:46.126786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:46.135767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:46.136633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:46.137721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:46.138393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:46.265459 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:03:46.266031 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:03:47.041407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:47.056858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03f12e8b-a2ff-49f0-89c7-52569857c92a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.934867 May 19 09:03:47.058316 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4705/6030] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:46 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:47.136276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:47.136915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:47.151412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:47.152100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:47.153064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:47.153696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:47.436351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:47.447867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e51c046-0a92-44a5-8bde-78a1212f79ae tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1547 microversion: 2.1 time: 0.315635 May 19 09:03:47.459555 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4706/6031] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:47 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1547 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:47.467525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:47.468205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:47.476002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:47.476468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:47.477262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:47.477855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:47.726114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:47.741846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9dfaff0a-d8cc-4577-afad-ed6461e37216 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1547 microversion: 2.1 time: 0.279990 May 19 09:03:47.743048 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4707/6032] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:47 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1547 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:47.859514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5c8f6afc-d046-4769-9cb5-3a2ff90b30d8 req-519aa109-4a96-47fd-9938-e38e334cdd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c438f2-6382-4c2c-ae26-af422738cc0b", "tag": "ed372b15-deb1-48d9-8fcc-f7a22fb13f77"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:47.878938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5c8f6afc-d046-4769-9cb5-3a2ff90b30d8 req-519aa109-4a96-47fd-9938-e38e334cdd05 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:47.880105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5c8f6afc-d046-4769-9cb5-3a2ff90b30d8 req-519aa109-4a96-47fd-9938-e38e334cdd05 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:47.921529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5c8f6afc-d046-4769-9cb5-3a2ff90b30d8 req-519aa109-4a96-47fd-9938-e38e334cdd05 service nova] Creating event network-changed:ed372b15-deb1-48d9-8fcc-f7a22fb13f77 for instance a4c438f2-6382-4c2c-ae26-af422738cc0b on chh2-842464-2 May 19 09:03:47.934871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5c8f6afc-d046-4769-9cb5-3a2ff90b30d8 req-519aa109-4a96-47fd-9938-e38e334cdd05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082147 May 19 09:03:47.938515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4708/6033] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 09:03:48.077067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:48.081992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:48.098384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:48.099174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:48.100738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:48.102541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:48.559448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:48.576024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5aa06abe-20f9-4a88-974d-a56d6e3c91b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.503652 May 19 09:03:48.577113 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4709/6034] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:48 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:49.593782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:49.594436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:49.636458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:49.637060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:49.638054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:49.638773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:50.096214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:50.108099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:50.132425 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b9d23d7-d1b3-48a0-8c33-be8c7a14886a tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.542925 May 19 09:03:50.138781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4710/6035] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:49 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:51.162060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:51.164336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:51.188077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:51.198462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:51.205257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:51.207315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:51.443724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:51.451988 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edbf18b8-1183-420c-b55b-f5815f3be701 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.299812 May 19 09:03:51.453804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4711/6036] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:51 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:51.931266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-562c361f-9afb-42b9-8c7a-c00288a8a0ab req-ff050ab1-5afd-47ac-b305-b5a9c50f8ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8950389-4e28-425f-8576-1905470fda62", "tag": "3ed121fd-2b55-402f-8050-802794d399a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:03:51.934836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:51.969269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-562c361f-9afb-42b9-8c7a-c00288a8a0ab req-ff050ab1-5afd-47ac-b305-b5a9c50f8ca6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:51.978162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-562c361f-9afb-42b9-8c7a-c00288a8a0ab req-ff050ab1-5afd-47ac-b305-b5a9c50f8ca6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:52.019870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-562c361f-9afb-42b9-8c7a-c00288a8a0ab req-ff050ab1-5afd-47ac-b305-b5a9c50f8ca6 service nova] Creating event network-changed:3ed121fd-2b55-402f-8050-802794d399a7 for instance e8950389-4e28-425f-8576-1905470fda62 on chh1-842464-2 May 19 09:03:52.027708 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-562c361f-9afb-42b9-8c7a-c00288a8a0ab req-ff050ab1-5afd-47ac-b305-b5a9c50f8ca6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100298 May 19 09:03:52.031336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4712/6037] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:03:52.472321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:52.473161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:52.489661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:52.494062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:52.495095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:52.495659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:52.621060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:53.150105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:53.160078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-837123fd-3dcd-4816-a5fd-02b7bec63e33 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.694171 May 19 09:03:53.162412 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4713/6038] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:52 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:54.180792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:54.182864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:54.195215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:03:54.223868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:54.228535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:54.229539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:54.230018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:54.475118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:54.487198 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-736b2c37-429c-4ea9-ad9e-5a498847b52f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.311247 May 19 09:03:54.488495 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4714/6039] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:54 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:55.504915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:55.505616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:55.512949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:55.513796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:55.514810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:55.515419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:55.699506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:55.709615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c47b660-32b2-4cbb-963d-9323b9d1327c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.208655 May 19 09:03:55.711045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4715/6040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:55 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:56.731592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:56.733934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:56.756008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:56.758299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:56.759423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:56.761553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:56.997400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:57.009987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46bfd2d7-5af4-4567-b1a1-63e9b22c5c07 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.285247 May 19 09:03:57.012666 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4716/6041] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:56 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:03:58.041424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:58.046255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:58.057805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:58.058370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:58.059190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:58.059653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:58.238477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:58.256648 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4227858-2f4b-45ac-b177-4acae26cf134 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1279 microversion: 2.1 time: 0.231939 May 19 09:03:58.257278 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4717/6042] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:58 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:03:59.274334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:03:59.275032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:03:59.284312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:59.284784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:59.285723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:03:59.286455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:03:59.433562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:03:59.446948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5afb27a-4be0-4c08-bb51-8b1dc8bf49ff tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.176223 May 19 09:03:59.448312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4718/6043] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:03:59 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:00.466634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:00.467523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:00.474467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:00.474920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:00.475594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:00.476055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:00.619550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:00.628252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fecdc1cb-2c42-4df8-916d-00d26e8ddd0f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.165824 May 19 09:04:00.628829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4719/6044] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:00 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:01.646394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:01.647010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:01.654515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:01.654987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:01.655796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:01.656255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:01.821137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:01.829439 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b33743a8-023b-4804-baf7-d8f25abbc997 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.187831 May 19 09:04:01.830742 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4720/6045] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:01 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:02.851266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:02.852009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:02.858866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:02.859349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:02.860128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:02.860579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:03.014533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:03.023384 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56a5f90e-8f38-4168-be1e-c5a291de4626 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.176067 May 19 09:04:03.023977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4721/6046] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:02 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:04.040968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:04.041658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:04.048897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:04.049291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:04.050122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:04.050575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:04.203062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:04.212175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd8f017a-d2c7-4b35-9575-765710551cce tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.175136 May 19 09:04:04.212778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4722/6047] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:04 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:05.230930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:05.231598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:05.239982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:05.240296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:05.241117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:05.243695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:05.402008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:05.413132 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ae31758-4605-4065-8ce9-783629512438 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.186265 May 19 09:04:05.414005 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4723/6048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:05 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:06.433003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:06.433726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:06.446365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:06.447312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:06.448207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:06.448676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:06.621684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:06.644306 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4bbde88-f607-4aab-9922-a304414c023b tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.216647 May 19 09:04:06.645504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4724/6049] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:06 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:07.664276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:07.664971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:07.673075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:07.674003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:07.675207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:07.675863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:08.182026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:08.191358 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f68cf0b3-44db-482e-aa0e-d11d40f7168f tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.529986 May 19 09:04:08.191358 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4725/6050] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:07 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:08.591269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-67e7f747-4ea3-482b-a021-e4de371345e8 req-324d0db0-f5ca-4190-b57d-863dc59dbf39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c438f2-6382-4c2c-ae26-af422738cc0b", "name": "network-vif-plugged", "status": "completed", "tag": "ed372b15-deb1-48d9-8fcc-f7a22fb13f77"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:04:08.601863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-67e7f747-4ea3-482b-a021-e4de371345e8 req-324d0db0-f5ca-4190-b57d-863dc59dbf39 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:08.602626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-67e7f747-4ea3-482b-a021-e4de371345e8 req-324d0db0-f5ca-4190-b57d-863dc59dbf39 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:08.620974 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-67e7f747-4ea3-482b-a021-e4de371345e8 req-324d0db0-f5ca-4190-b57d-863dc59dbf39 service nova] Creating event network-vif-plugged:ed372b15-deb1-48d9-8fcc-f7a22fb13f77 for instance a4c438f2-6382-4c2c-ae26-af422738cc0b on chh2-842464-2 May 19 09:04:08.628186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-67e7f747-4ea3-482b-a021-e4de371345e8 req-324d0db0-f5ca-4190-b57d-863dc59dbf39 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040695 May 19 09:04:08.629170 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4726/6051] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:04:09.210682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:09.211388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:09.218171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:09.218640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:09.219438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:09.219928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:09.382051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:09.390195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67c47d38-4315-4a02-a3f4-e19b2e37fc26 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1267 microversion: 2.1 time: 0.186044 May 19 09:04:09.390804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4727/6052] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:09 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:10.414650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:10.415300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:10.422691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:10.423437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:10.424331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:10.424792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:10.566929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:10.570807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:04:10.576245 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f526d923-78af-49ab-b695-e921de3b3a00 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1454 microversion: 2.1 time: 0.169796 May 19 09:04:10.577187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4728/6053] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:10 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:10.582612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:04:10.583557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:10.590358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:10.590862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:10.592001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:10.598067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:10.660639 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dca9d26c-737f-441a-a587-31da57c6358f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62/action" status: 200 len: 24573 microversion: 2.1 time: 0.082470 May 19 09:04:10.667484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4729/6054] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:04:10 2022] POST /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62/action => generated 24573 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 09:04:10.667484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:10.668191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:10.676373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:10.676832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:10.677669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:10.678164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:10.837491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:10.846625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc0900d7-b1ac-48cb-aecb-813e5cbc4071 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1454 microversion: 2.1 time: 0.183943 May 19 09:04:10.847249 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4730/6055] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:10 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:04:12.894311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-347feb47-8043-4558-83fe-f76bba507740 req-2e88496b-f285-4002-93c6-bd3d8a444051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c438f2-6382-4c2c-ae26-af422738cc0b", "tag": "ed372b15-deb1-48d9-8fcc-f7a22fb13f77"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:04:12.904132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-347feb47-8043-4558-83fe-f76bba507740 req-2e88496b-f285-4002-93c6-bd3d8a444051 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:12.904758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-347feb47-8043-4558-83fe-f76bba507740 req-2e88496b-f285-4002-93c6-bd3d8a444051 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:12.917964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-347feb47-8043-4558-83fe-f76bba507740 req-2e88496b-f285-4002-93c6-bd3d8a444051 service nova] Creating event network-changed:ed372b15-deb1-48d9-8fcc-f7a22fb13f77 for instance a4c438f2-6382-4c2c-ae26-af422738cc0b on chh2-842464-2 May 19 09:04:12.924388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-347feb47-8043-4558-83fe-f76bba507740 req-2e88496b-f285-4002-93c6-bd3d8a444051 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034342 May 19 09:04:12.925144 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4731/6056] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:04:21.836490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:04:21.837571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:21.846590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:21.847056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:21.847866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:21.848317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:21.906725 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a507342c-2f77-4dc4-8bb0-b464bc7db27b tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "POST /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62/action" status: 200 len: 32646 microversion: 2.1 time: 0.074391 May 19 09:04:21.914147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4732/6057] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:04:21 2022] POST /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62/action => generated 32646 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:04:23.043582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:23.044340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:23.053055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:23.053930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:23.054628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:23.055078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:23.086880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:04:23.177818 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a5adb0c-e5c7-4f1e-a407-2e9bfd5b99f8 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 204 len: 0 microversion: 2.1 time: 0.138860 May 19 09:04:23.181789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4733/6058] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:04:23 2022] DELETE /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:04:23.186739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0fa23522-1d7c-4edf-8226-922ed6b70ecd req-e1d753a2-b765-40f2-b606-e53b4e9b1cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8950389-4e28-425f-8576-1905470fda62", "tag": "3ed121fd-2b55-402f-8050-802794d399a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:04:23.197547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0fa23522-1d7c-4edf-8226-922ed6b70ecd req-e1d753a2-b765-40f2-b606-e53b4e9b1cea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:23.198226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0fa23522-1d7c-4edf-8226-922ed6b70ecd req-e1d753a2-b765-40f2-b606-e53b4e9b1cea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:23.214047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0fa23522-1d7c-4edf-8226-922ed6b70ecd req-e1d753a2-b765-40f2-b606-e53b4e9b1cea service nova] Creating event network-changed:3ed121fd-2b55-402f-8050-802794d399a7 for instance e8950389-4e28-425f-8576-1905470fda62 on chh1-842464-2 May 19 09:04:23.221780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0fa23522-1d7c-4edf-8226-922ed6b70ecd req-e1d753a2-b765-40f2-b606-e53b4e9b1cea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041054 May 19 09:04:23.222767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4734/6059] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:04:23.229094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:23.230061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:23.238014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:23.238605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:23.239683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:23.240236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:23.409976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:23.418341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02507a09-1e4e-4c43-8bad-1a34b2b8b8d4 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1672 microversion: 2.1 time: 0.194163 May 19 09:04:23.419227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4735/6060] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:23 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:04:24.436782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:24.437480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:24.441092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:04:24.447204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:24.447638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:24.448608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:24.449235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:24.760184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:24.774968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7d2c163-9dd1-448f-983b-56e9424e3c9f tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1672 microversion: 2.1 time: 0.341955 May 19 09:04:24.775721 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4736/6061] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:24 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1672 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:04:25.618428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-feaee1a6-47d0-4672-aa97-0f517f605475 req-57f53de0-17c8-426b-8e56-d97741244c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8950389-4e28-425f-8576-1905470fda62", "name": "network-vif-deleted", "tag": "3ed121fd-2b55-402f-8050-802794d399a7"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:04:25.629204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-feaee1a6-47d0-4672-aa97-0f517f605475 req-57f53de0-17c8-426b-8e56-d97741244c75 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:25.629742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-feaee1a6-47d0-4672-aa97-0f517f605475 req-57f53de0-17c8-426b-8e56-d97741244c75 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:25.642207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-feaee1a6-47d0-4672-aa97-0f517f605475 req-57f53de0-17c8-426b-8e56-d97741244c75 service nova] Creating event network-vif-deleted:3ed121fd-2b55-402f-8050-802794d399a7 for instance e8950389-4e28-425f-8576-1905470fda62 on chh1-842464-2 May 19 09:04:25.655554 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-feaee1a6-47d0-4672-aa97-0f517f605475 req-57f53de0-17c8-426b-8e56-d97741244c75 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040746 May 19 09:04:25.656215 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4737/6062] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:04:25.793703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:25.794575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:25.801995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:25.802386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:25.803226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:25.803682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:25.838784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:25.839165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:25.839627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lazy-loading 'fault' on Instance uuid e8950389-4e28-425f-8576-1905470fda62 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:04:25.895865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ddb36c721e46a7bb9f7cf32a7dc662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f10af0529347f889780b97a0116150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:04:25.903527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd3da015-bfcf-4519-9551-def499020471 tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 200 len: 1338 microversion: 2.1 time: 0.114135 May 19 09:04:25.906341 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4738/6063] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:25 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:04:26.922891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:26.923595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] [instance: e8950389-4e28-425f-8576-1905470fda62] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:04:26.932289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:26.932767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:26.933603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:04:26.934059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:04:26.947964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] HTTP exception thrown: Instance e8950389-4e28-425f-8576-1905470fda62 could not be found. May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Request method failure captured: May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 HTTP/1.1 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgdZ6Y4c6J8Qm5JE6Ok0xaMqt56v3qQmvh4zvKNAa1BTbh79wynMuVkX9Xbq0IAqvxfUOWJt1HyFAAIgQXP_er4xTGjFh5o7V6PNSjECv35AVqSHiVzXOwYa_v-_gk9AyBIhHFqTHur845sEfonzW0z6ZBFjFhKGfdwx-yTPU0qhU30 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 76f10af0529347f889780b97a0116150 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkBasicOps-1495837335 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/76f10af0529347f889780b97a0116150"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76f10af0529347f889780b97a0116150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_76f10af0529347f889780b97a0116150"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/76f10af0529347f889780b97a0116150"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkBasicOps-1495837335 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 76f10af0529347f889780b97a0116150 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkBasicOps-1495837335 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkBasicOps-1495837335-project May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 34ddb36c721e46a7bb9f7cf32a7dc662 May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkBasicOps-1495837335-project May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e8950389-4e28-425f-8576-1905470fda62 could not be found. May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e8950389-4e28-425f-8576-1905470fda62'} May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8950389-4e28-425f-8576-1905470fda62 could not be found. May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8950389-4e28-425f-8576-1905470fda62 could not be found. May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:04:26.949662 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8950389-4e28-425f-8576-1905470fda62 could not be found. May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Returning 404 to user: Instance e8950389-4e28-425f-8576-1905470fda62 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b31a62f7-c77f-4fe7-a1e6-aa263db066ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62" status: 404 len: 111 microversion: 2.1 time: 0.032248 May 19 09:04:26.959446 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4739/6064] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:04:26 2022] GET /compute/v2.1/servers/e8950389-4e28-425f-8576-1905470fda62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:04:27.171029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03988707-2526-46e5-b2e0-5a924204d1ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] Calling method '.version_select at 0x7f3210f6cdc0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:04:27.225523 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03988707-2526-46e5-b2e0-5a924204d1ef tempest-TestNetworkBasicOps-1495837335 tempest-TestNetworkBasicOps-1495837335-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-384864262" status: 202 len: 0 microversion: 2.1 time: 0.069211 May 19 09:04:27.230763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4740/6065] 10.222.0.78 () {58 vars in 1253 bytes} [Thu May 19 09:04:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-384864262 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:05:52.964352 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 09:05:52.965336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:05:52.968224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:05:52.973520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:52.974145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:52.987218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:52.987812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:52.988846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:52.989411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:53.016720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:05:53.113888 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd9f2bee-b734-404e-8fd0-0789d75be738 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 204 len: 0 microversion: 2.1 time: 0.155913 May 19 09:05:53.117934 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4741/6066] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:05:52 2022] DELETE /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:05:53.124626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1ec4b7ef-fdc2-470f-b38e-b26f68294c94 req-29575e4a-e6f5-4687-a24d-307874427729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c438f2-6382-4c2c-ae26-af422738cc0b", "tag": "ed372b15-deb1-48d9-8fcc-f7a22fb13f77"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:05:53.133941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ec4b7ef-fdc2-470f-b38e-b26f68294c94 req-29575e4a-e6f5-4687-a24d-307874427729 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:53.134402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ec4b7ef-fdc2-470f-b38e-b26f68294c94 req-29575e4a-e6f5-4687-a24d-307874427729 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:53.148322 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1ec4b7ef-fdc2-470f-b38e-b26f68294c94 req-29575e4a-e6f5-4687-a24d-307874427729 service nova] Creating event network-changed:ed372b15-deb1-48d9-8fcc-f7a22fb13f77 for instance a4c438f2-6382-4c2c-ae26-af422738cc0b on chh2-842464-2 May 19 09:05:53.154606 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1ec4b7ef-fdc2-470f-b38e-b26f68294c94 req-29575e4a-e6f5-4687-a24d-307874427729 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034366 May 19 09:05:53.155233 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4742/6067] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:05:53.163723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:53.164462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:53.171465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:53.171941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:53.172751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:53.173344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:53.557841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:05:53.569153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-32902c36-3438-47e4-a637-f761c933bac5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1579 microversion: 2.1 time: 0.412637 May 19 09:05:53.569808 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4743/6068] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:05:53 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1579 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:05:54.590290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:54.590983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:54.600012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:54.600479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:54.601277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:54.601761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:54.619267 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52360. May 19 09:05:54.850169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:05:54.860506 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24d44a49-c341-4a5a-bb3a-3675e6702e42 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1579 microversion: 2.1 time: 0.274554 May 19 09:05:54.862700 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4744/6069] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:05:54 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1579 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:05:55.383176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-51203fe2-f4df-4bdd-bb5e-25f0ed55a83d req-e383c063-3661-4b7e-be86-2ec9a2214a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c438f2-6382-4c2c-ae26-af422738cc0b", "name": "network-vif-deleted", "tag": "ed372b15-deb1-48d9-8fcc-f7a22fb13f77"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:05:55.392128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51203fe2-f4df-4bdd-bb5e-25f0ed55a83d req-e383c063-3661-4b7e-be86-2ec9a2214a04 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:55.392652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51203fe2-f4df-4bdd-bb5e-25f0ed55a83d req-e383c063-3661-4b7e-be86-2ec9a2214a04 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:55.404934 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-51203fe2-f4df-4bdd-bb5e-25f0ed55a83d req-e383c063-3661-4b7e-be86-2ec9a2214a04 service nova] Creating event network-vif-deleted:ed372b15-deb1-48d9-8fcc-f7a22fb13f77 for instance a4c438f2-6382-4c2c-ae26-af422738cc0b on chh2-842464-2 May 19 09:05:55.410421 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-51203fe2-f4df-4bdd-bb5e-25f0ed55a83d req-e383c063-3661-4b7e-be86-2ec9a2214a04 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 May 19 09:05:55.411332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4745/6070] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:05:55.879883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:55.880867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:55.888334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:55.888624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:55.889805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:55.890480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:55.960070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:05:55.970755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d7b1ea3-963a-4d72-883b-153947a31523 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.096398 May 19 09:05:55.971739 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4746/6071] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:05:55 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:05:56.988340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:56.989698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:56.998638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:56.999350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:57.000337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:57.000939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:57.068733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:05:57.077113 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93c3fe5c-c79f-4516-ada8-45d05655c950 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.092720 May 19 09:05:57.086440 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4747/6072] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:05:56 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:05:58.095464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:58.096519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:58.103984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:58.104517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:58.105412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:58.105960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:58.206662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:05:58.214457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95a28755-194f-4e4b-9f15-b72583805568 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.123751 May 19 09:05:58.215042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4748/6073] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:05:58 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:05:59.232744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:05:59.235095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:05:59.242960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:59.243417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:59.244203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:05:59.244834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:05:59.321099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:05:59.334897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-efcc2cde-9057-4380-aa2c-c111401d8f78 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.106600 May 19 09:05:59.335978 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4749/6074] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:05:59 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:00.354612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:00.355271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:00.364766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:00.365335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:00.366236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:00.366702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:00.440559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:00.451083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ca083d4-4f0e-4284-994f-da9b2defd8fa tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.099814 May 19 09:06:00.452016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4750/6075] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:00 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:01.469711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:01.470536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:01.483624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:01.484183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:01.485085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:01.485757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:01.565792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:01.574392 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4dd9479-597b-4e0b-b7cf-36f35616d6c6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.110166 May 19 09:06:01.584772 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4751/6076] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:01 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:02.592521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:02.593866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:02.602012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:02.602483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:02.603305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:02.603868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:02.683586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:02.693417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8a2e3393-ce27-4529-878f-12ee36c582b0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.105232 May 19 09:06:02.694152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4752/6077] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:02 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:03.711952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:03.712879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:03.722746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:03.723571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:03.724560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:03.725113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:03.800135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:03.808762 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d6ed592-8769-4f6e-9ab7-51ba92cf9cc5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.101222 May 19 09:06:03.809862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4753/6078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:03 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:04.827751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:04.828419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:04.835423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:04.835897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:04.836703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:04.837161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:04.923999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:04.931867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8bf27b3-c0ec-43ec-9288-2e731f32d03c tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 200 len: 1226 microversion: 2.1 time: 0.108349 May 19 09:06:04.932445 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4754/6079] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:04 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:06:05.948709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:05.950498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: a4c438f2-6382-4c2c-ae26-af422738cc0b] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:05.958337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:05.958799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:05.959606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:05.960052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:05.974863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance a4c438f2-6382-4c2c-ae26-af422738cc0b could not be found. May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b HTTP/1.1 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance a4c438f2-6382-4c2c-ae26-af422738cc0b could not be found. May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'a4c438f2-6382-4c2c-ae26-af422738cc0b'} May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c438f2-6382-4c2c-ae26-af422738cc0b could not be found. May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c438f2-6382-4c2c-ae26-af422738cc0b could not be found. May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:05.976554 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c438f2-6382-4c2c-ae26-af422738cc0b could not be found. May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance a4c438f2-6382-4c2c-ae26-af422738cc0b could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e550215-57f7-420b-8606-1731d1c02be5 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b" status: 404 len: 111 microversion: 2.1 time: 0.033820 May 19 09:06:05.980619 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4755/6080] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:05 2022] GET /compute/v2.1/servers/a4c438f2-6382-4c2c-ae26-af422738cc0b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:06:16.575466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:16.576890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:16.585278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:06:16.586276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:06:16.588288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:16.588964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:16.590245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:16.591830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:16.646631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:06:16.756282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53b1b704-b017-4f3d-b964-56f7df53fa41 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 204 len: 0 microversion: 2.1 time: 0.184433 May 19 09:06:16.756907 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4756/6081] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:06:16 2022] DELETE /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:06:16.766997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6871defc-b8d8-41fb-94da-ccc9ec130328 req-4f541f49-94c0-4c5c-9037-693e71bd3bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a21d49-63e9-4c4b-9d89-0d8d539eb404", "tag": "62e99169-ad1f-4d8f-a073-05fcb9ca4ead"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:06:16.777095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6871defc-b8d8-41fb-94da-ccc9ec130328 req-4f541f49-94c0-4c5c-9037-693e71bd3bd9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:16.777867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6871defc-b8d8-41fb-94da-ccc9ec130328 req-4f541f49-94c0-4c5c-9037-693e71bd3bd9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:16.802693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6871defc-b8d8-41fb-94da-ccc9ec130328 req-4f541f49-94c0-4c5c-9037-693e71bd3bd9 service nova] Creating event network-changed:62e99169-ad1f-4d8f-a073-05fcb9ca4ead for instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 on chh2-842464-2 May 19 09:06:16.808253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6871defc-b8d8-41fb-94da-ccc9ec130328 req-4f541f49-94c0-4c5c-9037-693e71bd3bd9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046061 May 19 09:06:16.813406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4757/6082] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:06:16.815654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:16.816160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:16.823150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:16.823620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:16.824425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:16.825248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:17.003377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:17.013449 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eaa54516-3ebb-4f71-b76e-87669cabfec1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1580 microversion: 2.1 time: 0.202624 May 19 09:06:17.021876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4758/6083] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:16 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1580 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:06:18.032122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:18.032896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:18.041640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:18.042953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:18.044134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:18.044934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:18.243886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:18.256290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f35cc40-0bff-44dd-84ba-a5a0790db816 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1580 microversion: 2.1 time: 0.226299 May 19 09:06:18.257114 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4759/6084] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:18 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1580 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:18.953021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-58a36dd1-835e-4148-833b-2962b294ab73 req-9bd32257-9c75-4dba-9c77-d6206ac1006c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a21d49-63e9-4c4b-9d89-0d8d539eb404", "name": "network-vif-deleted", "tag": "62e99169-ad1f-4d8f-a073-05fcb9ca4ead"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:06:18.965074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-58a36dd1-835e-4148-833b-2962b294ab73 req-9bd32257-9c75-4dba-9c77-d6206ac1006c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:18.968010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-58a36dd1-835e-4148-833b-2962b294ab73 req-9bd32257-9c75-4dba-9c77-d6206ac1006c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:19.005579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-58a36dd1-835e-4148-833b-2962b294ab73 req-9bd32257-9c75-4dba-9c77-d6206ac1006c service nova] Creating event network-vif-deleted:62e99169-ad1f-4d8f-a073-05fcb9ca4ead for instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 on chh2-842464-2 May 19 09:06:19.011077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-58a36dd1-835e-4148-833b-2962b294ab73 req-9bd32257-9c75-4dba-9c77-d6206ac1006c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062516 May 19 09:06:19.012150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4760/6085] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:06:19.281918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:19.283511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:19.291659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:19.292421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:19.294032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:19.294580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:19.385815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:19.394914 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7c69625-19fc-41eb-a412-ede70aef56a6 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.118355 May 19 09:06:19.396033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4761/6086] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:19 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:20.412332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:20.413809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:20.421848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:20.422626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:20.423936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:20.424598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:20.495330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:20.504356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f470f62b-ab7f-4cdf-a945-bf118bc94165 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.095908 May 19 09:06:20.505189 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4762/6087] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:20 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:06:21.521511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:21.522197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:21.530046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:21.530505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:21.531299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:21.531747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:21.614212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:21.626187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c15dbd5-c2a5-4e83-b5b3-81f84817c089 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.108590 May 19 09:06:21.627595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4763/6088] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:21 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:06:22.648699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:22.648699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:22.656099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:22.656554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:22.657366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:22.657821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:22.756255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:22.766105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4eaa9b7e-d154-4013-be0e-e8c47ad71642 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.122200 May 19 09:06:22.766702 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4764/6089] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:22 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:23.783368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:23.784076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:23.795075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:23.795544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:23.796359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:23.796800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:23.891060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:23.901055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9a23eb0-fb90-49bf-83bc-3c772fef41ef tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.121666 May 19 09:06:23.901998 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4765/6090] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:23 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:06:24.921101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:24.922109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:24.941340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:24.941904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:24.942745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:24.943200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:25.027454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:25.036614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6c6e833-1e69-4a0b-b963-e1d67657a8c1 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.120315 May 19 09:06:25.037187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4766/6091] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:24 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:26.055347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:26.056882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:26.065858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:26.066705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:26.067734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:26.068593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:26.146628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:26.156470 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc94b0d1-4db8-444a-b81e-bca327c1340e tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.105398 May 19 09:06:26.160823 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4767/6092] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:26 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:06:27.174642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:27.175410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:27.183185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:27.183666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:27.184985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:27.185472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:27.264098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:27.273496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c36f02f-53a4-456a-941b-1f346052fabd tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.102792 May 19 09:06:27.274446 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4768/6093] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:27 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:28.290854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:28.291323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:28.299706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:28.300093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:28.300972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:28.301465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:28.369851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8f60dda89434a2bb3d25947158dad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c5562659c3440c09b97b174cb803562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:06:28.378445 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b56a64d6-9cf8-4ee4-9880-b0ec958ef0ee tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 200 len: 1226 microversion: 2.1 time: 0.091983 May 19 09:06:28.379250 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4769/6094] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:28 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:06:29.396412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:29.397134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: b7a21d49-63e9-4c4b-9d89-0d8d539eb404] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:29.404789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:29.405471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:29.406278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:29.406732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:29.421052 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 could not be found. May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 HTTP/1.1 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 could not be found. May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b7a21d49-63e9-4c4b-9d89-0d8d539eb404'} May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 could not be found. May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 could not be found. May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:29.422763 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 could not be found. May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance b7a21d49-63e9-4c4b-9d89-0d8d539eb404 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7dd67745-8962-4d34-b416-1da7e2e1254d tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404" status: 404 len: 111 microversion: 2.1 time: 0.032022 May 19 09:06:29.428776 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4770/6095] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:29 2022] GET /compute/v2.1/servers/b7a21d49-63e9-4c4b-9d89-0d8d539eb404 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:06:29.945420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:29.946015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:29.952511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:29.953055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:29.953939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:29.954530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:29.970379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 HTTP/1.1 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dba987d1-9e5c-400a-a36d-922fe26ca859'} May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:06:29.972067 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:06:29.977065 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-effef103-54f2-43e3-85dd-2e356af19460 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 404 len: 111 microversion: 2.1 time: 0.032201 May 19 09:06:29.978026 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4771/6096] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:06:29 2022] DELETE /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:06:29.983252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:29.983889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] [instance: dba987d1-9e5c-400a-a36d-922fe26ca859] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:06:29.990183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:29.990644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:29.991431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:06:29.991881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:06:30.007555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] HTTP exception thrown: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Request method failure captured: May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 HTTP/1.1 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgQ5M6v3N8-GZoAlwnQ1vEzNSo2rCL5E9zdRvc94Nv7WN2e-dk3rYBbGtmjDAD3k-6gLGNECnSIAamoH4Sf_YrCEmN5x1nEyl7SDshXXOTjuQPcAEnOG6CjAa-Sj02Gp6SK377ODuDAerMvAh1NYig_mzmh4-VxHB8JVi-dtKJEIFXI May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7c5562659c3440c09b97b174cb803562"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7c5562659c3440c09b97b174cb803562"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7c5562659c3440c09b97b174cb803562"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestVolumeBootPattern-784033523 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 7c5562659c3440c09b97b174cb803562 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestVolumeBootPattern-784033523 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: f8f60dda89434a2bb3d25947158dad23 May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestVolumeBootPattern-784033523-project May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'dba987d1-9e5c-400a-a36d-922fe26ca859'} May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:06:30.009151 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Returning 404 to user: Instance dba987d1-9e5c-400a-a36d-922fe26ca859 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1ef94cb-8f2d-4fc0-8444-4b01c71696a3 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859" status: 404 len: 111 microversion: 2.1 time: 0.031930 May 19 09:06:30.018150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4772/6097] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:06:29 2022] GET /compute/v2.1/servers/dba987d1-9e5c-400a-a36d-922fe26ca859 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:06:38.829034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe387606-a060-4520-a33e-58e5a8464bf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] Calling method '.version_select at 0x7f3210f7ac10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:06:38.888990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe387606-a060-4520-a33e-58e5a8464bf0 tempest-TestVolumeBootPattern-784033523 tempest-TestVolumeBootPattern-784033523-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1808659732" status: 202 len: 0 microversion: 2.1 time: 0.079124 May 19 09:06:38.892340 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4773/6098] 10.222.0.78 () {58 vars in 1262 bytes} [Thu May 19 09:06:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1808659732 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:06:46.812040 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:06:46.812040 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:06:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:06:47.329760 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:06:47.330766 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:07:06.276846 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:07:06.277714 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:07:55.144224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:07:55.145578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:07:55.376430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-971381578", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:07:55.447255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] validate_networks() for None {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:07:55.704214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:07:55.704896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:07:55.705730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:07:55.706453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:07:55.707292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:07:55.726999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:55.727927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:55.730320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:55.731099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:55.763904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Getting quotas for project f213f031b8ca4a29ac11627191c60c32. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:07:55.774509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Getting quotas for user 9259c80ac9354c118b8f79b4d4806206 and project f213f031b8ca4a29ac11627191c60c32. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:07:55.807611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:07:55.811886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:07:55.897177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9343251a-db7c-4709-b259-331caba3ea56 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755199 May 19 09:07:55.898511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4774/6099] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:07:55.915808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93f700c2-febf-49f5-bacd-002ea55235da tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:07:55.917371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93f700c2-febf-49f5-bacd-002ea55235da tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:07:55.986478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93f700c2-febf-49f5-bacd-002ea55235da tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:07:55.997185 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93f700c2-febf-49f5-bacd-002ea55235da tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1221 microversion: 2.1 time: 0.088222 May 19 09:07:55.998025 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4775/6100] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:07:55 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:07:57.026844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:07:57.028138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:07:57.041727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:57.042889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:57.044184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:57.045016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:57.156141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:07:57.167134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-202943e4-296b-4841-9e92-7833904e8661 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1273 microversion: 2.1 time: 0.148542 May 19 09:07:57.168194 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4776/6101] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:07:57 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:07:58.190483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:07:58.191581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:07:58.206491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:58.207336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:58.208776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:58.209635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:58.569157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:07:58.579176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-223c02c0-5cb9-4e17-9afc-afea71a9bc88 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1321 microversion: 2.1 time: 0.396434 May 19 09:07:58.579833 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4777/6102] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:07:58 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:07:59.659078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c1334e66-f088-42cd-ae6b-c279e5ae46a9 req-596d27d5-745c-482a-a7b9-2cc351d0314e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cb84ad-ee5b-4345-8fdb-18ea7d649d61", "tag": "bb1757f6-1123-497c-a9c8-5c0c76553fd1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:07:59.671984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c1334e66-f088-42cd-ae6b-c279e5ae46a9 req-596d27d5-745c-482a-a7b9-2cc351d0314e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:59.672661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c1334e66-f088-42cd-ae6b-c279e5ae46a9 req-596d27d5-745c-482a-a7b9-2cc351d0314e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:59.686719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c1334e66-f088-42cd-ae6b-c279e5ae46a9 req-596d27d5-745c-482a-a7b9-2cc351d0314e service nova] Creating event network-changed:bb1757f6-1123-497c-a9c8-5c0c76553fd1 for instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 on chh2-842464-2 May 19 09:07:59.692834 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c1334e66-f088-42cd-ae6b-c279e5ae46a9 req-596d27d5-745c-482a-a7b9-2cc351d0314e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181261 May 19 09:07:59.693787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4778/6103] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:07:59.700523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:07:59.702067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:07:59.711515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:59.712177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:07:59.713777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:07:59.714367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:00.017689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:00.028055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f1a82c90-43be-46e8-9752-71b5c19a23c4 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1321 microversion: 2.1 time: 0.332594 May 19 09:08:00.028698 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4779/6104] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:07:59 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:01.046780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:01.047521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:01.054600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:01.055068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:01.055880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:01.056344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:01.319216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:01.331030 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-929b4f64-201c-4f68-8c83-7db462103d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1321 microversion: 2.1 time: 0.287994 May 19 09:08:01.331659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4780/6105] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:01 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:02.349529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:02.350352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:02.358422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:02.358909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:02.359725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:02.360187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:02.504361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:02.512919 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d8cc702-5d62-4c4e-b734-ae12ed2343f7 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1321 microversion: 2.1 time: 0.167361 May 19 09:08:02.513545 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4781/6106] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:02 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:03.530129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:03.530794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:03.538124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:03.538582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:03.539372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:03.539816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:03.695275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:03.709117 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe5c3613-aac4-4d2f-89b8-83e95fab70d3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1321 microversion: 2.1 time: 0.183229 May 19 09:08:03.710269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4782/6107] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:03 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:03.850313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7a944b7e-72b2-459d-8939-965c6de9c245 req-6ec6ef6c-aff4-4ef2-bdf3-0500ca0593f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cb84ad-ee5b-4345-8fdb-18ea7d649d61", "name": "network-vif-plugged", "status": "completed", "tag": "bb1757f6-1123-497c-a9c8-5c0c76553fd1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:03.859884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7a944b7e-72b2-459d-8939-965c6de9c245 req-6ec6ef6c-aff4-4ef2-bdf3-0500ca0593f9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:03.860361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7a944b7e-72b2-459d-8939-965c6de9c245 req-6ec6ef6c-aff4-4ef2-bdf3-0500ca0593f9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:03.873452 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7a944b7e-72b2-459d-8939-965c6de9c245 req-6ec6ef6c-aff4-4ef2-bdf3-0500ca0593f9 service nova] Creating event network-vif-plugged:bb1757f6-1123-497c-a9c8-5c0c76553fd1 for instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 on chh2-842464-2 May 19 09:08:03.878674 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7a944b7e-72b2-459d-8939-965c6de9c245 req-6ec6ef6c-aff4-4ef2-bdf3-0500ca0593f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032184 May 19 09:08:03.879293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4783/6108] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:08:04.733949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:04.734653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:04.741240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:04.741728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:04.742517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:04.742968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:04.904133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:04.912038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1155147d-1849-407d-83f0-413128155a38 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1321 microversion: 2.1 time: 0.183766 May 19 09:08:04.912701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4784/6109] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:04 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:05.933962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:05.935163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:05.940017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:05.951744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:05.952602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:05.954097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:05.954935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:05.992969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:06.112087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:06.123276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0f374c6-55fe-4aec-a9f8-eb144f670e04 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1470 microversion: 2.1 time: 0.196776 May 19 09:08:06.124162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4785/6110] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:05 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:06.209913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63309367-dcf4-42ed-97d6-74758ca0c451 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Calling method '.version_select at 0x7f321059d550>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.288639 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63309367-dcf4-42ed-97d6-74758ca0c451 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0c555d21710a432c8ad02a77e3c9d31d" status: 200 len: 371 microversion: 2.1 time: 0.145010 May 19 09:08:06.289652 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4786/6111] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 09:08:06 2022] GET /compute/v2.1/os-quota-sets/0c555d21710a432c8ad02a77e3c9d31d => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:08:06.302125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdc45477-f37f-4d35-af51-cf058a128ff0 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1655175617", "id": 1014592719, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:06.303856 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 09:08:06.303856 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 09:08:06.320173 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdc45477-f37f-4d35-af51-cf058a128ff0 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021848 May 19 09:08:06.320781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4787/6112] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:08:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:08:06.332310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1014592719"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:06.333488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:06.342788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.343291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.344115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.344574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.450928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fb7bbadc1a7546cca1b4cdf0f019c9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c555d21710a432c8ad02a77e3c9d31d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:06.461465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1655175617 {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:08:06.470252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.471014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.472255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.473012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.502111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Getting quotas for project f213f031b8ca4a29ac11627191c60c32. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:08:06.507912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Getting quotas for user 9259c80ac9354c118b8f79b4d4806206 and project f213f031b8ca4a29ac11627191c60c32. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:08:06.522024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] ram quota exceeded for 0c555d21710a432c8ad02a77e3c9d31d, tried to resize instance. May 19 09:08:06.522581 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Request method failure captured: May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61/action HTTP/1.1 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 39 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgjqKDSWuu_D4jC6M08yvIczxYFkOj52Q7KLceh919hRxiX2Q3RkFKHYolTri_AdOubpLPHmxflDb4LaMOhMeSJ8PXQFgcplLBl-o7SGxUilsukq5m3l1Wh4Mu1MY-c2U2MvqPl5Ii0P5MBdl0DcYoOTIw0AqBPgU4q8z7Lqokh6YhA May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0c555d21710a432c8ad02a77e3c9d31d May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-695593302 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-695593302 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0c555d21710a432c8ad02a77e3c9d31d May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-695593302 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-695593302-project-admin May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: fb7bbadc1a7546cca1b4cdf0f019c9f9 May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-695593302-project-admin May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: {"resize": {"flavorRef": "1014592719"}} May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '34cb84ad-ee5b-4345-8fdb-18ea7d649d61', 'body': {'resize': {'flavorRef': '1014592719'}}} May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:08:06.524679 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92a20a25-f5aa-4344-92c7-9e2f08797cea tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61/action" status: 403 len: 118 microversion: 2.1 time: 0.198599 May 19 09:08:06.533592 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4788/6113] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:08:06 2022] POST /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61/action => generated 118 bytes in 200 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 19 09:08:06.539352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4a49828c-5587-4da9-98d7-227d070e6125 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.539352 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 09:08:06.539352 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 09:08:06.565588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4a49828c-5587-4da9-98d7-227d070e6125 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1014592719" status: 202 len: 0 microversion: 2.1 time: 0.031183 May 19 09:08:06.566146 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4789/6114] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 09:08:06 2022] DELETE /compute/v2.1/flavors/1014592719 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:08:06.575311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbc27a35-89ad-40c9-b6f6-a59122d66d28 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.602757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbc27a35-89ad-40c9-b6f6-a59122d66d28 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032012 May 19 09:08:06.604191 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4790/6115] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 09:08:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:06.626994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4bbe763-a94a-46d1-96bb-2b2aa78f2ab8 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Calling method '.version_select at 0x7f3210432b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.717334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4bbe763-a94a-46d1-96bb-2b2aa78f2ab8 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0c555d21710a432c8ad02a77e3c9d31d" status: 200 len: 371 microversion: 2.1 time: 0.094641 May 19 09:08:06.717952 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4791/6116] 10.222.0.78 () {58 vars in 1241 bytes} [Thu May 19 09:08:06 2022] GET /compute/v2.1/os-quota-sets/0c555d21710a432c8ad02a77e3c9d31d => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:08:06.729214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ecc52b8-9d4e-4d2e-925e-a6a1bfda0d8c tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1719966488", "id": 2112958527, "os-flavor-access:is_public": "True"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:06.731642 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 09:08:06.731642 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 09:08:06.756196 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ecc52b8-9d4e-4d2e-925e-a6a1bfda0d8c tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.031188 May 19 09:08:06.756844 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4792/6117] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:08:06 2022] POST /compute/v2.1/flavors => generated 437 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:08:06.767823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2112958527"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:06.768812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:06.775350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.776068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.777024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.777507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.819977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'fb7bbadc1a7546cca1b4cdf0f019c9f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c555d21710a432c8ad02a77e3c9d31d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:06.828085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1719966488 {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:08:06.836316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.836857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.838546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.839126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.863877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Getting quotas for project f213f031b8ca4a29ac11627191c60c32. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:08:06.870543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Getting quotas for user 9259c80ac9354c118b8f79b4d4806206 and project f213f031b8ca4a29ac11627191c60c32. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:08:06.884882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] cores quota exceeded for 0c555d21710a432c8ad02a77e3c9d31d, tried to resize instance. May 19 09:08:06.885473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Request method failure captured: May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61/action HTTP/1.1 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 39 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgjqKDSWuu_D4jC6M08yvIczxYFkOj52Q7KLceh919hRxiX2Q3RkFKHYolTri_AdOubpLPHmxflDb4LaMOhMeSJ8PXQFgcplLBl-o7SGxUilsukq5m3l1Wh4Mu1MY-c2U2MvqPl5Ii0P5MBdl0DcYoOTIw0AqBPgU4q8z7Lqokh6YhA May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 0c555d21710a432c8ad02a77e3c9d31d May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-695593302 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Role: reader,member,admin May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: reader,member,admin May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c555d21710a432c8ad02a77e3c9d31d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-695593302 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 0c555d21710a432c8ad02a77e3c9d31d May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-695593302 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-695593302-project-admin May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: fb7bbadc1a7546cca1b4cdf0f019c9f9 May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-695593302-project-admin May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: {"resize": {"flavorRef": "2112958527"}} May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '34cb84ad-ee5b-4345-8fdb-18ea7d649d61', 'body': {'resize': {'flavorRef': '2112958527'}}} May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:08:06.887526 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccbe6fc3-ecff-4046-b067-e65ee5fb908f tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61/action" status: 403 len: 113 microversion: 2.1 time: 0.125307 May 19 09:08:06.892071 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4793/6118] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:08:06 2022] POST /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61/action => generated 113 bytes in 127 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 19 09:08:06.898708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae119e43-af4a-4588-8353-60ebcdf5df6d tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.899497 chdv-842464-2 devstack@n-api.service[119072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 09:08:06.899497 chdv-842464-2 devstack@n-api.service[119072]: warnings.warn(msg) May 19 09:08:06.919588 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae119e43-af4a-4588-8353-60ebcdf5df6d tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2112958527" status: 202 len: 0 microversion: 2.1 time: 0.024894 May 19 09:08:06.920198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4794/6119] 10.222.0.78 () {58 vars in 1160 bytes} [Thu May 19 09:08:06 2022] DELETE /compute/v2.1/flavors/2112958527 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:08:06.929015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d859d352-2ded-4b43-8710-893edfa7b114 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.953015 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d859d352-2ded-4b43-8710-893edfa7b114 tempest-ServersAdminNegativeTestJSON-695593302 tempest-ServersAdminNegativeTestJSON-695593302-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027749 May 19 09:08:06.953935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4795/6120] 10.222.0.78 () {58 vars in 1145 bytes} [Thu May 19 09:08:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:06.972124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:06.972642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:06.975791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:06.980825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.981279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:06.982111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:06.982556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:07.010561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:08:07.106137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e37b5777-5d93-4a98-a24d-d65e6623a27a tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 204 len: 0 microversion: 2.1 time: 0.137846 May 19 09:08:07.106666 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4796/6121] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:08:06 2022] DELETE /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:08:07.115537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:07.116355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:07.130326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:07.130791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:07.131590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:07.132048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:07.153433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:07.275933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:07.287477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ea4c8b9-bbe9-4b77-a252-276b2b7a5be3 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1476 microversion: 2.1 time: 0.176452 May 19 09:08:07.288080 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4797/6122] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:07 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1476 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:08.305929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:08.307319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:08.314779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:08.315249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:08.316054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:08.316511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:08.468919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:08.479680 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3fffbb82-f271-4d34-84e6-4755fa7a8004 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1476 microversion: 2.1 time: 0.177305 May 19 09:08:08.480923 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4798/6123] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:08 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:09.089069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ec3c7c5d-bc81-4033-86ba-c62456189aea req-7b5c9ee1-d615-4238-9475-1fbc65d1dcfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cb84ad-ee5b-4345-8fdb-18ea7d649d61", "name": "network-vif-deleted", "tag": "bb1757f6-1123-497c-a9c8-5c0c76553fd1"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:09.098167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ec3c7c5d-bc81-4033-86ba-c62456189aea req-7b5c9ee1-d615-4238-9475-1fbc65d1dcfc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:09.098660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ec3c7c5d-bc81-4033-86ba-c62456189aea req-7b5c9ee1-d615-4238-9475-1fbc65d1dcfc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:09.113833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ec3c7c5d-bc81-4033-86ba-c62456189aea req-7b5c9ee1-d615-4238-9475-1fbc65d1dcfc service nova] Creating event network-vif-deleted:bb1757f6-1123-497c-a9c8-5c0c76553fd1 for instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 on chh2-842464-2 May 19 09:08:09.121403 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ec3c7c5d-bc81-4033-86ba-c62456189aea req-7b5c9ee1-d615-4238-9475-1fbc65d1dcfc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 May 19 09:08:09.122042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4799/6124] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:08:09.500040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:09.500768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:09.507826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:09.508298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:09.509096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:09.510231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:09.561851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:09.562328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:09.562807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lazy-loading 'fault' on Instance uuid 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:08:09.621816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9259c80ac9354c118b8f79b4d4806206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f213f031b8ca4a29ac11627191c60c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:09.631747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a59760b5-dd54-4369-ac35-4364652bef55 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 200 len: 1311 microversion: 2.1 time: 0.137425 May 19 09:08:09.632877 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4800/6125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:09 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:10.652373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:10.653220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] [instance: 34cb84ad-ee5b-4345-8fdb-18ea7d649d61] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:10.660520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:10.661071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:10.661989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:10.662518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] HTTP exception thrown: Instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 could not be found. May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Request method failure captured: May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 HTTP/1.1 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgjq9W8LZk3MybEnDoEn6hNtImoQjvv6TtmN9_Jfe4rOBLEM2vwGB0uKbxMHRCt4U32fGLDHj4SHlB44TKapVxneZjWJpOUfeAso5cRZv2Tkcf6H99_to2K4NtojaZhMJfpF-oo45YMtVEosp9jQnHa9z70iHJOdiXQ1DAe7ZTGhei0 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: f213f031b8ca4a29ac11627191c60c32 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-943230415 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f213f031b8ca4a29ac11627191c60c32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f213f031b8ca4a29ac11627191c60c32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f213f031b8ca4a29ac11627191c60c32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f213f031b8ca4a29ac11627191c60c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-943230415 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: f213f031b8ca4a29ac11627191c60c32 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-943230415 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersAdminNegativeTestJSON-943230415-project May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9259c80ac9354c118b8f79b4d4806206 May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-943230415-project May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 could not be found. May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '34cb84ad-ee5b-4345-8fdb-18ea7d649d61'} May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 could not be found. May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:08:10.684150 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 could not be found. May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 could not be found. May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] Returning 404 to user: Instance 34cb84ad-ee5b-4345-8fdb-18ea7d649d61 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abf3e835-49bd-4719-ba76-77f1b5949d19 tempest-ServersAdminNegativeTestJSON-943230415 tempest-ServersAdminNegativeTestJSON-943230415-project] 10.222.0.78 "GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61" status: 404 len: 111 microversion: 2.1 time: 0.034131 May 19 09:08:10.690015 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4801/6126] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:10 2022] GET /compute/v2.1/servers/34cb84ad-ee5b-4345-8fdb-18ea7d649d61 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:08:14.235415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1863970301", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "4c0d3995-a166-4173-a42f-b69222a563a4"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:14.291502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] validate_networks() for [('4c0d3995-a166-4173-a42f-b69222a563a4', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:08:14.706522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:08:14.707076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:08:14.707693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:08:14.708232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:08:14.708767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:08:14.719446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:14.720109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:14.721340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:14.721897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:14.741659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Getting quotas for project a020d6f46def47dcb3680968d57496da. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:08:14.749016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Getting quotas for user 8cb783caaca84aa0bcb0c4b4fe88cb62 and project a020d6f46def47dcb3680968d57496da. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:08:14.762552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:08:14.764867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:08:14.813270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d2c2e7a-7ba3-45b0-9064-8058742315df tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722983 May 19 09:08:14.814061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4802/6127] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:08:14.824707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e5e18cc0-1db7-4351-ac11-739e06ada559 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:14.825406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e5e18cc0-1db7-4351-ac11-739e06ada559 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:14.894825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e5e18cc0-1db7-4351-ac11-739e06ada559 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:14.903307 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e5e18cc0-1db7-4351-ac11-739e06ada559 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1215 microversion: 2.1 time: 0.083091 May 19 09:08:14.904109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4803/6128] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:14 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:15.920924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:15.921734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:15.929047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:15.929576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:15.930367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:15.930819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:16.050804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:16.060297 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93500d47-6d2e-4543-975b-ca007bbe9416 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1275 microversion: 2.1 time: 0.143384 May 19 09:08:16.060884 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4804/6129] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:15 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:17.078157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:17.079529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:17.087243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:17.087731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:17.088555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:17.089003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:17.318760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:17.327970 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89aca533-e96c-4575-a6e8-76b1269396ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.253625 May 19 09:08:17.328582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4805/6130] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:17 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:17.692849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c8bc19f9-c40c-44a2-a323-9409ef944ed5 req-a59b5a26-571c-4e28-9036-d06f4c4ef780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd429f5-5cd6-47eb-a145-ef302c38b061", "tag": "dee7196f-2d71-4ac3-b71e-164f304c204d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:17.708101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c8bc19f9-c40c-44a2-a323-9409ef944ed5 req-a59b5a26-571c-4e28-9036-d06f4c4ef780 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:17.708851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c8bc19f9-c40c-44a2-a323-9409ef944ed5 req-a59b5a26-571c-4e28-9036-d06f4c4ef780 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:17.740840 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c8bc19f9-c40c-44a2-a323-9409ef944ed5 req-a59b5a26-571c-4e28-9036-d06f4c4ef780 service nova] Creating event network-changed:dee7196f-2d71-4ac3-b71e-164f304c204d for instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 on chh2-842464-2 May 19 09:08:17.748337 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c8bc19f9-c40c-44a2-a323-9409ef944ed5 req-a59b5a26-571c-4e28-9036-d06f4c4ef780 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061872 May 19 09:08:17.749153 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4806/6131] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:08:18.354721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:18.355430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:18.362156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:18.362655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:18.363454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:18.363908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:18.555614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:18.566330 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad789d6e-4956-4955-b3ba-f8077f151bfe tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.217807 May 19 09:08:18.566938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4807/6132] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:18 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:19.583556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:19.584279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:19.592932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:19.593447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:19.594278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:19.594738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:19.846886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:19.856200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6d63270-de8b-4ff4-a9f5-89eb21db865e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.276536 May 19 09:08:19.856806 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4808/6133] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:19 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:20.875764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:20.876693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:20.887259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:20.887735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:20.888544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:20.888996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:21.068453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:21.076306 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fc2bebd-3478-43f9-ae68-0f3270ed3446 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.205273 May 19 09:08:21.076890 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4809/6134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:20 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:22.095618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:22.096377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:22.109619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:22.110473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:22.111943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:22.112828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:22.287773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:22.305367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbab3f5d-87e4-4e3e-a556-70be386d30d6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.214429 May 19 09:08:22.306067 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4810/6135] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:22 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:23.322915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:23.323598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:23.330974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:23.331439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:23.332231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:23.332676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:23.487665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:23.496718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50e2b385-0218-4635-b7bd-7b72d7c1500c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.177553 May 19 09:08:23.497363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4811/6136] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:23 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:23.943035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8b971d07-b2f1-4e11-8b89-f11b96d5408f req-6a290576-93e5-45eb-bb9f-e4a56cb728b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd429f5-5cd6-47eb-a145-ef302c38b061", "name": "network-vif-plugged", "status": "completed", "tag": "dee7196f-2d71-4ac3-b71e-164f304c204d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:23.952571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b971d07-b2f1-4e11-8b89-f11b96d5408f req-6a290576-93e5-45eb-bb9f-e4a56cb728b9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:23.953047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8b971d07-b2f1-4e11-8b89-f11b96d5408f req-6a290576-93e5-45eb-bb9f-e4a56cb728b9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:23.967714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8b971d07-b2f1-4e11-8b89-f11b96d5408f req-6a290576-93e5-45eb-bb9f-e4a56cb728b9 service nova] Creating event network-vif-plugged:dee7196f-2d71-4ac3-b71e-164f304c204d for instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 on chh2-842464-2 May 19 09:08:23.975192 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8b971d07-b2f1-4e11-8b89-f11b96d5408f req-6a290576-93e5-45eb-bb9f-e4a56cb728b9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035848 May 19 09:08:23.975836 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4812/6137] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:08:24.516312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:24.516964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:24.523378 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:24.523769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:24.524549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:24.525642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:24.673841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:24.682669 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3581265-fd5b-4c86-9244-8649d7e1d347 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1315 microversion: 2.1 time: 0.171484 May 19 09:08:24.683275 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4813/6138] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:24 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:25.699895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:25.700554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:25.702488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:25.703741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:25.710887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:25.711348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:25.712201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:25.712774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:25.856783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:25.864733 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4db6075-de9f-42c4-98fe-9e2c423c40ad tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1501 microversion: 2.1 time: 0.168980 May 19 09:08:25.865348 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4814/6139] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:25 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:25.882200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:25.883198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:25.890792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:25.891262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:25.892046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:25.892496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:25.925143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:25.932771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:08:25.940216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:08:25.940737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:08:25.941149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:08:25.941610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:08:25.942045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:08:26.021701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34ff4970-208c-4880-9520-0090fe5dd651 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "POST /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061/action" status: 202 len: 0 microversion: 2.1 time: 0.143284 May 19 09:08:26.022251 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4815/6140] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:08:25 2022] POST /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:08:26.035069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:26.036267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:26.047737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:26.048591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:26.050194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:26.051025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:26.244619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:26.248506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:26.254175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8df632ee-59f2-457e-bf9c-22b72b6c0c54 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1510 microversion: 2.1 time: 0.226426 May 19 09:08:26.254784 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4816/6141] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:26 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:27.275790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:27.276792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:27.288453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:27.289351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:27.291381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:27.292193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:27.455192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:27.464777 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c131d66e-2b34-4c31-a7ae-5de06a34f8cf tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1510 microversion: 2.1 time: 0.195145 May 19 09:08:27.465423 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4817/6142] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:27 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:28.485059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:28.486223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:28.493954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:28.494983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:28.495812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:28.496273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:28.649346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:28.661485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c920ece-b343-4b97-bf0b-1700c191936d tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.179698 May 19 09:08:28.661861 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4818/6143] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:28 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:29.683939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:29.684605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:29.692036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:29.692503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:29.693345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:29.694342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:29.855496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:29.865625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a78d6ef-52d4-4ce5-8cc8-9d1f9944fbce tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.186956 May 19 09:08:29.866338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4819/6144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:29 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:30.883253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:30.883964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:30.892270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:30.892798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:30.893833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:30.894388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:31.047823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:31.057782 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa7b0157-48ff-4247-bd4e-b733bbbcc1da tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.178253 May 19 09:08:31.058308 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4820/6145] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:30 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:32.075152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:32.075850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:32.083010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:32.083483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:32.084293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:32.084750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:32.254334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:32.263135 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23a271ca-3b56-4400-a08a-d265173ca2c7 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.191946 May 19 09:08:32.263837 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4821/6146] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:32 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:33.280770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:33.281521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:33.289455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:33.290131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:33.291114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:33.291600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:33.444457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:33.453701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5353d03a-982c-4339-9566-2f3dafff235c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.176740 May 19 09:08:33.454322 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4822/6147] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:33 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:34.471768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:34.472461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:34.480527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:34.480992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:34.481846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:34.482313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:34.633189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:34.648663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81bce49d-752c-4355-a55d-4f901a2bc7a6 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.180616 May 19 09:08:34.649446 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4823/6148] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:34 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:35.666687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:35.667391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:35.676435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:35.677119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:35.678368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:35.679021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:35.826820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:35.835388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f05c387-584e-4f8f-a27f-24f433456d0e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.172669 May 19 09:08:35.836125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4824/6149] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:35 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:36.853952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:36.854634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:36.863002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:36.863512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:36.864327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:36.864789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:37.042121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:37.050640 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4f354cb-9e57-4cc8-bc27-15a98db9160b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.200968 May 19 09:08:37.051350 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4825/6150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:36 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:38.070940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:38.070940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:38.074295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:38.080990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:38.081617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:38.082509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:38.082977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:38.240185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:38.249069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b5db312f-3339-4f13-8c51-f66a5d3771b3 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.183898 May 19 09:08:38.249713 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4826/6151] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:38 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:39.266427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:39.267114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:39.275234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:39.275753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:39.276700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:39.277154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:39.450994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:39.459563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-45309604-e1b4-41cd-b55f-49ef06ae95e0 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.197004 May 19 09:08:39.460165 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4827/6152] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:39 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:40.480300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:40.480999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:40.492621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:40.493993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:40.495390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:40.496024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:40.787668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:40.812843 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d07068fa-3905-45f6-acc8-907f08a1676f tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.335891 May 19 09:08:40.824658 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4828/6153] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:40 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:41.838893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:41.840251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:41.851523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:41.852802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:41.854118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:41.854783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:42.033727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:42.047004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9577875b-2d5f-47af-a784-d7585b47b8ab tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.217771 May 19 09:08:42.048154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4829/6154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:41 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:43.068577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:43.069251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:43.077134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:43.077634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:43.078524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:43.078977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:43.257479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:43.266434 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e983376f-2b08-4614-a0c0-e0f3cbc9467e tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.201841 May 19 09:08:43.267051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4830/6155] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:43 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:44.284470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:44.285172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:44.293080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:44.293645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:44.294535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:44.294981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:44.443101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:44.451564 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6e7bf2c9-dd0c-4bc1-902f-443ab8fb3f1b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.171034 May 19 09:08:44.452179 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4831/6156] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:44 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:45.468463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:45.469229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:45.476350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:45.476818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:45.478486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:45.479174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:45.640480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:45.653085 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2dd921a6-7d48-4fd6-9b6a-5a878037a7b8 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.188798 May 19 09:08:45.653734 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4832/6157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:45 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:46.671738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:46.672427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:46.680358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:46.680810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:46.681700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:46.682157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:46.701834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:08:46.836439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:46.845244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87704413-3754-4513-8624-505a3f840f01 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.177518 May 19 09:08:46.845891 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4833/6158] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:46 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:47.863424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:47.864089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:47.872697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:47.873164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:47.874042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:47.874519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:48.018206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:48.034964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c9822ec0-dae0-4f73-ba9e-7ccb2292a518 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.175359 May 19 09:08:48.035594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4834/6159] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:47 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:49.052507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:49.053173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:49.061026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:49.061557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:49.062361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:49.062832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:49.214370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:49.222487 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f088eb0c-102c-4115-a4a6-656f95d2d1ac tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.174034 May 19 09:08:49.223078 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4835/6160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:49 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:50.241837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:50.242534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:50.250285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:50.250757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:50.251559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:50.252020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:50.396932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:50.406238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7f479df1-fbe6-4f9e-ae30-0a0f71835889 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.168352 May 19 09:08:50.406859 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4836/6161] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:50 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:51.426194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:51.427110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:51.435264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:51.435733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:51.436518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:51.436966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:51.592840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:51.600882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2c493c3-1b2b-4846-a27b-f4c43ce9a0c4 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.180813 May 19 09:08:51.601505 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4837/6162] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:51 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:52.619442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:52.620155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:52.627511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:52.627985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:52.628820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:52.629281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:52.782031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:52.789724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53ccf89a-7a83-4e9d-bbe9-70a1bfee1d7a tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.174426 May 19 09:08:52.790521 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4838/6163] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:52 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:53.807775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:53.808469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:53.816224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:53.816695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:53.817676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:53.818283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:53.986232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:53.996320 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb1a15d3-f3b0-429b-88a6-a94d127a78d5 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.192782 May 19 09:08:53.997494 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4839/6164] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:53 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:55.015356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:55.016103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:55.023172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:55.023638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:55.025036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:55.025519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:55.217795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:55.226278 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e39668fe-afbf-4281-aa44-f3bd111f69bb tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1515 microversion: 2.1 time: 0.214839 May 19 09:08:55.227708 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4840/6165] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:55 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:55.989640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-faf640ea-b7f4-454b-9cd6-5af23ab43184 req-3c44f63f-a883-4b17-9872-ca9bf1f167c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd429f5-5cd6-47eb-a145-ef302c38b061", "name": "network-vif-unplugged", "status": "completed", "tag": "dee7196f-2d71-4ac3-b71e-164f304c204d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:56.001107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-faf640ea-b7f4-454b-9cd6-5af23ab43184 req-3c44f63f-a883-4b17-9872-ca9bf1f167c8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:56.001813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-faf640ea-b7f4-454b-9cd6-5af23ab43184 req-3c44f63f-a883-4b17-9872-ca9bf1f167c8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:56.017918 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-faf640ea-b7f4-454b-9cd6-5af23ab43184 req-3c44f63f-a883-4b17-9872-ca9bf1f167c8 service nova] Creating event network-vif-unplugged:dee7196f-2d71-4ac3-b71e-164f304c204d for instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 on chh1-842464-2 May 19 09:08:56.026182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-faf640ea-b7f4-454b-9cd6-5af23ab43184 req-3c44f63f-a883-4b17-9872-ca9bf1f167c8 service nova] Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:08:56.038803 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-faf640ea-b7f4-454b-9cd6-5af23ab43184 req-3c44f63f-a883-4b17-9872-ca9bf1f167c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055449 May 19 09:08:56.039512 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4841/6166] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:08:56.246147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:56.246858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:56.254306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:56.254834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:56.255604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:56.256194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:56.526813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:56.535091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b10780a-c1ff-482a-8715-7547e899cd1c tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1514 microversion: 2.1 time: 0.293806 May 19 09:08:56.535724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4842/6167] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:56 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:57.553734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:57.554409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:57.563085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:57.563551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:57.564357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:57.564816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:57.709977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:57.725198 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb7e78fb-1142-4462-87d4-325b47b9bca1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1512 microversion: 2.1 time: 0.175283 May 19 09:08:57.726043 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4843/6168] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:57 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:08:58.076120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a2bbd822-e26b-4698-9080-0932a246fd06 req-e31fadb0-cac7-40b9-bdcb-b036b647afcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd429f5-5cd6-47eb-a145-ef302c38b061", "tag": "dee7196f-2d71-4ac3-b71e-164f304c204d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:08:58.085944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2bbd822-e26b-4698-9080-0932a246fd06 req-e31fadb0-cac7-40b9-bdcb-b036b647afcc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:58.087714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a2bbd822-e26b-4698-9080-0932a246fd06 req-e31fadb0-cac7-40b9-bdcb-b036b647afcc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:58.100852 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a2bbd822-e26b-4698-9080-0932a246fd06 req-e31fadb0-cac7-40b9-bdcb-b036b647afcc service nova] Creating event network-changed:dee7196f-2d71-4ac3-b71e-164f304c204d for instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 on chh1-842464-2 May 19 09:08:58.106873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-a2bbd822-e26b-4698-9080-0932a246fd06 req-e31fadb0-cac7-40b9-bdcb-b036b647afcc service nova] Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:08:58.117948 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a2bbd822-e26b-4698-9080-0932a246fd06 req-e31fadb0-cac7-40b9-bdcb-b036b647afcc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046657 May 19 09:08:58.118848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4844/6169] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:08:58.746444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:58.747289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:58.753921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:58.754390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:58.755185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:58.755639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:59.420755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:08:59.429052 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e6bad3f-8351-48af-a287-cb0713c848ea tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1509 microversion: 2.1 time: 0.688932 May 19 09:08:59.429695 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4845/6170] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:08:58 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1509 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:08:59.447472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:08:59.447990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:08:59.454581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:59.455039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:59.455852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:08:59.456309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:08:59.485053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:08:59.538569 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Found an unconfirmed migration during delete, id: 16, status: finished May 19 09:09:01.102607 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06acdf89-e72a-4fa4-9f8b-33b739e4189b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 204 len: 0 microversion: 2.1 time: 1.659364 May 19 09:09:01.103381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4846/6171] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:08:59 2022] DELETE /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 0 bytes in 1662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:09:01.114272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:01.115007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:01.121897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:01.122547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:01.123193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:01.123654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:01.291720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:01.299833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1b4bef8-fe12-4e32-9bb0-46c727089171 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1501 microversion: 2.1 time: 0.190281 May 19 09:09:01.300430 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4847/6172] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:01 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:02.322464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:02.324015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:02.331886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:02.332360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:02.333183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:02.333638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:02.353859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:02.550064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cb783caaca84aa0bcb0c4b4fe88cb62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a020d6f46def47dcb3680968d57496da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:02.558687 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c935184c-e749-4fee-af2b-8fe8d546b924 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 200 len: 1501 microversion: 2.1 time: 0.241106 May 19 09:09:02.559284 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4848/6173] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:02 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:02.634920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ebeab029-763a-4636-9fa5-381820f43719 req-93879352-d1a8-4024-9b20-c552bba84e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd429f5-5cd6-47eb-a145-ef302c38b061", "name": "network-vif-plugged", "status": "completed", "tag": "dee7196f-2d71-4ac3-b71e-164f304c204d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:02.644099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ebeab029-763a-4636-9fa5-381820f43719 req-93879352-d1a8-4024-9b20-c552bba84e9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:02.644650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ebeab029-763a-4636-9fa5-381820f43719 req-93879352-d1a8-4024-9b20-c552bba84e9e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:02.657254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ebeab029-763a-4636-9fa5-381820f43719 req-93879352-d1a8-4024-9b20-c552bba84e9e service nova] Creating event network-vif-plugged:dee7196f-2d71-4ac3-b71e-164f304c204d for instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 on chh1-842464-2 May 19 09:09:02.662727 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ebeab029-763a-4636-9fa5-381820f43719 req-93879352-d1a8-4024-9b20-c552bba84e9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102156 May 19 09:09:02.663637 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4849/6174] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:09:02.989457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f9d2afaa-a736-45a4-b8f1-5376e4cce295 req-478a39f1-a544-4bf4-b485-0f82e7d9cb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd429f5-5cd6-47eb-a145-ef302c38b061", "name": "network-vif-deleted", "tag": "dee7196f-2d71-4ac3-b71e-164f304c204d"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:02.999657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f9d2afaa-a736-45a4-b8f1-5376e4cce295 req-478a39f1-a544-4bf4-b485-0f82e7d9cb6b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.000114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f9d2afaa-a736-45a4-b8f1-5376e4cce295 req-478a39f1-a544-4bf4-b485-0f82e7d9cb6b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.012788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f9d2afaa-a736-45a4-b8f1-5376e4cce295 req-478a39f1-a544-4bf4-b485-0f82e7d9cb6b service nova] Creating event network-vif-deleted:dee7196f-2d71-4ac3-b71e-164f304c204d for instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 on chh1-842464-2 May 19 09:09:03.017780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f9d2afaa-a736-45a4-b8f1-5376e4cce295 req-478a39f1-a544-4bf4-b485-0f82e7d9cb6b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032602 May 19 09:09:03.018427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4850/6175] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:03.578876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:03.579593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:03.586253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.586953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.587754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.588219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.602535 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] HTTP exception thrown: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Request method failure captured: May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 HTTP/1.1 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgj9qEdnSoBwqXCODIqTbASCbYdFhrN8MK5qFVKRtKGLGA-1_Br4k-yCDRAkaHXqhSm2-Qv3WYd8Esbj9KlNj88fLHowoWbehnSJVKnQ_KxaGdukJ2KqIS6TzaO-gEzoZTczzL2DcJTiCVsWPhNQCYTPjlW5GDQAF9pkNjl879zmVMU May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a020d6f46def47dcb3680968d57496da May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a020d6f46def47dcb3680968d57496da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a020d6f46def47dcb3680968d57496da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a020d6f46def47dcb3680968d57496da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a020d6f46def47dcb3680968d57496da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a020d6f46def47dcb3680968d57496da May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1197116703-project May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8cb783caaca84aa0bcb0c4b4fe88cb62 May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1197116703-project May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5bd429f5-5cd6-47eb-a145-ef302c38b061'} May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:09:03.604221 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Returning 404 to user: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a36247a4-bccb-434d-ad72-47dcf583783b tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 404 len: 111 microversion: 2.1 time: 0.033250 May 19 09:09:03.609477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4851/6176] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:03 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:09:03.621114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:03.621668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:03.628142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.628613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.629450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.629909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.644663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] HTTP exception thrown: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Request method failure captured: May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 HTTP/1.1 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgj9qEdnSoBwqXCODIqTbASCbYdFhrN8MK5qFVKRtKGLGA-1_Br4k-yCDRAkaHXqhSm2-Qv3WYd8Esbj9KlNj88fLHowoWbehnSJVKnQ_KxaGdukJ2KqIS6TzaO-gEzoZTczzL2DcJTiCVsWPhNQCYTPjlW5GDQAF9pkNjl879zmVMU May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a020d6f46def47dcb3680968d57496da May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a020d6f46def47dcb3680968d57496da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a020d6f46def47dcb3680968d57496da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a020d6f46def47dcb3680968d57496da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a020d6f46def47dcb3680968d57496da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a020d6f46def47dcb3680968d57496da May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1197116703-project May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8cb783caaca84aa0bcb0c4b4fe88cb62 May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1197116703-project May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5bd429f5-5cd6-47eb-a145-ef302c38b061'} May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:09:03.646289 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Returning 404 to user: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-97bd8c9e-ca47-4690-b287-e84ee90624a2 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 404 len: 111 microversion: 2.1 time: 0.031399 May 19 09:09:03.651103 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4852/6177] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:09:03 2022] DELETE /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:09:03.656559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:03.657216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] [instance: 5bd429f5-5cd6-47eb-a145-ef302c38b061] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:03.663610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.664079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.665107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:03.665633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:03.681420 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] HTTP exception thrown: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Request method failure captured: May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 HTTP/1.1 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgj9qEdnSoBwqXCODIqTbASCbYdFhrN8MK5qFVKRtKGLGA-1_Br4k-yCDRAkaHXqhSm2-Qv3WYd8Esbj9KlNj88fLHowoWbehnSJVKnQ_KxaGdukJ2KqIS6TzaO-gEzoZTczzL2DcJTiCVsWPhNQCYTPjlW5GDQAF9pkNjl879zmVMU May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a020d6f46def47dcb3680968d57496da May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a020d6f46def47dcb3680968d57496da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a020d6f46def47dcb3680968d57496da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a020d6f46def47dcb3680968d57496da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a020d6f46def47dcb3680968d57496da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a020d6f46def47dcb3680968d57496da May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-DeleteServersTestJSON-1197116703 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-DeleteServersTestJSON-1197116703-project May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 8cb783caaca84aa0bcb0c4b4fe88cb62 May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-DeleteServersTestJSON-1197116703-project May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '5bd429f5-5cd6-47eb-a145-ef302c38b061'} May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:09:03.683013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] Returning 404 to user: Instance 5bd429f5-5cd6-47eb-a145-ef302c38b061 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa73ecd9-7487-4051-8731-245b4b437cc1 tempest-DeleteServersTestJSON-1197116703 tempest-DeleteServersTestJSON-1197116703-project] 10.222.0.78 "GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061" status: 404 len: 111 microversion: 2.1 time: 0.031677 May 19 09:09:03.687518 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4853/6178] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:03 2022] GET /compute/v2.1/servers/5bd429f5-5cd6-47eb-a145-ef302c38b061 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:09:06.411454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1879918100", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "a07706d3-2665-4a12-9437-66fe53b9f424"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:06.465611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] validate_networks() for [('a07706d3-2665-4a12-9437-66fe53b9f424', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:09:06.917012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:09:06.917500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:09:06.917993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:09:06.918418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:09:06.918846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:09:06.928233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:06.928695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:06.929547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:06.930007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:06.947369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Getting quotas for project a40b4ffad59c4bfd860f7c2f8d9ac178. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:09:06.953786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Getting quotas for user b59260da7c354acd9f3ad458ddb37199 and project a40b4ffad59c4bfd860f7c2f8d9ac178. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:09:06.972424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:09:06.975001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:09:07.023324 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae74bda9-42f9-49d3-a593-68674c4a8a3a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743671 May 19 09:09:07.024670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4854/6179] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:09:07.035101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbef1cdf-9322-42eb-8c6a-8d6f26ce8133 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:07.035744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbef1cdf-9322-42eb-8c6a-8d6f26ce8133 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:07.097767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbef1cdf-9322-42eb-8c6a-8d6f26ce8133 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:07.106168 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbef1cdf-9322-42eb-8c6a-8d6f26ce8133 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1218 microversion: 2.1 time: 0.074920 May 19 09:09:07.106716 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4855/6180] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:07 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:08.124338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:08.125002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:08.128229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:08.134498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:08.134969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:08.135815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:08.136279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:08.265686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:08.274400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d242882-2827-4f4f-9d36-92517541f7d1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1270 microversion: 2.1 time: 0.153929 May 19 09:09:08.275093 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4856/6181] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:08 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:09.294197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:09.294918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:09.302703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:09.303174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:09.303988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:09.304445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:09.562881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:09.574313 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3ee3b32-684f-47be-b0e0-699e04b47a1c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.286075 May 19 09:09:09.575042 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4857/6182] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:09 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:09.888413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1ae9d133-afd3-476c-9c58-cb3f30e08198 req-5f97a1a2-5f9f-41ca-a424-2d8afcf68303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee", "tag": "be47f2e9-c6c2-4e86-8f86-a382ae88c5ae"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:09.897497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ae9d133-afd3-476c-9c58-cb3f30e08198 req-5f97a1a2-5f9f-41ca-a424-2d8afcf68303 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:09.898061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1ae9d133-afd3-476c-9c58-cb3f30e08198 req-5f97a1a2-5f9f-41ca-a424-2d8afcf68303 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:09.911920 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1ae9d133-afd3-476c-9c58-cb3f30e08198 req-5f97a1a2-5f9f-41ca-a424-2d8afcf68303 service nova] Creating event network-changed:be47f2e9-c6c2-4e86-8f86-a382ae88c5ae for instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee on chh1-842464-2 May 19 09:09:09.924566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1ae9d133-afd3-476c-9c58-cb3f30e08198 req-5f97a1a2-5f9f-41ca-a424-2d8afcf68303 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040226 May 19 09:09:09.925732 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4858/6183] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:10.593869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:10.594587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:10.601716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:10.602905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:10.603541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:10.604011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:10.764854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:10.772615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67c2c448-ce89-45e1-9c28-3f752100ad91 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.184166 May 19 09:09:10.773210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4859/6184] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:10 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:11.790193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:11.790846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:11.798578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:11.799047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:11.802154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:11.802154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:11.943844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:11.952691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dae231e7-3b74-423e-9bcc-fec4f6370f82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.166612 May 19 09:09:11.953323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4860/6185] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:11 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:12.970395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:12.971089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:12.978515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:12.978986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:12.979710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:12.980206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:13.124922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:13.133689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d78b991a-3978-459b-a2b0-a3781161b5c5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.166899 May 19 09:09:13.134312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4861/6186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:12 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:14.151665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:14.152480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:14.159996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:14.160472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:14.161272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:14.161760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:14.308595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:14.316478 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bfe1f4b-ab9c-46dc-a31d-2d3d9f2f530e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.169310 May 19 09:09:14.317085 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4862/6187] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:14 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:15.334968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:15.336394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:15.343757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:15.344220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:15.345004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:15.345478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:15.499227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:15.507060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-417d558d-655f-49cb-925c-19fc4d26a06c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.176136 May 19 09:09:15.508199 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4863/6188] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:15 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:16.436401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3195ebd9-5de9-4e15-a45b-a66cc93ff597 req-3ba308ae-217a-4f51-846c-626946611067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee", "name": "network-vif-plugged", "status": "completed", "tag": "be47f2e9-c6c2-4e86-8f86-a382ae88c5ae"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:16.446478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3195ebd9-5de9-4e15-a45b-a66cc93ff597 req-3ba308ae-217a-4f51-846c-626946611067 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:16.446478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3195ebd9-5de9-4e15-a45b-a66cc93ff597 req-3ba308ae-217a-4f51-846c-626946611067 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:16.459674 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3195ebd9-5de9-4e15-a45b-a66cc93ff597 req-3ba308ae-217a-4f51-846c-626946611067 service nova] Creating event network-vif-plugged:be47f2e9-c6c2-4e86-8f86-a382ae88c5ae for instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee on chh1-842464-2 May 19 09:09:16.467254 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3195ebd9-5de9-4e15-a45b-a66cc93ff597 req-3ba308ae-217a-4f51-846c-626946611067 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035228 May 19 09:09:16.468033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4864/6189] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:16.527482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:16.528245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:16.535583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:16.536063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:16.537118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:16.537642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:16.743077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:16.748957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ef44da6-4ab9-4de4-9fc8-1e601d94fc1e tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1318 microversion: 2.1 time: 0.227684 May 19 09:09:16.753483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4865/6190] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:16 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:17.767160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:17.767841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:17.779651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:17.780561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:17.795387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:17.796030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:17.797061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:17.797542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:17.978301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:17.987105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1c005e6-02c2-4af5-9048-377a575678d8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1508 microversion: 2.1 time: 0.224193 May 19 09:09:17.987860 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4866/6191] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:17 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:18.008887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:18.009520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:18.016749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.017512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.018360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.018972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.250034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:18.259848 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0ea8f19-f500-4f36-9250-2252035c09bd tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1508 microversion: 2.1 time: 0.255469 May 19 09:09:18.260374 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4867/6192] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:18 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:18.277017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:18.278253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:18.284834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.285333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.286153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.286735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.376613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ef6feaf6-3172-41af-843b-3d3e9b288f5f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "PUT /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1080 microversion: 2.1 time: 0.104021 May 19 09:09:18.377269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4868/6193] 10.222.0.78 () {60 vars in 1255 bytes} [Thu May 19 09:09:18 2022] PUT /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1080 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:18.404082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:18.405515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:18.418163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.418985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.420377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.421171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.600191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:18.609455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d8dd962b-8e78-4516-9086-858bfade64af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1506 microversion: 2.1 time: 0.213434 May 19 09:09:18.610050 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4869/6194] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:18 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:18.630754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:18.631399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:18.638805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.639279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.640272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.640558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.812981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:18.818850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:18.824858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-97f0b01a-d257-475c-baf3-0c59509c442a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1506 microversion: 2.1 time: 0.200117 May 19 09:09:18.825682 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4870/6195] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:18 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:18.843066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:18.844091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:18.852210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.852597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.853769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:18.854274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:18.891250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:18.899038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:09:18.906957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:09:18.907397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:09:18.907894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:09:18.908325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:09:18.908757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:09:19.002989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7cdadf1a-9867-472f-b134-2b35a45bdd21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "POST /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee/action" status: 202 len: 0 microversion: 2.1 time: 0.163787 May 19 09:09:19.008248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4871/6196] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:09:18 2022] POST /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:09:19.018080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:19.019251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:19.032338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:19.033179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:19.034901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:19.035566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:19.249107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:19.259772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2bb9f9c6-0764-4955-8536-e2904dde76d7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1517 microversion: 2.1 time: 0.248298 May 19 09:09:19.260976 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4872/6197] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:19 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:20.279756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:20.280566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:20.291525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:20.292117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:20.293035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:20.293740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:20.474350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:20.484381 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81466028-8cad-46c3-8298-18d41f1bc189 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1517 microversion: 2.1 time: 0.208688 May 19 09:09:20.484979 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4873/6198] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:20 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:21.511130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:21.512373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:21.526545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:21.527500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:21.529250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:21.530262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:21.748323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:21.758209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-981dc2d0-ce65-46d7-b00c-47ce049b8857 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.256769 May 19 09:09:21.759220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4874/6199] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:21 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:22.779324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:22.780232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:22.788328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:22.789520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:22.790955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:22.791427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:22.976641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:22.986399 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b268b99-db2f-4857-923c-e4e3f1df64f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.213981 May 19 09:09:22.987775 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4875/6200] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:22 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:24.005425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:24.006466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:24.014308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:24.014904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:24.015941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:24.016304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:24.253126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:24.261529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da5adcc2-68c4-4935-82b2-37fbfb916fd6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.259998 May 19 09:09:24.262152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4876/6201] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:24 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:25.280360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:25.281109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:25.289423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:25.289908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:25.290705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:25.291160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:25.469078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:25.477756 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-743384be-94dc-4eaf-9bb9-2bcdfeb66d97 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.201550 May 19 09:09:25.478386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4877/6202] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:25 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:26.496330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:26.497093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:26.504350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:26.504812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:26.505650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:26.506103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:26.643194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:26.651417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93e5d695-54d0-4b23-8195-066363ffa990 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.160069 May 19 09:09:26.652012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4878/6203] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:26 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:27.669289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:27.670381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:27.676874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:27.677374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:27.678263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:27.678767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:27.821176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:27.828910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0b11393c-4179-4fb4-93e9-442bb318312c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.163536 May 19 09:09:27.829510 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4879/6204] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:27 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:28.848185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:28.848867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:28.857056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:28.857643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:28.858593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:28.858904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:29.009096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:29.017003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2dc04174-07af-4ec5-a460-041e1b9197e5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.173790 May 19 09:09:29.017832 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4880/6205] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:28 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:30.035385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:30.036230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:30.044484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:30.044952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:30.045988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:30.046259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:30.204172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:30.212186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34d0345d-aedd-4b5d-8ab1-7f62a961fe36 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.181069 May 19 09:09:30.212778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4881/6206] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:30 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:31.230826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:31.231617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:31.239195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:31.239843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:31.241167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:31.243089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:31.395001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:31.403845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33cb1662-7b0c-4d2b-8cd8-cc15a8789b2b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.178386 May 19 09:09:31.404638 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4882/6207] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:31 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:32.425937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:32.426998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:32.435703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:32.436279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:32.437100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:32.437655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:32.655605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:32.669925 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da298ac2-eb49-4c2c-87b6-57dad74dc471 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.248839 May 19 09:09:32.670911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4883/6208] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:32 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:33.690953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:33.691979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:33.699698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:33.700172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:33.701031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:33.701526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:33.858432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:33.866303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c4c7145-78cf-44ce-b63c-4e01fd5ba734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.179602 May 19 09:09:33.867407 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4884/6209] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:33 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:34.889081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:34.890369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:34.902896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:34.903598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:34.904921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:34.905730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:35.115567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:35.129968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbc1e442-f747-4076-8d0b-5b5b75940307 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.246162 May 19 09:09:35.131121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4885/6210] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:34 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:36.158326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:36.159432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:36.167626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:36.168097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:36.177771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:36.178365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:36.183475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:36.360943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:36.370637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec57e6ed-44a6-4a71-9d05-b252d486d03f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.216233 May 19 09:09:36.371241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4886/6211] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:36 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:37.390896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:37.391620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:37.400933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:37.401679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:37.402467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:37.402905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:37.607015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:37.615303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88620e5a-f0b1-49f3-8c51-a9b56930d1d2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.228691 May 19 09:09:37.615936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4887/6212] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:37 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:38.635309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:38.636030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:38.638884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=68 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:38.644831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:38.645213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:38.646052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:38.646510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:38.857955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:38.866371 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ed53ca6-482b-4f3a-a055-249ba811f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.235866 May 19 09:09:38.866993 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4888/6213] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:38 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:39.892060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:39.893192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:39.900936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:39.901442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:39.902257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:39.902715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:40.079299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:40.090363 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4545f5f-3ba1-444d-b6d2-d7cd92d63b9a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.202210 May 19 09:09:40.090920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4889/6214] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:39 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:41.117736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:41.118813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:41.127266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:41.127754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:41.128635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:41.129108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:41.325145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:41.334748 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-601daf59-aa53-4196-9321-bd9d3fcbc969 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.221766 May 19 09:09:41.335605 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4890/6215] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:41 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:42.354739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:42.355931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:42.365979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:42.367137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:42.368650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:42.369110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:42.555738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:42.565039 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b86f7364-b0d2-49be-b7a0-071784c5f632 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.215041 May 19 09:09:42.566354 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4891/6216] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:42 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:43.584300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:43.585262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:43.593278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:43.593776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:43.594589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:43.595061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:43.797733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:43.807545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5863e8d-9f87-4f50-be17-47bc1e4040e1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.227818 May 19 09:09:43.808150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4892/6217] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:43 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:44.825779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:44.826572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:44.834857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:44.835989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:44.836814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:44.837270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:45.005286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:45.014585 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e63abf2-d9fd-466a-add9-c24521759893 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.192725 May 19 09:09:45.015206 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4893/6218] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:44 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:46.033958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:46.034697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:46.043021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:46.043718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:46.048986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:46.049391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:46.244096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:46.252445 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0174a499-9d11-4989-a414-33d6bcb947e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.224303 May 19 09:09:46.253090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4894/6219] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:46 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:47.270909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:47.271723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:47.283577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:47.284251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:47.285832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:47.286624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:47.477399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:47.486204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65d8e70e-30ce-4e05-b97c-289d40a4a271 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1522 microversion: 2.1 time: 0.219382 May 19 09:09:47.486848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4895/6220] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:47 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:48.507047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:48.508029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:48.516650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:48.517406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:48.518376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:48.518959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:49.157065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:49.172341 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6f06a49-ff7e-4a6d-8f47-a8c7b8db8224 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1521 microversion: 2.1 time: 0.668991 May 19 09:09:49.173171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4896/6221] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:48 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:49.556710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-db5c67ba-8e0b-4593-aa81-4c99119a6650 req-ea765423-d517-466f-aaae-13551a2376bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee", "name": "network-vif-unplugged", "status": "completed", "tag": "be47f2e9-c6c2-4e86-8f86-a382ae88c5ae"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:49.574638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-db5c67ba-8e0b-4593-aa81-4c99119a6650 req-ea765423-d517-466f-aaae-13551a2376bb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:49.575191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-db5c67ba-8e0b-4593-aa81-4c99119a6650 req-ea765423-d517-466f-aaae-13551a2376bb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:49.591978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-db5c67ba-8e0b-4593-aa81-4c99119a6650 req-ea765423-d517-466f-aaae-13551a2376bb service nova] Creating event network-vif-unplugged:be47f2e9-c6c2-4e86-8f86-a382ae88c5ae for instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee on chh2-842464-2 May 19 09:09:49.599263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-db5c67ba-8e0b-4593-aa81-4c99119a6650 req-ea765423-d517-466f-aaae-13551a2376bb service nova] Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:09:49.613714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-db5c67ba-8e0b-4593-aa81-4c99119a6650 req-ea765423-d517-466f-aaae-13551a2376bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062505 May 19 09:09:49.615293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4897/6222] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:50.200244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:50.201020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:50.207950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:50.208415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:50.209480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:50.210404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:50.479924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:50.488885 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ef5b985-0956-431f-b47a-29c460f77734 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1521 microversion: 2.1 time: 0.293865 May 19 09:09:50.489849 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4898/6223] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:50 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:51.508074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:51.508772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:51.516235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:51.516699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:51.517529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:51.517976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:51.680890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:51.690973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d79454b-8686-4006-83e6-d6dbe28e495c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1519 microversion: 2.1 time: 0.186964 May 19 09:09:51.691560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4899/6224] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:51 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:51.707928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c17aa46c-54b5-4b5f-a735-750ade4f8a14 req-00a3284b-8841-4417-b82e-f98387487940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee", "tag": "be47f2e9-c6c2-4e86-8f86-a382ae88c5ae"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:51.719240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c17aa46c-54b5-4b5f-a735-750ade4f8a14 req-00a3284b-8841-4417-b82e-f98387487940 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:51.719881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c17aa46c-54b5-4b5f-a735-750ade4f8a14 req-00a3284b-8841-4417-b82e-f98387487940 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:51.737498 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c17aa46c-54b5-4b5f-a735-750ade4f8a14 req-00a3284b-8841-4417-b82e-f98387487940 service nova] Creating event network-changed:be47f2e9-c6c2-4e86-8f86-a382ae88c5ae for instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee on chh2-842464-2 May 19 09:09:51.744325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-c17aa46c-54b5-4b5f-a735-750ade4f8a14 req-00a3284b-8841-4417-b82e-f98387487940 service nova] Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:09:51.763314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c17aa46c-54b5-4b5f-a735-750ade4f8a14 req-00a3284b-8841-4417-b82e-f98387487940 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070029 May 19 09:09:51.764152 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4900/6225] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:09:52.719436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:52.720619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:52.729379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:52.729843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:52.730693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:52.731144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:53.066175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:53.078797 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e21bbfd-46cc-4a25-8247-9dfb53d528cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1516 microversion: 2.1 time: 0.365449 May 19 09:09:53.079781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4901/6226] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:52 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1516 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:53.102300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:53.102860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:53.109942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:53.110430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:53.111288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:53.111849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:53.169899 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:09:53.196791 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ad35328-3b07-4ad9-971e-824f9f71a6b2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "POST /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee/action" status: 204 len: 0 microversion: 2.1 time: 0.099293 May 19 09:09:53.197681 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4902/6227] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:09:53 2022] POST /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee/action => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:09:53.207587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:53.209012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:53.222936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:53.223557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:53.224755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:53.226082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:53.538121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:53.548622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b84ec75b-1356-4744-865a-7e91890222f1 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1516 microversion: 2.1 time: 0.345677 May 19 09:09:53.549443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4903/6228] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:53 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1516 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:54.377076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1721b997-1a52-44b5-a4d9-2a61dd20b6f0 req-1662771e-90bb-473b-8910-faa31d186bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee", "name": "network-vif-plugged", "status": "completed", "tag": "be47f2e9-c6c2-4e86-8f86-a382ae88c5ae"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:54.390689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1721b997-1a52-44b5-a4d9-2a61dd20b6f0 req-1662771e-90bb-473b-8910-faa31d186bd1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:54.391225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1721b997-1a52-44b5-a4d9-2a61dd20b6f0 req-1662771e-90bb-473b-8910-faa31d186bd1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:54.408924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1721b997-1a52-44b5-a4d9-2a61dd20b6f0 req-1662771e-90bb-473b-8910-faa31d186bd1 service nova] Creating event network-vif-plugged:be47f2e9-c6c2-4e86-8f86-a382ae88c5ae for instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee on chh2-842464-2 May 19 09:09:54.418730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-1721b997-1a52-44b5-a4d9-2a61dd20b6f0 req-1662771e-90bb-473b-8910-faa31d186bd1 service nova] Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:09:54.434025 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1721b997-1a52-44b5-a4d9-2a61dd20b6f0 req-1662771e-90bb-473b-8910-faa31d186bd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061311 May 19 09:09:54.435097 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4904/6229] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:54.574066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:54.575398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:54.595477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:54.596331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:54.597785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:54.598663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:54.797466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:54.806249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edb30023-2810-4a8f-8ab3-2bdc13c00181 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1508 microversion: 2.1 time: 0.241625 May 19 09:09:54.806876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4905/6230] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:54 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:54.829029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:54.830342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:54.843781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:54.844708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:54.846266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:54.847128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:55.036438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:55.048400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfd16fc2-37b8-4515-9ef4-14fa6a3c2089 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1508 microversion: 2.1 time: 0.226923 May 19 09:09:55.049012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4906/6231] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:54 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:09:55.066868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:55.067505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:55.075772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:55.076239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:55.077042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:55.077551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:55.253153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:55.262876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e45920b-47c6-4ecc-8010-b60ddd9e0a8d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 200 len: 1508 microversion: 2.1 time: 0.200210 May 19 09:09:55.263513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4907/6232] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:55 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:55.280374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:55.280892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:55.288762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:55.289347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:55.290210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:55.290663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:55.324112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:09:55.440496 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2ce6ae42-e143-4f07-ad30-882127465a62 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "DELETE /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 204 len: 0 microversion: 2.1 time: 0.163637 May 19 09:09:55.441659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4908/6233] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:09:55 2022] DELETE /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:09:55.513696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-485544121", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "a07706d3-2665-4a12-9437-66fe53b9f424"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:55.578397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] validate_networks() for [('a07706d3-2665-4a12-9437-66fe53b9f424', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:09:56.071479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:09:56.072056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:09:56.072657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:09:56.073265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:09:56.073894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:09:56.086111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:56.086677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:56.087573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:56.088019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:56.109127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Getting quotas for project a40b4ffad59c4bfd860f7c2f8d9ac178. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:09:56.115201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Getting quotas for user b59260da7c354acd9f3ad458ddb37199 and project a40b4ffad59c4bfd860f7c2f8d9ac178. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:09:56.129877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:09:56.132721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:09:56.187891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb7ba904-1a31-44ce-a851-805ff25a0c6d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678934 May 19 09:09:56.189129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4909/6234] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:09:56.205289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-537ac191-1ca5-4218-826f-f5974e998fc7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:56.205978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-537ac191-1ca5-4218-826f-f5974e998fc7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:56.280071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-537ac191-1ca5-4218-826f-f5974e998fc7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:56.292589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-537ac191-1ca5-4218-826f-f5974e998fc7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1217 microversion: 2.1 time: 0.091990 May 19 09:09:56.293649 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4910/6235] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:56 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:57.319569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:57.322388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:57.337965 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:57.338777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:57.340311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:57.341295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:57.464992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:57.484077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b8644d8d-847c-4715-a631-7dc01e571df9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1269 microversion: 2.1 time: 0.172370 May 19 09:09:57.486525 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4911/6236] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:57 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:57.629074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-efa16686-aae1-467c-868a-e9c231751771 req-984b5c0f-4779-458b-95c0-967f817ff4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee", "name": "network-vif-deleted", "tag": "be47f2e9-c6c2-4e86-8f86-a382ae88c5ae"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:57.650078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-efa16686-aae1-467c-868a-e9c231751771 req-984b5c0f-4779-458b-95c0-967f817ff4f1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:57.650955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-efa16686-aae1-467c-868a-e9c231751771 req-984b5c0f-4779-458b-95c0-967f817ff4f1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:57.679615 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-efa16686-aae1-467c-868a-e9c231751771 req-984b5c0f-4779-458b-95c0-967f817ff4f1 service nova] Creating event network-vif-deleted:be47f2e9-c6c2-4e86-8f86-a382ae88c5ae for instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee on chh2-842464-2 May 19 09:09:57.690423 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-efa16686-aae1-467c-868a-e9c231751771 req-984b5c0f-4779-458b-95c0-967f817ff4f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067968 May 19 09:09:57.691431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4912/6237] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:58.511613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:58.512875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:58.522108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:58.522556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:58.523549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:58.524200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:58.735127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:09:58.745641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e223426b-a243-4b0f-a34b-a244fbc436f6 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1317 microversion: 2.1 time: 0.240511 May 19 09:09:58.746530 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4913/6238] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:58 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:09:59.853696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4848317c-09aa-482b-8ec2-93609c75df49 req-d722330f-b479-4e56-bdfa-1de6287d6874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ed336e-4008-4eb6-9c03-55df080623c1", "tag": "323d53f9-e5d8-4dd4-a9bf-01cc4452df4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:09:59.862682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4848317c-09aa-482b-8ec2-93609c75df49 req-d722330f-b479-4e56-bdfa-1de6287d6874 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:59.863149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4848317c-09aa-482b-8ec2-93609c75df49 req-d722330f-b479-4e56-bdfa-1de6287d6874 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:59.876431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4848317c-09aa-482b-8ec2-93609c75df49 req-d722330f-b479-4e56-bdfa-1de6287d6874 service nova] Creating event network-changed:323d53f9-e5d8-4dd4-a9bf-01cc4452df4b for instance 51ed336e-4008-4eb6-9c03-55df080623c1 on chh2-842464-2 May 19 09:09:59.882348 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4848317c-09aa-482b-8ec2-93609c75df49 req-d722330f-b479-4e56-bdfa-1de6287d6874 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121318 May 19 09:09:59.882995 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4914/6239] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:09:59.889613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:09:59.890865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:09:59.900088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:59.900665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:09:59.901707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:09:59.902265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:00.096671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:00.106837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e11fd2f-1209-4ded-8d85-4420e4e61a21 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1317 microversion: 2.1 time: 0.222448 May 19 09:10:00.107815 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4915/6240] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:09:59 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:01.125864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:01.126645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:01.136001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:01.136470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:01.137382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:01.137927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:01.328060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:01.337642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36c0bfcf-ce89-48e0-b23f-7fea296a2b1a tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1317 microversion: 2.1 time: 0.215849 May 19 09:10:01.338362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4916/6241] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:01 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:02.359089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:02.359923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:02.368461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:02.368936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:02.369800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:02.370249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:02.578289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:02.597419 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a85d685b-c585-4ff7-bcd1-e48f7bf9866b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1317 microversion: 2.1 time: 0.234520 May 19 09:10:02.597419 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4917/6242] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:02 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:03.612763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:03.613728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:03.622592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:03.623072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:03.624239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:03.624708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:03.787225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:03.801699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3693e8b-8277-4382-8f8d-c2b1e2e0e973 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1317 microversion: 2.1 time: 0.191810 May 19 09:10:03.802603 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4918/6243] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:03 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:04.423521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0305dccf-ed1f-4ca8-a810-5485c3d4428a req-c9daf416-6f58-4018-a897-d676c31e7d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ed336e-4008-4eb6-9c03-55df080623c1", "name": "network-vif-plugged", "status": "completed", "tag": "323d53f9-e5d8-4dd4-a9bf-01cc4452df4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:04.440938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0305dccf-ed1f-4ca8-a810-5485c3d4428a req-c9daf416-6f58-4018-a897-d676c31e7d57 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:04.441839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0305dccf-ed1f-4ca8-a810-5485c3d4428a req-c9daf416-6f58-4018-a897-d676c31e7d57 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:04.465649 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0305dccf-ed1f-4ca8-a810-5485c3d4428a req-c9daf416-6f58-4018-a897-d676c31e7d57 service nova] Creating event network-vif-plugged:323d53f9-e5d8-4dd4-a9bf-01cc4452df4b for instance 51ed336e-4008-4eb6-9c03-55df080623c1 on chh2-842464-2 May 19 09:10:04.476076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0305dccf-ed1f-4ca8-a810-5485c3d4428a req-c9daf416-6f58-4018-a897-d676c31e7d57 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058605 May 19 09:10:04.477829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4919/6244] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:10:04.823427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:04.824603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:04.832595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:04.834247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:04.835491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:04.835669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:05.013859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:05.023572 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bdba782d-b35a-43ee-b364-31bd12e268cb tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1317 microversion: 2.1 time: 0.207349 May 19 09:10:05.024336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4920/6245] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:04 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:06.041264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:06.042401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:06.052232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.052853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.054455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.055024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.090206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:06.095748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:06.250604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:06.266326 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7e9dd65-267b-4721-8ca0-b5bbc95b5ec0 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1507 microversion: 2.1 time: 0.229249 May 19 09:10:06.267368 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4921/6246] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:06 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:06.286500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:06.287310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:06.291191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:06.300523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.301084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.301948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.302475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.480275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:06.494828 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edb38c41-b16a-4fee-9e31-29187bb4e7ad tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1507 microversion: 2.1 time: 0.213403 May 19 09:10:06.495642 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4922/6247] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:06 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:06.514722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:06.515836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:06.523843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.524316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.525138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.525659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.568252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:06.575590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:10:06.583726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:10:06.585110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:10:06.586337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:10:06.586920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:10:06.587401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:10:06.715664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f62dd1e-9b94-426c-989f-ff156ba6dba9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "POST /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1/action" status: 202 len: 0 microversion: 2.1 time: 0.204572 May 19 09:10:06.717057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4923/6248] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:10:06 2022] POST /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:10:06.731927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:06.733122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:06.743383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.743849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.745940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:06.745940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:06.972936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:06.990296 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76d7a466-571a-41db-995e-0f2ebe55f010 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1514 microversion: 2.1 time: 0.265867 May 19 09:10:07.000207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4924/6249] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:06 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:07.344523 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:10:07.345181 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:10:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:10:08.024368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:08.025538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:08.030834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:08.042850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:08.043665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:08.045055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:08.046073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:08.261549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:08.278291 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51958fd5-ffde-44a2-9df5-9deeb68f9cf5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1514 microversion: 2.1 time: 0.261498 May 19 09:10:08.279174 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4925/6250] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:08 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:09.309513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:09.310410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:09.319120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:09.319813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:09.320786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:09.321446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:09.533268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:09.546981 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d94c0a2-00b6-4b2f-a661-0705ec4adab5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.241531 May 19 09:10:09.547958 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4926/6251] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:09 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:10.577149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:10.578276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:10.588252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:10.588955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:10.589920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:10.590477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:10.783912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:10.793960 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80bcbbfd-40fe-456f-adb7-8a742415883c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.223445 May 19 09:10:10.794749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4927/6252] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:10 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:11.812273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:11.813282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:11.829853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:11.830338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:11.831194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:11.831652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:11.992284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:12.000417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8582456f-b781-4305-a960-05d0bf84984d tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.192106 May 19 09:10:12.001018 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4928/6253] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:11 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:13.020286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:13.022355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:13.030678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:13.031149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:13.032017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:13.032603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:13.212048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:13.227480 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a44fceb8-a86f-4aa9-a5a4-19f87e1764ed tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.211921 May 19 09:10:13.228375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4929/6254] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:13 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:14.253725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:14.254807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:14.262462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:14.262993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:14.263846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:14.264388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:14.444905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:14.453037 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-500934c9-a570-4f8a-a1db-fd12a69d3e79 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.203583 May 19 09:10:14.453675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4930/6255] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:14 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:15.480958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:15.481797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:15.491377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:15.491923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:15.492878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:15.493541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:15.691435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:15.704200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bf1221bd-d8fc-4f65-ab97-ac6aad5ca043 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.237072 May 19 09:10:15.705293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4931/6256] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:15 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:16.729368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:16.730650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:16.743414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:16.744029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:16.744891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:16.745379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:16.933126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:16.942958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2617304-81ca-4c05-96ef-af33c560e4e2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.222508 May 19 09:10:16.943753 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4932/6257] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:16 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:17.964488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:17.965484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:17.976734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:17.977421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:17.978519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:17.979203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:18.164626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:18.173265 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e1840d9-de8c-404f-b03f-0c108668a84b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.216573 May 19 09:10:18.173905 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4933/6258] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:17 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:19.197830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:19.198925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:19.211910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:19.212689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:19.214159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:19.214992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:19.417892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:19.426891 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2bb9f76-2aeb-4b69-8102-efdb535f2d56 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.236446 May 19 09:10:19.427661 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4934/6259] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:19 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:20.447974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:20.448889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:20.456828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:20.457527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:20.458679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:20.460127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:20.682623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:20.692493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e186cc6d-8838-4e26-b2b7-9d148cff9c82 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.249594 May 19 09:10:20.693377 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4935/6260] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:20 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:21.715971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:21.716662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:21.730172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:21.731027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:21.732609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:21.733430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:21.999409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:22.002435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:22.011805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e9886add-a6f5-47ed-924c-53a5e4beecbe tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.302997 May 19 09:10:22.012418 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4936/6261] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:21 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:23.033810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:23.034955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:23.049968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:23.050694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:23.052028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:23.053659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:23.265817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:23.275067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9644beb1-39aa-4948-9fa2-0223acb5356c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.247825 May 19 09:10:23.276112 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4937/6262] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:23 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:24.306567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:24.307581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:24.315572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:24.316041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:24.316843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:24.317421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:24.502648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:24.511863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c561d18-c8cb-4286-aef9-1d5b0f1e9355 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.210661 May 19 09:10:24.512487 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4938/6263] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:24 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:25.530206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:25.530911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:25.541880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:25.542943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:25.544265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:25.545121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:25.721997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:25.731338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65a1029c-c39c-4ce4-8847-595fafc8998b tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.205634 May 19 09:10:25.731948 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4939/6264] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:25 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:26.286638 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:10:26.287966 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:10:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:10:26.758197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:26.759230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:26.768596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:26.769209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:26.770170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:26.770725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:26.947051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:26.969357 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbc18eca-3440-476f-9a41-9c3fceed05af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.215863 May 19 09:10:26.970041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4940/6265] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:26 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:27.987560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:27.988323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:27.997411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:27.998035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:27.999086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:27.999740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:28.204661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:28.214227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3044c60a-7ec5-4aef-b400-9dc2a1a7d5f5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.230886 May 19 09:10:28.214856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4941/6266] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:27 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:29.233147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:29.233863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:29.241984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:29.242450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:29.243259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:29.243717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:29.399694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:29.408332 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc52bb1c-5123-415f-86bf-c38e0bf0e5a9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.178962 May 19 09:10:29.408938 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4942/6267] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:29 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:30.427295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:30.428835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:30.436727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:30.437198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:30.438065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:30.438526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:30.594501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:30.603535 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-914a4f46-ff28-4bb0-9272-3c93e2c26c66 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.180387 May 19 09:10:30.604200 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4943/6268] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:30 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:31.621218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:31.622009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:31.629489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:31.629952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:31.631761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:31.632445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:31.824074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:31.832552 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2e847fc-3cd9-4522-b881-494e418980b7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.215223 May 19 09:10:31.833167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4944/6269] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:31 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:32.862433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:32.863641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:32.876576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:32.877453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:32.878884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:32.879662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:33.055706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:33.064282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16aa3fc1-c04b-4000-b8c9-7f837997e589 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.209436 May 19 09:10:33.064899 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4945/6270] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:32 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:34.082699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:34.084303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:34.092460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:34.101668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:34.102549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:34.103009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:34.289488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:34.298452 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc08f2ba-1184-4112-9fbe-358992ea1c4c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.219605 May 19 09:10:34.299070 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4946/6271] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:34 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:35.319027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:35.319927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:35.327252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:35.327705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:35.328592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:35.329040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:35.523463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:35.532277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6d38ecd-7c1d-4897-8b78-76af3853bbd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1519 microversion: 2.1 time: 0.217881 May 19 09:10:35.532892 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4947/6272] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:35 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:36.552115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:36.553149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:36.561088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:36.561591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:36.562414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:36.562871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:37.194638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:37.203297 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-583a0e6c-de26-478a-9a12-9d2a08a2d0e8 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1518 microversion: 2.1 time: 0.655883 May 19 09:10:37.204019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4948/6273] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:36 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1518 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:37.258804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-364abaa6-c738-481a-bed0-96ddd98b7aeb req-edcf540a-bc2e-4e30-b25a-b0150804df9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ed336e-4008-4eb6-9c03-55df080623c1", "name": "network-vif-unplugged", "status": "completed", "tag": "323d53f9-e5d8-4dd4-a9bf-01cc4452df4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:37.267985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-364abaa6-c738-481a-bed0-96ddd98b7aeb req-edcf540a-bc2e-4e30-b25a-b0150804df9c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:37.268438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-364abaa6-c738-481a-bed0-96ddd98b7aeb req-edcf540a-bc2e-4e30-b25a-b0150804df9c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:37.282429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-364abaa6-c738-481a-bed0-96ddd98b7aeb req-edcf540a-bc2e-4e30-b25a-b0150804df9c service nova] Creating event network-vif-unplugged:323d53f9-e5d8-4dd4-a9bf-01cc4452df4b for instance 51ed336e-4008-4eb6-9c03-55df080623c1 on chh1-842464-2 May 19 09:10:37.289905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-364abaa6-c738-481a-bed0-96ddd98b7aeb req-edcf540a-bc2e-4e30-b25a-b0150804df9c service nova] Instance 51ed336e-4008-4eb6-9c03-55df080623c1 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:10:37.302851 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-364abaa6-c738-481a-bed0-96ddd98b7aeb req-edcf540a-bc2e-4e30-b25a-b0150804df9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048358 May 19 09:10:37.303898 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4949/6274] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:10:38.228624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:38.230021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:38.231400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=50 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:38.237767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:38.238300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:38.239161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:38.239782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:38.433043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:38.444177 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b00fdc7-417f-4e5b-8b6d-7043452f670f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1516 microversion: 2.1 time: 0.225398 May 19 09:10:38.444821 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4950/6275] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:38 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:39.320475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9acd3c8e-25fa-4025-8caa-04a310baad0b req-8eea4877-0ae9-4ae0-a980-ffc1becb0ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ed336e-4008-4eb6-9c03-55df080623c1", "tag": "323d53f9-e5d8-4dd4-a9bf-01cc4452df4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:39.331389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9acd3c8e-25fa-4025-8caa-04a310baad0b req-8eea4877-0ae9-4ae0-a980-ffc1becb0ae2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:39.331865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9acd3c8e-25fa-4025-8caa-04a310baad0b req-8eea4877-0ae9-4ae0-a980-ffc1becb0ae2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:39.346229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9acd3c8e-25fa-4025-8caa-04a310baad0b req-8eea4877-0ae9-4ae0-a980-ffc1becb0ae2 service nova] Creating event network-changed:323d53f9-e5d8-4dd4-a9bf-01cc4452df4b for instance 51ed336e-4008-4eb6-9c03-55df080623c1 on chh1-842464-2 May 19 09:10:39.353272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-9acd3c8e-25fa-4025-8caa-04a310baad0b req-8eea4877-0ae9-4ae0-a980-ffc1becb0ae2 service nova] Instance 51ed336e-4008-4eb6-9c03-55df080623c1 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:10:39.365537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9acd3c8e-25fa-4025-8caa-04a310baad0b req-8eea4877-0ae9-4ae0-a980-ffc1becb0ae2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048469 May 19 09:10:39.366238 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4951/6276] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:10:39.464298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:39.465103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:39.472362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:39.472931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:39.473871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:39.476078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:39.780650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:39.804688 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13e61986-5bda-40a0-8904-a4d442cb1fd7 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1516 microversion: 2.1 time: 0.345813 May 19 09:10:39.814799 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4952/6277] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:39 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:40.836671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:40.838130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:40.851013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:40.852120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:40.856271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:40.856774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:41.057786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:41.069543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7e577c8-4606-43e7-84e3-cb86d70d32e9 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1513 microversion: 2.1 time: 0.240730 May 19 09:10:41.070150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4953/6278] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:40 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:41.092458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:41.093254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:41.101384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:41.101866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:41.102719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:41.103160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:41.106597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:41.175521 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39aa8bf7-8cb6-4f11-8018-bf6e8bba00a2 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "POST /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1/action" status: 204 len: 0 microversion: 2.1 time: 0.087476 May 19 09:10:41.176347 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4954/6279] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:10:41 2022] POST /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:10:41.187284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:41.188040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:41.197224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:41.197907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:41.198850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:41.199696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:41.394349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:41.405049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-912cf097-5eee-4a4e-ba2b-a14b962e63f3 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1513 microversion: 2.1 time: 0.223084 May 19 09:10:41.406029 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4955/6280] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:41 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:42.425232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:42.426448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:42.435426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:42.436214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:42.437977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:42.437977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:42.679835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:42.693980 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2e7eae6-a0f2-4ee4-a650-7cb772a55d27 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1513 microversion: 2.1 time: 0.273871 May 19 09:10:42.695049 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4956/6281] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:42 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:43.714676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:43.715669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:43.724809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:43.725500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:43.726384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:43.726827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:43.887013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:43.896241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fafad28b-76fc-4b0b-9f92-9d8304f21f40 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1505 microversion: 2.1 time: 0.187249 May 19 09:10:43.897248 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4957/6282] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:43 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:43.914964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:43.915609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:43.922814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:43.923283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:43.924095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:43.924553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.096113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:44.105035 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee1f20da-e8d2-4863-b4e4-c79036b84b61 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1505 microversion: 2.1 time: 0.195237 May 19 09:10:44.105682 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4958/6283] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:43 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:44.135290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:44.136421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:44.148073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.148879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.150295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.151068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.319874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:44.337202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f3384bc-e527-42b5-8d5b-76a7e78b1e81 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1505 microversion: 2.1 time: 0.210395 May 19 09:10:44.337861 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4959/6284] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:44 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:10:44.356266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:44.356826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:44.363726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.364192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.365978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.366496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.408878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:10:44.510314 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6503401a-c1c1-412e-b412-a469d4037404 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "DELETE /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 204 len: 0 microversion: 2.1 time: 0.158165 May 19 09:10:44.511311 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4960/6285] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:10:44 2022] DELETE /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:10:44.530914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:44.531632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:44.542104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.542817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.544080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.544538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.576260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:10:44.638366 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.compute.api [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Instance is already in deleting state, ignoring this request May 19 09:10:44.639622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f033766f-cab2-4d45-85e8-f32cf0fb5ea5 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "DELETE /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 204 len: 0 microversion: 2.1 time: 0.112926 May 19 09:10:44.640477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4961/6286] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:10:44 2022] DELETE /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:10:44.650607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:44.651729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:44.658821 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.659445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.660483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.661059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.858397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:44.872118 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e98cd826-21d3-4410-8c30-813dbb02d892 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1511 microversion: 2.1 time: 0.226120 May 19 09:10:44.873098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4962/6287] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:44 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:44.889758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dff2a42e-178b-49f8-bbe7-2ea54efaeb89 req-8874980b-9ab2-496a-89b4-bd33f29218ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ed336e-4008-4eb6-9c03-55df080623c1", "name": "network-vif-plugged", "status": "completed", "tag": "323d53f9-e5d8-4dd4-a9bf-01cc4452df4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:44.902947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dff2a42e-178b-49f8-bbe7-2ea54efaeb89 req-8874980b-9ab2-496a-89b4-bd33f29218ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:44.904160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dff2a42e-178b-49f8-bbe7-2ea54efaeb89 req-8874980b-9ab2-496a-89b4-bd33f29218ee service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:44.921506 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dff2a42e-178b-49f8-bbe7-2ea54efaeb89 req-8874980b-9ab2-496a-89b4-bd33f29218ee service nova] Creating event network-vif-plugged:323d53f9-e5d8-4dd4-a9bf-01cc4452df4b for instance 51ed336e-4008-4eb6-9c03-55df080623c1 on chh1-842464-2 May 19 09:10:44.927751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dff2a42e-178b-49f8-bbe7-2ea54efaeb89 req-8874980b-9ab2-496a-89b4-bd33f29218ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042267 May 19 09:10:44.928577 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4963/6288] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:10:45.899883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:45.900686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:45.909565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:45.910060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:45.910990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:45.911510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:46.265628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59260da7c354acd9f3ad458ddb37199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40b4ffad59c4bfd860f7c2f8d9ac178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:46.276689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0a44151-61dd-4c54-ae6b-a68320d6c425 tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 200 len: 1511 microversion: 2.1 time: 0.383162 May 19 09:10:46.277663 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4964/6289] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:45 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:10:46.621919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c5954dac-148a-4b58-a22a-0ed3afc12a6e req-f82c4a11-2cda-4b5b-9a52-265780ec7c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ed336e-4008-4eb6-9c03-55df080623c1", "name": "network-vif-deleted", "tag": "323d53f9-e5d8-4dd4-a9bf-01cc4452df4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:46.638510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c5954dac-148a-4b58-a22a-0ed3afc12a6e req-f82c4a11-2cda-4b5b-9a52-265780ec7c25 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:46.639337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c5954dac-148a-4b58-a22a-0ed3afc12a6e req-f82c4a11-2cda-4b5b-9a52-265780ec7c25 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:46.662747 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c5954dac-148a-4b58-a22a-0ed3afc12a6e req-f82c4a11-2cda-4b5b-9a52-265780ec7c25 service nova] Creating event network-vif-deleted:323d53f9-e5d8-4dd4-a9bf-01cc4452df4b for instance 51ed336e-4008-4eb6-9c03-55df080623c1 on chh1-842464-2 May 19 09:10:46.672002 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c5954dac-148a-4b58-a22a-0ed3afc12a6e req-f82c4a11-2cda-4b5b-9a52-265780ec7c25 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057795 May 19 09:10:46.673197 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4965/6290] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:10:47.295827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:47.296717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 51ed336e-4008-4eb6-9c03-55df080623c1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:47.304863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:47.305383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:47.306291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:47.306783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:47.324651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] HTTP exception thrown: Instance 51ed336e-4008-4eb6-9c03-55df080623c1 could not be found. May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Request method failure captured: May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 HTTP/1.1 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgkyFcoqFhdt9e58Mqz9MkS_LkLwPW7Hx7yKTVwGSbtF-ZUIShTbSCeCAx0IhztAObmmB2wWY7vlckGgdRWs1byTkhftqNDDuE1TAyOpRMSN3-R-476jfpAJImHY5TW8PvP9lioedExvmTtoMj9o-OD7zS_o0zCujjUw2TrjJ-U1ugc May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a40b4ffad59c4bfd860f7c2f8d9ac178 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a40b4ffad59c4bfd860f7c2f8d9ac178 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerDiskConfigTestJSON-1200633327-project May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b59260da7c354acd9f3ad458ddb37199 May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerDiskConfigTestJSON-1200633327-project May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 51ed336e-4008-4eb6-9c03-55df080623c1 could not be found. May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '51ed336e-4008-4eb6-9c03-55df080623c1'} May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ed336e-4008-4eb6-9c03-55df080623c1 could not be found. May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ed336e-4008-4eb6-9c03-55df080623c1 could not be found. May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:10:47.326473 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ed336e-4008-4eb6-9c03-55df080623c1 could not be found. May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Returning 404 to user: Instance 51ed336e-4008-4eb6-9c03-55df080623c1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58b2eed7-2bb9-4cf0-acf6-55c786d752af tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1" status: 404 len: 111 microversion: 2.1 time: 0.037744 May 19 09:10:47.335542 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4966/6291] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:47 2022] GET /compute/v2.1/servers/51ed336e-4008-4eb6-9c03-55df080623c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:10:47.338430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:47.338971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:47.346075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:47.346546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:47.347395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:47.348121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:47.367325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] HTTP exception thrown: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Request method failure captured: May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee HTTP/1.1 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgkyFcoqFhdt9e58Mqz9MkS_LkLwPW7Hx7yKTVwGSbtF-ZUIShTbSCeCAx0IhztAObmmB2wWY7vlckGgdRWs1byTkhftqNDDuE1TAyOpRMSN3-R-476jfpAJImHY5TW8PvP9lioedExvmTtoMj9o-OD7zS_o0zCujjUw2TrjJ-U1ugc May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a40b4ffad59c4bfd860f7c2f8d9ac178 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a40b4ffad59c4bfd860f7c2f8d9ac178 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerDiskConfigTestJSON-1200633327-project May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b59260da7c354acd9f3ad458ddb37199 May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerDiskConfigTestJSON-1200633327-project May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee'} May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:10:47.369054 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Returning 404 to user: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9cdd9865-0c01-4e4d-9405-b6abfeeddc7f tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "DELETE /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 404 len: 111 microversion: 2.1 time: 0.036770 May 19 09:10:47.374122 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4967/6292] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:10:47 2022] DELETE /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:10:47.385127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:47.386351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] [instance: 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:47.398856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:47.399663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:47.401086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:47.401944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:47.431823 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] HTTP exception thrown: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Request method failure captured: May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee HTTP/1.1 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgkyFcoqFhdt9e58Mqz9MkS_LkLwPW7Hx7yKTVwGSbtF-ZUIShTbSCeCAx0IhztAObmmB2wWY7vlckGgdRWs1byTkhftqNDDuE1TAyOpRMSN3-R-476jfpAJImHY5TW8PvP9lioedExvmTtoMj9o-OD7zS_o0zCujjUw2TrjJ-U1ugc May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a40b4ffad59c4bfd860f7c2f8d9ac178 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a40b4ffad59c4bfd860f7c2f8d9ac178"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a40b4ffad59c4bfd860f7c2f8d9ac178 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1200633327 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerDiskConfigTestJSON-1200633327-project May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: b59260da7c354acd9f3ad458ddb37199 May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerDiskConfigTestJSON-1200633327-project May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee'} May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:10:47.435010 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] Returning 404 to user: Instance 56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7958c761-42c3-4bbb-b44d-a29bf4436f0c tempest-ServerDiskConfigTestJSON-1200633327 tempest-ServerDiskConfigTestJSON-1200633327-project] 10.222.0.78 "GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee" status: 404 len: 111 microversion: 2.1 time: 0.061254 May 19 09:10:47.441539 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4968/6293] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:47 2022] GET /compute/v2.1/servers/56e39e6c-ba2f-4a3e-9c4c-8a98b8d29fee => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:10:55.997885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6846723-e891-4b34-a70c-62cd3dd8638a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'create', calling method: .version_select at 0x7f321110d0d0>, body: {"keypair": {"name": "tempest-keypair-1831610942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCB10arOQObPJNueYfRMwRd+yUKswqfD3ml81b+uM64yP5wIsuFNUnRj2mbBHBOKM8CKOXrMLQl9JdPtNsNexEqwoBAO8InAaKJdJRJoxQONnU7b5I/SRfpMvBqvurnVA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:56.028531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c6846723-e891-4b34-a70c-62cd3dd8638a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:10:56.040723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c6846723-e891-4b34-a70c-62cd3dd8638a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:10:56.092536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6846723-e891-4b34-a70c-62cd3dd8638a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328596 May 19 09:10:56.093609 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4969/6294] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:10:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:10:58.123968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:10:58.131249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-208043990", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "090ff69e-1ae4-4e7a-a1bc-07327ed81938"}], "security_groups": [{"name": "tempest-securitygroup--1342956845"}], "key_name": "tempest-keypair-1831610942", "user_data": "}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:10:58.547912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] validate_networks() for [('090ff69e-1ae4-4e7a-a1bc-07327ed81938', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:10:59.137757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:10:59.138855 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:10:59.139247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:10:59.139827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:10:59.140346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:10:59.154935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:59.155660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:59.157009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:10:59.157770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:10:59.198877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:10:59.205728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:10:59.222221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:10:59.225764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:10:59.285691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03808bc9-05e8-42eb-8aeb-da5e1996beac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.163812 May 19 09:10:59.293076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4970/6295] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:10:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:10:59.305208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f597f95-800b-4446-8217-67c2a49f6483 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:10:59.306045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f597f95-800b-4446-8217-67c2a49f6483 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:10:59.377381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f597f95-800b-4446-8217-67c2a49f6483 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:10:59.392060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f597f95-800b-4446-8217-67c2a49f6483 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1238 microversion: 2.1 time: 0.093877 May 19 09:10:59.393629 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4971/6296] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:10:59 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:00.420912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:00.421974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:00.433274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:00.434159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:00.435579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:00.436386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:00.542674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:00.556195 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bec891ba-564c-40df-aa96-26591e02af4b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1290 microversion: 2.1 time: 0.139973 May 19 09:11:00.557359 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4972/6297] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:00 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:01.586388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:01.587628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:01.601187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:01.602042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:01.603498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:01.604299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:01.710478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:01.722056 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed77632d-d889-4eaf-80c6-2b46be85766b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1296 microversion: 2.1 time: 0.141520 May 19 09:11:01.724390 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4973/6298] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:01 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1296 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:02.752367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:02.753182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:02.764116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:02.764711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:02.765807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:02.766426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:02.986769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:03.012965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26db7408-3f8d-4cfe-9190-eabbcaa0e321 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1364 microversion: 2.1 time: 0.267343 May 19 09:11:03.013937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4974/6299] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:02 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:03.035581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e3583510-dba3-4851-acac-e0c57125fbee req-5f786e5d-a5dc-46ca-b5bd-6204b29931a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:03.047565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e3583510-dba3-4851-acac-e0c57125fbee req-5f786e5d-a5dc-46ca-b5bd-6204b29931a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:03.048372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e3583510-dba3-4851-acac-e0c57125fbee req-5f786e5d-a5dc-46ca-b5bd-6204b29931a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:03.064811 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e3583510-dba3-4851-acac-e0c57125fbee req-5f786e5d-a5dc-46ca-b5bd-6204b29931a8 service nova] Creating event network-changed:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh2-842464-2 May 19 09:11:03.071047 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e3583510-dba3-4851-acac-e0c57125fbee req-5f786e5d-a5dc-46ca-b5bd-6204b29931a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043466 May 19 09:11:03.071887 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4975/6300] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:11:04.043949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:04.045206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:04.054914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:04.055384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:04.056198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:04.056656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:04.245447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:04.255138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-baa7d8ac-dc4a-460d-b6ac-01250238c812 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1364 microversion: 2.1 time: 0.218537 May 19 09:11:04.256625 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4976/6301] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:04 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:05.276830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:05.277678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:05.285493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:05.286941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:05.288183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:05.288705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:05.467440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:05.482690 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a7943282-70a8-4c08-8d0d-ce26e0451a08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1364 microversion: 2.1 time: 0.209753 May 19 09:11:05.483654 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4977/6302] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:05 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:06.509799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:06.510727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:06.519554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:06.520358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:06.522256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:06.522752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:06.692003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:06.702287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd5e632d-f56e-4b47-b470-bd99ca7bc2a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1364 microversion: 2.1 time: 0.197620 May 19 09:11:06.703061 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4978/6303] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:06 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:07.727111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:07.728251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:07.742138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:07.742948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:07.744559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:07.745299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:07.923037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:07.931790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6afc1a7-c841-452b-8418-f2476c660c25 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1364 microversion: 2.1 time: 0.212413 May 19 09:11:07.932536 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4979/6304] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:07 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:08.792312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fb809c14-627f-4eeb-9e86-e483b687ee57 req-80a56e70-8b7d-4fba-9945-71b5157b9468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "name": "network-vif-plugged", "status": "completed", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:08.800279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:08.812986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fb809c14-627f-4eeb-9e86-e483b687ee57 req-80a56e70-8b7d-4fba-9945-71b5157b9468 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:08.814062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fb809c14-627f-4eeb-9e86-e483b687ee57 req-80a56e70-8b7d-4fba-9945-71b5157b9468 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:08.839624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fb809c14-627f-4eeb-9e86-e483b687ee57 req-80a56e70-8b7d-4fba-9945-71b5157b9468 service nova] Creating event network-vif-plugged:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh2-842464-2 May 19 09:11:08.850205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fb809c14-627f-4eeb-9e86-e483b687ee57 req-80a56e70-8b7d-4fba-9945-71b5157b9468 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066588 May 19 09:11:08.851309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4980/6305] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:11:08.950990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:08.951713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:08.959781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:08.960250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:08.961063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:08.961564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:09.141830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:09.150659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c4c87de-94f8-4dc2-896d-539fe11fea76 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1364 microversion: 2.1 time: 0.203776 May 19 09:11:09.151281 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4981/6306] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:08 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:10.169904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:10.170926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:10.172887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:10.173960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:10.182969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:10.183438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:10.184255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:10.184716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:10.406420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:10.415908 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e5568f4-00b7-4541-9815-2324429917fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1552 microversion: 2.1 time: 0.250604 May 19 09:11:10.416548 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4982/6307] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:10 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1552 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:10.443004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:10.443479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:10.450575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:10.451036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:10.452244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:10.452697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:10.551178 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-696e44e0-989f-4813-a074-261f1b041727 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112707 May 19 09:11:10.553234 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4983/6308] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 09:11:10 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:11:12.095837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:12.096733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:12.104458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:12.104914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:12.105748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:12.106198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:12.274938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:12.288472 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8b26fce5-9032-4e21-a807-43b0e1a58c7d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1552 microversion: 2.1 time: 0.199573 May 19 09:11:12.289212 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4984/6309] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:12 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:12.294921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e88a4d5d-76a2-4c4f-bf2c-b39eba680e6a req-198e8764-ec32-43c4-9e01-fc2873f43311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:12.307216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e88a4d5d-76a2-4c4f-bf2c-b39eba680e6a req-198e8764-ec32-43c4-9e01-fc2873f43311 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:12.308116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e88a4d5d-76a2-4c4f-bf2c-b39eba680e6a req-198e8764-ec32-43c4-9e01-fc2873f43311 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:12.324470 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e88a4d5d-76a2-4c4f-bf2c-b39eba680e6a req-198e8764-ec32-43c4-9e01-fc2873f43311 service nova] Creating event network-changed:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh2-842464-2 May 19 09:11:12.330293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e88a4d5d-76a2-4c4f-bf2c-b39eba680e6a req-198e8764-ec32-43c4-9e01-fc2873f43311 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039440 May 19 09:11:12.331305 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4985/6310] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:11:12.339689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:12.340891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:12.349850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:12.350320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:12.351157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:12.351617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:12.564755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:12.576646 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55d1b4f9-b2ec-4d34-937f-d430261ccb23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1552 microversion: 2.1 time: 0.243997 May 19 09:11:12.578225 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4986/6311] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:12 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1552 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:13.601484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:13.602735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:13.616271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:13.617103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:13.618629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:13.619462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:13.851170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:13.860283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9666ae81-b832-4716-b8a9-6e19ac6f60c1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1671 microversion: 2.1 time: 0.267259 May 19 09:11:13.860788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4987/6312] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:13 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:13.889847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:13.891024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:13.905364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:13.906237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:13.907747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:13.908557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:14.132194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:14.141583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aef99c98-9df1-4b68-9390-7caac76ed715 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1671 microversion: 2.1 time: 0.259153 May 19 09:11:14.142392 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4988/6313] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:13 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:14.161692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:14.162866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:14.169721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:14.170331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:14.171317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:14.171874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:14.214356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:14.223777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:11:14.230970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:11:14.231390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:11:14.231876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:11:14.232291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:11:14.232707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:11:14.266461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:14.309364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9b7f7000-1ebd-4062-9a5b-f3c78f1c2010 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c/action" status: 202 len: 0 microversion: 2.1 time: 0.152231 May 19 09:11:14.312987 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4989/6314] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:11:14 2022] POST /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:11:14.320579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:14.321398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:14.329092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:14.329603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:14.330446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:14.330896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:14.547323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:14.566566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9dded9ff-82c4-43eb-9da3-e3accd5f4f26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1680 microversion: 2.1 time: 0.244853 May 19 09:11:14.573758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4990/6315] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:14 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:15.595800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:15.596577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:15.606210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:15.606762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:15.607623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:15.608084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:15.803619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:15.814938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76556f57-9a00-4bad-98a6-654e9707d41e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1680 microversion: 2.1 time: 0.223296 May 19 09:11:15.816209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4991/6316] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:15 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:16.836407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:16.837532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:16.845205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:16.845688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:16.846484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:16.846931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:17.007717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:17.017141 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2c69f4a4-2b81-4f1a-b607-062014028f5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.186155 May 19 09:11:17.018001 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4992/6317] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:16 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:18.037278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:18.038091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:18.046730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:18.047349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:18.048152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:18.048609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:18.229431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:18.244150 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b387e0e8-ed1a-455e-bf96-af8cfa43c956 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.210839 May 19 09:11:18.245223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4993/6318] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:18 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:19.273367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:19.274057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:19.281646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:19.282111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:19.282908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:19.283363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:19.476932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:19.486130 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca02364f-21bf-4975-acca-4b961d20d584 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.217684 May 19 09:11:19.487223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4994/6319] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:19 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:20.506765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:20.507562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:20.516576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:20.517048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:20.517896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:20.518357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:20.684377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:20.693281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa303fdd-6a92-4cee-87a8-86e05db812bf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.191500 May 19 09:11:20.693926 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4995/6320] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:20 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:21.719517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:21.720223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:21.729468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:21.730051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:21.730862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:21.731319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:21.901240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:21.909342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7955c37b-0582-4eaf-92fd-1a553822c3cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.194720 May 19 09:11:21.909953 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4996/6321] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:21 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:22.930655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:22.932017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:22.944640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:22.945490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:22.946931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:22.948028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:23.178589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:23.193159 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87f6ee33-bad3-4a58-85af-ceada9e25150 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.268674 May 19 09:11:23.194295 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4997/6322] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:22 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:24.218023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:24.219147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:24.232546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:24.233387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:24.234730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:24.235514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:24.422731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:24.437005 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d3210e2-ae14-4634-9da3-c8dcc3da775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.225815 May 19 09:11:24.438074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4998/6323] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:24 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:25.458406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:25.459190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:25.467314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:25.468011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:25.468985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:25.469524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:25.633437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:25.642648 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fde154c8-d580-4870-8376-952051eeae86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.189632 May 19 09:11:25.643267 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 4999/6324] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:25 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:26.665137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:26.666129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:26.674221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:26.674691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:26.675540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:26.675997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:26.868540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:26.879176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7798677-ce98-45bd-a85e-5af15eb5a2c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.221346 May 19 09:11:26.880087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5000/6325] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:26 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:27.899903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:27.900973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:27.909015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:27.909530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:27.910857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:27.911542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:28.077046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:28.086348 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbaa585c-f614-445b-832b-0c74f20ec7db tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.192230 May 19 09:11:28.086957 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5001/6326] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:27 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:29.106026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:29.107194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:29.116474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:29.117001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:29.118056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:29.118602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:29.298809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:29.315055 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71bc9c52-1fa1-40f1-9549-30b3c66f3b7a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.213391 May 19 09:11:29.316164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5002/6327] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:29 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:30.341526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:30.342608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:30.354001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:30.354502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:30.355313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:30.355771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:30.542502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:30.551979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17e398c2-d811-4f9a-84bb-9b58e6606a7b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.215006 May 19 09:11:30.552763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5003/6328] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:30 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:31.581890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:31.583696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:31.594450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:31.595139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:31.596370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:31.597144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:31.765767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:31.774691 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb051184-cf12-4052-b43b-bb732e592c59 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.199064 May 19 09:11:31.775312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5004/6329] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:31 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:32.802594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:32.803919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:32.816512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:32.817383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:32.818586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:32.819399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:32.987427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:32.991876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:32.998613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bfeb3ba7-ac0f-4c6c-aadc-1f27d70fcca9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.202253 May 19 09:11:32.999234 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5005/6330] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:32 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:34.018019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:34.018721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:34.030095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:34.030671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:34.031492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:34.032156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:34.230371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:34.239067 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36d61681-291e-41b2-b618-755ff06eaac1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.225474 May 19 09:11:34.239667 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5006/6331] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:34 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:35.261935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:35.263104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:35.275471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:35.276289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:35.277728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:35.278541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:35.464299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:35.474434 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2654590-56b1-4990-9d31-fe5eebcb77c4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.219244 May 19 09:11:35.475040 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5007/6332] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:35 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:36.493265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:36.494314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:36.506557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:36.507425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:36.509004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:36.509893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:36.701400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:36.712211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08d4ae07-834e-407a-ae8c-e3520cfa2ce8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.223705 May 19 09:11:36.712856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5008/6333] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:36 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:37.730970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:37.732041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:37.740438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:37.741029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:37.741885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:37.742345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:37.908603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:37.918405 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a885c73-4365-41c8-a1bd-902de98b3dfd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.191432 May 19 09:11:37.919089 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5009/6334] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:37 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:38.937727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:38.938491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:38.941574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=64 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:38.947929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:38.948471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:38.949496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:38.950055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:39.126261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:39.136687 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d840fcb7-2df1-4dcb-85b7-7aa8d3089769 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.203990 May 19 09:11:39.137560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5010/6335] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:38 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:40.156188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:40.156951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:40.164886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:40.165539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:40.166388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:40.166843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:40.382456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:40.391635 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7adc5512-47b0-4209-8fda-a6077e1c9021 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.239408 May 19 09:11:40.393648 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5011/6336] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:40 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:41.415465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:41.416618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:41.429706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:41.430518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:41.431909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:41.432718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:41.673108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:41.686284 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8844a4d9-4fe9-46b8-aa02-8087e7778385 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.279004 May 19 09:11:41.687579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5012/6337] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:41 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:42.711883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:42.713255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:42.727158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:42.727989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:42.729427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:42.730301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:42.961459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:42.978469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed21576c-95c4-4a20-a791-2eec04331ad9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.274209 May 19 09:11:42.979442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5013/6338] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:42 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:44.005078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:44.005832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:44.013255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:44.013755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:44.014553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:44.015011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:44.183943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:44.192913 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ded7d343-e1bf-48bd-b514-a6b24ad15987 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.191865 May 19 09:11:44.193460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5014/6339] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:43 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:45.210463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:45.211175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:45.218632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:45.219094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:45.219905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:45.220355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:45.393563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:45.401821 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f962c1f6-ba58-4036-be86-26cea100775f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.195445 May 19 09:11:45.402427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5015/6340] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:45 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:46.418996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:46.419809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:46.428037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:46.428628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:46.429501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:46.430265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:46.591039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:46.599700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77b46ad9-697c-412c-bbf4-93509d4fa6ab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.184536 May 19 09:11:46.609415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5016/6341] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:46 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:47.619736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:47.620742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:47.631239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:47.631708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:47.632524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:47.632976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:47.837927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:47.851652 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3172cc9b-eb25-4891-8ca4-aac4e203876c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1685 microversion: 2.1 time: 0.236281 May 19 09:11:47.852785 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5017/6342] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:47 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1685 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:48.877739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:48.878500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:48.886179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:48.886635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:48.887426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:48.887877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:49.143971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:49.154062 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-39d55d51-f39f-4491-ad54-afd950dff818 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1684 microversion: 2.1 time: 0.279790 May 19 09:11:49.154937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5018/6343] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:48 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1684 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:49.252606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-052dacc1-d16c-477a-aff0-8b622aff2da1 req-d86a7572-ac1a-4760-8a78-9492a41cdd2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "name": "network-vif-unplugged", "status": "completed", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:49.270765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-052dacc1-d16c-477a-aff0-8b622aff2da1 req-d86a7572-ac1a-4760-8a78-9492a41cdd2c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:49.271062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-052dacc1-d16c-477a-aff0-8b622aff2da1 req-d86a7572-ac1a-4760-8a78-9492a41cdd2c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:49.287159 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-052dacc1-d16c-477a-aff0-8b622aff2da1 req-d86a7572-ac1a-4760-8a78-9492a41cdd2c service nova] Creating event network-vif-unplugged:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh1-842464-2 May 19 09:11:49.292943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-052dacc1-d16c-477a-aff0-8b622aff2da1 req-d86a7572-ac1a-4760-8a78-9492a41cdd2c service nova] Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:11:49.307163 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-052dacc1-d16c-477a-aff0-8b622aff2da1 req-d86a7572-ac1a-4760-8a78-9492a41cdd2c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059518 May 19 09:11:49.308054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5019/6344] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:11:50.175416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:50.177239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:50.184559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:50.185043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:50.185996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:50.186579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:50.438046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:50.470236 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb8f8e8d-119d-49fc-8fc2-98457af7e2e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1684 microversion: 2.1 time: 0.300086 May 19 09:11:50.471241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5020/6345] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:50 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1684 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:51.325772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0923430c-9bfa-4b16-baf9-8915a660e80b req-4d20fe46-424b-4dff-a24d-1517426c0ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:51.336614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0923430c-9bfa-4b16-baf9-8915a660e80b req-4d20fe46-424b-4dff-a24d-1517426c0ac1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:51.337137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0923430c-9bfa-4b16-baf9-8915a660e80b req-4d20fe46-424b-4dff-a24d-1517426c0ac1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:51.353250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0923430c-9bfa-4b16-baf9-8915a660e80b req-4d20fe46-424b-4dff-a24d-1517426c0ac1 service nova] Creating event network-changed:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh1-842464-2 May 19 09:11:51.360276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-0923430c-9bfa-4b16-baf9-8915a660e80b req-4d20fe46-424b-4dff-a24d-1517426c0ac1 service nova] Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:11:51.373794 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0923430c-9bfa-4b16-baf9-8915a660e80b req-4d20fe46-424b-4dff-a24d-1517426c0ac1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051765 May 19 09:11:51.374427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5021/6346] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:11:51.491597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:51.492323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:51.499811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:51.500451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:51.501449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:51.501918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:51.699889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:51.710881 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1255f6cc-fd9b-4ad9-bd6e-743c45e8a954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1682 microversion: 2.1 time: 0.225396 May 19 09:11:51.711750 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5022/6347] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:51 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:52.731546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:52.732219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:52.739959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:52.740424 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:52.741227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:52.741717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:52.746610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:11:52.923373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:52.931805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7ece1e5-db01-4d6b-978c-bf5bf182de97 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1679 microversion: 2.1 time: 0.204709 May 19 09:11:52.932415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5023/6348] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:52 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:52.951215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:52.951963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:52.958893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:52.959366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:52.960240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:52.960757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:53.038945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9d6b7314-d403-4c42-91e1-475283d5bf89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c/action" status: 204 len: 0 microversion: 2.1 time: 0.091302 May 19 09:11:53.039625 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5024/6349] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:11:52 2022] POST /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:11:53.050208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:53.051509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:53.058787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:53.059485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:53.060465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:53.060926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:53.269949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:53.291968 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-66e1e486-ed1f-48de-b21c-009575f8f9a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1679 microversion: 2.1 time: 0.246490 May 19 09:11:53.292593 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5025/6350] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:53 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:54.310250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:54.310949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:54.319785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:54.320260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:54.321085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:54.321706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:54.480564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:54.491894 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d9b3aed0-658d-4a3c-ae8b-032db6d92a61 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1679 microversion: 2.1 time: 0.185403 May 19 09:11:54.492946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5026/6351] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:54 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:55.015390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d9732c06-4056-4e4f-99fc-17409454c4e3 req-af3d9222-8dc8-4e66-99f7-f68d70ab7f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "name": "network-vif-plugged", "status": "completed", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:55.031421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d9732c06-4056-4e4f-99fc-17409454c4e3 req-af3d9222-8dc8-4e66-99f7-f68d70ab7f0c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:55.032538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d9732c06-4056-4e4f-99fc-17409454c4e3 req-af3d9222-8dc8-4e66-99f7-f68d70ab7f0c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:55.052134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d9732c06-4056-4e4f-99fc-17409454c4e3 req-af3d9222-8dc8-4e66-99f7-f68d70ab7f0c service nova] Creating event network-vif-plugged:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh1-842464-2 May 19 09:11:55.057845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d9732c06-4056-4e4f-99fc-17409454c4e3 req-af3d9222-8dc8-4e66-99f7-f68d70ab7f0c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049709 May 19 09:11:55.058639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5027/6352] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:11:55.512254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:55.513009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:55.529469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:55.529941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:55.530733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:55.531192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:55.716967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:55.727318 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cadb805a-d128-4aaf-98d6-0cad1ae3b954 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1671 microversion: 2.1 time: 0.220122 May 19 09:11:55.727940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5028/6353] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:55 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:55.745961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:55.746590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:55.754216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:55.754856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:55.755662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:55.756117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:55.942960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:55.957248 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbea2eb5-0829-4101-af36-20f31f3424c0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1671 microversion: 2.1 time: 0.214362 May 19 09:11:55.958356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5029/6354] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:55 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1671 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:55.988022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:55.989175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:55.999405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:56.000092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:56.001284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:56.001996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:56.200455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:56.213004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-731f3853-5a0d-44bc-97d3-1f9a95dfc717 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1671 microversion: 2.1 time: 0.232307 May 19 09:11:56.214028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5030/6355] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:55 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1671 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:56.241909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:56.242761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:56.251950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:56.252427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:56.253428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:56.254328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:56.287718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:11:56.426692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c4de01d-f44d-4c00-b17f-8557abc5ccac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 204 len: 0 microversion: 2.1 time: 0.191076 May 19 09:11:56.427455 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5031/6356] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:11:56 2022] DELETE /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:11:56.438020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:56.438861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:56.448741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:56.449191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:56.450215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:56.450681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:56.624306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:56.639635 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cc43242d-1be5-4921-bd9e-c5fedfe5f82c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1677 microversion: 2.1 time: 0.206088 May 19 09:11:56.640741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5032/6357] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:56 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:57.667819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:57.668599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:57.677564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:57.678040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:57.678931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:57.679391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:57.962749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:57.971376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-399dc8c1-8e2f-407f-babb-975d0e277a9f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1677 microversion: 2.1 time: 0.308123 May 19 09:11:57.972565 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5033/6358] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:57 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1677 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:11:59.006295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:11:59.007500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:11:59.032848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:59.033738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:59.035922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:59.036593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:59.147536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:11:59.157074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-23528ca2-7f35-4679-b3ca-bee5fa0460b2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 200 len: 1609 microversion: 2.1 time: 0.167289 May 19 09:11:59.157792 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5034/6359] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:11:58 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 1609 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:11:59.366568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4dd7aa11-e572-4db8-8745-1b86abe08389 req-1c6b4385-9be0-4709-9651-a01921d7eb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e4ef2de-5e3f-43c4-aa52-477b9041a04c", "name": "network-vif-deleted", "tag": "1316fa18-1245-43dd-91b5-d3eff77c1155"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:11:59.377176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4dd7aa11-e572-4db8-8745-1b86abe08389 req-1c6b4385-9be0-4709-9651-a01921d7eb1c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:11:59.378111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4dd7aa11-e572-4db8-8745-1b86abe08389 req-1c6b4385-9be0-4709-9651-a01921d7eb1c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:11:59.396756 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4dd7aa11-e572-4db8-8745-1b86abe08389 req-1c6b4385-9be0-4709-9651-a01921d7eb1c service nova] Creating event network-vif-deleted:1316fa18-1245-43dd-91b5-d3eff77c1155 for instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c on chh1-842464-2 May 19 09:11:59.402244 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4dd7aa11-e572-4db8-8745-1b86abe08389 req-1c6b4385-9be0-4709-9651-a01921d7eb1c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040312 May 19 09:11:59.402798 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5035/6360] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:12:00.184287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:00.185004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:00.192800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:00.193265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:00.194102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:00.194559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:00.212416 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c HTTP/1.1 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3e4ef2de-5e3f-43c4-aa52-477b9041a04c'} May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:12:00.214684 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e34a863-8079-401d-b120-173899862001 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 404 len: 111 microversion: 2.1 time: 0.037148 May 19 09:12:00.224932 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5036/6361] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:00 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:12:00.234933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:00.235557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:00.242841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:00.243306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:00.244116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:00.244571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:00.262510 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c HTTP/1.1 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3e4ef2de-5e3f-43c4-aa52-477b9041a04c'} May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:12:00.264115 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74f57251-d6f1-495e-905f-3482b5cc5633 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 404 len: 111 microversion: 2.1 time: 0.034646 May 19 09:12:00.270697 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5037/6362] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:00 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:12:00.323702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1515689903", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "090ff69e-1ae4-4e7a-a1bc-07327ed81938"}], "security_groups": [{"name": "tempest-securitygroup--1342956845"}], "key_name": "tempest-keypair-1831610942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:00.487066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] validate_networks() for [('090ff69e-1ae4-4e7a-a1bc-07327ed81938', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:12:00.955164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:12:00.955602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:12:00.956122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:12:00.957345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:12:00.957889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:12:00.968008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:00.968468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:00.969292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:00.969809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:00.992474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:12:01.003848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:12:01.022335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:12:01.024737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:12:01.091586 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5871d76f-c9e9-4b3b-b75b-10c1c2bdbf06 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771554 May 19 09:12:01.092959 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5038/6363] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:12:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:12:01.103981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e8aa7d3-a60f-44ca-a33f-eca975610cdb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:01.104608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e8aa7d3-a60f-44ca-a33f-eca975610cdb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:01.168754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e8aa7d3-a60f-44ca-a33f-eca975610cdb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:01.178182 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e8aa7d3-a60f-44ca-a33f-eca975610cdb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1239 microversion: 2.1 time: 0.078285 May 19 09:12:01.178771 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5039/6364] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:01 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:02.200646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:02.201364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:02.209635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:02.210128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:02.210926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:02.211391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:02.291263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:02.303684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0d16052-a6b4-4d5a-aefb-9a8554f1fdd5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1299 microversion: 2.1 time: 0.110226 May 19 09:12:02.304741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5040/6365] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:02 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:12:03.330655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:03.331984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:03.345160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:03.346266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:03.348584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:03.349464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:03.374153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:03.808331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:03.818571 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe5e4481-5c30-491a-809c-44c96d5ebc5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1365 microversion: 2.1 time: 0.492055 May 19 09:12:03.819190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5041/6366] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:03 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:04.273635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-b562fad2-79d8-4d92-98a0-9332f37be969 req-761e2b39-0ddc-4672-9934-d58d02fe8b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:04.285907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b562fad2-79d8-4d92-98a0-9332f37be969 req-761e2b39-0ddc-4672-9934-d58d02fe8b53 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:04.286452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-b562fad2-79d8-4d92-98a0-9332f37be969 req-761e2b39-0ddc-4672-9934-d58d02fe8b53 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:04.300999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-b562fad2-79d8-4d92-98a0-9332f37be969 req-761e2b39-0ddc-4672-9934-d58d02fe8b53 service nova] Creating event network-changed:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh1-842464-2 May 19 09:12:04.314694 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-b562fad2-79d8-4d92-98a0-9332f37be969 req-761e2b39-0ddc-4672-9934-d58d02fe8b53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045515 May 19 09:12:04.315314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5042/6367] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:12:04.840317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:04.841049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:04.848327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:04.848781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:04.849604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:04.850058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:05.022554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:05.030432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a2edd7c5-0ea6-4f6f-b19a-34afa96d5631 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1365 microversion: 2.1 time: 0.195532 May 19 09:12:05.031016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5043/6368] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:04 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:06.052298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:06.053126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:06.060866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:06.061367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:06.062204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:06.062633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:06.227092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:06.235139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71a80705-20ff-4043-8b83-0f6512274c99 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1365 microversion: 2.1 time: 0.189260 May 19 09:12:06.235744 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5044/6369] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:06 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:07.255787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:07.256557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:07.265426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:07.265935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:07.266918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:07.267375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:07.418027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:07.426567 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03d30fa3-fa49-4205-a387-ac7858e6ad21 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1365 microversion: 2.1 time: 0.175455 May 19 09:12:07.427168 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5045/6370] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:07 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:08.450514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:08.451233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:08.458519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:08.458993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:08.459795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:08.460250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:08.619095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:08.627746 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9c19cfec-d349-4b4e-9950-5ca4137d552c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1365 microversion: 2.1 time: 0.181067 May 19 09:12:08.628508 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5046/6371] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:08 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:09.106918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-27cad3a9-d42c-4e70-b25c-f9cf7e8f3441 req-5ef72d85-32e0-4edb-bce1-7fb7a966a549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "name": "network-vif-plugged", "status": "completed", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:09.111070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:09.120313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27cad3a9-d42c-4e70-b25c-f9cf7e8f3441 req-5ef72d85-32e0-4edb-bce1-7fb7a966a549 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:09.120799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-27cad3a9-d42c-4e70-b25c-f9cf7e8f3441 req-5ef72d85-32e0-4edb-bce1-7fb7a966a549 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:09.136029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-27cad3a9-d42c-4e70-b25c-f9cf7e8f3441 req-5ef72d85-32e0-4edb-bce1-7fb7a966a549 service nova] Creating event network-vif-plugged:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh1-842464-2 May 19 09:12:09.141394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-27cad3a9-d42c-4e70-b25c-f9cf7e8f3441 req-5ef72d85-32e0-4edb-bce1-7fb7a966a549 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038597 May 19 09:12:09.142005 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5047/6372] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:12:09.647536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:09.648252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:09.654745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:09.655215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:09.656008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:09.656462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:09.809098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:09.817179 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c1081c75-b3eb-4e5a-90cb-b89c70568ab8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1365 microversion: 2.1 time: 0.174964 May 19 09:12:09.817867 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5048/6373] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:09 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:10.834817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:10.835499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:10.842484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:10.842953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:10.843748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:10.844206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:10.978954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:10.990841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:10.998718 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d63344ba-e9b5-4c16-bdfe-13d03efb42f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1552 microversion: 2.1 time: 0.168416 May 19 09:12:10.999309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5049/6374] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:10 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:11.015873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:11.016383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:11.022853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:11.023320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:11.024179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:11.024648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:11.106676 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-122864de-437d-45d9-82a9-3916d4b18b74 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094497 May 19 09:12:11.107290 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5050/6375] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 09:12:11 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:12:12.567421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:12.575005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-95c8426e-79bc-4d10-897a-01249c7b40b2 req-efe96fe8-66bf-4c19-acd7-5d8ae54cf356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:12.586116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-95c8426e-79bc-4d10-897a-01249c7b40b2 req-efe96fe8-66bf-4c19-acd7-5d8ae54cf356 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:12.586569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-95c8426e-79bc-4d10-897a-01249c7b40b2 req-efe96fe8-66bf-4c19-acd7-5d8ae54cf356 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:12.608924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-95c8426e-79bc-4d10-897a-01249c7b40b2 req-efe96fe8-66bf-4c19-acd7-5d8ae54cf356 service nova] Creating event network-changed:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh1-842464-2 May 19 09:12:12.614546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-95c8426e-79bc-4d10-897a-01249c7b40b2 req-efe96fe8-66bf-4c19-acd7-5d8ae54cf356 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047572 May 19 09:12:12.615171 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5051/6376] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:12:42.181484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=9 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:42.182513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=49 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:42.186854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-985d4e94-56f2-4c37-b831-d9e9d2e9711e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:42.195551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985d4e94-56f2-4c37-b831-d9e9d2e9711e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:42.195944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985d4e94-56f2-4c37-b831-d9e9d2e9711e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:42.220008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-985d4e94-56f2-4c37-b831-d9e9d2e9711e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 09:12:42.271379 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-985d4e94-56f2-4c37-b831-d9e9d2e9711e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action" status: 202 len: 0 microversion: 2.1 time: 0.091697 May 19 09:12:42.272030 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5052/6377] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:12:42 2022] POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:12:42.280858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:42.281405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:42.288897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:42.289561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:42.290430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:42.290925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:42.440504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:42.454006 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a85fab82-ce97-401e-9679-4c8b0b8f0472 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.177431 May 19 09:12:42.454783 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5053/6378] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:42 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:43.474511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:43.475193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:43.482718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:43.483189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:43.483996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:43.487799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:43.634247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:43.642347 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-883d6191-4dc2-4ec8-893f-3466fe29f491 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.172910 May 19 09:12:43.643014 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5054/6379] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:43 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:44.661677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:44.662497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:44.670193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:44.670685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:44.671494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:44.671948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:44.827365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:44.835250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63add614-cf34-4831-a071-a070c642a7df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.178812 May 19 09:12:44.835879 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5055/6380] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:44 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:45.856257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:45.856961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:45.864631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:45.865097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:45.866306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:45.866768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:46.009083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:46.016924 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7ef8071-0bd4-4a87-b518-3d9d36979ff9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.164614 May 19 09:12:46.017533 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5056/6381] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:45 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:47.036239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:47.037016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:47.044455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:47.044922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:47.045747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:47.046262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:47.186891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:47.195545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e864fb59-d0e0-4d03-b506-5df7b42d6d95 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.164370 May 19 09:12:47.196148 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5057/6382] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:47 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:48.212766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:48.213742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:48.220386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:48.221452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:48.222241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:48.222684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:48.369684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:48.377469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cb9fedbd-6081-4f3b-bd96-548a91a8808a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.168354 May 19 09:12:48.378399 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5058/6383] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:48 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:49.396152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:49.396900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:49.408046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:49.409545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:49.410355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:49.410812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:49.557673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:49.566053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6006c9c4-9b28-4193-b904-40feca0347d5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.174381 May 19 09:12:49.566644 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5059/6384] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:49 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:12:50.583698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:50.584499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:50.591765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:50.592223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:50.593020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:50.593510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:50.744560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:50.754139 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a009f0ae-8773-4401-9e8a-fe76b4399541 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.174995 May 19 09:12:50.754956 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5060/6385] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:50 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:51.772584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:51.773375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:51.780413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:51.780884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:51.781736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:51.782192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:51.925011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:51.933745 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de2f6e44-f58e-41be-a49c-88d3277a4b2c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.165352 May 19 09:12:51.934344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5061/6386] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:51 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:52.951467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:52.952163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:52.960026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:52.960543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:52.961400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:52.961889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:53.130530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:53.139911 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2bc4069b-3250-42c2-ad81-c8d682da826a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1658 microversion: 2.1 time: 0.191911 May 19 09:12:53.140329 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5062/6387] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:52 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1658 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:53.158196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:53.159259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:53.165456 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:53.165923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:53.166702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:53.167149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:53.198019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:53.204285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:12:53.211754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:12:53.212185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:12:53.212668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:12:53.213089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:12:53.213541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:12:53.282599 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e99fbf04-4c42-4c94-9358-300e298c34ff tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action" status: 202 len: 0 microversion: 2.1 time: 0.128218 May 19 09:12:53.283822 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5063/6388] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:12:53 2022] POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:12:53.292723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:53.293393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:53.299779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:53.300235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:53.301034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:53.301527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:53.462523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:53.471476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7deddda6-b10e-47ec-a722-63b91df560dc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.182253 May 19 09:12:53.472352 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5064/6389] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:53 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:54.490693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:54.491396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:54.498318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:54.498779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:54.499552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:54.500011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:54.640831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:54.649077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f74a2cc2-e653-4feb-8e5e-c14d4fca8cf9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1681 microversion: 2.1 time: 0.162722 May 19 09:12:54.649712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5065/6390] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:54 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:55.666111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:55.666960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:55.674078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:55.674874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:55.675694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:55.676137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:55.681020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:12:55.832740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:55.841110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-552e56d3-14d4-43f9-bf3c-cf95c6f286b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1686 microversion: 2.1 time: 0.178799 May 19 09:12:55.841746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5066/6391] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:55 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:56.858483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:56.859174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:56.867200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:56.867755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:56.868413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:56.868869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:57.041416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:57.050225 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06ea8f05-8092-418c-baf1-f015224622b5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1686 microversion: 2.1 time: 0.195622 May 19 09:12:57.051016 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5067/6392] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:56 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1686 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:12:57.714724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8d9c67f1-a49b-49b4-909f-1a8f475de0b6 req-971ce447-cb75-4a7c-af54-b7b8f979a26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:57.724412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8d9c67f1-a49b-49b4-909f-1a8f475de0b6 req-971ce447-cb75-4a7c-af54-b7b8f979a26a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:57.725696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8d9c67f1-a49b-49b4-909f-1a8f475de0b6 req-971ce447-cb75-4a7c-af54-b7b8f979a26a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:57.738714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8d9c67f1-a49b-49b4-909f-1a8f475de0b6 req-971ce447-cb75-4a7c-af54-b7b8f979a26a service nova] Creating event network-vif-unplugged:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh2-842464-2 May 19 09:12:57.744981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-8d9c67f1-a49b-49b4-909f-1a8f475de0b6 req-971ce447-cb75-4a7c-af54-b7b8f979a26a service nova] Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:12:57.757017 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8d9c67f1-a49b-49b4-909f-1a8f475de0b6 req-971ce447-cb75-4a7c-af54-b7b8f979a26a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046257 May 19 09:12:57.757920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5068/6393] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:12:58.076300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:58.077197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:58.085389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:58.089776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:58.089776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:58.089776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:58.253084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:58.268493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea4424e2-ba68-440c-8825-698dacf4de82 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1685 microversion: 2.1 time: 0.198380 May 19 09:12:58.269603 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5069/6394] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:58 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1685 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:12:59.296531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:12:59.297207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:12:59.305516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:59.305990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:59.306796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:59.307255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:59.460858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:12:59.468613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad345286-192b-479b-9fab-efa486912764 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1685 microversion: 2.1 time: 0.176273 May 19 09:12:59.469201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5070/6395] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:12:59 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:12:59.771943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-38a462e7-2fe6-483f-9ed9-1afad2abe7ad req-8319582c-9636-4f7b-b8c3-5cdc98d0b583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:12:59.780259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-38a462e7-2fe6-483f-9ed9-1afad2abe7ad req-8319582c-9636-4f7b-b8c3-5cdc98d0b583 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:12:59.780725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-38a462e7-2fe6-483f-9ed9-1afad2abe7ad req-8319582c-9636-4f7b-b8c3-5cdc98d0b583 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:12:59.793016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-38a462e7-2fe6-483f-9ed9-1afad2abe7ad req-8319582c-9636-4f7b-b8c3-5cdc98d0b583 service nova] Creating event network-changed:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh2-842464-2 May 19 09:12:59.800745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-38a462e7-2fe6-483f-9ed9-1afad2abe7ad req-8319582c-9636-4f7b-b8c3-5cdc98d0b583 service nova] Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:12:59.812785 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-38a462e7-2fe6-483f-9ed9-1afad2abe7ad req-8319582c-9636-4f7b-b8c3-5cdc98d0b583 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044590 May 19 09:12:59.813441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5071/6396] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:13:00.489614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:00.490732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:00.497978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:00.498443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:00.499241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:00.499688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:00.695857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:00.708973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-53b12444-cfe1-4102-a213-c31996dd9218 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1683 microversion: 2.1 time: 0.224841 May 19 09:13:00.710125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5072/6397] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:00 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:01.733907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:01.734919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:01.745358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:01.746257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:01.747680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:01.748654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:01.908822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:01.921193 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-81efc262-6b25-49c1-ae47-96255d61571f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1679 microversion: 2.1 time: 0.193290 May 19 09:13:01.922033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5073/6398] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:01 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:01.942708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:01.943270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:01.950553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:01.951031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:01.951948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:01.952419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:02.027219 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c436869-e9b5-4cfa-b3fa-761201e3411f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action" status: 204 len: 0 microversion: 2.1 time: 0.090003 May 19 09:13:02.027906 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5074/6399] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:13:01 2022] POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:13:02.042872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:02.044058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:02.058911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:02.060016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:02.062290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:02.063339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:02.318950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:02.328923 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6d95629e-31b3-45d5-8ef9-8bdeba10df69 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1679 microversion: 2.1 time: 0.293234 May 19 09:13:02.329639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5075/6400] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:02 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1679 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:03.358070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:03.362741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:03.371590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:03.372060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:03.372877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:03.373409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:03.570338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:03.578667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ccca5f7-9729-4230-90b2-d1e63f30b2ac tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1679 microversion: 2.1 time: 0.227763 May 19 09:13:03.579229 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5076/6401] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:03 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:03.584016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1e247662-b627-4506-b2e9-0f72e20fcc5a req-0e446a78-b0d1-4fbb-930e-3b476497285f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "name": "network-vif-plugged", "status": "completed", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:03.595371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e247662-b627-4506-b2e9-0f72e20fcc5a req-0e446a78-b0d1-4fbb-930e-3b476497285f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:03.596314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e247662-b627-4506-b2e9-0f72e20fcc5a req-0e446a78-b0d1-4fbb-930e-3b476497285f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:03.615609 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1e247662-b627-4506-b2e9-0f72e20fcc5a req-0e446a78-b0d1-4fbb-930e-3b476497285f service nova] Creating event network-vif-plugged:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh2-842464-2 May 19 09:13:03.623518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-1e247662-b627-4506-b2e9-0f72e20fcc5a req-0e446a78-b0d1-4fbb-930e-3b476497285f service nova] Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:13:03.636419 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1e247662-b627-4506-b2e9-0f72e20fcc5a req-0e446a78-b0d1-4fbb-930e-3b476497285f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055766 May 19 09:13:03.637155 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5077/6402] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:13:04.598034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:04.599010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:04.605618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:04.606201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:04.606864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:04.607312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:04.756506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:04.764280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-68cbbf9d-9c96-4a99-aaa1-bc42b1b53fdc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1658 microversion: 2.1 time: 0.171700 May 19 09:13:04.764872 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5078/6403] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:04 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1658 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:04.781066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:04.781728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:04.788141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:04.788595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:04.789439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:04.789968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:04.944022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:04.951952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-887a1dd1-befc-4166-9736-d92639f1a5f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1658 microversion: 2.1 time: 0.174637 May 19 09:13:04.952559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5079/6404] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:04 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1658 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:04.968771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8276aff9-7936-4795-9974-e9afd951039f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:04.975789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8276aff9-7936-4795-9974-e9afd951039f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:04.976246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8276aff9-7936-4795-9974-e9afd951039f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:05.000743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8276aff9-7936-4795-9974-e9afd951039f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 09:13:05.048406 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8276aff9-7936-4795-9974-e9afd951039f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action" status: 202 len: 0 microversion: 2.1 time: 0.083343 May 19 09:13:05.053017 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5080/6405] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:13:04 2022] POST /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:13:05.059262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:05.060091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:05.069341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:05.070124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:05.071271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:05.073184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:05.293777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:05.296098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:05.304486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-63ff27ed-6b11-4e13-85ac-5fca4b7c61a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1667 microversion: 2.1 time: 0.249932 May 19 09:13:05.305343 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5081/6406] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:05 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1667 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:06.324474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:06.325297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:06.334789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:06.335330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:06.336332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:06.336849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:06.488010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:06.496051 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce5e20ae-746b-402a-a26a-77bc3cd1c52c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1671 microversion: 2.1 time: 0.176518 May 19 09:13:06.496767 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5082/6407] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:06 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:06.513442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:06.513958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:06.521752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:06.522393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:06.523454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:06.524021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:06.558025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:13:06.657542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2d434d4c-d278-4891-81a5-8632528f7244 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 204 len: 0 microversion: 2.1 time: 0.147429 May 19 09:13:06.659431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5083/6408] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:13:06 2022] DELETE /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:13:06.669961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:06.670756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:06.679002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:06.679513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:06.680320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:06.680714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:06.826345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:06.840104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4bbb781-c423-4038-b70e-3ec892d23f03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1677 microversion: 2.1 time: 0.174759 May 19 09:13:06.840743 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5084/6409] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:06 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:07.859018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:07.859693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:07.868265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:07.868759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:07.869714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:07.870175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:08.037222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:08.045573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9132d4a1-3566-4c24-b503-5e7e2ee19b26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1677 microversion: 2.1 time: 0.190522 May 19 09:13:08.046198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5085/6410] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:07 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:09.069367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:09.071192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:09.081674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:09.084284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:09.084284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:09.084284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:09.163167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:09.173776 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c0a0aab-21da-4416-a21c-04077f9b1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 200 len: 1609 microversion: 2.1 time: 0.110088 May 19 09:13:09.174458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5086/6411] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:09 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 1609 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:09.190638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d5ce3591-2352-47fa-8c35-3432bbf01ae4 req-48a0b2e8-f5aa-4635-84ae-7b1dffb7a05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "014d638e-d0d2-49b1-80f4-c75cfad53ae3", "name": "network-vif-deleted", "tag": "2501c10e-0615-4409-8b00-a53aea251523"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:09.202493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d5ce3591-2352-47fa-8c35-3432bbf01ae4 req-48a0b2e8-f5aa-4635-84ae-7b1dffb7a05a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:09.202988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d5ce3591-2352-47fa-8c35-3432bbf01ae4 req-48a0b2e8-f5aa-4635-84ae-7b1dffb7a05a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:09.218161 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d5ce3591-2352-47fa-8c35-3432bbf01ae4 req-48a0b2e8-f5aa-4635-84ae-7b1dffb7a05a service nova] Creating event network-vif-deleted:2501c10e-0615-4409-8b00-a53aea251523 for instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 on chh2-842464-2 May 19 09:13:09.226493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d5ce3591-2352-47fa-8c35-3432bbf01ae4 req-48a0b2e8-f5aa-4635-84ae-7b1dffb7a05a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041602 May 19 09:13:09.227703 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5087/6412] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:13:10.199670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:10.200396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:10.208740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:10.209244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:10.210105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:10.210592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:10.229775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 HTTP/1.1 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '014d638e-d0d2-49b1-80f4-c75cfad53ae3'} May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:13:10.231478 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e1cb9bba-0acb-480c-9646-ff9ffe4629e9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 404 len: 111 microversion: 2.1 time: 0.037718 May 19 09:13:10.236319 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5088/6413] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:10 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:13:10.251158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:10.251873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:10.258872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:10.259346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:10.260166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:10.260609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:10.286593 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 HTTP/1.1 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '014d638e-d0d2-49b1-80f4-c75cfad53ae3'} May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:13:10.288192 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-242ff6c2-aaa6-4ad1-acec-c2fe77d32847 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 404 len: 111 microversion: 2.1 time: 0.043663 May 19 09:13:10.293277 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5089/6414] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:10 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:13:10.349368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1048532947", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "090ff69e-1ae4-4e7a-a1bc-07327ed81938"}], "security_groups": [{"name": "tempest-securitygroup--1342956845"}], "key_name": "tempest-keypair-1831610942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:10.473833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] validate_networks() for [('090ff69e-1ae4-4e7a-a1bc-07327ed81938', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:13:10.915962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:13:10.916404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:13:10.916923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:13:10.917381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:13:10.917820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:13:10.927045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:10.927502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:10.928320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:10.928767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:10.947122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:13:10.953001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:13:10.963103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:10.967462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:13:10.969871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:13:11.019984 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-847f550a-0b37-4e88-99e5-b1fa11af395a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675632 May 19 09:13:11.020676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5090/6415] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:13:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:13:11.030571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb601f41-aa76-4b9a-883b-e33daf67d8f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:11.031237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb601f41-aa76-4b9a-883b-e33daf67d8f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:11.182368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb601f41-aa76-4b9a-883b-e33daf67d8f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:11.191088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb601f41-aa76-4b9a-883b-e33daf67d8f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1239 microversion: 2.1 time: 0.164078 May 19 09:13:11.191954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5091/6416] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:11 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1239 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:12.211118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:12.211807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:12.218783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:12.219244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:12.220027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:12.221105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:12.286756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:12.295059 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e65a3006-3e5f-4d6a-88b8-e5f04b620a0a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1297 microversion: 2.1 time: 0.088855 May 19 09:13:12.295653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5092/6417] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:12 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:13.313862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:13.314618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:13.322906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:13.322906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:13.323709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:13.324168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:13.487172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:13.504799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6617a820-4b28-4ae9-be2a-b3c602dbb8f7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.194748 May 19 09:13:13.505488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5093/6418] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:13 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:13.671728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d0f773d0-f4f5-4a3e-b3e0-efca52791eea req-ceaf94a2-cc9e-4c81-b948-41c4ec3d63dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:13.693923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0f773d0-f4f5-4a3e-b3e0-efca52791eea req-ceaf94a2-cc9e-4c81-b948-41c4ec3d63dc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:13.694395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0f773d0-f4f5-4a3e-b3e0-efca52791eea req-ceaf94a2-cc9e-4c81-b948-41c4ec3d63dc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:13.713613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d0f773d0-f4f5-4a3e-b3e0-efca52791eea req-ceaf94a2-cc9e-4c81-b948-41c4ec3d63dc service nova] Creating event network-changed:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:13:13.719029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d0f773d0-f4f5-4a3e-b3e0-efca52791eea req-ceaf94a2-cc9e-4c81-b948-41c4ec3d63dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054095 May 19 09:13:13.719650 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5094/6419] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:13:14.523525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:14.524158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:14.531941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:14.532406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:14.533223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:14.533717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:14.678711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:14.686390 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31cf8913-267a-417e-92b0-7411f66d777b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.167337 May 19 09:13:14.686969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5095/6420] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:14 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:15.703884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:15.704566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:15.713374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:15.713841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:15.714654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:15.715100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:15.873518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:15.881665 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2b1b2c1-44ac-4858-95ab-565841e5dc1b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.181697 May 19 09:13:15.882277 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5096/6421] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:15 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:16.900643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:16.901903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:16.909748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:16.910209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:16.911022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:16.911477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:17.062609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:17.071191 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-231701d0-2ea6-4f0b-93e1-1120df91994e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.174891 May 19 09:13:17.071818 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5097/6422] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:16 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:18.088972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:18.089771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:18.097597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:18.098069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:18.099110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:18.099568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:18.238287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:18.246205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-937fc04e-3a67-41bb-859d-a4ae539689fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.161107 May 19 09:13:18.246793 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5098/6423] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:18 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:19.264204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:19.264986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:19.273704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:19.274202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:19.275088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:19.275499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:19.447654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:19.455858 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcc80c14-6f13-4392-ad17-7b9d7f53307a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.195504 May 19 09:13:19.456504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5099/6424] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:19 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:19.461383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-43d1d250-b52b-4f1a-b2ea-835148a5d871 req-1d56fc4e-9dbd-4256-b6fd-720ab149259a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "name": "network-vif-plugged", "status": "completed", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:19.470235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-43d1d250-b52b-4f1a-b2ea-835148a5d871 req-1d56fc4e-9dbd-4256-b6fd-720ab149259a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:19.470772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-43d1d250-b52b-4f1a-b2ea-835148a5d871 req-1d56fc4e-9dbd-4256-b6fd-720ab149259a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:19.483566 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-43d1d250-b52b-4f1a-b2ea-835148a5d871 req-1d56fc4e-9dbd-4256-b6fd-720ab149259a service nova] Creating event network-vif-plugged:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:13:19.490545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-43d1d250-b52b-4f1a-b2ea-835148a5d871 req-1d56fc4e-9dbd-4256-b6fd-720ab149259a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 May 19 09:13:19.491118 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5100/6425] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:13:20.475222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:20.475983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:20.482660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:20.483118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:20.483903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:20.484350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:20.624489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:20.628155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:20.637116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16fc2086-7201-4603-8c46-6f03a2c7b729 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1365 microversion: 2.1 time: 0.167095 May 19 09:13:20.638102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5101/6426] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:20 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:21.655791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:21.656446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:21.658442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:21.659141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:21.666951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:21.667409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:21.668213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:21.668649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:21.825434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:21.833562 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05e9bb4f-3b16-42e4-af59-3579da345877 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1552 microversion: 2.1 time: 0.182230 May 19 09:13:21.834196 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5102/6427] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:21 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1552 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:21.851711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:21.852314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:21.859222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:21.859683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:21.860470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:21.861619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:21.944271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c59b56e-7af2-4ef8-a9f2-7c2021e23027 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097199 May 19 09:13:21.944912 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5103/6428] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 09:13:21 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:13:23.045516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4eacc620-ff8f-4cec-b57b-6b2baefa9de5 req-61957a7c-5aa4-4afb-848a-192ee448207e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:23.054815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4eacc620-ff8f-4cec-b57b-6b2baefa9de5 req-61957a7c-5aa4-4afb-848a-192ee448207e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:23.055272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4eacc620-ff8f-4cec-b57b-6b2baefa9de5 req-61957a7c-5aa4-4afb-848a-192ee448207e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:23.068122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4eacc620-ff8f-4cec-b57b-6b2baefa9de5 req-61957a7c-5aa4-4afb-848a-192ee448207e service nova] Creating event network-changed:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:13:23.073613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4eacc620-ff8f-4cec-b57b-6b2baefa9de5 req-61957a7c-5aa4-4afb-848a-192ee448207e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108361 May 19 09:13:23.074338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5104/6429] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:13:26.701231 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:13:26.701958 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:13:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:13:27.355940 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:13:27.356634 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:13:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:13:46.298156 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:13:46.299085 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:13:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:13:53.294715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:53.295476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:13:53.299737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:13:53.300804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:53.308838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:53.309327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:53.310118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:53.310568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:53.344746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:53.351500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:13:53.357841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:13:53.358277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:13:53.358763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:13:53.359185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:13:53.359608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:13:53.427024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08146004-9d7c-483a-bc3d-70b6e839b8d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.134411 May 19 09:13:53.427647 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5105/6430] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:13:53 2022] POST /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:13:53.437429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:53.438621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:53.445322 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:53.445809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:53.446614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:53.447068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:53.588760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:53.597971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2c43e4e-0603-40e2-bba7-7e29f412324d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1680 microversion: 2.1 time: 0.164415 May 19 09:13:53.598882 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5106/6431] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:53 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:54.616697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:54.617410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:54.625155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:54.626843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:54.627304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:54.627768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:54.783043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:54.799992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-14ddf3ba-ca05-4771-975a-5bf91602101a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1680 microversion: 2.1 time: 0.185796 May 19 09:13:54.801712 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5107/6432] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:54 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:55.820262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:55.821743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:55.830889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:55.831349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:55.832186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:55.832741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:56.069878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:56.078770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5dc2ff28-305a-4653-a34c-369a4badce23 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1680 microversion: 2.1 time: 0.262801 May 19 09:13:56.079572 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5108/6433] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:55 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:13:57.107101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:57.108058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:57.116831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:57.117371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:57.118244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:57.118734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:57.299406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:57.308702 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58c98468-7ab2-404f-91d1-67ba4ac68acb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.205662 May 19 09:13:57.309417 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5109/6434] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:57 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:58.331191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:58.332288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:58.342752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:58.343248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:58.344169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:58.344831 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:58.559232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:58.574993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f2b6f26b-5afb-470d-bf8f-f5817e810c5e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.249083 May 19 09:13:58.575889 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5110/6435] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:58 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:13:59.600459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:13:59.601620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:13:59.614635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:59.615479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:59.616945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:13:59.617766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:13:59.812435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:13:59.834809 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd7d6b2e-6552-49a1-ad95-4146a732a24a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.242521 May 19 09:13:59.835351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5111/6436] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:13:59 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:00.857749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:00.858728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:00.868227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:00.869041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:00.869928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:00.870611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:01.053838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:01.062810 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-502fe7da-9f98-41c9-9737-8fda8428fed0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.211600 May 19 09:14:01.063517 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5112/6437] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:00 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:02.084645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:02.085731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:02.098976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:02.099784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:02.101212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:02.102039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:02.274361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:02.283852 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5afd34f0-6066-4641-80f8-7f4a74b45a86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.205398 May 19 09:14:02.284476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5113/6438] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:02 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:03.302162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:03.302880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:03.311460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:03.312025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:03.313502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:03.314175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:03.475748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:03.484268 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-77c3342d-9dfa-488f-ac20-03d908a3bf93 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.185919 May 19 09:14:03.485473 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5114/6439] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:03 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:04.503365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:04.504059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:04.511348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:04.511810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:04.512610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:04.513081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:04.700320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:04.710997 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-001605a1-3438-452c-bb73-e169b2ab24a1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.212310 May 19 09:14:04.711844 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5115/6440] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:04 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:05.737822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:05.739042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:05.751865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:05.752703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:05.754122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:05.754939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:05.965502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:05.976609 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b75e885f-b0bf-4ca0-b2b2-d5a2b3a0f5bb tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.246305 May 19 09:14:05.977732 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5116/6441] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:05 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:06.999425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:07.000910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:07.008731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:07.009193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:07.010036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:07.010487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:07.180676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:07.190123 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ecde3411-c5d8-4013-8e9b-255e6f175b2e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1685 microversion: 2.1 time: 0.194473 May 19 09:14:07.190748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5117/6442] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:06 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:08.214645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:08.215879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:08.229774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:08.230693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:08.232313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:08.233234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:08.907843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:08.918976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6f5db97-dcec-4bff-bc96-2653f7557fc3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1684 microversion: 2.1 time: 0.711580 May 19 09:14:08.919620 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5118/6443] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:08 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1684 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:09.377249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9e6e0d44-7e3f-45ec-bc48-b34bb809eced req-e3f5b90d-4dca-48d4-9271-a0ad9238891f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "name": "network-vif-unplugged", "status": "completed", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:09.388426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9e6e0d44-7e3f-45ec-bc48-b34bb809eced req-e3f5b90d-4dca-48d4-9271-a0ad9238891f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:09.388895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9e6e0d44-7e3f-45ec-bc48-b34bb809eced req-e3f5b90d-4dca-48d4-9271-a0ad9238891f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:09.412282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9e6e0d44-7e3f-45ec-bc48-b34bb809eced req-e3f5b90d-4dca-48d4-9271-a0ad9238891f service nova] Creating event network-vif-unplugged:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh1-842464-2 May 19 09:14:09.419048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-9e6e0d44-7e3f-45ec-bc48-b34bb809eced req-e3f5b90d-4dca-48d4-9271-a0ad9238891f service nova] Instance eeb91c92-0a47-4db9-b259-96d514b11e6d is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:14:09.432707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9e6e0d44-7e3f-45ec-bc48-b34bb809eced req-e3f5b90d-4dca-48d4-9271-a0ad9238891f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168531 May 19 09:14:09.434007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5119/6444] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:09.952382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:09.954123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:09.962009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:09.962483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:09.963581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:09.964365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:09.997588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:10.252621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:10.263525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f8672e2-9964-483f-9e05-9fb9a9014ad5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1684 microversion: 2.1 time: 0.315682 May 19 09:14:10.264160 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5120/6445] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:09 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1684 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:11.287128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:11.288084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:11.298531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:11.299076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:11.300179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:11.300803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:11.466858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:11.481551 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ba8bba6-9a08-437c-97b4-e807da3b2b45 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1682 microversion: 2.1 time: 0.200840 May 19 09:14:11.482135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5121/6446] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:11 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:11.489715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f848ae68-690d-42f9-984a-1b97629b586f req-1dc17e93-2722-4145-829b-c5e4048f8e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:11.496600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f848ae68-690d-42f9-984a-1b97629b586f req-1dc17e93-2722-4145-829b-c5e4048f8e38 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:11.497074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f848ae68-690d-42f9-984a-1b97629b586f req-1dc17e93-2722-4145-829b-c5e4048f8e38 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:11.510250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f848ae68-690d-42f9-984a-1b97629b586f req-1dc17e93-2722-4145-829b-c5e4048f8e38 service nova] Creating event network-changed:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh1-842464-2 May 19 09:14:11.517088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-f848ae68-690d-42f9-984a-1b97629b586f req-1dc17e93-2722-4145-829b-c5e4048f8e38 service nova] Instance eeb91c92-0a47-4db9-b259-96d514b11e6d is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:14:11.530413 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f848ae68-690d-42f9-984a-1b97629b586f req-1dc17e93-2722-4145-829b-c5e4048f8e38 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046755 May 19 09:14:11.531928 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5122/6447] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:14:12.503002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:12.503895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:12.513033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.513548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.514389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.514881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.685382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:12.694461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c0f7ed5c-0603-4eb6-8d9e-d162e0eb2dd2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1679 microversion: 2.1 time: 0.196725 May 19 09:14:12.694935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5123/6448] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:12 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:12.711528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:12.712085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:12.719035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.719539 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.720482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.721013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.771573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.772302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.773807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.774528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.811402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:14:12.823384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:14:12.969209 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3f804265-e070-4b4d-a190-32b84e3a5514 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.260216 May 19 09:14:12.970304 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5124/6449] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:14:12 2022] POST /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:14:12.980863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:12.981648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:12.991401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.992136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:12.993238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:12.994035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:13.233910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:13.245827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fc173b3-1ddc-45eb-a84c-2571bffe843c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1678 microversion: 2.1 time: 0.268902 May 19 09:14:13.246381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5125/6450] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:12 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1678 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:14.264010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:14.264957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:14.273391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:14.273861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:14.274728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:14.275114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:14.443340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:14.451790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f06f4bc1-1759-4003-9f95-9abf1785e465 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1678 microversion: 2.1 time: 0.191729 May 19 09:14:14.452398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5126/6451] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:14 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:15.469976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:15.470654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:15.481812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:15.482280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:15.483092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:15.483549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:15.706892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:15.716399 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5fa6db7-9ff0-4d62-988f-324aae7663df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1678 microversion: 2.1 time: 0.250195 May 19 09:14:15.728146 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5127/6452] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:15 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:15.926242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6af70686-cdf6-4f22-9de6-575ff8747bc7 req-8dffdc6b-e9a1-46a1-bc34-4736a804097c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "name": "network-vif-plugged", "status": "completed", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:15.936453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6af70686-cdf6-4f22-9de6-575ff8747bc7 req-8dffdc6b-e9a1-46a1-bc34-4736a804097c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:15.936949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6af70686-cdf6-4f22-9de6-575ff8747bc7 req-8dffdc6b-e9a1-46a1-bc34-4736a804097c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:15.951202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6af70686-cdf6-4f22-9de6-575ff8747bc7 req-8dffdc6b-e9a1-46a1-bc34-4736a804097c service nova] Creating event network-vif-plugged:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:14:15.958573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-6af70686-cdf6-4f22-9de6-575ff8747bc7 req-8dffdc6b-e9a1-46a1-bc34-4736a804097c service nova] Instance eeb91c92-0a47-4db9-b259-96d514b11e6d is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:14:15.972530 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6af70686-cdf6-4f22-9de6-575ff8747bc7 req-8dffdc6b-e9a1-46a1-bc34-4736a804097c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128439 May 19 09:14:15.973098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5128/6453] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:16.641031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f0cf5f77-16ca-4c3a-807e-010881aeb7b1 req-4cf0b2d6-f9fe-4e81-9d62-aff8ea089d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "name": "network-vif-unplugged", "status": "completed", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:16.650784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f0cf5f77-16ca-4c3a-807e-010881aeb7b1 req-4cf0b2d6-f9fe-4e81-9d62-aff8ea089d18 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:16.651242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f0cf5f77-16ca-4c3a-807e-010881aeb7b1 req-4cf0b2d6-f9fe-4e81-9d62-aff8ea089d18 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:16.669537 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f0cf5f77-16ca-4c3a-807e-010881aeb7b1 req-4cf0b2d6-f9fe-4e81-9d62-aff8ea089d18 service nova] Creating event network-vif-unplugged:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:14:16.678513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-f0cf5f77-16ca-4c3a-807e-010881aeb7b1 req-4cf0b2d6-f9fe-4e81-9d62-aff8ea089d18 service nova] Instance eeb91c92-0a47-4db9-b259-96d514b11e6d is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:14:16.694628 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f0cf5f77-16ca-4c3a-807e-010881aeb7b1 req-4cf0b2d6-f9fe-4e81-9d62-aff8ea089d18 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136223 May 19 09:14:16.695411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5129/6454] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:14:16.743896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:16.744735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:16.756254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:16.756797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:16.758009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:16.758817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:16.965336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:16.977654 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82eb9917-648a-4ea1-969d-963204caf2a5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1678 microversion: 2.1 time: 0.238355 May 19 09:14:16.978342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5130/6455] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:16 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:17.998064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:17.998991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:18.009072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:18.009581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:18.010646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:18.011157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:18.498143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:18.514890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c13ac31b-54b1-432f-b5b7-6506175b3a03 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1678 microversion: 2.1 time: 0.521212 May 19 09:14:18.516149 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5131/6456] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:17 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1678 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:18.743196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9cc5a22b-2c19-4945-9b7c-4434fb1dc2be req-72513110-e6a6-4f41-b756-51f306fa7c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:18.752854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9cc5a22b-2c19-4945-9b7c-4434fb1dc2be req-72513110-e6a6-4f41-b756-51f306fa7c96 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:18.753330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9cc5a22b-2c19-4945-9b7c-4434fb1dc2be req-72513110-e6a6-4f41-b756-51f306fa7c96 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:18.775305 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9cc5a22b-2c19-4945-9b7c-4434fb1dc2be req-72513110-e6a6-4f41-b756-51f306fa7c96 service nova] Creating event network-changed:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:14:18.782004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-9cc5a22b-2c19-4945-9b7c-4434fb1dc2be req-72513110-e6a6-4f41-b756-51f306fa7c96 service nova] Instance eeb91c92-0a47-4db9-b259-96d514b11e6d is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:14:18.798213 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9cc5a22b-2c19-4945-9b7c-4434fb1dc2be req-72513110-e6a6-4f41-b756-51f306fa7c96 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057733 May 19 09:14:18.799266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5132/6457] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:19.536739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:19.538786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:19.550261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:19.551313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:19.552559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:19.554515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:19.779300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:19.789905 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-02ca0ebc-ac21-40bc-bfd3-bfbeb6b5ee98 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1671 microversion: 2.1 time: 0.258262 May 19 09:14:19.801963 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5133/6458] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:19 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:19.808037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:19.808802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:19.820668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:19.821125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:19.821974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:19.822420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:19.985002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:19.993493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6878b12-ed95-4e99-ba7f-9f802189fdf0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1671 microversion: 2.1 time: 0.189760 May 19 09:14:19.994108 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5134/6459] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:19 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:20.018751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:20.019573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:20.027606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:20.028509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:20.030148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:20.030814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:20.055532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:20.208866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:20.217277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-121c55ff-6057-4ce1-9651-94d217ce0f6d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1671 microversion: 2.1 time: 0.204926 May 19 09:14:20.217945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5135/6460] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:20 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:20.234926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:20.235513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:20.242618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:20.243090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:20.243890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:20.244336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:20.282903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:14:20.386606 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d887d0c1-11d8-4ee0-950a-ebf68f677d86 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 204 len: 0 microversion: 2.1 time: 0.152956 May 19 09:14:20.387756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5136/6461] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:14:20 2022] DELETE /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:14:20.398111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:20.398894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:20.406167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:20.406871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:20.407871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:20.408386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:20.582676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:20.591792 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85476e2f-8ca4-4466-97b3-2609f25c5cab tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1677 microversion: 2.1 time: 0.198528 May 19 09:14:20.592653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5137/6462] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:20 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:21.615825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:21.617144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:21.627019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:21.627617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:21.628806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:21.629414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:21.808690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:21.818536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-737e7c3a-ca3b-4637-8b40-e83650798b18 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1677 microversion: 2.1 time: 0.210283 May 19 09:14:21.819164 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5138/6463] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:21 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:21.824178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-18e4eb6a-f385-44ef-9c54-5a434af8bea8 req-8118a7e0-67ec-4c56-aa40-f3ee17cf89df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "name": "network-vif-plugged", "status": "completed", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:21.834040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18e4eb6a-f385-44ef-9c54-5a434af8bea8 req-8118a7e0-67ec-4c56-aa40-f3ee17cf89df service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:21.834650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-18e4eb6a-f385-44ef-9c54-5a434af8bea8 req-8118a7e0-67ec-4c56-aa40-f3ee17cf89df service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:21.851246 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-18e4eb6a-f385-44ef-9c54-5a434af8bea8 req-8118a7e0-67ec-4c56-aa40-f3ee17cf89df service nova] Creating event network-vif-plugged:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:14:21.857975 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-18e4eb6a-f385-44ef-9c54-5a434af8bea8 req-8118a7e0-67ec-4c56-aa40-f3ee17cf89df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037522 May 19 09:14:21.858665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5139/6464] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:14:22.842919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:22.850176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:22.851282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:22.861747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:22.863444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:22.864544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:22.865172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:22.977843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:22.990808 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed1c020e-50d2-46c5-8aa6-694efd095249 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 200 len: 1609 microversion: 2.1 time: 0.150401 May 19 09:14:22.993626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5140/6465] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:22 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 1609 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:23.020740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e6bfb779-4406-42f2-9f6e-23752850ae0c req-1eeb3c6f-56b1-4293-9bd7-05c77073c798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb91c92-0a47-4db9-b259-96d514b11e6d", "name": "network-vif-deleted", "tag": "973a31fd-bc2e-4dbf-bdb8-e002aa05392b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:23.035815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e6bfb779-4406-42f2-9f6e-23752850ae0c req-1eeb3c6f-56b1-4293-9bd7-05c77073c798 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:23.037689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e6bfb779-4406-42f2-9f6e-23752850ae0c req-1eeb3c6f-56b1-4293-9bd7-05c77073c798 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:23.063242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e6bfb779-4406-42f2-9f6e-23752850ae0c req-1eeb3c6f-56b1-4293-9bd7-05c77073c798 service nova] Creating event network-vif-deleted:973a31fd-bc2e-4dbf-bdb8-e002aa05392b for instance eeb91c92-0a47-4db9-b259-96d514b11e6d on chh2-842464-2 May 19 09:14:23.070142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e6bfb779-4406-42f2-9f6e-23752850ae0c req-1eeb3c6f-56b1-4293-9bd7-05c77073c798 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055579 May 19 09:14:23.070921 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5141/6466] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:24.016618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:24.017603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:24.020283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:24.027166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:24.027731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:24.028553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:24.029006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:24.046721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d HTTP/1.1 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'eeb91c92-0a47-4db9-b259-96d514b11e6d'} May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:14:24.050286 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96eb72d2-e2b5-4415-b9ab-3eaf0e886746 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 404 len: 111 microversion: 2.1 time: 0.040284 May 19 09:14:24.061073 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5142/6467] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:24 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:14:24.082497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:24.083341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:24.091264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:24.091846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:24.092747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:24.093266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:24.110402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d HTTP/1.1 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'eeb91c92-0a47-4db9-b259-96d514b11e6d'} May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:14:24.112223 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3c51d6ce-cc2a-478c-a633-39921dc05ed8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 404 len: 111 microversion: 2.1 time: 0.036432 May 19 09:14:24.130386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5143/6468] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:24 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:14:24.172890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1052861090", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "090ff69e-1ae4-4e7a-a1bc-07327ed81938"}], "security_groups": [{"name": "tempest-securitygroup--1342956845"}], "key_name": "tempest-keypair-1831610942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:24.339132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] validate_networks() for [('090ff69e-1ae4-4e7a-a1bc-07327ed81938', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:14:24.931874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:14:24.932365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:14:24.932865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:14:24.933298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:14:24.933748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:14:24.947186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:24.947655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:24.948471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:24.948933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:24.973059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:14:24.979178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:14:24.999400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:14:25.002528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:14:25.057786 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9bad6d2b-2752-49fa-9c94-4068c2808aca tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891185 May 19 09:14:25.063681 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5144/6469] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:14:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:14:25.073751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1c76ade-1a2c-4028-b9a1-c4862656e5c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:25.074809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1c76ade-1a2c-4028-b9a1-c4862656e5c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:25.142931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1c76ade-1a2c-4028-b9a1-c4862656e5c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:25.150836 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1c76ade-1a2c-4028-b9a1-c4862656e5c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1239 microversion: 2.1 time: 0.083403 May 19 09:14:25.151629 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5145/6470] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:25 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:26.179793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:26.180502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:26.188848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:26.189335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:26.190194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:26.190631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:26.262770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:26.271469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3babfc5e-2c7d-4db3-9aa1-4c2ea0f3823a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1291 microversion: 2.1 time: 0.095771 May 19 09:14:26.272111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5146/6471] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:26 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1291 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:27.290110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:27.290807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:27.299214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:27.308511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:27.309551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:27.310021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:27.400221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:27.419223 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b005174b-b742-43e8-98f0-7267d7e2dc1a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1297 microversion: 2.1 time: 0.132816 May 19 09:14:27.419904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5147/6472] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:27 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:28.415298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9cb9ddf5-4369-44f0-afd0-8df928b90bcd req-ba213e6a-11b9-4c01-886d-04aa0e241f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:28.428515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9cb9ddf5-4369-44f0-afd0-8df928b90bcd req-ba213e6a-11b9-4c01-886d-04aa0e241f66 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:28.429043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9cb9ddf5-4369-44f0-afd0-8df928b90bcd req-ba213e6a-11b9-4c01-886d-04aa0e241f66 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:28.454912 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9cb9ddf5-4369-44f0-afd0-8df928b90bcd req-ba213e6a-11b9-4c01-886d-04aa0e241f66 service nova] Creating event network-changed:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh1-842464-2 May 19 09:14:28.463395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9cb9ddf5-4369-44f0-afd0-8df928b90bcd req-ba213e6a-11b9-4c01-886d-04aa0e241f66 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052573 May 19 09:14:28.464369 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5148/6473] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:28.472791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:28.474281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:28.486660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:28.487152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:28.488034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:28.488794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:28.757714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:28.769352 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33b12232-ccc2-4d6a-959d-455014990555 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1365 microversion: 2.1 time: 0.303033 May 19 09:14:28.770134 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5149/6474] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:28 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:14:29.789391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:29.790083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:29.798442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:29.798916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:29.799729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:29.800189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:30.036351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:30.044319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8249fd97-3b67-4b3b-8527-411376519d3a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1365 microversion: 2.1 time: 0.259206 May 19 09:14:30.044993 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5150/6475] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:29 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:31.062279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:31.064094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:31.071940 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:31.072517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:31.073215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:31.073717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:31.225754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:31.233664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0f9201c8-41c8-4346-8b4c-bc98a018cdaf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1365 microversion: 2.1 time: 0.176539 May 19 09:14:31.234293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5151/6476] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:31 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:32.251437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:32.252105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:32.260563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:32.261027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:32.261906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:32.262467 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:32.410357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:32.419903 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0cbfe730-f472-4c56-8006-48602440cc78 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1365 microversion: 2.1 time: 0.172899 May 19 09:14:32.420517 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5152/6477] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:32 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:33.438832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:33.439614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:33.446644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:33.447114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:33.447910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:33.448372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:33.604822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:33.615259 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f0abbde-4ef5-4dcf-a21d-e98a17a55788 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1365 microversion: 2.1 time: 0.180117 May 19 09:14:33.616071 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5153/6478] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:33 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:33.807294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f0881c09-813c-46e5-82e0-9f13537b7a6b req-9d1ee3bd-a9e7-4fed-88cf-33adef04e5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "name": "network-vif-plugged", "status": "completed", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:33.815939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f0881c09-813c-46e5-82e0-9f13537b7a6b req-9d1ee3bd-a9e7-4fed-88cf-33adef04e5a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:33.816428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f0881c09-813c-46e5-82e0-9f13537b7a6b req-9d1ee3bd-a9e7-4fed-88cf-33adef04e5a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:33.830102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f0881c09-813c-46e5-82e0-9f13537b7a6b req-9d1ee3bd-a9e7-4fed-88cf-33adef04e5a8 service nova] Creating event network-vif-plugged:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh1-842464-2 May 19 09:14:33.835091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f0881c09-813c-46e5-82e0-9f13537b7a6b req-9d1ee3bd-a9e7-4fed-88cf-33adef04e5a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031686 May 19 09:14:33.835705 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5154/6479] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:34.636160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:34.636882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:34.644100 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:34.644564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:34.645390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:34.645839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:34.795529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:34.803492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5cbe735-2f4c-4349-a37d-a4ae7cab8925 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1365 microversion: 2.1 time: 0.172373 May 19 09:14:34.804342 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5155/6480] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:34 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:35.821492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:35.822161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:35.824189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:35.824888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:35.831816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:35.832275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:35.833061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:35.833540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:35.837639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:14:35.972282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:14:35.980331 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad36c7de-e3e7-4cd9-a6ec-e973088085be tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1552 microversion: 2.1 time: 0.162850 May 19 09:14:35.980916 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5156/6481] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:14:35 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:14:35.998272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:14:35.998781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:14:36.006730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:36.007202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:36.008021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:36.008472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:36.090754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-586aebc8-db04-443c-afd4-4575c4b4b4fa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096316 May 19 09:14:36.091379 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5157/6482] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 09:14:35 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:14:37.119552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0e741553-b9ef-4b6c-b840-b498d85e893c req-66dc1027-4ec1-468b-9ecd-7378582c8fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:14:37.128393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0e741553-b9ef-4b6c-b840-b498d85e893c req-66dc1027-4ec1-468b-9ecd-7378582c8fc4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:14:37.128845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0e741553-b9ef-4b6c-b840-b498d85e893c req-66dc1027-4ec1-468b-9ecd-7378582c8fc4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:14:37.141088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0e741553-b9ef-4b6c-b840-b498d85e893c req-66dc1027-4ec1-468b-9ecd-7378582c8fc4 service nova] Creating event network-changed:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh1-842464-2 May 19 09:14:37.146536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0e741553-b9ef-4b6c-b840-b498d85e893c req-66dc1027-4ec1-468b-9ecd-7378582c8fc4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031386 May 19 09:14:37.147198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5158/6483] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:15:12.512820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:15:12.513596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=10 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:15:12.518739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:12.519471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:12.527550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:12.528011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:12.528804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:12.529281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:12.695630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:12.704360 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-490da10d-9a45-42d6-93c9-ff48c9a7e1b0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1671 microversion: 2.1 time: 0.194632 May 19 09:15:12.704947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5159/6484] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:12 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1671 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:12.722008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d1ecd82-5a95-4eeb-98c3-53b9556fbbcd"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:15:12.723147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:12.732529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:12.733948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:12.734772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:12.735233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:12.998790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84f96256-3405-4dc6-9cb9-b9112c98f4f2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281564 May 19 09:15:13.016718 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5160/6485] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 09:15:12 2022] POST /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:15:30.190677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:15:30.191526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:15:30.195994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:15:30.197123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:30.205907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:30.206368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:30.207160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:30.207605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:30.238736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:30.245932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:15:30.254148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:15:30.254602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:15:30.255087 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:15:30.255510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:15:30.256000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:15:30.326189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1afc5528-4c5a-4246-9616-b8e502caa0e7 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/action" status: 202 len: 0 microversion: 2.1 time: 0.137316 May 19 09:15:30.328121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5161/6486] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:15:30 2022] POST /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:15:30.336469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:30.337115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:30.352920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:30.353538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:30.354246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:30.354769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:30.508588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:30.525069 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2583eec-dbf1-4705-bfc7-5b13357f3b22 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1726 microversion: 2.1 time: 0.192015 May 19 09:15:30.526174 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5162/6487] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:30 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1726 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:31.548700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:31.549508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:31.556686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:31.557264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:31.558098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:31.558544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:31.756503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:31.766207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6eecd5f-b2b3-46f8-b046-7aadb815804b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1726 microversion: 2.1 time: 0.221628 May 19 09:15:31.766793 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5163/6488] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:31 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:32.793586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:32.794558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:32.803894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:32.804366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:32.805244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:32.805669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:32.948206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:32.958103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61ee973d-44fc-4b7c-b428-6e2692a0e4a0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.168911 May 19 09:15:32.958705 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5164/6489] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:32 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:33.976688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:33.977693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:33.991320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:33.991791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:33.992661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:33.993070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:34.149911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:34.158354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-32a542e4-1b7a-462d-9cff-a1bd4252b93b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.186007 May 19 09:15:34.158935 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5165/6490] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:33 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:35.176129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:35.176793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:35.191695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:35.192167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:35.192974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:35.193466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:35.335286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:35.346169 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb3bbf6b-7cc3-43fd-bb24-7ededc442659 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.173873 May 19 09:15:35.346777 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5166/6491] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:35 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:36.364795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:36.365503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:36.372529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:36.373022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:36.373869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:36.374351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:36.515775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:36.524115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-708b54ef-6152-41e2-826d-e4dab578b5c6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.163226 May 19 09:15:36.524709 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5167/6492] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:36 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:37.541928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:37.542593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:37.550239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:37.550711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:37.551524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:37.551990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:37.715036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:37.723872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49f3438e-3700-44b9-95fd-1d2931e02424 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.185806 May 19 09:15:37.724722 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5168/6493] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:37 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:38.741639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:38.742349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:38.749996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:38.750454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:38.751264 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:38.751707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:38.897596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:38.906612 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3145f813-08b0-4404-986b-064a5d3ac1a3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.168991 May 19 09:15:38.907218 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5169/6494] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:38 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:39.924656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:39.925334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:39.932682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:39.933149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:39.934014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:39.934469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:40.075640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:40.097560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d897b32c-e78e-46d9-8c02-c31a9c1c1f6c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.177058 May 19 09:15:40.098243 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5170/6495] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:39 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:41.118036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:41.118036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:41.125523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:41.125994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:41.126973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:41.127560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:41.280259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:41.290143 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ebd154c0-7069-47ca-b48d-72f45eb01f89 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.177982 May 19 09:15:41.290588 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5171/6496] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:41 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:15:42.310304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:42.311671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:42.318691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:42.319158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:42.319948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:42.320407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:42.524291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:42.534249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1954bbd-0d26-4189-8275-f156ae955a5a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.227770 May 19 09:15:42.535344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5172/6497] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:42 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:43.560240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:43.561084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:43.568128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:43.568571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:43.569396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:43.569837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:43.727829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:43.737397 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51af1a71-f7a7-4eb2-bf98-dda77e33d6aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.180971 May 19 09:15:43.738010 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5173/6498] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:43 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:44.755057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:44.755741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:44.764063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:44.764741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:44.765579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:44.766043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:44.918452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:44.927271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b58554ce-6f7a-4286-bf76-f413acc9ed2b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.176259 May 19 09:15:44.927854 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5174/6499] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:44 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:45.946088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:45.947145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:45.958697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:45.959202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:45.960012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:45.960476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:46.113185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:46.121897 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d92c8b55-5903-40e2-a276-5fd05bc1a9e6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.181094 May 19 09:15:46.122491 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5175/6500] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:45 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:47.140796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:47.141503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:47.150019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:47.150498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:47.151314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:47.151773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:47.157791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:15:47.304935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:47.315049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79babbfb-3b5e-4d1e-9d22-cf29bf7dd464 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.178323 May 19 09:15:47.315649 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5176/6501] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:47 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:48.332670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:48.333491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:48.340660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:48.341121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:48.342809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:48.343497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:48.524913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:48.538696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e584a75-ba5f-4c6a-af24-4db1f35dd01b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.209821 May 19 09:15:48.539426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5177/6502] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:48 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:49.557594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:49.558294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:49.566464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:49.566922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:49.567921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:49.568435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:49.754887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:49.766096 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-84fdfe5e-1325-4443-80a0-e6328d7ec0f0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.212393 May 19 09:15:49.766758 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5178/6503] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:49 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:50.788340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:50.789408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:50.799105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:50.799928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:50.801363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:50.802142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:50.967915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:50.978353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5cdc00a-4f0c-47f5-9330-2e93a41148f1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.193947 May 19 09:15:50.979095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5179/6504] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:50 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:51.998481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:51.999427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:52.007432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:52.007955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:52.008814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:52.009336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:52.199377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:52.209882 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f0ad977-8c85-4a3e-aff6-2f6b4ebaa337 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.216182 May 19 09:15:52.210504 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5180/6505] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:51 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:53.229094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:53.229828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:53.237692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:53.238101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:53.238905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:53.239363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:53.402278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:53.411764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-79ebe724-880c-44b6-b3d8-8c9523b0eb70 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.187109 May 19 09:15:53.412395 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5181/6506] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:53 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:15:54.430284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:54.431274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:54.439066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:54.439555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:54.440369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:54.441360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:54.602316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:54.612779 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8fb2146f-2fe8-479e-b29d-a475ab981c0c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.186365 May 19 09:15:54.613434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5182/6507] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:54 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:55.712344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:55.713561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:55.726484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:55.727512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:55.728910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:55.729750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:55.920770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:55.936518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb0f26cb-4629-4486-a8e4-1e6a62ae4c38 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.307759 May 19 09:15:55.937387 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5183/6508] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:55 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:56.969137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:56.970419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:56.984868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:56.985870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:56.987500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:56.988336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:57.206439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:57.215965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0309dd9-3ca5-4576-a7d3-8be3f7b25e48 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.255414 May 19 09:15:57.217864 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5184/6509] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:56 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:15:58.236277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:58.237440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:58.244778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:58.245244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:58.246174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:58.246628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:58.426691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:58.444569 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6770077e-332e-45a8-bd72-ca16b19e1e9b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.204495 May 19 09:15:58.445323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5185/6510] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:58 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:15:59.463519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:15:59.464289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:15:59.472888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:59.473404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:59.474972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:15:59.475498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:15:59.649927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:15:59.659906 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b8619ba-9a8c-4e49-b6e7-412b54dda77d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.200238 May 19 09:15:59.660595 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5186/6511] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:15:59 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:00.679128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:00.680168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:00.682758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=57 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:00.690853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:00.691329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:00.692281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:00.692621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:00.862613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:00.872083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78a5dd8b-c9a3-41ca-bfe0-27b47066b8cf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.197625 May 19 09:16:00.872756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5187/6512] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:00 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:01.892180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:01.892911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:01.901190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:01.901793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:01.902611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:01.903073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:02.062944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:02.072853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-42dd6ec2-02ed-4711-a24c-010778c40a26 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.185285 May 19 09:16:02.073411 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5188/6513] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:01 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:03.090584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:03.091361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:03.098776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:03.099249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:03.100329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:03.100788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:03.241705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:03.251115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92a4aa5f-37dc-41fb-aac7-222e30fafa08 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1731 microversion: 2.1 time: 0.164592 May 19 09:16:03.251748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5189/6514] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:03 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:04.204945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-5aeb1be8-2856-40d1-a536-9be1a2449fa7 req-083f4046-3be3-40e1-a28c-1c757f68887c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "name": "network-vif-unplugged", "status": "completed", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:04.217496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5aeb1be8-2856-40d1-a536-9be1a2449fa7 req-083f4046-3be3-40e1-a28c-1c757f68887c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:04.218521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-5aeb1be8-2856-40d1-a536-9be1a2449fa7 req-083f4046-3be3-40e1-a28c-1c757f68887c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:04.233904 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-5aeb1be8-2856-40d1-a536-9be1a2449fa7 req-083f4046-3be3-40e1-a28c-1c757f68887c service nova] Creating event network-vif-unplugged:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh2-842464-2 May 19 09:16:04.241515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-5aeb1be8-2856-40d1-a536-9be1a2449fa7 req-083f4046-3be3-40e1-a28c-1c757f68887c service nova] Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:16:04.256845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-5aeb1be8-2856-40d1-a536-9be1a2449fa7 req-083f4046-3be3-40e1-a28c-1c757f68887c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056472 May 19 09:16:04.257662 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5190/6515] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:16:04.270007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:04.270919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:04.278217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:04.279596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:04.280521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:04.281277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:04.461839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:04.471849 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-552cb2ca-9512-498d-bd2b-4a9e0a91c929 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1730 microversion: 2.1 time: 0.206303 May 19 09:16:04.472781 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5191/6516] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:04 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:05.491978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:05.493013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:05.502212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:05.502809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:05.503786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:05.504333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:05.673863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:05.692417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4176d2b-72be-45c9-989d-817c21a62df5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1730 microversion: 2.1 time: 0.204816 May 19 09:16:05.693804 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5192/6517] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:05 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:05.704781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-0ab12b7f-1bfc-467f-9efd-e52b0e4577e3 req-9605ac74-ca10-4029-a40c-32b9bf1210a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:05.720789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0ab12b7f-1bfc-467f-9efd-e52b0e4577e3 req-9605ac74-ca10-4029-a40c-32b9bf1210a9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:05.722131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-0ab12b7f-1bfc-467f-9efd-e52b0e4577e3 req-9605ac74-ca10-4029-a40c-32b9bf1210a9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:05.731265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:05.751850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-0ab12b7f-1bfc-467f-9efd-e52b0e4577e3 req-9605ac74-ca10-4029-a40c-32b9bf1210a9 service nova] Creating event network-changed:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh2-842464-2 May 19 09:16:05.762438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-0ab12b7f-1bfc-467f-9efd-e52b0e4577e3 req-9605ac74-ca10-4029-a40c-32b9bf1210a9 service nova] Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:16:05.776187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-0ab12b7f-1bfc-467f-9efd-e52b0e4577e3 req-9605ac74-ca10-4029-a40c-32b9bf1210a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079879 May 19 09:16:05.776931 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5193/6518] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:16:06.712030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:06.713895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:06.722302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:06.722930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:06.723915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:06.724918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:06.886500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:06.896201 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d5c15cc-7ea3-41dc-84e0-4ca0850e94f6 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.189272 May 19 09:16:06.896901 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5194/6519] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:06 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:07.913897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:07.914759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:07.921962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:07.922430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:07.923240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:07.923816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:08.072736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:08.082460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6b8a5396-31f3-4a60-a917-2b13b3db04b9 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.172551 May 19 09:16:08.083078 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5195/6520] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:07 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:09.100588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:09.101280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:09.108775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:09.109236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:09.110092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:09.110548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:09.292115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:09.307876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ada3eb37-021d-4fbc-affc-91cb08d6ac3e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.211115 May 19 09:16:09.309044 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5196/6521] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:09 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:10.335901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:10.336636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:10.344559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:10.345049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:10.345877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:10.346335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:10.508227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:10.518225 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2d40ce15-f294-42db-9cbd-689086d98b5d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.186331 May 19 09:16:10.519039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5197/6522] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:10 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:11.535798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:11.536832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:11.544930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:11.545493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:11.546565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:11.547028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:11.715172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:11.725112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-186d668e-2e97-4de7-be80-eec77ce2dd1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.193394 May 19 09:16:11.726137 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5198/6523] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:11 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:12.754624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:12.755359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:12.762757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:12.763814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:12.764627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:12.765085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:12.918161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:12.926910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c89c5655-3afd-482e-b7d8-f2f2bb67daf2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.176151 May 19 09:16:12.927756 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5199/6524] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:12 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:13.945455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:13.946241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:13.954962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:13.955439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:13.956257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:13.956747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:14.135258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:14.146208 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18fd3446-346c-4306-81e3-ae5f87d37591 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.204727 May 19 09:16:14.146966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5200/6525] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:13 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:15.165701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:15.166420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:15.178092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:15.178635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:15.179589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:15.180489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:15.345280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:15.354360 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b66031a6-3d8f-40c6-803d-201b030f1d34 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.193324 May 19 09:16:15.354961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5201/6526] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:15 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:16.373386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:16.374339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:16.383110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:16.383740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:16.384612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:16.385219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:16.537167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:16.546761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc7e3f91-53e9-43bf-b140-cf806296c948 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.178258 May 19 09:16:16.547379 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5202/6527] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:16 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:17.565373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:17.566137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:17.574417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:17.574883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:17.576111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:17.576687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:17.764955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:17.773447 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e54c82b-dfc7-473c-b0c4-ab48f4734518 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.212220 May 19 09:16:17.774095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5203/6528] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:17 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:18.791376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:18.792121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:18.800228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:18.800696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:18.801563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:18.802024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:18.952346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:18.961518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-75a9aaa0-c30d-407f-a2bd-2d80fc2ffb67 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.174179 May 19 09:16:18.962136 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5204/6529] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:18 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:19.990751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:19.991484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:19.999556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:20.000033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:20.000835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:20.001298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:20.147755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:20.156539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a14424c-1cfc-47f6-a76d-a08e009cd957 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.169703 May 19 09:16:20.157147 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5205/6530] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:19 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:21.174951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:21.175692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:21.183097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:21.183576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:21.184361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:21.185581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:21.369754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:21.380439 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a84270cf-b2d6-4857-a445-9cf87286408a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.209498 May 19 09:16:21.381289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5206/6531] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:21 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:22.399336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:22.400217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:22.406475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:22.406948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:22.413488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:22.414106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:22.568869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:22.578194 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1dc34cb1-56a0-44da-af57-83ad12cc79d2 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.184029 May 19 09:16:22.579252 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5207/6532] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:22 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:23.606353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:23.607118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:23.615627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:23.616083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:23.616880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:23.617350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:23.787477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:23.796159 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59f774da-05b0-44ce-8a04-8881d3692074 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1728 microversion: 2.1 time: 0.196561 May 19 09:16:23.796768 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5208/6533] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:23 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:24.814880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:24.815511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:24.823107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:24.823580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:24.824397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:24.824848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:24.975165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:24.983846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0c7c457b-6f06-49cc-a399-ae3fb3b36642 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1725 microversion: 2.1 time: 0.173660 May 19 09:16:24.984464 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5209/6534] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:24 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:25.002009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:25.002569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:25.018129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:25.018598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:25.019413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:25.019873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:25.024560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:25.061733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:25.062209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:25.063164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:25.063624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:25.087699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:16:25.093995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Getting quotas for user 7222636279ae4933b111a20da96b2ffa and project a61cab651928440da8da84301651f654. Resources: {'ram', 'cores'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:16:25.216711 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b0de8e8-b183-4110-bcbc-616ecb4f6a09 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "POST /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/action" status: 202 len: 0 microversion: 2.1 time: 0.217629 May 19 09:16:25.216711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5210/6535] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:16:24 2022] POST /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:16:25.228517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:25.229246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:25.236962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:25.237528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:25.238494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:25.238997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:25.391119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:25.400110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e9fb1b1-df00-4ab1-b040-f082cf7d48ad tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.176732 May 19 09:16:25.400721 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5211/6536] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:25 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:26.210933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1e100618-311d-4665-bb3c-87384889ee53 req-d5c6d247-e859-408b-99b3-770e3ab74528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "name": "network-vif-plugged", "status": "completed", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:26.223083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e100618-311d-4665-bb3c-87384889ee53 req-d5c6d247-e859-408b-99b3-770e3ab74528 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:26.223627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e100618-311d-4665-bb3c-87384889ee53 req-d5c6d247-e859-408b-99b3-770e3ab74528 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:26.237865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1e100618-311d-4665-bb3c-87384889ee53 req-d5c6d247-e859-408b-99b3-770e3ab74528 service nova] Creating event network-vif-plugged:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh2-842464-2 May 19 09:16:26.244468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-1e100618-311d-4665-bb3c-87384889ee53 req-d5c6d247-e859-408b-99b3-770e3ab74528 service nova] Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:16:26.258228 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1e100618-311d-4665-bb3c-87384889ee53 req-d5c6d247-e859-408b-99b3-770e3ab74528 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052162 May 19 09:16:26.259481 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5212/6537] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:16:26.419462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:26.420216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:26.427124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:26.427584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:26.428379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:26.428891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:26.579399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:26.587827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e655394c-f27c-4bd6-8aa2-72053a12cf29 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.172968 May 19 09:16:26.588413 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5213/6538] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:26 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:27.606997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:27.607830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:27.625714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:27.626464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:27.627007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:27.627478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:27.782387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:27.791290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93db4a98-a4cb-451c-aaac-8b8e07c0f4ed tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.188391 May 19 09:16:27.791901 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5214/6539] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:27 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:28.815753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:28.817137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:28.834526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:28.835360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:28.836759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:28.837575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:29.050941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:29.060370 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2aca0f68-bbec-44d8-b236-45b2eb086c4f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.252875 May 19 09:16:29.060954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5215/6540] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:28 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:30.083515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:30.085088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:30.093280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:30.093781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:30.094895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:30.095291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:30.289024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:30.301458 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6ed0f804-1f28-4a7b-b997-01d976522cb0 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.222367 May 19 09:16:30.302095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5216/6541] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:30 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:30.312376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3276f548-648f-47e8-959a-f5c4f535c3ee req-463f2e8f-fa08-4da4-abda-d1a7ae7a0646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "name": "network-vif-unplugged", "status": "completed", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:30.325929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3276f548-648f-47e8-959a-f5c4f535c3ee req-463f2e8f-fa08-4da4-abda-d1a7ae7a0646 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:30.326598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3276f548-648f-47e8-959a-f5c4f535c3ee req-463f2e8f-fa08-4da4-abda-d1a7ae7a0646 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:30.342979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3276f548-648f-47e8-959a-f5c4f535c3ee req-463f2e8f-fa08-4da4-abda-d1a7ae7a0646 service nova] Creating event network-vif-unplugged:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh2-842464-2 May 19 09:16:30.349092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-3276f548-648f-47e8-959a-f5c4f535c3ee req-463f2e8f-fa08-4da4-abda-d1a7ae7a0646 service nova] Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:16:30.361796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3276f548-648f-47e8-959a-f5c4f535c3ee req-463f2e8f-fa08-4da4-abda-d1a7ae7a0646 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057966 May 19 09:16:30.362706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5217/6542] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:16:31.330453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:31.331478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:31.333345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:31.340292 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:31.341673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:31.342547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:31.343007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:31.520130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:31.531252 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f093754-d946-4fca-9438-a516eac7de9c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.206239 May 19 09:16:31.532198 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5218/6543] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:31 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:32.551190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:32.551933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:32.561596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:32.562210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:32.562947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:32.563289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:32.721747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:32.738853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-624a0800-e021-40dc-ac3d-063bfd80b7fd tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.191154 May 19 09:16:32.739963 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5219/6544] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:32 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:33.757151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:33.757950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:33.767230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:33.767765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:33.768589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:33.769045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:34.036073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:34.046146 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-57342634-8259-4200-8b14-83f88ee00931 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.292994 May 19 09:16:34.047050 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5220/6545] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:33 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:34.852196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e0e0f269-71a9-4f7a-b5ce-f4aa02935d07 req-25fcbe35-40c0-4e57-a039-731d3a6879a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:34.863945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e0e0f269-71a9-4f7a-b5ce-f4aa02935d07 req-25fcbe35-40c0-4e57-a039-731d3a6879a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:34.864708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e0e0f269-71a9-4f7a-b5ce-f4aa02935d07 req-25fcbe35-40c0-4e57-a039-731d3a6879a2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:34.880188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e0e0f269-71a9-4f7a-b5ce-f4aa02935d07 req-25fcbe35-40c0-4e57-a039-731d3a6879a2 service nova] Creating event network-changed:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh1-842464-2 May 19 09:16:34.895244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-e0e0f269-71a9-4f7a-b5ce-f4aa02935d07 req-25fcbe35-40c0-4e57-a039-731d3a6879a2 service nova] Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:16:34.918197 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e0e0f269-71a9-4f7a-b5ce-f4aa02935d07 req-25fcbe35-40c0-4e57-a039-731d3a6879a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071068 May 19 09:16:34.919694 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5221/6546] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:16:35.066124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:35.066893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:35.073999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:35.076890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:35.077526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:35.078948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:35.079685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:35.357201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:35.367364 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-17a06d07-adbe-4a17-b1af-649a871ef9e1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.306736 May 19 09:16:35.378133 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5222/6547] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:35 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:36.386350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:36.387047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:36.395640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:36.396112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:36.396939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:36.397463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:36.561714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:36.571125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-743cb5c2-fe75-498a-994a-5d4b81b582df tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.189011 May 19 09:16:36.572336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5223/6548] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:36 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:37.589454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:37.590154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:37.598572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:37.599043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:37.600141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:37.600601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:37.776768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:37.781684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:37.788222 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3616dfa6-7163-4e60-a158-92e527bcb93f tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.202673 May 19 09:16:37.788848 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5224/6549] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:37 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:38.806604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:38.807313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:38.823710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:38.824226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:38.826293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:38.826901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:38.986165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:38.999205 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e51aa069-4dd6-4d30-bcb7-93a9116d48b4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.197387 May 19 09:16:38.999950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5225/6550] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:38 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:40.017218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:40.017933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:40.025045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:40.025608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:40.026398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:40.026853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:40.200496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:40.209987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2cfda178-600c-4711-ace9-9c0552e8c11b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.196806 May 19 09:16:40.210579 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5226/6551] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:40 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:41.228968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:41.229799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:41.237589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:41.238065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:41.238878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:41.239337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:41.410181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:41.422352 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f58f74d-282b-47cf-8b04-5573cea1080d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.197924 May 19 09:16:41.423233 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5227/6552] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:41 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:42.444932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:42.446556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:42.461149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:42.462134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:42.463472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:42.464384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:42.676724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:42.687311 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f66d4772-b0eb-4d78-b4ab-07160422e4ec tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.249786 May 19 09:16:42.688328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5228/6553] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:42 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:43.713764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:43.714508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:43.723023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:43.723487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:43.724304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:43.725018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:43.908943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:43.919402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11cb4ac8-d16f-4744-8c7a-e166b5d64a1d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.210344 May 19 09:16:43.920039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5229/6554] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:43 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:44.938500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:44.939501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:44.946932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:44.947402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:44.948214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:44.948681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:45.123147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:45.137356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-432a780e-236b-48e5-9ea0-3a97da45980a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.204374 May 19 09:16:45.138291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5230/6555] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:44 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:46.164972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:46.166076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:46.174297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:46.174773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:46.175600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:46.176064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:46.399241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:46.418203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3c97ebb-11ab-4730-bd31-5c0847ae27d1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.258200 May 19 09:16:46.426830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5231/6556] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:46 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:46.710439 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:16:46.710772 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:16:47.366925 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:16:47.367653 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:16:47.445923 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:47.446671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:47.454493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:47.454967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:47.456289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:47.457180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:47.655162 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:47.665251 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d07f7d75-4bb8-439b-8adb-8efb7913794d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.223197 May 19 09:16:47.666319 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5232/6557] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:47 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:48.690544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:48.691652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:48.699775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:48.700234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:48.701064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:48.701621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:48.877141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:48.886550 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b46e01cc-e413-451b-a85a-6e96839181ce tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.200252 May 19 09:16:48.888032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5233/6558] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:48 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:49.908384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:49.909349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:49.919704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:49.920172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:49.920991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:49.921499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:50.077418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:50.087266 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c840cc81-beab-411d-a44f-b59bb30aafa3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.185237 May 19 09:16:50.087950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5234/6559] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:49 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:51.107531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:51.108602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:51.116299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:51.116886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:51.117817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:51.118404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:51.288240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:51.299679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-61c90617-9bb9-4bfd-838d-7021e3b1e92c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.197695 May 19 09:16:51.300336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5235/6560] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:51 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:52.324409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:52.325350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:52.332992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:52.333510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:52.334361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:52.334829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:52.490969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:52.500870 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad650f5d-adac-4370-a3c0-4558cd03b3e3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.180338 May 19 09:16:52.501515 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5236/6561] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:52 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:53.519589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:53.520377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:53.528044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:53.528505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:53.529272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:53.529762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:53.678019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:53.688148 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dd005473-3e53-4427-beae-30e7b358285d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1724 microversion: 2.1 time: 0.172534 May 19 09:16:53.688757 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5237/6562] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:53 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:54.706670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:54.707697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:54.715605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:54.716071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:54.717026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:54.717525 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:54.879729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:54.888771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9494749d-43e3-4d2f-9016-87f4d00fa203 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1717 microversion: 2.1 time: 0.186394 May 19 09:16:54.889391 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5238/6563] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:54 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:54.904860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:54.905549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:54.911884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:54.912369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:54.913211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:54.913690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.056647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:55.065828 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b57bed57-fe1c-4dd3-a6df-5b1ace52bfa4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1717 microversion: 2.1 time: 0.164832 May 19 09:16:55.066415 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5239/6564] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:54 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:55.083397 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:55.084022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:55.090561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:55.091091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.091878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:55.092336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.239682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:55.248632 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ae34a724-2e4c-4af1-b561-d9f149a4928b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1717 microversion: 2.1 time: 0.169111 May 19 09:16:55.249223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5240/6565] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:55 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1717 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:55.265237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:55.265698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:55.272291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:55.272752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.273593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:55.274073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.296065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:16:55.304663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:16:55.397262 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3b55726-a9e5-40ce-b231-3c6def346082 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 204 len: 0 microversion: 2.1 time: 0.135854 May 19 09:16:55.398375 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5241/6566] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:16:55 2022] DELETE /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:16:55.407663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:55.408410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:55.415102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:55.415562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.416377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:55.416836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:55.581837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:55.591200 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40d75f2b-8cf4-4030-802e-8ecb78a30579 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1723 microversion: 2.1 time: 0.187424 May 19 09:16:55.591873 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5242/6567] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:55 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:16:56.611416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:56.612433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:56.619818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:56.620290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:56.621208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:56.621703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:56.815195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:56.824287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-791b692d-f566-4c34-be41-c1a82d4ffa39 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1723 microversion: 2.1 time: 0.217315 May 19 09:16:56.826077 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5243/6568] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:56 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:57.845435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:57.847844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:57.863703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:57.864163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:57.864986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:57.865480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:57.955203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:57.966357 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2584796f-2cf6-4b5e-84fa-43ae062163d4 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1655 microversion: 2.1 time: 0.125093 May 19 09:16:57.973224 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5244/6569] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:57 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1655 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:16:58.030060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-04297efa-65ba-4a0e-af3b-d04d3cad516d req-48ae3b5e-4779-4d4c-af3b-65d258f32957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13", "name": "network-vif-deleted", "tag": "de6b6d1e-266e-46f2-93e3-96f9c4ab2f66"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:16:58.056651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-04297efa-65ba-4a0e-af3b-d04d3cad516d req-48ae3b5e-4779-4d4c-af3b-65d258f32957 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:58.057863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-04297efa-65ba-4a0e-af3b-d04d3cad516d req-48ae3b5e-4779-4d4c-af3b-65d258f32957 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:58.093539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-04297efa-65ba-4a0e-af3b-d04d3cad516d req-48ae3b5e-4779-4d4c-af3b-65d258f32957 service nova] Creating event network-vif-deleted:de6b6d1e-266e-46f2-93e3-96f9c4ab2f66 for instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 on chh1-842464-2 May 19 09:16:58.111028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-04297efa-65ba-4a0e-af3b-d04d3cad516d req-48ae3b5e-4779-4d4c-af3b-65d258f32957 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092866 May 19 09:16:58.112325 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5245/6570] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:16:58.988601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:16:58.989590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:16:58.998003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:58.998679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:58.999506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:16:58.999970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:16:59.089741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:16:59.101953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ae54e47-7417-4d88-a18b-948f0f36a20a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.118688 May 19 09:16:59.102779 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5246/6571] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:16:58 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:00.131489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:00.132672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:00.159671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:00.160619 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:00.164389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:00.165283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:00.256080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:00.268539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-574caad4-7888-4585-9383-0db93e812f94 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.150797 May 19 09:17:00.269628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5247/6572] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:00 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:01.297604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:01.298336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:01.306852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:01.307317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:01.308125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:01.308606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:01.395997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:01.406207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9210eb87-8b8f-4784-8cbd-9ad39fc60683 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.114848 May 19 09:17:01.407210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5248/6573] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:01 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:02.426014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:02.426833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:02.430141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:02.438660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:02.439125 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:02.440012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:02.440661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:02.513607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:02.523556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fb48812-ee8f-49ae-9971-c75ee61f184d tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.101827 May 19 09:17:02.524507 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5249/6574] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:02 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:03.546769 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:03.547732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:03.555379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:03.555843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:03.556920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:03.557543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:03.633155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:03.643304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ca6d38b-1f57-4161-9bcb-12e87e7ea8f5 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.100686 May 19 09:17:03.643908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5250/6575] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:03 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:04.662387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:04.663151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:04.671312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:04.671861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:04.672953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:04.673699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:04.745722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:04.755253 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8971b27f-2708-41f2-991b-caefacbd968a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.096897 May 19 09:17:04.755862 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5251/6576] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:04 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:05.776189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:05.777235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:05.785827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:05.786302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:05.787109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:05.787570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:05.872911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:05.882402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-93c27837-c567-4897-bced-c7b413eeadcf tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.111709 May 19 09:17:05.883007 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5252/6577] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:05 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:06.306782 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:17:06.307640 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:17:06.913833 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:06.914836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:06.922610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:06.923469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:06.923885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:06.924349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:07.003036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:07.019893 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c8b1884-217b-4eb5-b57d-2d8413cf2f7c tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.113889 May 19 09:17:07.021006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5253/6578] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:06 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:08.048928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:08.049739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:08.058172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:08.059330 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:08.060208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:08.060712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:08.158350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:08.171692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cd5deaa1-5384-4781-a540-2285a20028e8 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1370 microversion: 2.1 time: 0.128300 May 19 09:17:08.185493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5254/6579] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:08 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:09.203105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:09.204022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:09.213160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:09.213674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:09.214526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:09.215083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:09.258628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:09.259107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:09.259597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lazy-loading 'fault' on Instance uuid 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:17:09.330687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7222636279ae4933b111a20da96b2ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61cab651928440da8da84301651f654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:09.342098 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2b0fc9d-e1df-40d3-abca-52d60c9329aa tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 200 len: 1375 microversion: 2.1 time: 0.144533 May 19 09:17:09.343132 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5255/6580] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:09 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 1375 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:10.364711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:10.365537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:10.377082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:10.377734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:10.378677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:10.379288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:10.398538 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 HTTP/1.1 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13'} May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:10.400348 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3424852-e5d1-46c1-9a26-851cf6503958 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 404 len: 111 microversion: 2.1 time: 0.041715 May 19 09:17:10.410655 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5256/6581] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:10 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:10.471353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:10.472350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:10.479863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:10.480915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:10.481920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:10.482739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:10.498943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-volume_attachments HTTP/1.1 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13'} May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:10.500681 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55ac87b4-acdd-4c6d-8a21-0f4bd539d4fc tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035461 May 19 09:17:10.508435 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5257/6582] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:17:10 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:17.184574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.185698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.193916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.194560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.195460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.196119 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.204756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:17.220330 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 HTTP/1.1 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13'} May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.222693 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a76fa42e-740d-4f48-97f2-f8e3c4d2f85b tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 404 len: 111 microversion: 2.1 time: 0.044831 May 19 09:17:17.234805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5258/6583] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:17 2022] DELETE /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:17.244208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.244859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.253845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.254317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.255132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.255591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.272635 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 HTTP/1.1 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13'} May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.274437 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-398b6beb-80f6-40ae-8922-1b41d9f6b567 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13" status: 404 len: 111 microversion: 2.1 time: 0.045113 May 19 09:17:17.284484 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5259/6584] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:17 2022] GET /compute/v2.1/servers/9d89342e-c3e5-45ed-b4cb-bbeb9ff97a13 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:17.286944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.286944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.294924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.295431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.296500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.296915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.323060 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d HTTP/1.1 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'eeb91c92-0a47-4db9-b259-96d514b11e6d'} May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.326618 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3691d4e9-50db-4cc2-8d2e-a18f360102fe tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 404 len: 111 microversion: 2.1 time: 0.047092 May 19 09:17:17.334939 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5260/6585] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:17 2022] DELETE /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:17.344593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.346242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: eeb91c92-0a47-4db9-b259-96d514b11e6d] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.358463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.359309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.360734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.361562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.390696 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d HTTP/1.1 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'eeb91c92-0a47-4db9-b259-96d514b11e6d'} May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.395099 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.404560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance eeb91c92-0a47-4db9-b259-96d514b11e6d could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.406376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-45f56217-8e01-41d2-8c11-57b9fccf8064 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d" status: 404 len: 111 microversion: 2.1 time: 0.068084 May 19 09:17:17.410969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5261/6586] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:17 2022] GET /compute/v2.1/servers/eeb91c92-0a47-4db9-b259-96d514b11e6d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:17:17.419744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.420663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.430414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.431068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.432148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.432705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.456893 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 HTTP/1.1 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '014d638e-d0d2-49b1-80f4-c75cfad53ae3'} May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.458559 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b284591-5343-4dad-8521-7841583e62c3 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 404 len: 111 microversion: 2.1 time: 0.047741 May 19 09:17:17.467281 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5262/6587] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:17 2022] DELETE /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:17.472274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.473192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 014d638e-d0d2-49b1-80f4-c75cfad53ae3] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.481690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.482441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.483567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.484030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.503226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 HTTP/1.1 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '014d638e-d0d2-49b1-80f4-c75cfad53ae3'} May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.504873 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 014d638e-d0d2-49b1-80f4-c75cfad53ae3 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2268c95a-0262-48b2-a227-fd6821f1618a tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3" status: 404 len: 111 microversion: 2.1 time: 0.038950 May 19 09:17:17.514672 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5263/6588] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:17 2022] GET /compute/v2.1/servers/014d638e-d0d2-49b1-80f4-c75cfad53ae3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:17:17.518475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.519030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.526320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.526931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.527872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.528335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.545334 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c HTTP/1.1 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3e4ef2de-5e3f-43c4-aa52-477b9041a04c'} May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.547140 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f203e126-3e41-4271-b566-3d8eca19eb9e tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 404 len: 111 microversion: 2.1 time: 0.035584 May 19 09:17:17.557731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5264/6589] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:17 2022] DELETE /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:17.565520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.566717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] [instance: 3e4ef2de-5e3f-43c4-aa52-477b9041a04c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:17.578303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.579133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.580744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:17.581417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:17.610721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] HTTP exception thrown: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Request method failure captured: May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c HTTP/1.1 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgmfbEAiq1wTSQFA5lHJAiC_RRlzKbcKbUPsuYisog2V_PJAJbWv-kCY0-o5nuorwazxtKjwhlCycCQAUim0j0arvf_uRilQveiGZUvwyKcPx4mQ2RMe69IkgndJFnWAyN7b54kBuT3AdSLoMTJUaNjYs_NWOu-uHd0FL7-lWlIATtY May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a61cab651928440da8da84301651f654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a61cab651928440da8da84301651f654"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a61cab651928440da8da84301651f654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: a61cab651928440da8da84301651f654 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServerActionsTestJSON-606894518 May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 7222636279ae4933b111a20da96b2ffa May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServerActionsTestJSON-606894518-project May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '3e4ef2de-5e3f-43c4-aa52-477b9041a04c'} May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:17.613962 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Returning 404 to user: Instance 3e4ef2de-5e3f-43c4-aa52-477b9041a04c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d33a130-e91b-4529-b936-c0b9f44b5f46 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c" status: 404 len: 111 microversion: 2.1 time: 0.059333 May 19 09:17:17.627711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5265/6590] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:17 2022] GET /compute/v2.1/servers/3e4ef2de-5e3f-43c4-aa52-477b9041a04c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:17:17.631376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-902aae94-db25-4ef6-8426-47ab95d9fdc1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] Calling method '.version_select at 0x7f3211ad2310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:17.677591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-902aae94-db25-4ef6-8426-47ab95d9fdc1 tempest-ServerActionsTestJSON-606894518 tempest-ServerActionsTestJSON-606894518-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831610942" status: 202 len: 0 microversion: 2.1 time: 0.053194 May 19 09:17:17.678670 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5266/6591] 10.222.0.78 () {58 vars in 1220 bytes} [Thu May 19 09:17:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831610942 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:17:26.202868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1867343083", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "2354bdab-7fb7-4b39-8c9a-be6eaf91e343"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:26.270210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] validate_networks() for [('2354bdab-7fb7-4b39-8c9a-be6eaf91e343', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:17:27.087675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:17:27.088548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:17:27.089966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:17:27.091319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:17:27.092022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:17:27.109657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:27.110166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:27.111126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:27.111621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:27.131380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Getting quotas for project 98e8cadd9dc54219b1e96fbb2705af37. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:17:27.137943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Getting quotas for user 0dcaea62973d4ca88b89beaf7753a213 and project 98e8cadd9dc54219b1e96fbb2705af37. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:17:27.153379 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:17:27.155751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:17:27.226027 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7026b3a6-be74-41e8-a7d7-2cd33825bab1 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176311 May 19 09:17:27.227196 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5267/6592] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:17:27.245043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fb109d56-05c4-41d4-be14-6ec0dbb5357a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:27.246312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fb109d56-05c4-41d4-be14-6ec0dbb5357a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:27.316854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fb109d56-05c4-41d4-be14-6ec0dbb5357a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:27.328131 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fb109d56-05c4-41d4-be14-6ec0dbb5357a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1217 microversion: 2.1 time: 0.089940 May 19 09:17:27.329141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5268/6593] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:27 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:28.347261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:28.348175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:28.358530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:28.359008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:28.359840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:28.360297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:28.447745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:28.456790 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dba3518e-4dda-48e1-b9f1-7193c689ae71 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1269 microversion: 2.1 time: 0.113677 May 19 09:17:28.457649 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5269/6594] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:28 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:29.479736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:29.481447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:29.500085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:29.500997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:29.501841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:29.502304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:29.699723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:29.711276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba0e6cef-4915-4356-8822-bf701f0a05b3 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1317 microversion: 2.1 time: 0.235271 May 19 09:17:29.712443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5270/6595] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:29 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:30.240483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c2b3c52f-d57c-4b77-b2e4-94ea08b9683e req-f7e1b451-6be5-4f4d-a4d6-b2ad10aa667c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6219cf5-740d-4351-a6b8-3a552a5b926e", "tag": "9482fc5a-afa2-4411-80b8-01b2b3fe87d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:30.255422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c2b3c52f-d57c-4b77-b2e4-94ea08b9683e req-f7e1b451-6be5-4f4d-a4d6-b2ad10aa667c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:30.255986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c2b3c52f-d57c-4b77-b2e4-94ea08b9683e req-f7e1b451-6be5-4f4d-a4d6-b2ad10aa667c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:30.272820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c2b3c52f-d57c-4b77-b2e4-94ea08b9683e req-f7e1b451-6be5-4f4d-a4d6-b2ad10aa667c service nova] Creating event network-changed:9482fc5a-afa2-4411-80b8-01b2b3fe87d3 for instance f6219cf5-740d-4351-a6b8-3a552a5b926e on chh2-842464-2 May 19 09:17:30.280864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c2b3c52f-d57c-4b77-b2e4-94ea08b9683e req-f7e1b451-6be5-4f4d-a4d6-b2ad10aa667c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046869 May 19 09:17:30.281544 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5271/6596] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:17:30.737977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:30.738906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:30.745517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:30.746298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:30.747058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:30.747518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:30.904886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:30.912985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2d1f4915-07a1-4c83-9bb7-039672d6b144 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1317 microversion: 2.1 time: 0.180409 May 19 09:17:30.913685 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5272/6597] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:30 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:31.937630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:31.939054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:31.950823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:31.951401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:31.952657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:31.953369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:32.138261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:32.150971 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72b93eac-a8d0-4c37-bba6-42e50184b525 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1317 microversion: 2.1 time: 0.223846 May 19 09:17:32.151561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5273/6598] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:31 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:33.176788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:33.178052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:33.180708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:33.188258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:33.188716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:33.189540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:33.189989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:33.332060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:33.340998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-15ca78dd-b26a-4fd6-8179-898d9141bc8e tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1317 microversion: 2.1 time: 0.168215 May 19 09:17:33.341791 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5274/6599] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:33 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:34.359013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:34.359783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:34.368438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:34.369143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:34.370225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:34.370798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:34.571697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:34.585979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-267b089b-a69e-46d2-af5a-103aaf89bad6 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1317 microversion: 2.1 time: 0.231085 May 19 09:17:34.587257 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5275/6600] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:34 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:34.597491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-34939a7c-26b1-4714-8a2b-842e0a0f2049 req-516eaf9a-3a0a-483e-a91d-930219b5e996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6219cf5-740d-4351-a6b8-3a552a5b926e", "name": "network-vif-plugged", "status": "completed", "tag": "9482fc5a-afa2-4411-80b8-01b2b3fe87d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:34.607501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-34939a7c-26b1-4714-8a2b-842e0a0f2049 req-516eaf9a-3a0a-483e-a91d-930219b5e996 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:34.607969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-34939a7c-26b1-4714-8a2b-842e0a0f2049 req-516eaf9a-3a0a-483e-a91d-930219b5e996 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:34.623361 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-34939a7c-26b1-4714-8a2b-842e0a0f2049 req-516eaf9a-3a0a-483e-a91d-930219b5e996 service nova] Creating event network-vif-plugged:9482fc5a-afa2-4411-80b8-01b2b3fe87d3 for instance f6219cf5-740d-4351-a6b8-3a552a5b926e on chh2-842464-2 May 19 09:17:34.632026 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-34939a7c-26b1-4714-8a2b-842e0a0f2049 req-516eaf9a-3a0a-483e-a91d-930219b5e996 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043153 May 19 09:17:34.632688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5276/6601] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:17:35.608841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:35.609590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:35.616155 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:35.616629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:35.617461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:35.617922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:35.778514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:35.789249 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d09d4f4-98df-43c5-93fc-109309b98075 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1317 microversion: 2.1 time: 0.185612 May 19 09:17:35.790101 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5277/6602] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:35 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:36.811683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:36.812389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:36.820090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:36.820569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:36.821509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:36.821971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:36.991791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:37.000764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8cec0aa9-e5ed-4b56-9c1a-16a517ccda41 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.193886 May 19 09:17:37.001449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5278/6603] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:36 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:37.069612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-878806821", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "2354bdab-7fb7-4b39-8c9a-be6eaf91e343"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:37.119340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:37.138377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] validate_networks() for [('2354bdab-7fb7-4b39-8c9a-be6eaf91e343', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:17:37.325663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:37.578765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:17:37.579231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:17:37.579755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:17:37.580333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:17:37.580775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:17:37.590172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:37.590637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:37.591559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:37.591985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:37.617069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Getting quotas for project 98e8cadd9dc54219b1e96fbb2705af37. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:17:37.623632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Getting quotas for user 0dcaea62973d4ca88b89beaf7753a213 and project 98e8cadd9dc54219b1e96fbb2705af37. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:17:37.637911 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:17:37.640334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:17:37.703536 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f8053bd-4f92-4057-aadb-896e395eb270 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637791 May 19 09:17:37.704500 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5279/6604] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:17:37.716678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d4556d43-9392-4c9f-922d-b3cd6eaaa63c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:37.717437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d4556d43-9392-4c9f-922d-b3cd6eaaa63c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:37.788972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d4556d43-9392-4c9f-922d-b3cd6eaaa63c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:37.799527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d4556d43-9392-4c9f-922d-b3cd6eaaa63c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1216 microversion: 2.1 time: 0.088011 May 19 09:17:37.800455 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5280/6605] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:37 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:38.821849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:38.822718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:38.834321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:38.835062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:38.835998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:38.836440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:38.944382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:38.953875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba77fbdb-2075-4c0c-a9ff-eb6182f863da tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1286 microversion: 2.1 time: 0.139443 May 19 09:17:38.954486 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5281/6606] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:38 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:39.978538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:39.979847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:39.989638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:39.990108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:39.990928 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:39.991384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:40.247781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:40.256034 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d945a8d-09cb-4ec0-a623-8f23d71f33b9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.286841 May 19 09:17:40.256717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5282/6607] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:39 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:40.778191 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fc58dd40-6c4b-4a20-90a8-ea01dec4593d req-6fa7ab34-4af7-4abc-ada6-da0ba9ff19a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a50668d-2b58-45f0-a4c8-9445a794e61f", "tag": "59a021ac-a8bd-4cd3-8497-ddba85b9cac4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:40.791681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fc58dd40-6c4b-4a20-90a8-ea01dec4593d req-6fa7ab34-4af7-4abc-ada6-da0ba9ff19a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:40.794176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fc58dd40-6c4b-4a20-90a8-ea01dec4593d req-6fa7ab34-4af7-4abc-ada6-da0ba9ff19a8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:40.817157 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fc58dd40-6c4b-4a20-90a8-ea01dec4593d req-6fa7ab34-4af7-4abc-ada6-da0ba9ff19a8 service nova] Creating event network-changed:59a021ac-a8bd-4cd3-8497-ddba85b9cac4 for instance 4a50668d-2b58-45f0-a4c8-9445a794e61f on chh1-842464-2 May 19 09:17:40.822921 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fc58dd40-6c4b-4a20-90a8-ea01dec4593d req-6fa7ab34-4af7-4abc-ada6-da0ba9ff19a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058740 May 19 09:17:40.824384 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5283/6608] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:17:41.276508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:41.278960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:41.286823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:41.287293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:41.288116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:41.288719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:41.477966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:41.486457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4683a3a-caeb-49b8-9eed-dc4f9b0d7c77 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.214207 May 19 09:17:41.487056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5284/6609] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:41 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:42.504696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:42.505406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:42.514502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:42.514971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:42.515789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:42.516294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:42.775658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:42.787866 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9d65da4-edc2-4c97-ac90-027e1b18513a tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.287220 May 19 09:17:42.789559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5285/6610] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:42 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:43.807098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:43.808546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:43.816742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:43.817199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:43.818039 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:43.818498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:43.838323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:43.987901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:43.997176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e8b1f036-2718-4b74-84bd-bed408bc629b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.193302 May 19 09:17:43.997814 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5286/6611] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:43 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:45.019157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:45.020386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:45.032745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:45.033208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:45.034050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:45.034501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:45.205550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:45.215273 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c369c0d-2b63-4b15-b2c4-1a5a36c3ffe5 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.202957 May 19 09:17:45.225003 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5287/6612] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:45 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:46.232917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:46.233697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:46.240841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:46.241343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:46.242136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:46.242592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:46.392413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:46.403036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5074bb05-1f91-4f7f-8a2c-8be97e154ab8 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.174872 May 19 09:17:46.403883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5288/6613] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:46 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:46.898103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e9e85181-07f9-4270-92c7-05eae5f0cbc8 req-88fa806e-7f6f-49fa-bdd8-5b8f1d354142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a50668d-2b58-45f0-a4c8-9445a794e61f", "name": "network-vif-plugged", "status": "completed", "tag": "59a021ac-a8bd-4cd3-8497-ddba85b9cac4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:46.908325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e9e85181-07f9-4270-92c7-05eae5f0cbc8 req-88fa806e-7f6f-49fa-bdd8-5b8f1d354142 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:46.908871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e9e85181-07f9-4270-92c7-05eae5f0cbc8 req-88fa806e-7f6f-49fa-bdd8-5b8f1d354142 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:46.923132 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e9e85181-07f9-4270-92c7-05eae5f0cbc8 req-88fa806e-7f6f-49fa-bdd8-5b8f1d354142 service nova] Creating event network-vif-plugged:59a021ac-a8bd-4cd3-8497-ddba85b9cac4 for instance 4a50668d-2b58-45f0-a4c8-9445a794e61f on chh1-842464-2 May 19 09:17:46.928457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e9e85181-07f9-4270-92c7-05eae5f0cbc8 req-88fa806e-7f6f-49fa-bdd8-5b8f1d354142 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034262 May 19 09:17:46.929376 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5289/6614] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:17:47.421411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:47.422210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:47.429845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:47.430303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:47.431096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:47.431543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:47.584541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:47.593474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f73b595d-639f-497d-8bc2-9b41822be4cc tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1316 microversion: 2.1 time: 0.176785 May 19 09:17:47.594087 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5290/6615] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:47 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:48.611500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:48.612219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:48.614124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:48.614851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:48.622320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:48.622778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:48.623564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:48.624021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:48.770065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:48.778714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4d065cf-50a6-45e4-8d31-be73c5d5d622 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1506 microversion: 2.1 time: 0.171337 May 19 09:17:48.779301 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5291/6616] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:48 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:48.795213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:48.795737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:48.802383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:48.802853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:48.803657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:48.804110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:48.836287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:17:48.924764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07be379b-21da-481e-8904-23a7fd992dca tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 204 len: 0 microversion: 2.1 time: 0.132779 May 19 09:17:48.925237 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5292/6617] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:48 2022] DELETE /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:17:48.935282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:48.936010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:48.942200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:48.942662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:48.943451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:48.943904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:49.106523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:49.114446 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9de5c91e-1710-4b43-a4e2-817c9af8d147 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1512 microversion: 2.1 time: 0.184491 May 19 09:17:49.115034 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5293/6618] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:48 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:50.132514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:50.133279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:50.141683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:50.142172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:50.143033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:50.143601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:50.407029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:50.415115 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76a80183-c127-40ad-b2b3-71398eb06ad4 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 200 len: 1512 microversion: 2.1 time: 0.286733 May 19 09:17:50.415961 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5294/6619] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:50 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:50.782037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-635b0666-2b9d-4388-84fa-b8a7ce2c4b25 req-afa5c1ad-3aa5-4cc6-96ee-79c3de6ebafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a50668d-2b58-45f0-a4c8-9445a794e61f", "name": "network-vif-deleted", "tag": "59a021ac-a8bd-4cd3-8497-ddba85b9cac4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:50.800563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-635b0666-2b9d-4388-84fa-b8a7ce2c4b25 req-afa5c1ad-3aa5-4cc6-96ee-79c3de6ebafd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:50.800943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-635b0666-2b9d-4388-84fa-b8a7ce2c4b25 req-afa5c1ad-3aa5-4cc6-96ee-79c3de6ebafd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:50.816028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-635b0666-2b9d-4388-84fa-b8a7ce2c4b25 req-afa5c1ad-3aa5-4cc6-96ee-79c3de6ebafd service nova] Creating event network-vif-deleted:59a021ac-a8bd-4cd3-8497-ddba85b9cac4 for instance 4a50668d-2b58-45f0-a4c8-9445a794e61f on chh1-842464-2 May 19 09:17:50.821445 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-635b0666-2b9d-4388-84fa-b8a7ce2c4b25 req-afa5c1ad-3aa5-4cc6-96ee-79c3de6ebafd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043162 May 19 09:17:50.821982 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5295/6620] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:17:51.438660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:51.439415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:51.446112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.446689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.447695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.448298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.465445 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] HTTP exception thrown: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f HTTP/1.1 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4a50668d-2b58-45f0-a4c8-9445a794e61f'} May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:51.467210 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 404 to user: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54d06ca0-a299-44ba-93ab-c0183d8c679d tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 404 len: 111 microversion: 2.1 time: 0.039660 May 19 09:17:51.474122 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5296/6621] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:51 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:51.479325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:51.480524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:51.487315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.487888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.488988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.489650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.671090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:51.681778 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8602f00f-be0d-49aa-84f1-460a1e2f2f3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.206126 May 19 09:17:51.682671 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5297/6622] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:51 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:51.701130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59744495-32d1-47ed-b14f-5cac84748f24 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:51.702310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-59744495-32d1-47ed-b14f-5cac84748f24 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: e8df7d2e-c288-42e7-b282-08ebb29d5f73] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:51.708238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-59744495-32d1-47ed-b14f-5cac84748f24 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] HTTP exception thrown: Instance e8df7d2e-c288-42e7-b282-08ebb29d5f73 could not be found. May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59744495-32d1-47ed-b14f-5cac84748f24 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/e8df7d2e-c288-42e7-b282-08ebb29d5f73/action HTTP/1.1 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 32 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: {"resize": {"flavorRef": "452"}} May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e8df7d2e-c288-42e7-b282-08ebb29d5f73 could not be found. May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e8df7d2e-c288-42e7-b282-08ebb29d5f73', 'body': {'resize': {'flavorRef': '452'}}} May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8df7d2e-c288-42e7-b282-08ebb29d5f73 could not be found. May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:51.709975 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8df7d2e-c288-42e7-b282-08ebb29d5f73 could not be found. May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8df7d2e-c288-42e7-b282-08ebb29d5f73 could not be found. May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59744495-32d1-47ed-b14f-5cac84748f24 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 404 to user: Instance e8df7d2e-c288-42e7-b282-08ebb29d5f73 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59744495-32d1-47ed-b14f-5cac84748f24 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "POST /compute/v2.1/servers/e8df7d2e-c288-42e7-b282-08ebb29d5f73/action" status: 404 len: 111 microversion: 2.1 time: 0.015747 May 19 09:17:51.718746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5298/6623] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:17:51 2022] POST /compute/v2.1/servers/e8df7d2e-c288-42e7-b282-08ebb29d5f73/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:51.722418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:51.723067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:51.731358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.731768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.732616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.733079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.885492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:51.895035 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0cd0a64-2865-4783-93a1-25bf30ed4217 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.177067 May 19 09:17:51.895631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5299/6624] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:51 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:51.914280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:51.914909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:51.921489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.921955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:51.922745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:51.923194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.083813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:52.092954 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f04543a-7e50-45c8-ae63-a6382e238914 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.183734 May 19 09:17:52.093584 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5300/6625] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:51 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:52.117633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "fba26445-c87b-4077-b1ee-47525a7971c5"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:52.118582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.127144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.127614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.128433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.128888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.169345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:52.175394 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] HTTP exception thrown: Flavor fba26445-c87b-4077-b1ee-47525a7971c5 could not be found. May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e/action HTTP/1.1 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 65 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: {"resize": {"flavorRef": "fba26445-c87b-4077-b1ee-47525a7971c5"}} May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: exception: Flavor fba26445-c87b-4077-b1ee-47525a7971c5 could not be found. May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f6219cf5-740d-4351-a6b8-3a552a5b926e', 'body': {'resize': {'flavorRef': 'fba26445-c87b-4077-b1ee-47525a7971c5'}}} May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 09:17:52.177228 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor fba26445-c87b-4077-b1ee-47525a7971c5 could not be found. May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor fba26445-c87b-4077-b1ee-47525a7971c5 could not be found. May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor fba26445-c87b-4077-b1ee-47525a7971c5 could not be found. May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 400 to user: Flavor fba26445-c87b-4077-b1ee-47525a7971c5 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba0bdf51-6fcb-465b-84b7-86aa620824a0 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "POST /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e/action" status: 400 len: 107 microversion: 2.1 time: 0.065366 May 19 09:17:52.183493 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5301/6626] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:17:52 2022] POST /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e/action => generated 107 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 09:17:52.187914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:52.188550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.194952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.195418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.196225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.196682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.369407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:52.383276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb78b5e2-0a8e-48a0-b586-76c8eba90f65 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.199008 May 19 09:17:52.383895 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5302/6627] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:52 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:52.405255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:52.405939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.413941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.414460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.415457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.415976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.570488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:52.580027 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d2b629a-1e45-4056-a394-763da1ed3271 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.180769 May 19 09:17:52.580652 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5303/6628] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:52 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:52.597069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a34ef2e1-34ad-4f9c-8a78-854a8aca1c3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a34ef2e1-34ad-4f9c-8a78-854a8aca1c3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: request: POST /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e/action HTTP/1.1 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 29 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: {"resize": {"flavorRef": ""}} May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f6219cf5-740d-4351-a6b8-3a552a5b926e', 'body': {'resize': {'flavorRef': ''}}} May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise error May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi On instance['resize']: May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi '' May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.599412 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a34ef2e1-34ad-4f9c-8a78-854a8aca1c3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a34ef2e1-34ad-4f9c-8a78-854a8aca1c3c tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "POST /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e/action" status: 400 len: 113 microversion: 2.1 time: 0.008276 May 19 09:17:52.606664 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5304/6629] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:17:52 2022] POST /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 09:17:52.611750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:52.615015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.621150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.622342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.623693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.624346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.784366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:52.788342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:52.795386 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44d6712a-a75b-405a-9d01-a147c548e9e9 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1506 microversion: 2.1 time: 0.187665 May 19 09:17:52.795954 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5305/6630] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:52 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:52.815488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:52.816129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.823566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.824036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.824843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.825296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.841956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] HTTP exception thrown: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f HTTP/1.1 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4a50668d-2b58-45f0-a4c8-9445a794e61f'} May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:52.843603 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 404 to user: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc8d19c9-2925-4982-8010-b3afdb08bc14 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 404 len: 111 microversion: 2.1 time: 0.033907 May 19 09:17:52.848979 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5306/6631] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:52 2022] DELETE /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:17:52.853903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:52.855123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: 4a50668d-2b58-45f0-a4c8-9445a794e61f] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.861447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.861922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.862719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.863178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.877752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] HTTP exception thrown: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f HTTP/1.1 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '4a50668d-2b58-45f0-a4c8-9445a794e61f'} May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:52.879244 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 404 to user: Instance 4a50668d-2b58-45f0-a4c8-9445a794e61f could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-03eb7dc7-b706-414e-9ef9-d21422e4cc87 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f" status: 404 len: 111 microversion: 2.1 time: 0.030897 May 19 09:17:52.888425 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5307/6632] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:52 2022] GET /compute/v2.1/servers/4a50668d-2b58-45f0-a4c8-9445a794e61f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:17:52.890344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:52.890882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:52.898703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.899176 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.900037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:52.900504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:52.931816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:17:53.020148 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07e029ab-c5d9-4313-862f-f5e06917a677 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 204 len: 0 microversion: 2.1 time: 0.134270 May 19 09:17:53.020909 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5308/6633] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:17:52 2022] DELETE /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:17:53.029643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:53.030504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:53.036624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:53.037082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:53.037919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:53.038367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:53.186045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:53.194057 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8d15c1a-2a4f-49d6-860f-21320f85733b tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1512 microversion: 2.1 time: 0.168815 May 19 09:17:53.194660 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5309/6634] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:53 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:54.211901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:54.212605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:54.216356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:17:54.222066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:54.222569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:54.223368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:54.223823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:54.390638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:54.398542 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83ac73e9-0679-4794-8238-68964b5a8251 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1512 microversion: 2.1 time: 0.190619 May 19 09:17:54.399129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5310/6635] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:54 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:17:54.984241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6b6db81d-3938-4484-ac79-6a37ee49dc42 req-e59c6c7d-7874-4651-9160-2a74193ccd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6219cf5-740d-4351-a6b8-3a552a5b926e", "name": "network-vif-deleted", "tag": "9482fc5a-afa2-4411-80b8-01b2b3fe87d3"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:17:54.997437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6b6db81d-3938-4484-ac79-6a37ee49dc42 req-e59c6c7d-7874-4651-9160-2a74193ccd56 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:54.998014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6b6db81d-3938-4484-ac79-6a37ee49dc42 req-e59c6c7d-7874-4651-9160-2a74193ccd56 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:55.011841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6b6db81d-3938-4484-ac79-6a37ee49dc42 req-e59c6c7d-7874-4651-9160-2a74193ccd56 service nova] Creating event network-vif-deleted:9482fc5a-afa2-4411-80b8-01b2b3fe87d3 for instance f6219cf5-740d-4351-a6b8-3a552a5b926e on chh2-842464-2 May 19 09:17:55.017217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6b6db81d-3938-4484-ac79-6a37ee49dc42 req-e59c6c7d-7874-4651-9160-2a74193ccd56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040002 May 19 09:17:55.017875 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5311/6636] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:17:55.418607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:55.419810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:55.426630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:55.427199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:55.428021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:55.428478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:55.465595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:55.466069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:55.466549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lazy-loading 'fault' on Instance uuid f6219cf5-740d-4351-a6b8-3a552a5b926e {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:17:55.517226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dcaea62973d4ca88b89beaf7753a213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98e8cadd9dc54219b1e96fbb2705af37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:17:55.524481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b7243b81-f6cc-4d10-a17f-a838732b4ff7 tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 200 len: 1307 microversion: 2.1 time: 0.111684 May 19 09:17:55.525089 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5312/6637] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:55 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:17:56.543635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:17:56.544410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] [instance: f6219cf5-740d-4351-a6b8-3a552a5b926e] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:17:56.552373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:56.552943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:56.554022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:17:56.554485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:17:56.572153 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] HTTP exception thrown: Instance f6219cf5-740d-4351-a6b8-3a552a5b926e could not be found. May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Request method failure captured: May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e HTTP/1.1 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgslijaSAyV1wUVByIDXWqgVnTCY4yvFTtHiYT6nfaRHhtFLb4fWtPDQe9wtto-8SrBmdfV015bX5ajgl1Zxn0J6X9y68g-li1k5KkLVaVyQDjp9RHsZS6eArUuc6sGb4yoOgpL_kOU2iMYGShynzITUAfDntTF_oFd2c2FVirWTsEc May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98e8cadd9dc54219b1e96fbb2705af37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 98e8cadd9dc54219b1e96fbb2705af37 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-100846819 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 0dcaea62973d4ca88b89beaf7753a213 May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-ServersNegativeTestJSON-100846819-project May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f6219cf5-740d-4351-a6b8-3a552a5b926e could not be found. May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f6219cf5-740d-4351-a6b8-3a552a5b926e'} May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6219cf5-740d-4351-a6b8-3a552a5b926e could not be found. May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6219cf5-740d-4351-a6b8-3a552a5b926e could not be found. May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:17:56.575222 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6219cf5-740d-4351-a6b8-3a552a5b926e could not be found. May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] Returning 404 to user: Instance f6219cf5-740d-4351-a6b8-3a552a5b926e could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fc488ee7-7006-4d25-b8ad-5381a588f6ce tempest-ServersNegativeTestJSON-100846819 tempest-ServersNegativeTestJSON-100846819-project] 10.222.0.78 "GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e" status: 404 len: 111 microversion: 2.1 time: 0.038495 May 19 09:17:56.584356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5313/6638] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:17:56 2022] GET /compute/v2.1/servers/f6219cf5-740d-4351-a6b8-3a552a5b926e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:18:33.418542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=9 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:18:33.419323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:18:33.670567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87b4a78a-0a50-40b4-a657-c1d664ad67a2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Action: 'create', calling method: .version_select at 0x7f3217b7d790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-626126510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWD6kfkcL4NPlZMp4yCXWCK7AAF52KcANaaIF7iD2E+yscDvVOkM/KX3zXADowkYKmkG3zmq1W1a4IHAXN3sLl677VqsLnZuR1bXwjmUNRrRl0UV4XdmJ8E66dr4b3qWw=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:18:33.692713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-87b4a78a-0a50-40b4-a657-c1d664ad67a2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:18:33.699012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-87b4a78a-0a50-40b4-a657-c1d664ad67a2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for user 5e6adfdecd134216a1db087ca53ae51c and project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:18:33.733003 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87b4a78a-0a50-40b4-a657-c1d664ad67a2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.320667 May 19 09:18:33.733817 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5314/6639] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:18:33 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:18:33.788746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-735743866", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-626126510", "networks": [{"uuid": "1f6ee5df-68bb-4404-b42b-2eaec8e79870"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:18:34.001262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] validate_networks() for [('1f6ee5df-68bb-4404-b42b-2eaec8e79870', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:18:34.483011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:18:34.483700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:18:34.483993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:18:34.484382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:18:34.484790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:18:34.495181 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:34.495654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:34.496764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:34.497219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:34.521817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:18:34.529627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for user 5e6adfdecd134216a1db087ca53ae51c and project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:18:34.544951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:18:34.547237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:18:34.607228 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a2b003cc-1b3b-40b1-843a-dcaf0f38498c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823693 May 19 09:18:34.608176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5315/6640] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:18:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:18:34.620107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a066d6bf-c168-4deb-a116-fafad7a795b3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:34.620812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a066d6bf-c168-4deb-a116-fafad7a795b3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:34.683898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a066d6bf-c168-4deb-a116-fafad7a795b3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:34.691979 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a066d6bf-c168-4deb-a116-fafad7a795b3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1261 microversion: 2.1 time: 0.076942 May 19 09:18:34.692789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5316/6641] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:34 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:18:35.711261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:35.714244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:35.732576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:35.733221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:35.735085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:35.736288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:35.845988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:35.855596 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed57a292-52b8-491d-82f3-b349b0292377 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1321 microversion: 2.1 time: 0.149741 May 19 09:18:35.856475 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5317/6642] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:35 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:18:36.879398 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:36.880431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:36.898637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:36.899301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:36.900978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:36.902400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:37.351272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:37.362325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7474c8da-d87f-444c-936b-8c3bd2a1531d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1361 microversion: 2.1 time: 0.490654 May 19 09:18:37.379962 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5318/6643] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:36 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1361 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:18:37.912699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f62cbc92-2cef-4960-ba24-820ce2b10e72 req-8f875517-0e6a-4416-b5f4-adb9bf60833d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f422c2e4-d027-4ba6-a56f-e96396d8e1e1", "tag": "2cf2849a-4356-4556-8d13-f7726013eff5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:18:37.954828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f62cbc92-2cef-4960-ba24-820ce2b10e72 req-8f875517-0e6a-4416-b5f4-adb9bf60833d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:37.962390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f62cbc92-2cef-4960-ba24-820ce2b10e72 req-8f875517-0e6a-4416-b5f4-adb9bf60833d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:38.000982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f62cbc92-2cef-4960-ba24-820ce2b10e72 req-8f875517-0e6a-4416-b5f4-adb9bf60833d service nova] Creating event network-changed:2cf2849a-4356-4556-8d13-f7726013eff5 for instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 on chh1-842464-2 May 19 09:18:38.010395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f62cbc92-2cef-4960-ba24-820ce2b10e72 req-8f875517-0e6a-4416-b5f4-adb9bf60833d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100765 May 19 09:18:38.011567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5319/6644] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:18:38.381541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:38.382445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:38.391250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:38.391723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:38.392689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:38.393170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:38.583428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:38.606559 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ba1825e-2c98-466e-a16b-bbfe1131424f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1361 microversion: 2.1 time: 0.218391 May 19 09:18:38.606559 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5320/6645] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:38 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:18:39.613869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:39.614582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:39.622054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:39.622524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:39.623443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:39.623894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:39.852931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:39.861485 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f86b42a2-2828-42ed-8a0e-5ea729ec7e40 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1361 microversion: 2.1 time: 0.251612 May 19 09:18:39.862092 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5321/6646] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:39 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:18:40.879496 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:40.880164 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:40.888021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:40.888491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:40.889320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:40.889803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:41.045786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:41.054196 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f9dc740a-1b3e-4eb2-8bff-5f90d46fe14d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1361 microversion: 2.1 time: 0.179046 May 19 09:18:41.055011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5322/6647] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:40 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:18:42.075782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:42.077074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:42.085274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:42.085783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:42.086768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:42.087228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:42.251009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:42.260707 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41a756d9-85dc-41f0-b271-b01d1e80ff58 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1361 microversion: 2.1 time: 0.191144 May 19 09:18:42.265350 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5323/6648] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:42 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:18:43.146529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2f0aeae6-26d0-46c0-8880-52857d4921e2 req-94a0a71c-b265-46c1-b676-b9637b5b76c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f422c2e4-d027-4ba6-a56f-e96396d8e1e1", "name": "network-vif-plugged", "status": "completed", "tag": "2cf2849a-4356-4556-8d13-f7726013eff5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:18:43.158493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2f0aeae6-26d0-46c0-8880-52857d4921e2 req-94a0a71c-b265-46c1-b676-b9637b5b76c7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:43.158963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2f0aeae6-26d0-46c0-8880-52857d4921e2 req-94a0a71c-b265-46c1-b676-b9637b5b76c7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:43.172267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2f0aeae6-26d0-46c0-8880-52857d4921e2 req-94a0a71c-b265-46c1-b676-b9637b5b76c7 service nova] Creating event network-vif-plugged:2cf2849a-4356-4556-8d13-f7726013eff5 for instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 on chh1-842464-2 May 19 09:18:43.177422 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2f0aeae6-26d0-46c0-8880-52857d4921e2 req-94a0a71c-b265-46c1-b676-b9637b5b76c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034717 May 19 09:18:43.178406 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5324/6649] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:18:43.278526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:43.279252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:43.285984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:43.286462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:43.287274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:43.287738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:43.457434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:43.465170 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b31d15dd-163a-4872-a351-64196145fb2c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1361 microversion: 2.1 time: 0.191010 May 19 09:18:43.465789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5325/6650] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:43 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:18:44.483563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:44.484290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:44.491580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:44.492035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:44.492824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:44.493265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:44.510262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:18:44.646272 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:44.654844 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27aeacc9-5a3a-4fa0-b25d-6b23811f4a9b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1553 microversion: 2.1 time: 0.176133 May 19 09:18:44.655460 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5326/6651] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:44 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:18:44.671233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:18:44.671881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:44.682227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:44.682719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:44.683605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:44.684051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:44.688635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:18:44.823076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:18:44.831188 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d5a3a002-c8db-44f8-9cd9-0f0ddc7fd704 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1553 microversion: 2.1 time: 0.163774 May 19 09:18:44.831843 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5327/6652] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:18:44 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:18:47.643886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "607d63f3-b7d3-4ebe-ac42-dff8e507dde8"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:18:47.645086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:18:47.654533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:47.655001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:47.655785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:18:47.656326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:18:47.954402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d06259a9-6b8b-478a-9e67-e2e7118325f5 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "POST /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314617 May 19 09:18:47.955044 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5328/6653] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 09:18:47 2022] POST /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:05.056282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:05.057187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:05.062354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:05.063086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:05.071158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:05.071630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:05.072426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:05.072870 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:05.171608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lazy-loading 'services' on Instance uuid f422c2e4-d027-4ba6-a56f-e96396d8e1e1 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:19:05.250187 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2830af6e-ae64-4f88-afbd-6437d44efc1a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments/607d63f3-b7d3-4ebe-ac42-dff8e507dde8" status: 202 len: 0 microversion: 2.1 time: 0.195844 May 19 09:19:05.250724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5329/6654] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:19:05 2022] DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments/607d63f3-b7d3-4ebe-ac42-dff8e507dde8 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:19:05.260001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:05.261420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:05.268053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:05.268540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:05.269406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:05.269856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:05.303955 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d9a8b3c-2257-4131-9342-341f24bed543 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048590 May 19 09:19:05.304607 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5330/6655] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:05 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:06.315761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:06.317053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:06.324885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:06.325377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:06.326179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:06.326683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:06.364203 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1290c80-5f86-4156-bcce-947b503cbd8f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052694 May 19 09:19:06.368353 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5331/6656] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:06 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:07.375257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:07.377014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:07.384774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:07.385427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:07.386270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:07.386734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:07.424228 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fcd587fd-67d0-46a9-9630-121881c11022 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052940 May 19 09:19:07.425141 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5332/6657] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:07 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:08.436377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:08.437374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:08.444486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:08.444962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:08.445796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:08.446253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:08.491151 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f5a488aa-2cd3-41dd-9295-b0bba9d8bf16 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058877 May 19 09:19:08.491760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5333/6658] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:08 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:09.504552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:09.506053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:09.515084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:09.515717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:09.516712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:09.517170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:09.551151 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-76924aa3-0ed4-413b-8d4b-1d5c471467e6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050936 May 19 09:19:09.551760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5334/6659] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:09 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:19:10.566759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:10.567790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:10.580568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:10.582066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:10.582967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:10.583455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:10.617771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b63b77dc-bd4e-4406-a268-e93c16ed1e20 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057331 May 19 09:19:10.618398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5335/6660] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:10 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:11.631524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:11.632542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:11.641752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:11.642239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:11.643122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:11.643578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:11.681133 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b0676d3-3e96-45dd-8f12-e305e7f4e54c tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054027 May 19 09:19:11.682238 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5336/6661] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:11 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:12.693420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:12.694478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:12.702355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:12.702819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:12.703867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:12.704328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:12.740741 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-906c16de-9b47-49e0-9632-efc498ef8b8b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051368 May 19 09:19:12.741344 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5337/6662] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:12 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:13.754194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:13.755134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:13.762332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:13.762837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:13.763654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:13.764236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:13.798049 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-320d2cf4-e15e-4989-9b6b-9222bc198471 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048834 May 19 09:19:13.798660 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5338/6663] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:13 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:14.815054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:14.815054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:14.820871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:14.821481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:14.822336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:14.822844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:14.856402 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d53519e7-35c5-4619-9021-e214569c9efc tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048693 May 19 09:19:14.857351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5339/6664] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:14 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:15.868694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:15.869681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:15.877075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:15.877580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:15.878380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:15.878840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:15.919896 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d001a553-44d3-49ac-be60-e0d728450318 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055463 May 19 09:19:15.920503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5340/6665] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:15 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 09:19:15.932392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:15.932967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:15.939254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:15.939713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:15.940505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:15.940957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:16.024967 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] HTTP exception thrown: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 is not attached to volume 607d63f3-b7d3-4ebe-ac42-dff8e507dde8 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Request method failure captured: May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments/607d63f3-b7d3-4ebe-ac42-dff8e507dde8 HTTP/1.1 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgtilcksvcNUlX_nyK-2_yrYG9yfyq5ezoNxAh3cBoOTakc0LYA9VWRq35lIcoxIkudYCH4Y7lM0vFUF8yhu80a1EtxPHlK0AFhNtdYqtuGmtYmpS5a6orptF5F0-J9FZVclUSEs6fOe66xr9LuLhHlpUGtKufNbNBBtLR59c2Wi1Ec May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5e6adfdecd134216a1db087ca53ae51c May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 is not attached to volume 607d63f3-b7d3-4ebe-ac42-dff8e507dde8 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': 'f422c2e4-d027-4ba6-a56f-e96396d8e1e1', 'id': '607d63f3-b7d3-4ebe-ac42-dff8e507dde8'} May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 607d63f3-b7d3-4ebe-ac42-dff8e507dde8. May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 is not attached to volume 607d63f3-b7d3-4ebe-ac42-dff8e507dde8 May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:19:16.030291 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 is not attached to volume 607d63f3-b7d3-4ebe-ac42-dff8e507dde8 May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Returning 404 to user: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 is not attached to volume 607d63f3-b7d3-4ebe-ac42-dff8e507dde8 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c43060d-181d-4ec5-bffd-006cd6506bd1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments/607d63f3-b7d3-4ebe-ac42-dff8e507dde8" status: 404 len: 154 microversion: 2.1 time: 0.104969 May 19 09:19:16.035645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5341/6666] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:19:15 2022] DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1/os-volume_attachments/607d63f3-b7d3-4ebe-ac42-dff8e507dde8 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:19:22.577558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:22.578260 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:22.590621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:22.591009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:22.592037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:22.592485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:22.620794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:19:22.731290 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-858b4864-80c8-48c0-86ab-67670d1d20e7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 204 len: 0 microversion: 2.1 time: 0.157564 May 19 09:19:22.731827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5342/6667] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:19:22 2022] DELETE /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:19:22.741185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:22.741950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:22.750360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:22.750659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:22.751235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:22.751708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:22.756563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:22.913000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:22.923094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8562e397-2d56-4edf-868e-55516fd0f486 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1559 microversion: 2.1 time: 0.186400 May 19 09:19:22.923826 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5343/6668] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:22 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:23.944716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:23.945474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:23.953301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:23.953812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:23.954620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:23.955082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:24.099225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:24.108822 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e7a47df9-8cd5-43d7-880e-39576fa46232 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1559 microversion: 2.1 time: 0.168242 May 19 09:19:24.109852 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5344/6669] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:23 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:24.828778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d2c01281-ca87-488b-9e50-da34c95bc77d req-812ee5f4-66a6-45c5-b021-2831dabf2cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f422c2e4-d027-4ba6-a56f-e96396d8e1e1", "name": "network-vif-deleted", "tag": "2cf2849a-4356-4556-8d13-f7726013eff5"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:19:24.839576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d2c01281-ca87-488b-9e50-da34c95bc77d req-812ee5f4-66a6-45c5-b021-2831dabf2cd8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:24.840623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d2c01281-ca87-488b-9e50-da34c95bc77d req-812ee5f4-66a6-45c5-b021-2831dabf2cd8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:24.854492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d2c01281-ca87-488b-9e50-da34c95bc77d req-812ee5f4-66a6-45c5-b021-2831dabf2cd8 service nova] Creating event network-vif-deleted:2cf2849a-4356-4556-8d13-f7726013eff5 for instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 on chh1-842464-2 May 19 09:19:24.860225 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d2c01281-ca87-488b-9e50-da34c95bc77d req-812ee5f4-66a6-45c5-b021-2831dabf2cd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108345 May 19 09:19:24.860820 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5345/6670] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:25.127761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:25.129062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:25.138802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:25.140014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:25.140898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:25.141389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:25.184204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:25.185075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:25.185768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lazy-loading 'fault' on Instance uuid f422c2e4-d027-4ba6-a56f-e96396d8e1e1 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:19:25.236394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:25.246043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b0d096e6-3501-461d-bc55-5e7e900c8cd7 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 200 len: 1351 microversion: 2.1 time: 0.122500 May 19 09:19:25.246673 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5346/6671] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:25 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:26.264303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:26.265027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: f422c2e4-d027-4ba6-a56f-e96396d8e1e1] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:26.272321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:26.272792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:26.273628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:26.274090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:26.290175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] HTTP exception thrown: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 could not be found. May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Request method failure captured: May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 HTTP/1.1 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgtilcksvcNUlX_nyK-2_yrYG9yfyq5ezoNxAh3cBoOTakc0LYA9VWRq35lIcoxIkudYCH4Y7lM0vFUF8yhu80a1EtxPHlK0AFhNtdYqtuGmtYmpS5a6orptF5F0-J9FZVclUSEs6fOe66xr9LuLhHlpUGtKufNbNBBtLR59c2Wi1Ec May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5e6adfdecd134216a1db087ca53ae51c May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 could not be found. May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f422c2e4-d027-4ba6-a56f-e96396d8e1e1'} May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 could not be found. May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 could not be found. May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:19:26.291890 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 could not be found. May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Returning 404 to user: Instance f422c2e4-d027-4ba6-a56f-e96396d8e1e1 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce94ed33-d4d8-45e6-a3e1-0de72afa3422 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1" status: 404 len: 111 microversion: 2.1 time: 0.033062 May 19 09:19:26.297511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5347/6672] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:26 2022] GET /compute/v2.1/servers/f422c2e4-d027-4ba6-a56f-e96396d8e1e1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:19:26.302722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-faa59665-3e3e-4815-bf4f-21c5a09f790f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '.version_select at 0x7f3217ad2c10>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:26.323772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-faa59665-3e3e-4815-bf4f-21c5a09f790f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-626126510" status: 202 len: 0 microversion: 2.1 time: 0.025430 May 19 09:19:26.324498 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5348/6673] 10.222.0.78 () {58 vars in 1274 bytes} [Thu May 19 09:19:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-626126510 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:19:26.347575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2409dceb-7cf4-4780-94b1-d2455dfb3ed2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Action: 'create', calling method: .version_select at 0x7f3211df70d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1876579461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy8i4S6ps78QYvYZR7JQCdypWNhWv5xDYCSYk2rQqxsGOwstnjgsBrCVy0BTEcvcflEfoxuQ/VFxRUMbomK1j4CyXwJxjqfirgX9R1Y0sKQ1xfUGOn185H/r3nmGVY3Bg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:19:26.363943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2409dceb-7cf4-4780-94b1-d2455dfb3ed2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:19:26.370097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-2409dceb-7cf4-4780-94b1-d2455dfb3ed2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for user 5e6adfdecd134216a1db087ca53ae51c and project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:19:26.398833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2409dceb-7cf4-4780-94b1-d2455dfb3ed2 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055293 May 19 09:19:26.400133 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5349/6674] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:19:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:26.455415 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1596204622", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1876579461", "networks": [{"uuid": "1f6ee5df-68bb-4404-b42b-2eaec8e79870"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:19:26.516980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] validate_networks() for [('1f6ee5df-68bb-4404-b42b-2eaec8e79870', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:19:27.031038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:19:27.031501 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:19:27.032101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:19:27.032536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:19:27.033065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:19:27.043163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:27.043541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:27.044364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:27.044818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:27.068617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:19:27.075567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Getting quotas for user 5e6adfdecd134216a1db087ca53ae51c and project 63ab34a070fd4fb8b902dbf21a2d6be6. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:19:27.088722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:19:27.091121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:19:27.145319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-316d9c0c-bdff-4452-8b93-431b552797f9 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693957 May 19 09:19:27.148394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5350/6675] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:19:27.159728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0bcfd64-8ddf-4bf5-84cc-6a843695d308 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:27.160474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0bcfd64-8ddf-4bf5-84cc-6a843695d308 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:27.222611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d0bcfd64-8ddf-4bf5-84cc-6a843695d308 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:27.235693 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0bcfd64-8ddf-4bf5-84cc-6a843695d308 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1263 microversion: 2.1 time: 0.081621 May 19 09:19:27.237132 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5351/6676] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:27 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:28.258243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:28.259195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:28.270372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:28.270851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:28.271783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:28.272243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:28.363430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:28.386376 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44d3b14d-77d7-4d68-8e87-e496da8f2423 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1323 microversion: 2.1 time: 0.135317 May 19 09:19:28.387280 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5352/6677] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:28 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1323 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:29.418647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:29.419995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:29.430395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:29.431735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:29.432662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:29.433533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:29.970313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:29.980809 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dbf574d5-a3f4-49c3-b413-6d442fa9ae7b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.579149 May 19 09:19:29.981855 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5353/6678] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:29 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:30.428686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-69dbd9cf-4665-443d-a76d-e740b2ff18be req-a7583812-57ba-4c6b-afad-5b3070a95b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077f5e5b-dad2-4719-a6e9-de0c91463f0c", "tag": "8cf5ff70-879f-4d3a-ac4a-83e2666c94e4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:19:30.444483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-69dbd9cf-4665-443d-a76d-e740b2ff18be req-a7583812-57ba-4c6b-afad-5b3070a95b31 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:30.445097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-69dbd9cf-4665-443d-a76d-e740b2ff18be req-a7583812-57ba-4c6b-afad-5b3070a95b31 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:30.459507 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-69dbd9cf-4665-443d-a76d-e740b2ff18be req-a7583812-57ba-4c6b-afad-5b3070a95b31 service nova] Creating event network-changed:8cf5ff70-879f-4d3a-ac4a-83e2666c94e4 for instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c on chh2-842464-2 May 19 09:19:30.466349 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-69dbd9cf-4665-443d-a76d-e740b2ff18be req-a7583812-57ba-4c6b-afad-5b3070a95b31 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151055 May 19 09:19:30.467451 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5354/6679] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:31.003088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:31.003756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:31.011304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:31.011776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:31.012584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:31.013075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:31.161907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:31.171169 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34f19d86-17f7-4d63-b4d5-6a8414e7ffed tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.173305 May 19 09:19:31.171973 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5355/6680] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:30 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:32.190896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:32.191609 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:32.198795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:32.199259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:32.200062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:32.200518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:32.360513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:32.369454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-72ea6ffc-6627-4255-bd07-f0bf1d8d5420 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.183234 May 19 09:19:32.370059 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5356/6681] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:32 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:33.387209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:33.387876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:33.395134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:33.395602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:33.396393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:33.396848 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:33.551132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:33.559041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96331c09-cffa-4cef-9fa0-49adb1c9ac1d tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.176266 May 19 09:19:33.559628 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5357/6682] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:33 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:34.575706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:34.576565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:34.585073 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:34.585635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:34.586409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:34.587108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:34.744220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:34.752319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1932067-38cc-46d4-8b2b-938d53589bda tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.180910 May 19 09:19:34.752950 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5358/6683] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:34 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:35.769662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:35.770432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:35.773578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:35.784267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:35.784972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:35.786229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:35.786922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:35.943349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:35.953587 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b06e97dd-11de-4cad-96fd-742fd80e6b33 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.187802 May 19 09:19:35.954196 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5359/6684] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:35 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:36.973547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:36.973547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:36.980170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:36.980642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:36.981527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:36.981998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:37.056971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:37.147028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:37.155212 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-54a7fbf9-6211-4d78-a368-fa2c9f4b1994 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.187960 May 19 09:19:37.155934 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5360/6685] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:36 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:19:37.221005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-2b10d985-729d-4ff3-8119-2409e748973d req-212e8bd7-1dc8-4870-be7a-da6de4895d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077f5e5b-dad2-4719-a6e9-de0c91463f0c", "name": "network-vif-plugged", "status": "completed", "tag": "8cf5ff70-879f-4d3a-ac4a-83e2666c94e4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:19:37.229729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2b10d985-729d-4ff3-8119-2409e748973d req-212e8bd7-1dc8-4870-be7a-da6de4895d64 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:37.230199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-2b10d985-729d-4ff3-8119-2409e748973d req-212e8bd7-1dc8-4870-be7a-da6de4895d64 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:37.239772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:37.250598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-2b10d985-729d-4ff3-8119-2409e748973d req-212e8bd7-1dc8-4870-be7a-da6de4895d64 service nova] Creating event network-vif-plugged:8cf5ff70-879f-4d3a-ac4a-83e2666c94e4 for instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c on chh2-842464-2 May 19 09:19:37.255845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-2b10d985-729d-4ff3-8119-2409e748973d req-212e8bd7-1dc8-4870-be7a-da6de4895d64 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098816 May 19 09:19:37.256477 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5361/6686] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:19:38.174290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:38.175097 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:38.182669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:38.183128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:38.183915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:38.184366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:38.345771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:38.354476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b141606-8e3e-4b17-b972-a1912cbfeb97 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1363 microversion: 2.1 time: 0.185618 May 19 09:19:38.357479 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5362/6687] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:38 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:39.376562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:39.377263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:39.385199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:39.385779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:39.386615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:39.387070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:39.527063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:39.535175 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-56c8e0bd-5dda-4fae-a2a6-d17469498590 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1554 microversion: 2.1 time: 0.163063 May 19 09:19:39.535738 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5363/6688] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:39 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:39.551804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:39.552435 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:39.559705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:39.560163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:39.560959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:39.561440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:39.711020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:19:39.719800 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4cd247e5-7a94-46d6-8201-2bbb16fda32a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1554 microversion: 2.1 time: 0.171756 May 19 09:19:39.720401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5364/6689] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:19:39 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:19:42.283481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:19:42.284782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:42.292360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:42.292907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:42.293806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:42.294329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:42.372585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:42.574734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c41eaeca-42f9-47d0-8fc8-7b6ae3d14ac8 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "POST /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295471 May 19 09:19:42.575552 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5365/6690] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 09:19:42 2022] POST /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:19:59.687166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:59.688105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:19:59.692240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:59.692842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:59.701476 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:59.701938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:59.702747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:59.703193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:59.790985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lazy-loading 'services' on Instance uuid 077f5e5b-dad2-4719-a6e9-de0c91463f0c {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:19:59.868833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b6b94799-c589-4c04-a646-3794484b0be1 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments/9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb" status: 202 len: 0 microversion: 2.1 time: 0.182692 May 19 09:19:59.869630 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5366/6691] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:19:59 2022] DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments/9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:19:59.878955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:19:59.880055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:19:59.887553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:59.888022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:59.889647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:19:59.890316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:19:59.927312 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ff785cf6-98bc-48a8-954d-3381ec581632 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052694 May 19 09:19:59.928189 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5367/6692] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:19:59 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:00.939376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:00.940323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:00.948275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:00.948739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:00.949574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:00.950030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:00.985136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-536c33e7-6a57-4c31-a4b2-73c009dbdfff tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049872 May 19 09:20:00.985775 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5368/6693] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:00 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:01.997862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:01.998859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:02.006298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:02.006765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:02.007577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:02.008030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:02.055804 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c51e151d-ff19-42d2-8b1e-a49646c9f273 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063201 May 19 09:20:02.056490 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5369/6694] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:01 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:03.067998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:03.069108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:03.077075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:03.077568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:03.078373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:03.078827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:03.112007 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-34374f53-0792-4451-83bd-70daa0afb33f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048150 May 19 09:20:03.112594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5370/6695] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:03 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:04.124083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:04.125179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:04.134055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:04.134839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:04.135930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:04.136526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:04.174103 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b7292e7-4491-4f97-b40c-66c1cb7812cb tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054071 May 19 09:20:04.174750 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5371/6696] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:04 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:05.187461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:05.188404 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:05.195478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:05.196440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:05.197236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:05.197719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:05.229388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d75e303c-f12c-4a81-920a-61341822aa61 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045826 May 19 09:20:05.230012 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5372/6697] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:05 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:06.241813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:06.243218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:06.251941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:06.252437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:06.253252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:06.253724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:06.288701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-455716b5-d0a7-4e00-ab89-d49ee293cffa tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051476 May 19 09:20:06.289964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5373/6698] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:06 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:20:07.300625 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:07.301724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:07.311395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:07.312218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:07.313289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:07.313989 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:07.347965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b9b0aa7e-5e13-4e46-825b-b23ed5d44a50 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051433 May 19 09:20:07.348557 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5374/6699] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:07 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:07.381557 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:20:07.382157 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:20:08.360385 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:08.361357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:08.372613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:08.373179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:08.374406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:08.375236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:08.412066 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eff7c648-c836-4167-9104-6e828709b1e3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055887 May 19 09:20:08.412669 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5375/6700] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:08 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:09.424605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:09.425604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:09.432775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:09.433250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:09.434147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:09.434605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:09.468443 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7d8c3bd6-6c9a-41e3-9acc-b1b4aee0867b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048120 May 19 09:20:09.469045 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5376/6701] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:09 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:10.480339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:10.481514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:10.489360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:10.489837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:10.490653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:10.491109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:10.524853 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43d081bb-f1d4-4f00-9652-7958dd9879da tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049155 May 19 09:20:10.525503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5377/6702] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:20:10 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 09:20:10.535972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:10.536553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:10.548681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:10.549200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:10.550034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:10.550497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:10.637358 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] HTTP exception thrown: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c is not attached to volume 9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Request method failure captured: May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments/9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb HTTP/1.1 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgtilcksvcNUlX_nyK-2_yrYG9yfyq5ezoNxAh3cBoOTakc0LYA9VWRq35lIcoxIkudYCH4Y7lM0vFUF8yhu80a1EtxPHlK0AFhNtdYqtuGmtYmpS5a6orptF5F0-J9FZVclUSEs6fOe66xr9LuLhHlpUGtKufNbNBBtLR59c2Wi1Ec May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5e6adfdecd134216a1db087ca53ae51c May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c is not attached to volume 9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': '077f5e5b-dad2-4719-a6e9-de0c91463f0c', 'id': '9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb'} May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb. May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c is not attached to volume 9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:20:10.639011 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c is not attached to volume 9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Returning 404 to user: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c is not attached to volume 9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-43ff7ea9-b9ef-49dd-b8fa-fb176341187b tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments/9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb" status: 404 len: 154 microversion: 2.1 time: 0.109129 May 19 09:20:10.643876 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5378/6703] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:20:10 2022] DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c/os-volume_attachments/9ea4cc5c-6e44-4cf5-88cb-c3f5ba89edeb => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:20:17.192128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:17.192744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:17.210112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:17.210583 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:17.212319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:17.212780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:17.243760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:20:17.333280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bfe20149-2186-4ffe-a867-b9729294d3f3 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 204 len: 0 microversion: 2.1 time: 0.144710 May 19 09:20:17.333853 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5379/6704] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:20:17 2022] DELETE /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:20:17.343418 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:17.344138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:17.350901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:17.351421 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:17.352673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:17.353121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:17.359595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:20:17.506046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:17.515575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6efd29e0-5e2e-428e-8c24-0a447370b296 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1560 microversion: 2.1 time: 0.176315 May 19 09:20:17.516427 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5380/6705] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:17 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:18.532616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:18.533288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:18.541564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:18.542037 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:18.542844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:18.543306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:18.699956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:18.708757 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7603140-927e-4a6f-be20-1922ad92af1f tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1560 microversion: 2.1 time: 0.180184 May 19 09:20:18.709422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5381/6706] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:18 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:19.466056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-432d3541-8273-4205-b11f-50809f9979f0 req-65fb73c1-3405-4e13-b3f8-624c26073926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077f5e5b-dad2-4719-a6e9-de0c91463f0c", "name": "network-vif-deleted", "tag": "8cf5ff70-879f-4d3a-ac4a-83e2666c94e4"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:20:19.475440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-432d3541-8273-4205-b11f-50809f9979f0 req-65fb73c1-3405-4e13-b3f8-624c26073926 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:19.475814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-432d3541-8273-4205-b11f-50809f9979f0 req-65fb73c1-3405-4e13-b3f8-624c26073926 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:19.489799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-432d3541-8273-4205-b11f-50809f9979f0 req-65fb73c1-3405-4e13-b3f8-624c26073926 service nova] Creating event network-vif-deleted:8cf5ff70-879f-4d3a-ac4a-83e2666c94e4 for instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c on chh2-842464-2 May 19 09:20:19.496425 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-432d3541-8273-4205-b11f-50809f9979f0 req-65fb73c1-3405-4e13-b3f8-624c26073926 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 May 19 09:20:19.497502 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5382/6707] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:19.730334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:19.731075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:19.738265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:19.738723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:19.739606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:19.739993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:19.777203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:19.777694 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:19.778168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lazy-loading 'fault' on Instance uuid 077f5e5b-dad2-4719-a6e9-de0c91463f0c {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:20:19.834068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6adfdecd134216a1db087ca53ae51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ab34a070fd4fb8b902dbf21a2d6be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:19.844323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a1a247e-8afe-45b7-b211-6f3686591183 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 200 len: 1353 microversion: 2.1 time: 0.120755 May 19 09:20:19.845031 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5383/6708] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:19 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 1353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:20.862742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:20.863589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] [instance: 077f5e5b-dad2-4719-a6e9-de0c91463f0c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:20.871551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:20.872020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:20.872820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:20.873287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:20.887986 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] HTTP exception thrown: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c could not be found. May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Request method failure captured: May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c HTTP/1.1 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgtilcksvcNUlX_nyK-2_yrYG9yfyq5ezoNxAh3cBoOTakc0LYA9VWRq35lIcoxIkudYCH4Y7lM0vFUF8yhu80a1EtxPHlK0AFhNtdYqtuGmtYmpS5a6orptF5F0-J9FZVclUSEs6fOe66xr9LuLhHlpUGtKufNbNBBtLR59c2Wi1Ec May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63ab34a070fd4fb8b902dbf21a2d6be6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 63ab34a070fd4fb8b902dbf21a2d6be6 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-320808090 May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 5e6adfdecd134216a1db087ca53ae51c May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestEncryptedCinderVolumes-320808090-project May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c could not be found. May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '077f5e5b-dad2-4719-a6e9-de0c91463f0c'} May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c could not be found. May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c could not be found. May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:20:20.889715 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c could not be found. May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Returning 404 to user: Instance 077f5e5b-dad2-4719-a6e9-de0c91463f0c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d0b4ceaf-c2e5-47d9-addc-35ae5e23223a tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c" status: 404 len: 111 microversion: 2.1 time: 0.032428 May 19 09:20:20.895575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5384/6709] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:20 2022] GET /compute/v2.1/servers/077f5e5b-dad2-4719-a6e9-de0c91463f0c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:20:20.903820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4d5f6aeb-f1e4-4d82-a2df-2f1a50402aa6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] Calling method '.version_select at 0x7f3210f7a790>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:20.923852 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4d5f6aeb-f1e4-4d82-a2df-2f1a50402aa6 tempest-TestEncryptedCinderVolumes-320808090 tempest-TestEncryptedCinderVolumes-320808090-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1876579461" status: 202 len: 0 microversion: 2.1 time: 0.026533 May 19 09:20:20.924441 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5385/6710] 10.222.0.78 () {58 vars in 1277 bytes} [Thu May 19 09:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1876579461 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:20:26.318317 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:20:26.319191 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:20:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:20:51.768135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=22 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:20:51.769009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:20:51.773907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4004252-8b10-43ea-b8c3-2117e213f7a0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Action: 'create', calling method: .version_select at 0x7f321053b8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-284306928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaXHolbot0Es3575eGGYf1KNwkOBH+gKHVxaV1f/105Fxq1uQhm5u5At4XjpPLJ6hUfnyABhSZ0a6dcuDbfjsWAv2/f7tOHOf/7AOIB90IGMqG4L2aYLhEMoltcdl8qcQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:20:51.791984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c4004252-8b10-43ea-b8c3-2117e213f7a0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Getting quotas for project b03ca9310307426db12babf74b2f3aa5. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:20:51.797518 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c4004252-8b10-43ea-b8c3-2117e213f7a0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Getting quotas for user d56910e901fb4c0ca18fba5c90b82521 and project b03ca9310307426db12babf74b2f3aa5. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:20:51.825574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4004252-8b10-43ea-b8c3-2117e213f7a0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059543 May 19 09:20:51.826183 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5386/6711] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:20:51 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:20:51.883603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1778694333", "imageRef": "ae138ed4-2c8a-4a73-91b4-8ec0c1afd501", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-284306928", "networks": [{"uuid": "da97514d-6120-485a-b618-c4a6b87757ef"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:20:51.937220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] validate_networks() for [('da97514d-6120-485a-b618-c4a6b87757ef', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:20:52.371117 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:20:52.378109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:20:52.378109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:20:52.378109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:20:52.378109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:20:52.383438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:52.383910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:52.384742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:52.385205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:52.407592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Getting quotas for project b03ca9310307426db12babf74b2f3aa5. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:20:52.413060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Getting quotas for user d56910e901fb4c0ca18fba5c90b82521 and project b03ca9310307426db12babf74b2f3aa5. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:20:52.426276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:20:52.428512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae138ed4-2c8a-4a73-91b4-8ec0c1afd501',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:20:52.478895 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ce9e171-ec7b-4fa3-a965-07ae6d8ed5b9 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599887 May 19 09:20:52.479580 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5387/6712] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:20:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:20:52.490168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-220509bd-3fac-495e-89c1-69b6580e77f1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:52.490807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-220509bd-3fac-495e-89c1-69b6580e77f1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:52.548811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-220509bd-3fac-495e-89c1-69b6580e77f1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:52.556710 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-220509bd-3fac-495e-89c1-69b6580e77f1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1258 microversion: 2.1 time: 0.070421 May 19 09:20:52.557348 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5388/6713] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:52 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:53.575408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:53.576884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:53.586278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:53.586814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:53.587740 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:53.588210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:53.657758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:53.670491 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-791bca32-6ac6-4b3d-8164-2bbe01eadccf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1310 microversion: 2.1 time: 0.098904 May 19 09:20:53.671312 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5389/6714] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:53 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:54.691002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:54.692533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:54.701760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:54.702242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:54.703055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:54.703932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:54.930696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:54.941772 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a8e9623-a296-495d-a138-de07015ae365 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.255068 May 19 09:20:54.942390 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5390/6715] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:54 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:55.963080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:55.965508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:55.987894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:55.988922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:55.990440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:55.991820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:56.172267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:56.181751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cbefba79-2c89-47dd-ad1e-4fb85d6c71fd tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.225519 May 19 09:20:56.190177 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5391/6716] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:55 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:20:57.203417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:57.204118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:57.212825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:57.213286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:57.214206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:57.214753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:57.379742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:57.388862 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a157ba75-da29-4ae6-9003-7dc2bd725c8f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.189323 May 19 09:20:57.399671 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5392/6717] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:57 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:20:58.408218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:58.408927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:58.417177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:58.418023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:58.418825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:58.419273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:58.601295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:58.610342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d529996f-d22c-4f35-83d6-fb9db158cc27 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.206551 May 19 09:20:58.610947 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5393/6718] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:58 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:20:59.628216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:20:59.629069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:20:59.637332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:59.637838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:59.638648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:20:59.639099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:20:59.844343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:20:59.856613 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b04ef979-86e3-4fa3-a241-087e69ff9a7c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.232307 May 19 09:20:59.857829 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5394/6719] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:20:59 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:00.882880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:00.883688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:00.891340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:00.892050 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:00.892860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:00.893425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:01.063594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:01.074499 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5763ef16-f6e1-48ad-9b03-c512305066fa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.196262 May 19 09:21:01.075131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5395/6720] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:00 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:21:02.099160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:02.099895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:02.107918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:02.108377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:02.109163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:02.109638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:02.269570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:02.281213 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-89da668d-c371-43b5-80a2-ac2b79322501 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.185781 May 19 09:21:02.289362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5396/6721] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:02 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:02.485743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8f8ee319-e42c-445d-a4d6-485598a59a8a req-a9e216e0-ee82-4dff-8fd9-48185561b9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:02.514079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:21:02.516887 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8f8ee319-e42c-445d-a4d6-485598a59a8a req-a9e216e0-ee82-4dff-8fd9-48185561b9b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:02.517798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8f8ee319-e42c-445d-a4d6-485598a59a8a req-a9e216e0-ee82-4dff-8fd9-48185561b9b4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:02.532008 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8f8ee319-e42c-445d-a4d6-485598a59a8a req-a9e216e0-ee82-4dff-8fd9-48185561b9b4 service nova] Creating event network-changed:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:21:02.538681 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8f8ee319-e42c-445d-a4d6-485598a59a8a req-a9e216e0-ee82-4dff-8fd9-48185561b9b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058720 May 19 09:21:02.539323 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5397/6722] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:21:03.297437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:21:03.302883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:03.304411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:03.311519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:03.311971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:03.312762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:03.313219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:03.464358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:03.472129 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-963ea2c9-1e05-4d68-9d98-1ef300204caa tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.175753 May 19 09:21:03.472977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5398/6723] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:03 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:04.491365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:04.492210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:04.499817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:04.500280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:04.501092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:04.501577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:04.652001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:04.659816 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3baa2f9e-241d-49dc-965e-6a75fc40641b tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.172661 May 19 09:21:04.660529 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5399/6724] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:04 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:05.676972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:05.677804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:05.685764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:05.686232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:05.687038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:05.687493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:05.833270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:05.841142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c9b6f2e-1ef6-4bfb-8729-2aa8c51d65d3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.168362 May 19 09:21:05.841762 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5400/6725] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:05 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:06.857784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:06.858471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:06.866536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:06.867131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:06.867955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:06.868453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:07.015707 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:07.024194 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-565a21a6-b312-4210-b9b6-3a83ef78d636 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.170146 May 19 09:21:07.024859 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5401/6726] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:06 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:08.042081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:08.042743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:08.049712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:08.050177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:08.050967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:08.051422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:08.208643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:08.217583 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d6c26a0a-87af-41fa-887a-472c48753994 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.179389 May 19 09:21:08.219801 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5402/6727] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:08 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:09.237591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:09.238776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:09.246445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:09.246936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:09.247724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:09.248177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:09.415145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:09.424021 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36941a19-a0cb-4a3b-b98c-7836606f8805 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.191017 May 19 09:21:09.425135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5403/6728] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:09 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:09.430980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-75f18f18-036b-4249-8436-696df01c32a5 req-1ba6dc71-1c16-4b7b-b438-792e042f094c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "name": "network-vif-plugged", "status": "completed", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:09.440498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-75f18f18-036b-4249-8436-696df01c32a5 req-1ba6dc71-1c16-4b7b-b438-792e042f094c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:09.440791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-75f18f18-036b-4249-8436-696df01c32a5 req-1ba6dc71-1c16-4b7b-b438-792e042f094c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:09.454875 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-75f18f18-036b-4249-8436-696df01c32a5 req-1ba6dc71-1c16-4b7b-b438-792e042f094c service nova] Creating event network-vif-plugged:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:21:09.461560 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-75f18f18-036b-4249-8436-696df01c32a5 req-1ba6dc71-1c16-4b7b-b438-792e042f094c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 May 19 09:21:09.462403 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5404/6729] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:21:10.443236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:10.444028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:10.451182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:10.451649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:10.452445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:10.452901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:10.611980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:10.621752 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db64695f-a77e-4565-b426-1d9587ba1be8 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1358 microversion: 2.1 time: 0.183327 May 19 09:21:10.622911 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5405/6730] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:10 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:11.644491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:11.645177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:11.654165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:11.654767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:11.655627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:11.656131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:11.687426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:21:11.815628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:11.824692 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a050ffc0-5935-4d3b-bb2d-00b0fda313a4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1548 microversion: 2.1 time: 0.184112 May 19 09:21:11.825365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5406/6731] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:11 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:11.842134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:11.842765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:11.849107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:11.849597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:11.851779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:11.852515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:12.007729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:12.015679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1fd0255e-6469-49c7-9ec8-419e349e2bee tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1548 microversion: 2.1 time: 0.177331 May 19 09:21:12.016264 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5407/6732] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:11 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:12.037497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:12.041484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:12.042273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Searching by: {'deleted': False, 'project_id': 'b03ca9310307426db12babf74b2f3aa5'} {{(pid=119072) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 09:21:12.047982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:12.048451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:12.049257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:12.049738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:12.077014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.multi_cell_list [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 09:21:12.107964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-612b4f3c-f073-4111-857c-7e870c01d09e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.074413 May 19 09:21:12.108550 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5408/6733] 10.222.0.78 () {58 vars in 1124 bytes} [Thu May 19 09:21:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:21:12.119490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:12.120136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:12.126907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:12.127391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:12.128226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:12.128759 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:12.301696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:12.311501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-795a80d5-4072-4ab5-a51b-23b0d445ff4a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1548 microversion: 2.1 time: 0.196390 May 19 09:21:12.312097 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5409/6734] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:12 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:14.990393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf9f06d7-9471-4c30-a9c2-f4b929fd5641"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:14.992573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:15.000374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:15.000849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:15.001753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:15.002201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:15.282611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-351ed7c9-34d4-4300-bf15-899462b4ca6f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296257 May 19 09:21:15.283293 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5410/6735] 10.222.0.78 () {60 vars in 1322 bytes} [Thu May 19 09:21:14 2022] POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:21:32.429514 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:21:32.430374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:21:32.431071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:21:32.435081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:32.435793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:32.443879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:32.444909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:32.445727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:32.446174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:32.594132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:32.604367 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c2ff6083-ed06-44ec-a49c-7092fb94e8cf tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1594 microversion: 2.1 time: 0.176738 May 19 09:21:32.604981 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5411/6736] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:32 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1594 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:34.496812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ce4fa424-2a5b-47f4-9cd4-2659cec65fdf req-da9604ae-0de4-4720-9fec-8b23a259698b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:34.512136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ce4fa424-2a5b-47f4-9cd4-2659cec65fdf req-da9604ae-0de4-4720-9fec-8b23a259698b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:34.512984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ce4fa424-2a5b-47f4-9cd4-2659cec65fdf req-da9604ae-0de4-4720-9fec-8b23a259698b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:34.530679 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ce4fa424-2a5b-47f4-9cd4-2659cec65fdf req-da9604ae-0de4-4720-9fec-8b23a259698b service nova] Creating event network-changed:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:21:34.543864 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ce4fa424-2a5b-47f4-9cd4-2659cec65fdf req-da9604ae-0de4-4720-9fec-8b23a259698b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043594 May 19 09:21:34.544730 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5412/6737] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:21:35.704115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-956871845"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:35.704983 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:35.712601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:35.713368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:35.714346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:35.714842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:35.862629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Adding security group ee11a1f1-b88d-4515-ab20-bfdd02700a2f to port 732c19c1-955a-4aed-9673-2e49077ae646 May 19 09:21:36.282835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-069300a1-b84b-4ced-af6b-5ffcce50ca90 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/action" status: 202 len: 0 microversion: 2.1 time: 0.583823 May 19 09:21:36.284534 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5413/6738] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:21:35 2022] POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:21:36.296289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:36.297048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:36.309845 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:36.312131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:36.313823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:36.314310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:36.524999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:36.533559 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fd6b14af-eebf-40c8-8ec6-59d8e4b8134d tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1759 microversion: 2.1 time: 0.241066 May 19 09:21:36.535239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5414/6739] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:36 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1759 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:21:36.562710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a66cf66b-3546-41ee-ba97-7f21e87366c4 req-6a6fe40c-8d9c-4b71-8058-1fe9560fa027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:36.574143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a66cf66b-3546-41ee-ba97-7f21e87366c4 req-6a6fe40c-8d9c-4b71-8058-1fe9560fa027 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:36.574598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a66cf66b-3546-41ee-ba97-7f21e87366c4 req-6a6fe40c-8d9c-4b71-8058-1fe9560fa027 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:36.586713 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a66cf66b-3546-41ee-ba97-7f21e87366c4 req-6a6fe40c-8d9c-4b71-8058-1fe9560fa027 service nova] Creating event network-changed:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:21:36.592221 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a66cf66b-3546-41ee-ba97-7f21e87366c4 req-6a6fe40c-8d9c-4b71-8058-1fe9560fa027 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035767 May 19 09:21:36.592883 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5415/6740] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:21:43.932175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:21:43.933296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:43.939714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:43.940217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:43.941009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:43.941500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:44.024641 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-655ca6e7-a6ee-42e7-8368-e338d1127c8a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/action" status: 202 len: 0 microversion: 2.1 time: 0.097951 May 19 09:21:44.025315 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5416/6741] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:21:43 2022] POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:21:44.034783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:44.035617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:44.044329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:44.044844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:44.046091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:44.046528 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:44.210900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:44.220063 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a0c195dd-924e-4d96-ae52-98f8dd360a12 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1751 microversion: 2.1 time: 0.190020 May 19 09:21:44.220714 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5417/6742] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:44 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:45.239715 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:45.240529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:45.247587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:45.248046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:45.248829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:45.249279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:45.420402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:45.430184 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a92bc89f-3cbc-4b5a-b66b-adb174fe3376 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.194190 May 19 09:21:45.430802 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5418/6743] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:45 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:21:46.449072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:46.449773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:46.456749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:46.457215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:46.458046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:46.458506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:46.620223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:46.628943 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-70c0790c-d4bd-41ff-bec1-c4a85cd9c34c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.183884 May 19 09:21:46.629582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5419/6744] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:46 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:47.647223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:47.648049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:47.655193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:47.655639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:47.656441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:47.656891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:47.819799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:47.828582 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f5e2594-fc04-48f4-b2eb-230461224f0e tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.185337 May 19 09:21:47.829175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5420/6745] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:47 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:48.846213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:48.846936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:48.854875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:48.855337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:48.856122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:48.856570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:49.286133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:49.295087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b89ede73-db9f-4661-8325-970f20a0bf3a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.452742 May 19 09:21:49.295676 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5421/6746] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:48 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:21:50.314179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:50.314818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:50.324943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:50.325689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:50.327237 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:50.327925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:50.498465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:50.508122 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c02fde79-a167-43e9-b440-c44adf3197db tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.197856 May 19 09:21:50.508729 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5422/6747] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:50 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:51.527335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:51.528184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:51.535678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:51.536142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:51.537033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:51.537569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:51.701205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:51.710018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3b855a6-7948-49d1-a99b-3d56558939e1 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.188260 May 19 09:21:51.710641 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5423/6748] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:51 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:21:52.729615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:52.730498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:52.737994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:52.738472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:52.739276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:52.739789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:52.907255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:52.916574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f048e7c8-2f2f-4b1b-87e0-7c9c52a20b66 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.192852 May 19 09:21:52.917167 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5424/6749] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:52 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:53.937137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:53.937856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:53.946198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:53.946685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:53.947472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:53.947914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:54.149991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:54.159087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12b726f0-4c02-49f7-9d77-58549e211abe tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.225828 May 19 09:21:54.159707 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5425/6750] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:53 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:55.180233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:55.180952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:55.188137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:55.188610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:55.189562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:55.189990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:55.356752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:55.365102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e07e9f8-8171-4311-acbd-a4259160d36f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1756 microversion: 2.1 time: 0.191396 May 19 09:21:55.366291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5426/6751] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:55 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:21:56.385886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:21:56.386841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:21:56.396374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:56.396943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:56.397939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:21:56.398585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:21:56.562871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:21:56.571492 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c4db21cc-d56d-40c8-a82c-32bcaba54984 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1759 microversion: 2.1 time: 0.190806 May 19 09:21:56.572080 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5427/6752] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:21:56 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:22:29.467925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-956871845"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:22:29.469055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:29.470988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=34 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:22:29.471819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:22:29.478599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:29.479025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:29.479828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:29.480277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:29.620721 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.network.security_group_api [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Removing security group ee11a1f1-b88d-4515-ab20-bfdd02700a2f from port 732c19c1-955a-4aed-9673-2e49077ae646 May 19 09:22:30.047030 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-80231b5d-05ed-4ccb-9170-737d36fefbb0 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/action" status: 202 len: 0 microversion: 2.1 time: 0.584488 May 19 09:22:30.048296 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5428/6753] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:22:29 2022] POST /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:22:30.056565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8dd9d350-23b2-4aa5-918a-838f46adc80f req-e371934c-b28a-43fe-8565-2f967ad16084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:22:30.066682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8dd9d350-23b2-4aa5-918a-838f46adc80f req-e371934c-b28a-43fe-8565-2f967ad16084 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:30.067152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8dd9d350-23b2-4aa5-918a-838f46adc80f req-e371934c-b28a-43fe-8565-2f967ad16084 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:30.091207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8dd9d350-23b2-4aa5-918a-838f46adc80f req-e371934c-b28a-43fe-8565-2f967ad16084 service nova] Creating event network-changed:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:22:30.097515 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8dd9d350-23b2-4aa5-918a-838f46adc80f req-e371934c-b28a-43fe-8565-2f967ad16084 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044641 May 19 09:22:30.098311 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5429/6754] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:31.351006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:31.351752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:31.359441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:31.359913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:31.360714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:31.361170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:31.468261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lazy-loading 'services' on Instance uuid e139c75b-703e-453a-aa19-7810166a9387 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:22:31.558740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3cb3b8c-1ddf-4191-a67c-112ce92e3ee4 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments/bf9f06d7-9471-4c30-a9c2-f4b929fd5641" status: 202 len: 0 microversion: 2.1 time: 0.211864 May 19 09:22:31.559561 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5430/6755] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:22:31 2022] DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments/bf9f06d7-9471-4c30-a9c2-f4b929fd5641 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:22:31.569888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:31.570395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:31.577329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:31.577872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:31.578708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:31.579242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:31.633476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f87ee480-c8de-481a-b18c-54db7eeaf435 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068752 May 19 09:22:31.634762 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5431/6756] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:31 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:32.119375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c2034fae-7465-48b6-8e7f-7eaefccdb981 req-5fb2d38f-9c2f-4349-8776-3bf7b155f01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:22:32.128070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c2034fae-7465-48b6-8e7f-7eaefccdb981 req-5fb2d38f-9c2f-4349-8776-3bf7b155f01d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:32.128535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c2034fae-7465-48b6-8e7f-7eaefccdb981 req-5fb2d38f-9c2f-4349-8776-3bf7b155f01d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:32.142016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c2034fae-7465-48b6-8e7f-7eaefccdb981 req-5fb2d38f-9c2f-4349-8776-3bf7b155f01d service nova] Creating event network-changed:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:22:32.147601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c2034fae-7465-48b6-8e7f-7eaefccdb981 req-5fb2d38f-9c2f-4349-8776-3bf7b155f01d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 May 19 09:22:32.148421 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5432/6757] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:32.651647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:32.653565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:32.663219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:32.663888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:32.664920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:32.665772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:32.712479 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1191c4dd-055f-4502-9d3d-c654ca39fe2c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068375 May 19 09:22:32.713558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5433/6758] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:32 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:33.724647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:33.725669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:33.733765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:33.734231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:33.735033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:33.735491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:33.777662 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8571bf62-5922-4ac9-823d-603313c24920 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057053 May 19 09:22:33.778282 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5434/6759] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:33 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:34.791805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:34.792757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:34.800725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:34.801395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:34.802185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:34.802630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:34.834482 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-356f80ea-b4d2-4826-9e62-34c54da37515 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047573 May 19 09:22:34.835062 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5435/6760] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:34 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:35.847059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:35.848214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:35.856507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:35.856966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:35.857827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:35.858270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:35.889937 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31fe7ae5-4113-4c8a-9d6b-89bcc5ab95f3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 May 19 09:22:35.890754 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5436/6761] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:35 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:36.901812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:36.902929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:36.910059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:36.910517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:36.911306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:36.911757 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:36.943854 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-29cff663-a824-4db0-8534-5edd7555f051 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046826 May 19 09:22:36.944541 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5437/6762] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:36 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:37.956613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:37.957507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:37.965414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:37.965897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:37.966702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:37.967161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:37.999962 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b2db1aa-9f58-4d72-8a3c-b3807a9eee9c tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047458 May 19 09:22:38.000547 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5438/6763] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:37 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:22:39.012520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:39.013535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:39.021047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:39.021546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:39.022367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:39.022815 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:39.056568 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad59e0ba-2ffd-46f2-9dfd-d453bdb42354 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 May 19 09:22:39.057175 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5439/6764] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:39 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:40.069686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:40.070795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:40.078684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:40.079344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:40.080205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:40.080728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:40.116196 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2f5a0f8d-18fc-4d90-a7a4-63c8292f0e59 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049470 May 19 09:22:40.116196 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5440/6765] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:40 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:41.126704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:41.127949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:41.136474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:41.136943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:41.137812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:41.138269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:41.174764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5e36de40-2d03-485a-ba1f-87d76a7d3ba3 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052184 May 19 09:22:41.178757 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5441/6766] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:41 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:42.187126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:42.188202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:42.195438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:42.196749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:42.197719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:42.198182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:42.236304 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ccdc89a4-53f6-4283-b01c-b681d8411a79 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053280 May 19 09:22:42.236908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5442/6767] 10.222.0.78 () {58 vars in 1301 bytes} [Thu May 19 09:22:42 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 09:22:42.248353 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:42.248889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:42.256696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:42.257157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:42.258636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:42.259232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:42.345272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] HTTP exception thrown: Instance e139c75b-703e-453a-aa19-7810166a9387 is not attached to volume bf9f06d7-9471-4c30-a9c2-f4b929fd5641 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Request method failure captured: May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: request: DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments/bf9f06d7-9471-4c30-a9c2-f4b929fd5641 HTTP/1.1 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgviKoO98OmnZpOSc10TnOf-RTNHBQ0Jq-f-4P-L63Q4qp_osOleKOHPVaMtKsMRO5_njBAENDeXgq36QgK129ACyuonRT5gmOsa4EV2urNZ-brtaOHL0SZV2gyJZzyPN3Sw2ZfqaED_ZSrEPLUn_O7H4mj3S4f3SjyJAlUYCFomB_Y May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b03ca9310307426db12babf74b2f3aa5 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestMinimumBasicScenario-1786703039 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestMinimumBasicScenario-1786703039 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b03ca9310307426db12babf74b2f3aa5 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1786703039 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestMinimumBasicScenario-1786703039-project May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d56910e901fb4c0ca18fba5c90b82521 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestMinimumBasicScenario-1786703039-project May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e139c75b-703e-453a-aa19-7810166a9387 is not attached to volume bf9f06d7-9471-4c30-a9c2-f4b929fd5641 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'server_id': 'e139c75b-703e-453a-aa19-7810166a9387', 'id': 'bf9f06d7-9471-4c30-a9c2-f4b929fd5641'} May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf9f06d7-9471-4c30-a9c2-f4b929fd5641. May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e139c75b-703e-453a-aa19-7810166a9387 is not attached to volume bf9f06d7-9471-4c30-a9c2-f4b929fd5641 May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:22:42.346931 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e139c75b-703e-453a-aa19-7810166a9387 is not attached to volume bf9f06d7-9471-4c30-a9c2-f4b929fd5641 May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Returning 404 to user: Instance e139c75b-703e-453a-aa19-7810166a9387 is not attached to volume bf9f06d7-9471-4c30-a9c2-f4b929fd5641 {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-845f55ba-81fd-4090-a6e0-0821f348951f tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments/bf9f06d7-9471-4c30-a9c2-f4b929fd5641" status: 404 len: 154 microversion: 2.1 time: 0.104638 May 19 09:22:42.353736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5443/6768] 10.222.0.78 () {58 vars in 1415 bytes} [Thu May 19 09:22:42 2022] DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387/os-volume_attachments/bf9f06d7-9471-4c30-a9c2-f4b929fd5641 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 09:22:48.832999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:48.833712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:48.840461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:48.840921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:48.841758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:48.842205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:48.872485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:22:48.903078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:22:48.963835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8341d2c0-4944-474d-8022-caf76737fa83 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 204 len: 0 microversion: 2.1 time: 0.135419 May 19 09:22:48.968121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5444/6769] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:22:48 2022] DELETE /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:22:48.974102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:48.974829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:48.982357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:48.982824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:48.983634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:48.984093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:49.140214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:22:49.149880 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-98b050c2-7c62-4e19-8270-39b2f48069b5 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1554 microversion: 2.1 time: 0.179739 May 19 09:22:49.150519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5445/6770] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:22:48 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:22:50.167718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:50.168406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:50.175659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:50.176143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:50.176925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:50.177411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:50.335738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:22:50.347068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e399a904-a632-4799-98c5-fbc3aeafbac7 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1554 microversion: 2.1 time: 0.183331 May 19 09:22:50.347688 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5446/6771] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:22:50 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:22:51.230537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e6d42734-e421-4eb5-9a10-924b7b3e0165 req-cb372f12-eac8-4b7c-8ac2-d71a2e5ed9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e139c75b-703e-453a-aa19-7810166a9387", "name": "network-vif-deleted", "tag": "732c19c1-955a-4aed-9673-2e49077ae646"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:22:51.240089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e6d42734-e421-4eb5-9a10-924b7b3e0165 req-cb372f12-eac8-4b7c-8ac2-d71a2e5ed9b6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:51.240620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e6d42734-e421-4eb5-9a10-924b7b3e0165 req-cb372f12-eac8-4b7c-8ac2-d71a2e5ed9b6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:51.254092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e6d42734-e421-4eb5-9a10-924b7b3e0165 req-cb372f12-eac8-4b7c-8ac2-d71a2e5ed9b6 service nova] Creating event network-vif-deleted:732c19c1-955a-4aed-9673-2e49077ae646 for instance e139c75b-703e-453a-aa19-7810166a9387 on chh2-842464-2 May 19 09:22:51.259518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e6d42734-e421-4eb5-9a10-924b7b3e0165 req-cb372f12-eac8-4b7c-8ac2-d71a2e5ed9b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 May 19 09:22:51.260150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5447/6772] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:22:51.365977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:51.366705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:51.374475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:51.374939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:51.375744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:51.376453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:51.417432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:51.417894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:51.418372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lazy-loading 'fault' on Instance uuid e139c75b-703e-453a-aa19-7810166a9387 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:22:51.464796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56910e901fb4c0ca18fba5c90b82521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b03ca9310307426db12babf74b2f3aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:22:51.472863 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e27602f2-20d7-4cc7-a6e2-a099d3becf5a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 200 len: 1348 microversion: 2.1 time: 0.111114 May 19 09:22:51.473492 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5448/6773] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:22:51 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:22:52.491399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:52.492091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] [instance: e139c75b-703e-453a-aa19-7810166a9387] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:22:52.500114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:52.500586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:52.501423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:22:52.501883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:22:52.517670 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] HTTP exception thrown: Instance e139c75b-703e-453a-aa19-7810166a9387 could not be found. May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Request method failure captured: May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 HTTP/1.1 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgviKoO98OmnZpOSc10TnOf-RTNHBQ0Jq-f-4P-L63Q4qp_osOleKOHPVaMtKsMRO5_njBAENDeXgq36QgK129ACyuonRT5gmOsa4EV2urNZ-brtaOHL0SZV2gyJZzyPN3Sw2ZfqaED_ZSrEPLUn_O7H4mj3S4f3SjyJAlUYCFomB_Y May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: b03ca9310307426db12babf74b2f3aa5 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestMinimumBasicScenario-1786703039 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b03ca9310307426db12babf74b2f3aa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestMinimumBasicScenario-1786703039 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: b03ca9310307426db12babf74b2f3aa5 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1786703039 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestMinimumBasicScenario-1786703039-project May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: d56910e901fb4c0ca18fba5c90b82521 May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestMinimumBasicScenario-1786703039-project May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e139c75b-703e-453a-aa19-7810166a9387 could not be found. May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e139c75b-703e-453a-aa19-7810166a9387'} May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e139c75b-703e-453a-aa19-7810166a9387 could not be found. May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e139c75b-703e-453a-aa19-7810166a9387 could not be found. May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:22:52.519434 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e139c75b-703e-453a-aa19-7810166a9387 could not be found. May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Returning 404 to user: Instance e139c75b-703e-453a-aa19-7810166a9387 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-da36a348-e04e-4ae6-972f-b05af905b652 tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387" status: 404 len: 111 microversion: 2.1 time: 0.033585 May 19 09:22:52.525963 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5449/6774] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:22:52 2022] GET /compute/v2.1/servers/e139c75b-703e-453a-aa19-7810166a9387 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:22:52.530818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c8b4c910-3ee8-4770-b18f-3e0e008b9f0a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] Calling method '.version_select at 0x7f3210425e50>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:22:52.553256 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c8b4c910-3ee8-4770-b18f-3e0e008b9f0a tempest-TestMinimumBasicScenario-1786703039 tempest-TestMinimumBasicScenario-1786703039-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-284306928" status: 202 len: 0 microversion: 2.1 time: 0.026311 May 19 09:22:52.554056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5450/6775] 10.222.0.78 () {58 vars in 1268 bytes} [Thu May 19 09:22:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-284306928 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:23:02.432319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1e574df5-693f-4c7a-842a-b3436d246480 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: .version_select at 0x7f3210434430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2012808241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMHGpaQZEibfWuQg0X6ckXP7PBvOhpEYK4l5JjIZQsnrJe1xEOhTgS6I0Q7wcUYDey1HdWokdbzL5T2MGGxIYlMwTJeQzW0yK8zIChrCtqSKa8fLmMKpI3THSVrUUv70Q=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:02.436644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:02.451158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1e574df5-693f-4c7a-842a-b3436d246480 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:23:02.456551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1e574df5-693f-4c7a-842a-b3436d246480 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:23:02.484662 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1e574df5-693f-4c7a-842a-b3436d246480 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.233789 May 19 09:23:02.485274 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5451/6776] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:23:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:23:08.781651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:08.786621 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-666003688", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "b53211d0-719c-45d8-9704-f60e998fef9b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2012808241", "security_groups": [{"name": "tempest-secgroup-smoke-1192305694"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:08.945045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] validate_networks() for [('b53211d0-719c-45d8-9704-f60e998fef9b', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:23:09.454187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:23:09.454828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:23:09.455436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:23:09.456019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:23:09.456553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:23:09.469555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:09.470643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:09.471641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:09.472489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:09.497849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:23:09.504277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:23:09.525402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:23:09.528316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:23:09.588270 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5639cd5-7557-465c-9e37-d4467cf2b860 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807183 May 19 09:23:09.590054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5452/6777] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:23:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:23:09.604370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed072fa8-33dd-46f6-ab7c-b37a434df8f7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:09.605004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed072fa8-33dd-46f6-ab7c-b37a434df8f7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:09.679250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed072fa8-33dd-46f6-ab7c-b37a434df8f7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:09.688010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed072fa8-33dd-46f6-ab7c-b37a434df8f7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1266 microversion: 2.1 time: 0.088958 May 19 09:23:09.689357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5453/6778] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:09 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:23:10.711984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:10.717150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:10.725603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:10.726153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:10.727156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:10.727945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:10.849434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:10.858831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50082777-658c-462a-b004-4eecb3228269 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1318 microversion: 2.1 time: 0.155252 May 19 09:23:10.859858 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5454/6779] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:10 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:23:11.883864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:11.883864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:11.891857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:11.892657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:11.893559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:11.894184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:12.088211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:12.100976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0a963f72-9d30-46db-92b6-35312864c578 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.224916 May 19 09:23:12.102257 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5455/6780] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:11 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:23:12.799235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-35f887c3-791f-4e8f-906a-9051dba516dc req-366b97ba-b0b8-4e5f-9f00-5b70dc0124d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86766d-a47b-41b1-9e4f-009f9e892a80", "tag": "3f2f70fd-fc67-46fa-8c9a-33cbd88d5012"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:12.809542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-35f887c3-791f-4e8f-906a-9051dba516dc req-366b97ba-b0b8-4e5f-9f00-5b70dc0124d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:12.810139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-35f887c3-791f-4e8f-906a-9051dba516dc req-366b97ba-b0b8-4e5f-9f00-5b70dc0124d3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:12.831091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-35f887c3-791f-4e8f-906a-9051dba516dc req-366b97ba-b0b8-4e5f-9f00-5b70dc0124d3 service nova] Creating event network-changed:3f2f70fd-fc67-46fa-8c9a-33cbd88d5012 for instance ec86766d-a47b-41b1-9e4f-009f9e892a80 on chh2-842464-2 May 19 09:23:12.836363 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-35f887c3-791f-4e8f-906a-9051dba516dc req-366b97ba-b0b8-4e5f-9f00-5b70dc0124d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043415 May 19 09:23:12.836969 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5456/6781] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:23:13.122067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:13.122794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:13.136516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:13.137143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:13.138036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:13.138611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:13.293880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:13.301842 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1cf1c41d-0dc4-47c1-a15d-85cbd633b931 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.185570 May 19 09:23:13.302442 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5457/6782] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:13 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:14.319018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:14.319914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:14.327408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:14.327868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:14.328666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:14.329112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:14.469812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:14.479783 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-999bd2c4-9104-40eb-bf23-90dc03df87d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.164582 May 19 09:23:14.480424 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5458/6783] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:14 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:15.497762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:15.498439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:15.505390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:15.505850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:15.506634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:15.507080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:15.657734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:15.665700 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fd617ca-07d9-4b74-a29d-cb6d7af67f6f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.172339 May 19 09:23:15.666363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5459/6784] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:15 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:16.683582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:16.684277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:16.691634 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:16.692107 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:16.692909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:16.693401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:16.843767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:16.852013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2dc5062-7c61-4227-ae66-d3cf29ef3d89 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.172291 May 19 09:23:16.852659 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5460/6785] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:16 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:17.869889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:17.870802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:17.881474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:17.881943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:17.883297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:17.883907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:18.027867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:18.035871 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e41a7561-336f-4f9f-b4c9-e2355382a09f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.171182 May 19 09:23:18.036468 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5461/6786] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:17 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:19.055270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:19.056202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:19.066961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:19.067526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:19.068380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:19.068838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:19.217902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:19.231978 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0ecd5627-a439-44fe-a81f-19dfdbe62768 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.181398 May 19 09:23:19.232649 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5462/6787] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:19 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:20.004042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c252a8e2-c28b-454e-b43a-28e87265862e req-14aae023-5619-454c-bc7b-5351fd2b5ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86766d-a47b-41b1-9e4f-009f9e892a80", "name": "network-vif-plugged", "status": "completed", "tag": "3f2f70fd-fc67-46fa-8c9a-33cbd88d5012"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:20.008331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:20.010775 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:20.017462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c252a8e2-c28b-454e-b43a-28e87265862e req-14aae023-5619-454c-bc7b-5351fd2b5ca5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:20.017917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c252a8e2-c28b-454e-b43a-28e87265862e req-14aae023-5619-454c-bc7b-5351fd2b5ca5 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:20.030009 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c252a8e2-c28b-454e-b43a-28e87265862e req-14aae023-5619-454c-bc7b-5351fd2b5ca5 service nova] Creating event network-vif-plugged:3f2f70fd-fc67-46fa-8c9a-33cbd88d5012 for instance ec86766d-a47b-41b1-9e4f-009f9e892a80 on chh2-842464-2 May 19 09:23:20.035338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c252a8e2-c28b-454e-b43a-28e87265862e req-14aae023-5619-454c-bc7b-5351fd2b5ca5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035394 May 19 09:23:20.036314 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5463/6788] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:23:20.251241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:20.251952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:20.258867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:20.259340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:20.260220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:20.260683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:20.415412 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:20.424388 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d255228a-cc8e-4481-89fb-7506c9c7fbc7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1392 microversion: 2.1 time: 0.179375 May 19 09:23:20.425006 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5464/6789] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:20 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:21.442118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:21.442773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:21.450643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:21.451101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:21.451885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:21.452340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:21.605858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:21.614415 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dad9eb37-08ba-4f05-8986-2550d48e7940 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1564 microversion: 2.1 time: 0.176291 May 19 09:23:21.615495 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5465/6790] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:21 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:21.633022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:21.633669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:21.639891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:21.640350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:21.641120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:21.641588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:21.780755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:21.789243 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-057206c5-0e8f-47fb-afc9-733c439d3974 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1564 microversion: 2.1 time: 0.160187 May 19 09:23:21.789869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5466/6791] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:21 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:23:23.604949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:23.605703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:23.612779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:23.613251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:23.614089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:23.614541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:23.766748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:23.775409 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eef1a653-dd48-47f3-ab11-2b10ab2cadaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1564 microversion: 2.1 time: 0.175844 May 19 09:23:23.776041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5467/6792] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:23 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:23:23.780674 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-134abb31-15b9-4fec-b6a2-7972caaa13f9 req-8ad2644f-42a3-4441-9139-48949cfd00ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86766d-a47b-41b1-9e4f-009f9e892a80", "tag": "3f2f70fd-fc67-46fa-8c9a-33cbd88d5012"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:23.794568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-134abb31-15b9-4fec-b6a2-7972caaa13f9 req-8ad2644f-42a3-4441-9139-48949cfd00ef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:23.795140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-134abb31-15b9-4fec-b6a2-7972caaa13f9 req-8ad2644f-42a3-4441-9139-48949cfd00ef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:23.808543 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-134abb31-15b9-4fec-b6a2-7972caaa13f9 req-8ad2644f-42a3-4441-9139-48949cfd00ef service nova] Creating event network-changed:3f2f70fd-fc67-46fa-8c9a-33cbd88d5012 for instance ec86766d-a47b-41b1-9e4f-009f9e892a80 on chh2-842464-2 May 19 09:23:23.817675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-134abb31-15b9-4fec-b6a2-7972caaa13f9 req-8ad2644f-42a3-4441-9139-48949cfd00ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040305 May 19 09:23:23.818562 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5468/6793] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:23:27.392044 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:23:27.392693 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:23:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:23:46.328655 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:23:46.329680 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:23:47.113626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:47.114438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=80 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:47.119738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:47.120889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:47.128737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:47.129211 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:47.130041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:47.130493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:47.204091 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cf8b224e-a8a9-4c6a-9bb9-1cdefa873545 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action" status: 200 len: 24576 microversion: 2.1 time: 0.092522 May 19 09:23:47.204891 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5469/6794] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:23:47 2022] POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action => generated 24576 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:23:58.136828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:23:58.137574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:58.140152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:58.140806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:23:58.146908 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:58.148023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:58.148819 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:58.149263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:58.223651 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c3c3c3d-0018-41b6-81c1-d17ea60e206e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action" status: 202 len: 0 microversion: 2.1 time: 0.091458 May 19 09:23:58.224328 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5470/6795] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:23:58 2022] POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:23:58.235826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:58.238962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:58.246014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:58.246776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:58.247788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:58.248251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:58.462462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:58.471241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-11faf9f9-a9d6-4012-991b-bf8608f5c943 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1688 microversion: 2.1 time: 0.240628 May 19 09:23:58.471999 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5471/6796] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:58 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:23:59.491704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:23:59.492577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:23:59.499441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:59.499901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:59.500718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:23:59.501163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:23:59.651179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:23:59.659234 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e324291-d5ba-4225-ab17-46c9bf4f47e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1668 microversion: 2.1 time: 0.172127 May 19 09:23:59.659824 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5472/6797] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:23:59 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:00.767171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:00.768307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:00.776823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:00.777286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:00.778103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:00.778555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:00.846545 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-24076233-1aad-41e5-ad14-341e4d5f72d7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action" status: 200 len: 32640 microversion: 2.1 time: 0.083237 May 19 09:24:00.847221 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5473/6798] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:24:00 2022] POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action => generated 32640 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:24:00.859555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:00.860201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:00.867916 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:00.868407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:00.869256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:00.869747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:00.950606 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20c273d5-01d4-42f2-a0fb-ff40c81f0c8a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action" status: 202 len: 0 microversion: 2.1 time: 0.094918 May 19 09:24:00.951181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5474/6799] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:24:00 2022] POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:24:00.961391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:00.962127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:00.968766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:00.969238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:00.970179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:00.970988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:01.122978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:01.135985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ac3c4b2-efbb-4fb1-b860-a88853eab1d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1675 microversion: 2.1 time: 0.179802 May 19 09:24:01.136750 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5475/6800] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:00 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:02.155466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:02.156201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:02.163281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:02.163877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:02.164649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:02.165108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:02.311747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:02.320207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69e4c216-5872-4c85-8d06-2cfed5557be7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1683 microversion: 2.1 time: 0.168072 May 19 09:24:02.320887 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5476/6801] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:02 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:02.420360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:02.421315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:02.428033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:02.429442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:02.430179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:02.430624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:02.488789 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69596a7d-9646-43eb-a62c-274550a8b1b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action" status: 200 len: 38476 microversion: 2.1 time: 0.072364 May 19 09:24:02.489624 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5477/6802] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:24:02 2022] POST /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80/action => generated 38476 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:24:03.553779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:03.554762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:03.564238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:03.564758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:03.565858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:03.566666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:03.597994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:24:03.700136 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8731a173-eac1-464d-b58e-a8bb33d5f430 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 204 len: 0 microversion: 2.1 time: 0.150882 May 19 09:24:03.700778 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5478/6803] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:24:03 2022] DELETE /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:24:03.708190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-914522b0-d1a4-4be9-8f6e-a60ee4162bfc req-810556cb-02d4-405f-820c-dd52d243aea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86766d-a47b-41b1-9e4f-009f9e892a80", "tag": "3f2f70fd-fc67-46fa-8c9a-33cbd88d5012"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:03.721693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-914522b0-d1a4-4be9-8f6e-a60ee4162bfc req-810556cb-02d4-405f-820c-dd52d243aea6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:03.722161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-914522b0-d1a4-4be9-8f6e-a60ee4162bfc req-810556cb-02d4-405f-820c-dd52d243aea6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:03.734466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-914522b0-d1a4-4be9-8f6e-a60ee4162bfc req-810556cb-02d4-405f-820c-dd52d243aea6 service nova] Creating event network-changed:3f2f70fd-fc67-46fa-8c9a-33cbd88d5012 for instance ec86766d-a47b-41b1-9e4f-009f9e892a80 on chh2-842464-2 May 19 09:24:03.739938 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-914522b0-d1a4-4be9-8f6e-a60ee4162bfc req-810556cb-02d4-405f-820c-dd52d243aea6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037194 May 19 09:24:03.741512 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5479/6804] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:24:03.747612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:03.748344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:03.755809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:03.756195 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:03.758132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:03.758748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:03.930209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:03.939433 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c69e4554-fe76-4f40-9daf-944297b41edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1689 microversion: 2.1 time: 0.196670 May 19 09:24:03.939957 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5480/6805] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:03 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:24:04.958333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:04.959032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:04.966926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:04.967396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:04.968541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:04.969010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:05.136128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:05.144734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a1d9326-3686-4e1b-b49d-bb55eace71f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1689 microversion: 2.1 time: 0.190312 May 19 09:24:05.145363 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5481/6806] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:04 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:05.855669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4868a4f6-4379-4983-af8d-3f16bc2c1562 req-aee70580-687b-46ca-abf4-6ebdb727a7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86766d-a47b-41b1-9e4f-009f9e892a80", "name": "network-vif-deleted", "tag": "3f2f70fd-fc67-46fa-8c9a-33cbd88d5012"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:05.865098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4868a4f6-4379-4983-af8d-3f16bc2c1562 req-aee70580-687b-46ca-abf4-6ebdb727a7fc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:05.867151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4868a4f6-4379-4983-af8d-3f16bc2c1562 req-aee70580-687b-46ca-abf4-6ebdb727a7fc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:05.880999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4868a4f6-4379-4983-af8d-3f16bc2c1562 req-aee70580-687b-46ca-abf4-6ebdb727a7fc service nova] Creating event network-vif-deleted:3f2f70fd-fc67-46fa-8c9a-33cbd88d5012 for instance ec86766d-a47b-41b1-9e4f-009f9e892a80 on chh2-842464-2 May 19 09:24:05.886850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4868a4f6-4379-4983-af8d-3f16bc2c1562 req-aee70580-687b-46ca-abf4-6ebdb727a7fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 May 19 09:24:05.887487 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5482/6807] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:24:06.167225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:06.168017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:06.175139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:06.175603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:06.176437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:06.176894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:06.213861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:06.214326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:06.214809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lazy-loading 'fault' on Instance uuid ec86766d-a47b-41b1-9e4f-009f9e892a80 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:24:06.264508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:06.278765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-21fd65d2-79f5-4b94-9274-a40240d96a79 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 200 len: 1356 microversion: 2.1 time: 0.117086 May 19 09:24:06.279701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5483/6808] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:06 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 1356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:24:07.297671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:07.298396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: ec86766d-a47b-41b1-9e4f-009f9e892a80] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:07.305631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:07.306096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:07.306895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:07.307341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:07.321952 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] HTTP exception thrown: Instance ec86766d-a47b-41b1-9e4f-009f9e892a80 could not be found. May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Request method failure captured: May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 HTTP/1.1 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgx1UZVv1qp1J03tkdAlVHhQ8Hd6ER5mjT9UpeQyvGw34gvpVN6kXD58v4acOTFO9_ifZh47Jt2efgOAEtoE68wk-WcZCpbSQ2P3u0zdNF_MZ9JjHYCnz6X7YIUWMszLkXoO1OiftbvZh2NgGztFrwcrbODlXqWMSjuH5X1zcI_I824 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca75f10643384d57baccbceca3b6892f May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance ec86766d-a47b-41b1-9e4f-009f9e892a80 could not be found. May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'ec86766d-a47b-41b1-9e4f-009f9e892a80'} May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec86766d-a47b-41b1-9e4f-009f9e892a80 could not be found. May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec86766d-a47b-41b1-9e4f-009f9e892a80 could not be found. May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:24:07.323643 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec86766d-a47b-41b1-9e4f-009f9e892a80 could not be found. May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Returning 404 to user: Instance ec86766d-a47b-41b1-9e4f-009f9e892a80 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a3f7b83-1f7a-4160-8089-9986d15b34c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80" status: 404 len: 111 microversion: 2.1 time: 0.031504 May 19 09:24:07.330013 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5484/6809] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:07 2022] GET /compute/v2.1/servers/ec86766d-a47b-41b1-9e4f-009f9e892a80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:24:11.064797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcc747e0-e56d-42a2-8966-c8f02822b602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '.version_select at 0x7f3211fcd310>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:11.090468 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bcc747e0-e56d-42a2-8966-c8f02822b602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2012808241" status: 202 len: 0 microversion: 2.1 time: 0.029589 May 19 09:24:11.091971 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5485/6810] 10.222.0.78 () {58 vars in 1283 bytes} [Thu May 19 09:24:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2012808241 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:24:11.120178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-560e58d4-f751-40e5-b2e0-752913e958e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: .version_select at 0x7f32123333a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1148819430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVhbZ4M/NMUmfDXtMHyHcy5KuFHsfhtM1b+T1Havv8zP8XbF7GMcGny/2OS0BFzj+6NMXzMhIxHgU1n56nyqvhlnfv9HqsewgJgZRGUx5hnvMaU1qYPYxSY37vmDPqlpA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:11.138717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-560e58d4-f751-40e5-b2e0-752913e958e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:24:11.144976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-560e58d4-f751-40e5-b2e0-752913e958e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:24:11.174116 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-560e58d4-f751-40e5-b2e0-752913e958e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058939 May 19 09:24:11.174722 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5486/6811] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:24:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:24:18.639294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-732122510", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "fb1352b1-2b43-47ae-a6fc-03f3676539fe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1148819430", "security_groups": [{"name": "tempest-secgroup-smoke-1351199812"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:18.652720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:24:18.842493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] validate_networks() for [('fb1352b1-2b43-47ae-a6fc-03f3676539fe', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:24:19.437684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:24:19.438600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:24:19.439532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:24:19.440304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:24:19.440838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:24:19.454554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:19.455085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:19.456317 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:19.457464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:19.487896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:24:19.495228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:24:19.514971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:24:19.520251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:24:19.593041 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aff1f524-2998-413e-ae85-c9c42ed210af tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960487 May 19 09:24:19.594582 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5487/6812] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:24:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:24:19.617256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c974398c-e3af-4605-991d-beb73b49f8a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:19.617256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c974398c-e3af-4605-991d-beb73b49f8a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:19.708796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c974398c-e3af-4605-991d-beb73b49f8a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:19.720638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c974398c-e3af-4605-991d-beb73b49f8a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1266 microversion: 2.1 time: 0.117610 May 19 09:24:19.721494 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5488/6813] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:19 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:20.755576 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:20.757033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:20.774058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:20.775623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:20.778780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:20.780633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:20.950661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:20.973250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9854871e-df16-4048-bd7d-e54abdf479d9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1326 microversion: 2.1 time: 0.228939 May 19 09:24:20.974380 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5489/6814] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:20 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:24:22.004925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:22.009001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:22.025202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:22.025890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:22.028329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:22.028874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:22.388054 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:22.398802 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6d816d7-be16-4926-8af1-5d853cbfdb1f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.400202 May 19 09:24:22.400287 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5490/6815] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:21 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:24:23.046238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-cb4662d5-bb60-4817-a2df-0237782c4c92 req-e39d65f6-ae1f-491b-900c-62df955475f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d19ca0d-ecc6-4e9c-8b33-9cf00862afff", "tag": "6071f894-8a79-4dfc-bd73-7028e26d1718"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:23.062106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cb4662d5-bb60-4817-a2df-0237782c4c92 req-e39d65f6-ae1f-491b-900c-62df955475f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:23.062792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-cb4662d5-bb60-4817-a2df-0237782c4c92 req-e39d65f6-ae1f-491b-900c-62df955475f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:23.097460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-cb4662d5-bb60-4817-a2df-0237782c4c92 req-e39d65f6-ae1f-491b-900c-62df955475f3 service nova] Creating event network-changed:6071f894-8a79-4dfc-bd73-7028e26d1718 for instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff on chh1-842464-2 May 19 09:24:23.104258 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-cb4662d5-bb60-4817-a2df-0237782c4c92 req-e39d65f6-ae1f-491b-900c-62df955475f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063649 May 19 09:24:23.106589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5491/6816] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:24:23.420230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:23.420868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:23.432329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:23.432985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:23.434124 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:23.435196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:23.938798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:23.950910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa79d72b-a14d-4255-948d-497ae40e0778 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.535165 May 19 09:24:23.952102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5492/6817] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:23 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:24.979595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:24.980321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:24.988070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:24.988538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:24.989406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:24.989878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:25.256557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:25.265466 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-44a84d31-b18a-4e9d-ba71-c5f70ad67658 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.291523 May 19 09:24:25.266076 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5493/6818] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:24 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:24:26.289433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:26.290494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:26.298531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:26.299002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:26.299837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:26.300294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:26.519532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:26.530277 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f9a8c06-3a6c-4662-a0e4-7ebb1f9e8a30 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.245174 May 19 09:24:26.531099 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5494/6819] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:26 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:27.549755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:27.550552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:27.561145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:27.561728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:27.562624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:27.563096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:27.764383 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:27.773250 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe9be051-7adc-47d5-b121-b95633251179 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.227713 May 19 09:24:27.774001 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5495/6820] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:27 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:28.795147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:28.796143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:28.801179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:24:28.813797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:28.814753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:28.816743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:28.817834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:29.026643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:29.041724 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5349ca8f-fbf3-4e80-93dc-b8906486a552 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.253843 May 19 09:24:29.042763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5496/6821] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:28 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:29.051642 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-58dcc607-9d22-4994-8556-d35b809a443f req-d7c7fecf-ab31-4e8d-a17f-05ef28894465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d19ca0d-ecc6-4e9c-8b33-9cf00862afff", "name": "network-vif-plugged", "status": "completed", "tag": "6071f894-8a79-4dfc-bd73-7028e26d1718"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:29.068669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-58dcc607-9d22-4994-8556-d35b809a443f req-d7c7fecf-ab31-4e8d-a17f-05ef28894465 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:29.069697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-58dcc607-9d22-4994-8556-d35b809a443f req-d7c7fecf-ab31-4e8d-a17f-05ef28894465 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:29.092229 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-58dcc607-9d22-4994-8556-d35b809a443f req-d7c7fecf-ab31-4e8d-a17f-05ef28894465 service nova] Creating event network-vif-plugged:6071f894-8a79-4dfc-bd73-7028e26d1718 for instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff on chh1-842464-2 May 19 09:24:29.102076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-58dcc607-9d22-4994-8556-d35b809a443f req-d7c7fecf-ab31-4e8d-a17f-05ef28894465 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057081 May 19 09:24:29.103311 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5497/6822] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:24:30.058309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:24:30.060296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:24:30.065903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:30.066838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:30.082985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:30.083461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:30.084395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:30.085213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:30.281141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:30.298353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-60c3e087-5009-4466-aab5-e565ac105e1d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1392 microversion: 2.1 time: 0.240921 May 19 09:24:30.299469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5498/6823] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:30 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:31.331930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:31.333103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:31.347882 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:31.348737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:31.350774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:31.351645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:31.581898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:31.593356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-241c5146-bbd3-4b3b-bbf6-3039e032af02 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1562 microversion: 2.1 time: 0.269044 May 19 09:24:31.593886 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5499/6824] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:31 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1562 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:24:31.621900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:31.624597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:31.633450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:31.634295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:31.635767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:31.636638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:31.847523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:31.857223 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa542182-79ad-4df4-b89c-cc7e5ff87a43 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1562 microversion: 2.1 time: 0.248131 May 19 09:24:31.857893 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5500/6825] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:31 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:34.839268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:24:34.840047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:34.850239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:34.851029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:34.852068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:34.852614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:35.070656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:24:35.088238 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7db61eb9-a9c8-45f6-97bb-df202d514a19 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1562 microversion: 2.1 time: 0.258622 May 19 09:24:35.089260 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5501/6826] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:24:34 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1562 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:24:35.181689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a11c6255-d369-4302-bdcc-12f6b6c8d29c req-08d6a985-a88f-44a5-bdab-865b12104ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d19ca0d-ecc6-4e9c-8b33-9cf00862afff", "tag": "6071f894-8a79-4dfc-bd73-7028e26d1718"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:35.196441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a11c6255-d369-4302-bdcc-12f6b6c8d29c req-08d6a985-a88f-44a5-bdab-865b12104ff3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:35.196926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a11c6255-d369-4302-bdcc-12f6b6c8d29c req-08d6a985-a88f-44a5-bdab-865b12104ff3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:35.212991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a11c6255-d369-4302-bdcc-12f6b6c8d29c req-08d6a985-a88f-44a5-bdab-865b12104ff3 service nova] Creating event network-changed:6071f894-8a79-4dfc-bd73-7028e26d1718 for instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff on chh1-842464-2 May 19 09:24:35.221620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a11c6255-d369-4302-bdcc-12f6b6c8d29c req-08d6a985-a88f-44a5-bdab-865b12104ff3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130758 May 19 09:24:35.222273 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5502/6827] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:24:55.482894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:24:55.484045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=74 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:24:55.488449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:24:55.493738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:24:55.498287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:55.498764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:55.499716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:24:55.500194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:24:55.560474 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dcbd5729-e7f1-4e78-81ae-491d3c830454 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff/action" status: 200 len: 24557 microversion: 2.1 time: 0.079223 May 19 09:24:55.561299 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5503/6828] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:24:55 2022] POST /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff/action => generated 24557 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:25:06.636318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:25:06.638135 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:06.642844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:25:06.643926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:25:06.662130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:06.662755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:06.663773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:06.664185 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:06.777993 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-37a65969-60c3-4de8-aa40-1c59abf7f546 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff/action" status: 202 len: 0 microversion: 2.1 time: 0.149098 May 19 09:25:06.779159 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5504/6829] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:25:06 2022] POST /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:25:06.796479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:06.796479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:06.801026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:06.801493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:06.802918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:06.803726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:07.099589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:07.113541 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28796130-e927-4e46-ad50-ac8fa74b319f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1672 microversion: 2.1 time: 0.327884 May 19 09:25:07.114637 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5505/6830] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:06 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1672 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:08.133629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:08.134462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:08.142910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:08.143381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:08.144213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:08.144675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:08.316861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:08.326845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36ad2cfe-ef37-4600-abbe-208968f33079 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.198362 May 19 09:25:08.327474 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5506/6831] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:08 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:09.346444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:09.347240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:09.360546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:09.361056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:09.362376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:09.362963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:09.546774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:09.557990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa9ce16d-c35c-4d1e-b04e-fa34dd43c0a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.215621 May 19 09:25:09.558679 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5507/6832] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:09 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:10.578907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:10.580001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:10.587275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:10.587767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:10.588578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:10.589027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:10.803868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:10.825712 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-74cb982c-7df5-4f1a-a93f-7624e252ae5b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.251328 May 19 09:25:10.826394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5508/6833] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:10 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:11.852218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:11.853005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:11.862361 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:11.862988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:11.863902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:11.864494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:12.039767 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:12.055781 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6c55a923-9e5d-40dd-a984-e2c045392356 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.207253 May 19 09:25:12.056847 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5509/6834] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:11 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:13.079266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:13.080545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:13.093701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:13.094549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:13.095998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:13.096838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:13.288755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:13.297293 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4bd3121-e2c2-44a3-95d8-8312b9cf3f86 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.225788 May 19 09:25:13.297933 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5510/6835] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:13 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:25:14.317328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:14.318824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:14.326175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:14.326649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:14.327469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:14.327932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:14.530449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:14.540276 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f65d2a5f-25b9-4ae4-b4a3-aec7caf5f3dd tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.227130 May 19 09:25:14.540898 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5511/6836] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:14 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:15.560334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:15.561509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:15.569749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:15.570784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:15.571851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:15.572407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:15.750990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:15.759573 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-985e88b3-0fab-4ccb-a6a0-48a204f3eee9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.204068 May 19 09:25:15.760200 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5512/6837] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:15 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:16.778589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:16.779402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:16.788720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:16.789271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:16.790109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:16.790671 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:16.986035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:16.995137 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-58fd6ed6-277b-4ffb-b534-831838701158 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.220702 May 19 09:25:16.995748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5513/6838] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:16 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:18.014370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:18.015094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:18.025154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:18.026888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:18.028472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:18.029598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:18.205088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:18.214750 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f315fd4c-bd63-4cd1-8d52-5f8b871e1bf8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.204465 May 19 09:25:18.215389 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5514/6839] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:18 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:19.238440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:19.239205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:19.248345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:19.248962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:19.249902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:19.250419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:19.461595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:19.470556 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e8d0175-c97b-4946-b71e-8332dc649c21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.236215 May 19 09:25:19.471214 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5515/6840] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:19 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:25:20.494267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:20.495349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:20.517078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:20.517885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:20.519174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:20.519784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:20.736482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:20.747356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea85383e-7004-40f8-ad15-4f4d1a60d33b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.260523 May 19 09:25:20.747981 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5516/6841] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:20 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:21.775719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:21.776563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:21.784474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:21.785075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:21.787235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:21.787823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:21.974596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:21.986686 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-65102048-114a-4267-a8c3-d3d7b7e916b1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.215214 May 19 09:25:21.987317 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5517/6842] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:21 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:23.004764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:23.006600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:23.027064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:23.027708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:23.028918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:23.029650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:23.216303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:23.226505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a958213d-4ced-487c-9177-78eb543628b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1677 microversion: 2.1 time: 0.225965 May 19 09:25:23.227135 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5518/6843] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:22 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:24.246441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:24.247331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:24.255754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:24.256606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:24.257615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:24.258226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:24.281454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:25:24.453902 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:24.463300 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c5973984-c0eb-43a3-8aac-bcf0376826d5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1680 microversion: 2.1 time: 0.221739 May 19 09:25:24.463927 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5519/6844] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:24 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:25:48.699783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:25:48.701520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:48.705016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=32 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:25:48.706058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:25:48.717695 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:48.718548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:48.720063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:48.720857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:48.806486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5429011a-19b9-416b-aab1-29b7351aee21 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff/action" status: 200 len: 67135 microversion: 2.1 time: 0.114967 May 19 09:25:48.807505 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5520/6845] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:25:48 2022] POST /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff/action => generated 67135 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:25:56.494746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:56.495991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:56.511628 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:56.512608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:56.514257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:56.515090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:56.572910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:25:56.701207 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d3771c9-d91c-4d01-85b7-f099f6fcfd94 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 204 len: 0 microversion: 2.1 time: 0.213822 May 19 09:25:56.702940 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5521/6846] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:25:56 2022] DELETE /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:25:56.714032 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c8ec2b40-8ca2-49e4-a2ae-6045140f5a57 req-1ce34da1-4f79-4cd6-ab90-25372882b13a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d19ca0d-ecc6-4e9c-8b33-9cf00862afff", "tag": "6071f894-8a79-4dfc-bd73-7028e26d1718"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:25:56.734577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c8ec2b40-8ca2-49e4-a2ae-6045140f5a57 req-1ce34da1-4f79-4cd6-ab90-25372882b13a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:56.735438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c8ec2b40-8ca2-49e4-a2ae-6045140f5a57 req-1ce34da1-4f79-4cd6-ab90-25372882b13a service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:56.760189 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c8ec2b40-8ca2-49e4-a2ae-6045140f5a57 req-1ce34da1-4f79-4cd6-ab90-25372882b13a service nova] Creating event network-changed:6071f894-8a79-4dfc-bd73-7028e26d1718 for instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff on chh1-842464-2 May 19 09:25:56.770516 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c8ec2b40-8ca2-49e4-a2ae-6045140f5a57 req-1ce34da1-4f79-4cd6-ab90-25372882b13a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064574 May 19 09:25:56.771895 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5522/6847] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:25:56.781898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:56.783524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:56.802013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:56.802667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:56.804167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:56.804991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:57.036013 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:57.045529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c7416842-f37e-49f7-9bcf-493783f023ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1686 microversion: 2.1 time: 0.271993 May 19 09:25:57.046158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5523/6848] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:56 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1686 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:25:58.065286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:58.066280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:58.074154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:58.074639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:58.075478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:58.075949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:58.727008 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:25:58.746731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-326739d4-5ec1-438e-aa74-6c2bf0d11925 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 200 len: 1686 microversion: 2.1 time: 0.685395 May 19 09:25:58.747934 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5524/6849] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:58 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 1686 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:25:58.858224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4c546c56-0706-4576-aa78-bdda3d2b4193 req-d9f39806-03d7-4e13-b31d-cd47b6b6efa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d19ca0d-ecc6-4e9c-8b33-9cf00862afff", "name": "network-vif-deleted", "tag": "6071f894-8a79-4dfc-bd73-7028e26d1718"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:25:58.868553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4c546c56-0706-4576-aa78-bdda3d2b4193 req-d9f39806-03d7-4e13-b31d-cd47b6b6efa0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:58.869067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4c546c56-0706-4576-aa78-bdda3d2b4193 req-d9f39806-03d7-4e13-b31d-cd47b6b6efa0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:58.885928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4c546c56-0706-4576-aa78-bdda3d2b4193 req-d9f39806-03d7-4e13-b31d-cd47b6b6efa0 service nova] Creating event network-vif-deleted:6071f894-8a79-4dfc-bd73-7028e26d1718 for instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff on chh1-842464-2 May 19 09:25:58.892126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4c546c56-0706-4576-aa78-bdda3d2b4193 req-d9f39806-03d7-4e13-b31d-cd47b6b6efa0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039483 May 19 09:25:58.893210 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5525/6850] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:25:59.772947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:25:59.774004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:25:59.781218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:59.781724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:59.782557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:25:59.783026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:25:59.800829 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] HTTP exception thrown: Instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff could not be found. May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Request method failure captured: May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff HTTP/1.1 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgx1UZVv1qp1J03tkdAlVHhQ8Hd6ER5mjT9UpeQyvGw34gvpVN6kXD58v4acOTFO9_ifZh47Jt2efgOAEtoE68wk-WcZCpbSQ2P3u0zdNF_MZ9JjHYCnz6X7YIUWMszLkXoO1OiftbvZh2NgGztFrwcrbODlXqWMSjuH5X1zcI_I824 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca75f10643384d57baccbceca3b6892f May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff could not be found. May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '8d19ca0d-ecc6-4e9c-8b33-9cf00862afff'} May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff could not be found. May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff could not be found. May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:25:59.804626 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff could not be found. May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Returning 404 to user: Instance 8d19ca0d-ecc6-4e9c-8b33-9cf00862afff could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a4d735f-baaf-45a5-8d71-b916786b4ca3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff" status: 404 len: 111 microversion: 2.1 time: 0.041010 May 19 09:25:59.815461 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5526/6851] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:25:59 2022] GET /compute/v2.1/servers/8d19ca0d-ecc6-4e9c-8b33-9cf00862afff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:26:04.661685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-26dac66d-979b-46be-9aa9-6e72320dfac0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '.version_select at 0x7f32102043a0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:04.687754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-26dac66d-979b-46be-9aa9-6e72320dfac0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1148819430" status: 202 len: 0 microversion: 2.1 time: 0.034417 May 19 09:26:04.688511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5527/6852] 10.222.0.78 () {58 vars in 1283 bytes} [Thu May 19 09:26:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1148819430 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:26:04.723706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f869a068-0b5b-4a60-a5b5-b58324edf814 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: .version_select at 0x7f32104f5a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-221166110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeny4ucOQdN8ofunET1ZX53jJk06wykQjl7DXS9j4wIwD5Zybcqn2oQLm/E/xwNBssdAUHDeXVojgDUC+rqcRnobb7vxex3R7YmY9KyybHml+GVw/estqZBmCAMvWVCCA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:04.741979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f869a068-0b5b-4a60-a5b5-b58324edf814 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:26:04.749879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-f869a068-0b5b-4a60-a5b5-b58324edf814 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:26:04.782418 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f869a068-0b5b-4a60-a5b5-b58324edf814 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.063145 May 19 09:26:04.783309 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5528/6853] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:26:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:26:12.903521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:26:12.912380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-546218504", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "a42c405a-6dd9-4602-be93-b74bb2efec31"}], "key_name": "tempest-TestNetworkAdvancedServerOps-221166110", "security_groups": [{"name": "tempest-secgroup-smoke-1570929565"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:13.153447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] validate_networks() for [('a42c405a-6dd9-4602-be93-b74bb2efec31', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:26:13.944308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:26:13.945425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:26:13.945977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:26:13.946722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:26:13.947474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:26:13.964295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:13.965079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:13.966427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:13.967183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:13.999725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:26:14.006756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:26:14.023420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:26:14.025964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:26:14.079272 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-548d5558-3ab9-49a3-8f19-7e9e81b55263 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.179197 May 19 09:26:14.079853 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5529/6854] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:26:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:26:14.103678 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5adbba58-2a29-435a-b576-224e1381ed4a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:14.104346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5adbba58-2a29-435a-b576-224e1381ed4a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:14.180450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5adbba58-2a29-435a-b576-224e1381ed4a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:14.191414 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5adbba58-2a29-435a-b576-224e1381ed4a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1265 microversion: 2.1 time: 0.097597 May 19 09:26:14.193936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5530/6855] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:14 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:26:15.216515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:15.217972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:15.229503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:15.230584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:15.231669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:15.232350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:15.371016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:15.385400 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a74648c-8460-4d6f-a929-53be36e7b8c6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1317 microversion: 2.1 time: 0.172992 May 19 09:26:15.386502 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5531/6856] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:15 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:16.409212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:16.410575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:16.448296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:16.449653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:16.451531 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:16.452302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:16.582320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:16.602787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a35a8e25-b2f4-48b6-8365-f14de969f2bf tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1323 microversion: 2.1 time: 0.200382 May 19 09:26:16.604400 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5532/6857] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:16 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1323 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:17.631883 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:17.633530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:17.655342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:17.656804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:17.658527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:17.659750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:17.993099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:18.013493 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0219fede-d6d2-40bf-9510-8e6bc1f8a29c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.390407 May 19 09:26:18.015027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5533/6858] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:17 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:26:18.215278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-7ee0450b-953f-48d9-ad30-042b5650d75e req-5e859869-6565-4010-a843-6234560aa738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:18.228826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7ee0450b-953f-48d9-ad30-042b5650d75e req-5e859869-6565-4010-a843-6234560aa738 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:18.229522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-7ee0450b-953f-48d9-ad30-042b5650d75e req-5e859869-6565-4010-a843-6234560aa738 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:18.244428 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-7ee0450b-953f-48d9-ad30-042b5650d75e req-5e859869-6565-4010-a843-6234560aa738 service nova] Creating event network-changed:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh2-842464-2 May 19 09:26:18.251939 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-7ee0450b-953f-48d9-ad30-042b5650d75e req-5e859869-6565-4010-a843-6234560aa738 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227372 May 19 09:26:18.253543 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5534/6859] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:26:19.049565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:19.050271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:19.054700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:26:19.064567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:19.065533 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:19.067670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:19.068499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:19.262374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:19.272456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-50edda4c-9de4-4b60-a36d-db773500eeda tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.227975 May 19 09:26:19.273469 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5535/6860] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:19 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:20.295500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:20.296450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:20.306182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:20.306542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:20.307363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:20.307816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:20.611658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:20.621072 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-82409d71-e140-4adf-8961-e7ece3175eee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.329633 May 19 09:26:20.621741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5536/6861] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:20 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:21.640685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:21.641471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:21.649597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:21.650059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:21.650862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:21.651307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:21.808030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:21.818323 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e878cce3-3664-4005-a3ab-9c72cffc3132 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.181713 May 19 09:26:21.819039 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5537/6862] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:21 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:22.838867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:22.840281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:22.850066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:22.850541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:22.851365 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:22.851820 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:23.026304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:23.034850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27ede691-b2fa-4c1e-b291-44f8636e3b87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.202812 May 19 09:26:23.035920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5538/6863] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:22 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:24.063249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:24.064023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:24.067014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:26:24.073613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:24.074221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:24.074932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:24.075384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:24.197165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:26:24.272430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:24.286484 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1cc846f8-0237-4a8e-82ed-484fe1ca1567 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.226935 May 19 09:26:24.287463 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5539/6864] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:24 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:24.843364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3fde955c-719c-4f2b-b0ce-ff93519fc756 req-23d35a65-9e92-45c4-b890-23f5ba88acd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "name": "network-vif-plugged", "status": "completed", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:24.856410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3fde955c-719c-4f2b-b0ce-ff93519fc756 req-23d35a65-9e92-45c4-b890-23f5ba88acd9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:24.856879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3fde955c-719c-4f2b-b0ce-ff93519fc756 req-23d35a65-9e92-45c4-b890-23f5ba88acd9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:24.874452 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3fde955c-719c-4f2b-b0ce-ff93519fc756 req-23d35a65-9e92-45c4-b890-23f5ba88acd9 service nova] Creating event network-vif-plugged:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh2-842464-2 May 19 09:26:24.885574 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3fde955c-719c-4f2b-b0ce-ff93519fc756 req-23d35a65-9e92-45c4-b890-23f5ba88acd9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133002 May 19 09:26:24.886675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5540/6865] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:26:25.309992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:25.311077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:25.318904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:25.319373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:25.320282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:25.320784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:25.518402 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:25.528305 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f256ff40-b100-4444-9ef8-dd5db910cb14 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1391 microversion: 2.1 time: 0.223435 May 19 09:26:25.528946 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5541/6866] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:25 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:26.548409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:26.549425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:26.558233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:26.558702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:26.559513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:26.559970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:26.736298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:26.747032 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-96986c7e-88c5-4665-a91d-64e1447e77d0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1563 microversion: 2.1 time: 0.204056 May 19 09:26:26.747724 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5542/6867] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:26 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1563 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:26.767006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:26.767650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:26.774551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:26.775028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:26.776009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:26.776623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:26.948777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:26.958241 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69cdabc3-339a-4b3f-aa25-5f38307e4208 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1563 microversion: 2.1 time: 0.194846 May 19 09:26:26.958894 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5543/6868] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:26 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:26:29.368180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:29.371792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:29.386174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:29.387563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:29.388672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:29.389612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:29.627423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:29.637577 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed9e97c2-842f-4770-bb35-99c32a77c97d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1563 microversion: 2.1 time: 0.278581 May 19 09:26:29.638332 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5544/6869] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:29 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1563 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:26:29.643553 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-8957c284-53f1-42bc-8491-2f2eca613666 req-f29fa097-e47f-440e-9f90-6d0349ebc5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:29.655449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8957c284-53f1-42bc-8491-2f2eca613666 req-f29fa097-e47f-440e-9f90-6d0349ebc5f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:29.668263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-8957c284-53f1-42bc-8491-2f2eca613666 req-f29fa097-e47f-440e-9f90-6d0349ebc5f3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:29.685441 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-8957c284-53f1-42bc-8491-2f2eca613666 req-f29fa097-e47f-440e-9f90-6d0349ebc5f3 service nova] Creating event network-changed:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh2-842464-2 May 19 09:26:29.691946 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-8957c284-53f1-42bc-8491-2f2eca613666 req-f29fa097-e47f-440e-9f90-6d0349ebc5f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052173 May 19 09:26:29.692717 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5545/6870] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:26:47.401274 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:26:47.402236 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:26:52.036806 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=21 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:26:52.037632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=80 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:26:52.042749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:52.043957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:52.053381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:52.053994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:52.054648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:52.055104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:52.128614 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a734c7b3-de99-4e9e-9ba9-9fec899c49c5 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action" status: 200 len: 24574 microversion: 2.1 time: 0.094187 May 19 09:26:52.129749 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5546/6871] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:26:52 2022] POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action => generated 24574 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:26:58.572011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:26:58.573166 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:58.584128 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:58.584603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:58.585586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:58.586257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:58.652972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:58.666275 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Old instance type m1.heat2, new instance type m1.heat {{(pid=119072) resize /opt/stack/nova/nova/compute/api.py:4166}} May 19 09:26:58.680061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:26:58.680839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:26:58.681790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:26:58.682521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:26:58.683423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:26:58.792378 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a603e5be-ee62-4396-ab30-e9dbfec6f6d2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action" status: 202 len: 0 microversion: 2.1 time: 0.225886 May 19 09:26:58.794098 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5547/6872] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:26:58 2022] POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:26:58.811602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:26:58.813042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:26:58.827548 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:58.828377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:58.829932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:26:58.831149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:26:59.202172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:26:59.219762 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-648e47bc-cf8f-429a-b247-723d1fa811e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1691 microversion: 2.1 time: 0.416137 May 19 09:26:59.221500 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5548/6873] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:26:58 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1691 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:27:00.240959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:00.242152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:00.251305 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:00.251905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:00.253258 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:00.254110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:00.476787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:00.491274 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ecbe417d-5409-4e7e-a5e0-7de3ca908699 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1691 microversion: 2.1 time: 0.254397 May 19 09:27:00.492372 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5549/6874] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:00 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1691 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:01.513341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:01.514420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:01.525396 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:01.526212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:01.527240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:01.527946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:01.724268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:01.733044 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10d4a811-af62-41af-afdc-8c0519cfcf00 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.225060 May 19 09:27:01.733701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5550/6875] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:01 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:02.752750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:02.754174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:02.762969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:02.763481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:02.764547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:02.765099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:02.947470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:02.958288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-abebfaf9-b8c2-4e6d-9d91-0f6f69b4f2b8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.209584 May 19 09:27:02.959150 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5551/6876] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:02 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:03.977200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:03.978000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:03.985979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:03.986450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:03.987875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:03.988342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:04.149787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:04.158734 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa90e7b6-525f-4ffc-a6a4-e3aa83591049 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.185775 May 19 09:27:04.160365 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5552/6877] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:03 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:05.179105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:05.179858 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:05.187685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:05.188230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:05.189040 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:05.189537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:05.385075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:05.395469 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e2b02ca6-9d06-4b29-b08b-2ead3fb1576d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.221398 May 19 09:27:05.396128 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5553/6878] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:05 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:06.339772 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:27:06.340375 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:27:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:27:06.416019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:06.416880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:06.428403 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:06.429209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:06.430760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:06.431606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:06.617265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:06.630087 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d7eff4ce-a9ea-434d-93be-6aab590d7d03 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.219280 May 19 09:27:06.630908 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5554/6879] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:06 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:07.649957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:07.650624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:07.658595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:07.659932 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:07.661479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:07.661949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:07.856346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:07.865597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d413a6f-2ac3-44f2-abbe-ece1d04d8c64 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.219614 May 19 09:27:07.866239 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5555/6880] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:07 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:08.893066 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:08.894785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:08.907221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:08.907976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:08.909163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:08.909982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:09.132693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:09.141481 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aaabded6-5b5f-4fc6-bb5e-1b161431c5e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.252722 May 19 09:27:09.142308 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5556/6881] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:08 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:10.161969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:10.163079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:10.171371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:10.171956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:10.172977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:10.176360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:10.371982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:10.382620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fda45828-f73e-4441-9e13-77990ce1133a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.225630 May 19 09:27:10.383259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5557/6882] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:10 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:11.405433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:11.406564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:11.420367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:11.421159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:11.422627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:11.423670 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:11.611081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:11.621457 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6731ccc9-0177-4e40-a196-3c27e009ddaa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.223255 May 19 09:27:11.622306 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5558/6883] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:11 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:12.639462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:12.640430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:12.649602 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:12.650497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:12.652069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:12.652947 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:12.852973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:12.862719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e32e14f0-077f-4c2b-a5d1-e01509b94eea tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1696 microversion: 2.1 time: 0.226621 May 19 09:27:12.863336 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5559/6884] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:12 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:13.881564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:13.882656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:13.890590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:13.891182 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:13.892172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:13.892567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:14.269805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:14.278570 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1acfea66-19f2-4d87-ba92-97e7adca3ad1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1695 microversion: 2.1 time: 0.402107 May 19 09:27:14.279187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5560/6885] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:13 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1695 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:14.714494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c6bd490f-7989-4739-8710-eae05bc5f412 req-2a2b5ba8-d39b-4aad-bd3b-d0d9115f6ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "name": "network-vif-unplugged", "status": "completed", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:14.725919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c6bd490f-7989-4739-8710-eae05bc5f412 req-2a2b5ba8-d39b-4aad-bd3b-d0d9115f6ad0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:14.726665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c6bd490f-7989-4739-8710-eae05bc5f412 req-2a2b5ba8-d39b-4aad-bd3b-d0d9115f6ad0 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:14.745698 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c6bd490f-7989-4739-8710-eae05bc5f412 req-2a2b5ba8-d39b-4aad-bd3b-d0d9115f6ad0 service nova] Creating event network-vif-unplugged:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh1-842464-2 May 19 09:27:14.749607 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:27:14.755239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-c6bd490f-7989-4739-8710-eae05bc5f412 req-2a2b5ba8-d39b-4aad-bd3b-d0d9115f6ad0 service nova] Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:27:14.769813 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c6bd490f-7989-4739-8710-eae05bc5f412 req-2a2b5ba8-d39b-4aad-bd3b-d0d9115f6ad0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060340 May 19 09:27:14.770356 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5561/6886] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:27:15.301808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:15.302926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:15.313538 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:15.314015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:15.314906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:15.316529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:15.608746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:15.619417 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6be4a67e-ba36-479c-bf5b-f525bda560e3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1695 microversion: 2.1 time: 0.325623 May 19 09:27:15.620028 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5562/6887] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:15 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1695 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:16.651608 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:16.652693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:16.666431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:16.667457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:16.669368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:16.670222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:16.905203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:16.917736 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0fcb01cc-84c7-4b59-8039-d8771e46371e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1693 microversion: 2.1 time: 0.271056 May 19 09:27:16.917736 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5563/6888] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:16 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1693 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:27:16.920009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-dc008123-4766-4869-bb81-e7956aa0a6e3 req-1ae0d537-3222-4990-bc75-74f9007e9f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:16.931764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc008123-4766-4869-bb81-e7956aa0a6e3 req-1ae0d537-3222-4990-bc75-74f9007e9f4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:16.932440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-dc008123-4766-4869-bb81-e7956aa0a6e3 req-1ae0d537-3222-4990-bc75-74f9007e9f4e service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:16.952509 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-dc008123-4766-4869-bb81-e7956aa0a6e3 req-1ae0d537-3222-4990-bc75-74f9007e9f4e service nova] Creating event network-changed:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh1-842464-2 May 19 09:27:16.960154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [req-dc008123-4766-4869-bb81-e7956aa0a6e3 req-1ae0d537-3222-4990-bc75-74f9007e9f4e service nova] Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 is migrating within the same cell, copying events to all relevant hosts: {'chh1-842464-2', 'chh2-842464-2'} {{(pid=119072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 19 09:27:16.973298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-dc008123-4766-4869-bb81-e7956aa0a6e3 req-1ae0d537-3222-4990-bc75-74f9007e9f4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057035 May 19 09:27:16.974181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5564/6889] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:27:17.942741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:17.943703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:17.950771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:17.951228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:17.952036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:17.952494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:18.336813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:18.349956 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8d7b2315-b0f2-4e51-8a7d-89954a8888d1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1693 microversion: 2.1 time: 0.412898 May 19 09:27:18.350589 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5565/6890] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:17 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1693 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:19.374979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:19.376020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:19.390407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:19.390777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:19.392210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:19.393003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:19.598951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:19.608602 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c98f1478-dea2-4089-8124-dc9526e451b0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1690 microversion: 2.1 time: 0.241825 May 19 09:27:19.609209 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5566/6891] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:19 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:27:19.630614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:19.631089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:19.638102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:19.638574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:19.639505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:19.639964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:19.751345 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04486630-0d10-4506-8607-3e8f5854af59 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action" status: 204 len: 0 microversion: 2.1 time: 0.125412 May 19 09:27:19.753416 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5567/6892] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:27:19 2022] POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:27:19.772241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:19.773228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:19.789756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:19.790414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:19.791500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:19.792089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:20.071938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:20.082202 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3e4dac73-f5dc-424c-802f-c1c819b665ae tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1690 microversion: 2.1 time: 0.320451 May 19 09:27:20.082831 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5568/6893] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:19 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:27:20.100739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:20.101521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:20.108534 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:20.109041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:20.109972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:20.110444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:20.459582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:20.478029 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4849449c-0014-48bb-8dd6-143a1d89ec2f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1690 microversion: 2.1 time: 0.381686 May 19 09:27:20.478692 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5569/6894] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:20 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1690 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:21.410606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-14fd41b2-da85-4c2e-9005-32af21a037dd req-4eccc919-87d2-43f1-a662-469e441f4dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "name": "network-vif-plugged", "status": "completed", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:21.426065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-14fd41b2-da85-4c2e-9005-32af21a037dd req-4eccc919-87d2-43f1-a662-469e441f4dab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:21.426900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-14fd41b2-da85-4c2e-9005-32af21a037dd req-4eccc919-87d2-43f1-a662-469e441f4dab service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:21.443998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-14fd41b2-da85-4c2e-9005-32af21a037dd req-4eccc919-87d2-43f1-a662-469e441f4dab service nova] Creating event network-vif-plugged:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh1-842464-2 May 19 09:27:21.450637 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-14fd41b2-da85-4c2e-9005-32af21a037dd req-4eccc919-87d2-43f1-a662-469e441f4dab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045846 May 19 09:27:21.451277 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5570/6895] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:27:21.517359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:21.520980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:21.529849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:21.530460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:21.531357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:21.531878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:21.750713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:21.759868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4ee43933-1ba6-4c41-86ad-8b2323194602 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1682 microversion: 2.1 time: 0.261908 May 19 09:27:21.760480 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5571/6896] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:21 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:27:41.999346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:42.001520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:42.007637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=56 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:27:42.009912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:27:42.023998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:42.024873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:42.026454 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:42.027346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:42.112428 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fe1ccdf4-58b1-4378-b750-1d7e8066b440 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action" status: 200 len: 24579 microversion: 2.1 time: 0.120811 May 19 09:27:42.113526 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5572/6897] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:27:41 2022] POST /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06/action => generated 24579 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:27:49.499959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:49.501333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:49.517269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:49.518881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:49.520653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:49.521586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:49.579746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:27:49.722494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aad37d5c-15a0-4534-ba57-542ace89b204 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 204 len: 0 microversion: 2.1 time: 0.231307 May 19 09:27:49.723431 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5573/6898] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:27:49 2022] DELETE /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:27:49.733010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-85f2aa62-e250-4270-830a-aa27a304b9c1 req-53ee9218-afbe-4d6e-8277-9552b20ef292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:49.750508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-85f2aa62-e250-4270-830a-aa27a304b9c1 req-53ee9218-afbe-4d6e-8277-9552b20ef292 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:49.751355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-85f2aa62-e250-4270-830a-aa27a304b9c1 req-53ee9218-afbe-4d6e-8277-9552b20ef292 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:49.771706 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-85f2aa62-e250-4270-830a-aa27a304b9c1 req-53ee9218-afbe-4d6e-8277-9552b20ef292 service nova] Creating event network-changed:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh1-842464-2 May 19 09:27:49.777624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-85f2aa62-e250-4270-830a-aa27a304b9c1 req-53ee9218-afbe-4d6e-8277-9552b20ef292 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052100 May 19 09:27:49.778424 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5574/6899] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:27:49.785550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:49.786293 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:49.794380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:49.794849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:49.795673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:49.796130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:50.029953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:50.044868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a437d86a-027e-4d45-a570-9d41d6523dee tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1688 microversion: 2.1 time: 0.264683 May 19 09:27:50.045909 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5575/6900] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:49 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1688 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:27:51.077570 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:51.078912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:51.092261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:51.092886 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:51.094545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:51.095436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:51.407104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:27:51.422295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4f1d7b34-ba2b-42dc-b4ab-a7c29b84546f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 200 len: 1688 microversion: 2.1 time: 0.351931 May 19 09:27:51.423741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5576/6901] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:51 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 1688 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:27:51.713717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1e1aa5b9-14e0-4472-8944-f41ef69e20b6 req-f65d2e08-971a-4c23-8e1f-a149b5e4cbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6575b2-93bc-4d48-bbf1-6de4bbce1c06", "name": "network-vif-deleted", "tag": "105f7ccb-f7c5-4380-bdd2-85d5e1650042"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:51.728373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e1aa5b9-14e0-4472-8944-f41ef69e20b6 req-f65d2e08-971a-4c23-8e1f-a149b5e4cbba service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:51.728847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e1aa5b9-14e0-4472-8944-f41ef69e20b6 req-f65d2e08-971a-4c23-8e1f-a149b5e4cbba service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:51.744303 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1e1aa5b9-14e0-4472-8944-f41ef69e20b6 req-f65d2e08-971a-4c23-8e1f-a149b5e4cbba service nova] Creating event network-vif-deleted:105f7ccb-f7c5-4380-bdd2-85d5e1650042 for instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 on chh1-842464-2 May 19 09:27:51.753754 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1e1aa5b9-14e0-4472-8944-f41ef69e20b6 req-f65d2e08-971a-4c23-8e1f-a149b5e4cbba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044367 May 19 09:27:51.755291 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5577/6902] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:27:52.445362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:52.446244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:27:52.453837 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:52.454251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:52.455724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:27:52.456234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:27:52.474389 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] HTTP exception thrown: Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 could not be found. May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Request method failure captured: May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 HTTP/1.1 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgx1UZVv1qp1J03tkdAlVHhQ8Hd6ER5mjT9UpeQyvGw34gvpVN6kXD58v4acOTFO9_ifZh47Jt2efgOAEtoE68wk-WcZCpbSQ2P3u0zdNF_MZ9JjHYCnz6X7YIUWMszLkXoO1OiftbvZh2NgGztFrwcrbODlXqWMSjuH5X1zcI_I824 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca75f10643384d57baccbceca3b6892f May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 could not be found. May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '7c6575b2-93bc-4d48-bbf1-6de4bbce1c06'} May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 could not be found. May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 could not be found. May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:27:52.476091 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 could not be found. May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Returning 404 to user: Instance 7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-497e3ad1-5b10-402c-9cfb-0b61589f97e6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06" status: 404 len: 111 microversion: 2.1 time: 0.039563 May 19 09:27:52.485936 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5578/6903] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:27:52 2022] GET /compute/v2.1/servers/7c6575b2-93bc-4d48-bbf1-6de4bbce1c06 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:27:57.575697 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04b7e06d-e2e4-4ce3-9266-6e980c93f8ca tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '.version_select at 0x7f32103358b0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:27:57.610636 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04b7e06d-e2e4-4ce3-9266-6e980c93f8ca tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-221166110" status: 202 len: 0 microversion: 2.1 time: 0.040327 May 19 09:27:57.611385 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5579/6904] 10.222.0.78 () {58 vars in 1280 bytes} [Thu May 19 09:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-221166110 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:27:57.649937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3561c9c4-321a-4a82-9cf7-6ac439fd6c4d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: .version_select at 0x7f321030bca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2050011534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOESCEAWWJUv2d+oHmbdvYoOY8pB6Vi3Kqcb0LPEzC0Yhjz+Ss2QTzxp/lPCE0RDHVBCEM2A6AUIXEF14H3whi7V/lZ6ND73Xz/iyYG3sn8UzlvWw/Ldw28bvKfhIgMpiQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:27:57.679722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3561c9c4-321a-4a82-9cf7-6ac439fd6c4d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:27:57.691217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3561c9c4-321a-4a82-9cf7-6ac439fd6c4d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:27:57.733185 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3561c9c4-321a-4a82-9cf7-6ac439fd6c4d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.091171 May 19 09:27:57.733952 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5580/6905] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:27:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:28:06.044852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:06.152860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-692766725", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "36e4bf21-47c9-4cdb-a9c7-2b1ff5b753f3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2050011534", "security_groups": [{"name": "tempest-secgroup-smoke-902528534"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:28:06.357262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] validate_networks() for [('36e4bf21-47c9-4cdb-a9c7-2b1ff5b753f3', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:28:07.013244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:28:07.014564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:28:07.015519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:28:07.016307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:28:07.017065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:28:07.038569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:07.039428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:07.041046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:07.041912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:07.079598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:28:07.091780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:28:07.121328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:28:07.126174 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:28:07.207094 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b8bec42-c523-49ed-8128-a980207a819e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.162837 May 19 09:28:07.209181 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5581/6906] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:28:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:28:07.224035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f12ab21-bdf6-4525-8796-80dfe1f2d14c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:07.225221 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f12ab21-bdf6-4525-8796-80dfe1f2d14c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:07.349014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f12ab21-bdf6-4525-8796-80dfe1f2d14c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:07.370312 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f12ab21-bdf6-4525-8796-80dfe1f2d14c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1266 microversion: 2.1 time: 0.153365 May 19 09:28:07.372434 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5582/6907] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:07 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:08.399458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:08.400499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:08.410377 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:08.410913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:08.411934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:08.412466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:08.511935 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:08.523419 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-303bcc3c-73e6-4be7-b34f-177bed5b36a9 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1318 microversion: 2.1 time: 0.128687 May 19 09:28:08.524037 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5583/6908] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:08 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1318 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:09.548112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:09.550462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:09.562232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:09.562914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:09.564070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:09.565336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:09.688550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:09.705667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-31bacc3c-7664-41e5-a16f-c3a8a4f5d42a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1324 microversion: 2.1 time: 0.163097 May 19 09:28:09.706944 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5584/6909] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:09 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1324 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:10.737070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:10.738236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:10.773633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:10.774508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:10.776667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:10.777857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:11.126045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:11.136336 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c0e994f-860a-4efc-9093-04fce6c012fa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.405880 May 19 09:28:11.136945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5585/6910] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:10 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:28:11.236637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-81a7429c-9858-4fff-a2db-1703096b0a7e req-32800549-e16a-4efa-822e-a4569667975b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66983afb-2475-42ed-a41a-e2fb92759da9", "tag": "4929de38-6aff-487f-9d57-9539e56cf19c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:28:11.253936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-81a7429c-9858-4fff-a2db-1703096b0a7e req-32800549-e16a-4efa-822e-a4569667975b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:11.260617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-81a7429c-9858-4fff-a2db-1703096b0a7e req-32800549-e16a-4efa-822e-a4569667975b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:11.280037 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-81a7429c-9858-4fff-a2db-1703096b0a7e req-32800549-e16a-4efa-822e-a4569667975b service nova] Creating event network-changed:4929de38-6aff-487f-9d57-9539e56cf19c for instance 66983afb-2475-42ed-a41a-e2fb92759da9 on chh2-842464-2 May 19 09:28:11.294666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-81a7429c-9858-4fff-a2db-1703096b0a7e req-32800549-e16a-4efa-822e-a4569667975b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062602 May 19 09:28:11.296126 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5586/6911] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:28:12.156445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:12.157279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:12.159691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:12.166331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:12.166795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:12.167611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:12.168068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:12.348405 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:12.357138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dfda3f41-468e-4c28-8fb5-4cd2bb905690 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.206118 May 19 09:28:12.357788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5587/6912] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:12 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:13.376256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:13.378930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:13.386850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:13.387428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:13.388301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:13.388824 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:13.587231 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:13.597428 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-08b2507f-c79c-4098-b7f7-1c21acd45788 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.225653 May 19 09:28:13.598051 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5588/6913] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:13 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:28:14.625512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:14.626679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:14.634393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:14.634868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:14.635682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:14.636149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:14.865580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:14.878579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1a759664-e13f-4eae-a91c-fd6cb658e716 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.256789 May 19 09:28:14.879321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5589/6914] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:14 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:15.898301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:15.899102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:15.907241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:15.908948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:15.910219 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:15.910912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:16.106721 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:16.116079 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-996373d9-5ac0-4bc1-a332-dc79b514092a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.223444 May 19 09:28:16.116715 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5590/6915] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:15 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:17.135909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:17.137044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:17.140732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:17.150250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:17.150980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:17.151931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:17.152459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:17.344798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:17.353361 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-06467696-05c7-4a6a-ab4f-a0cf2ed3bed1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.221603 May 19 09:28:17.354011 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5591/6916] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:17 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:28:17.359635 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-51298aca-5a7f-4fba-b685-c151a2f3ae62 req-8e0c3550-8ea7-413d-9092-d46483c663cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66983afb-2475-42ed-a41a-e2fb92759da9", "name": "network-vif-plugged", "status": "completed", "tag": "4929de38-6aff-487f-9d57-9539e56cf19c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:28:17.364002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:17.371926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51298aca-5a7f-4fba-b685-c151a2f3ae62 req-8e0c3550-8ea7-413d-9092-d46483c663cb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:17.372391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-51298aca-5a7f-4fba-b685-c151a2f3ae62 req-8e0c3550-8ea7-413d-9092-d46483c663cb service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:17.387343 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-51298aca-5a7f-4fba-b685-c151a2f3ae62 req-8e0c3550-8ea7-413d-9092-d46483c663cb service nova] Creating event network-vif-plugged:4929de38-6aff-487f-9d57-9539e56cf19c for instance 66983afb-2475-42ed-a41a-e2fb92759da9 on chh2-842464-2 May 19 09:28:17.393820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-51298aca-5a7f-4fba-b685-c151a2f3ae62 req-8e0c3550-8ea7-413d-9092-d46483c663cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038453 May 19 09:28:17.394459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5592/6917] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:28:18.374683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:18.375838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:18.383629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:18.384102 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:18.384929 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:18.385426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:18.581866 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:18.592505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eba8024b-0133-4f6e-928a-dfe370bab031 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1391 microversion: 2.1 time: 0.223678 May 19 09:28:18.593131 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5593/6918] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:18 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:19.617601 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:19.618792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:19.632045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:19.632868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:19.634325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:19.635144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:19.855668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:19.866142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c88a4c50-83d1-41b6-9abf-5622d460c00e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1563 microversion: 2.1 time: 0.257335 May 19 09:28:19.866765 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5594/6919] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:19 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1563 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:19.884801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:19.885368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:19.893193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:19.893710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:19.895220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:19.895773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:20.066912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:20.076298 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6b4c6bd-1829-41a8-8235-9b10aa8ceda2 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1563 microversion: 2.1 time: 0.195782 May 19 09:28:20.077041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5595/6920] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:19 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1563 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:22.842684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:22.846532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:22.861567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:22.862311 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:22.863778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:22.864594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:23.108676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:23.118622 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cce14004-47dd-46f5-a6ce-a06ea90be890 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1563 microversion: 2.1 time: 0.286232 May 19 09:28:23.119256 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5596/6921] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:22 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1563 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:28:23.137535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-38f5f68e-1b56-4644-8e3c-38f7fc00a13b req-bc56fdca-22c6-4fe0-b4ff-da5672e905c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66983afb-2475-42ed-a41a-e2fb92759da9", "tag": "4929de38-6aff-487f-9d57-9539e56cf19c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:28:23.153575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-38f5f68e-1b56-4644-8e3c-38f7fc00a13b req-bc56fdca-22c6-4fe0-b4ff-da5672e905c2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:23.154309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-38f5f68e-1b56-4644-8e3c-38f7fc00a13b req-bc56fdca-22c6-4fe0-b4ff-da5672e905c2 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:23.174625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-38f5f68e-1b56-4644-8e3c-38f7fc00a13b req-bc56fdca-22c6-4fe0-b4ff-da5672e905c2 service nova] Creating event network-changed:4929de38-6aff-487f-9d57-9539e56cf19c for instance 66983afb-2475-42ed-a41a-e2fb92759da9 on chh2-842464-2 May 19 09:28:23.181140 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-38f5f68e-1b56-4644-8e3c-38f7fc00a13b req-bc56fdca-22c6-4fe0-b4ff-da5672e905c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050909 May 19 09:28:23.182145 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5597/6922] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:28:43.632163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:28:43.634172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:43.637091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=21 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:43.638052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=80 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:43.655669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:43.656208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:43.662797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:43.662797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:43.748401 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2294c053-fa70-46f3-b643-ef49ed4436c1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action" status: 200 len: 24569 microversion: 2.1 time: 0.124665 May 19 09:28:43.749600 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5598/6923] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:28:43 2022] POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action => generated 24569 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 09:28:54.704777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ea3527be-b47f-4835-8bbd-2eeebeff068c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:28:54.709840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:54.711151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:28:54.725640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea3527be-b47f-4835-8bbd-2eeebeff068c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:54.726512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ea3527be-b47f-4835-8bbd-2eeebeff068c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:54.766134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ea3527be-b47f-4835-8bbd-2eeebeff068c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Going to try to stop instance {{(pid=119072) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 09:28:54.824665 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ea3527be-b47f-4835-8bbd-2eeebeff068c tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action" status: 202 len: 0 microversion: 2.1 time: 0.128632 May 19 09:28:54.825970 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5599/6924] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:28:54 2022] POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:28:54.840146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:54.841764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:54.855380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:54.856197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:54.857946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:54.858798 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:55.054519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:55.063632 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b1271f50-4075-40b2-bf07-a1dc152f8258 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.231980 May 19 09:28:55.064330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5600/6925] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:54 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:56.089471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:56.090400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:56.100795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:56.101699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:56.103113 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:56.104000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:56.277859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:56.287561 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f4c91969-69b8-4d72-b23b-046a91845d62 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.202121 May 19 09:28:56.288173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5601/6926] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:56 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:57.311770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:57.312970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:57.328656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:57.329617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:57.331204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:57.332118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:57.512370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:57.523463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5b33d0df-cec7-424b-bbb3-9ee04abc0f9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.219679 May 19 09:28:57.524081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5602/6927] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:57 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:58.542346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:58.543188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:58.551684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:58.552158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:58.553187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:58.553761 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:58.853802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:28:58.868640 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-447df54a-8358-4a63-a412-4180f15ab0ad tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.329968 May 19 09:28:58.869818 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5603/6928] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:58 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:28:59.896434 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:28:59.897582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:28:59.904927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:59.905453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:28:59.906367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:28:59.906818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:00.082083 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:00.091350 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4c77c55-6245-49a6-bf9a-a599bdd64d9d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.199296 May 19 09:29:00.092034 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5604/6929] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:28:59 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:29:01.118479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:01.119485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:01.128629 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:01.129105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:01.129972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:01.130432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:01.347443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:01.358689 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-df4dc86c-2782-48f4-9bbc-a937a98be4fc tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.251824 May 19 09:29:01.359307 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5605/6930] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:01 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:02.380840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:02.381969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:02.389395 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:02.389876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:02.390692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:02.391153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:02.591862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:02.611982 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c27f4d63-5a8b-454c-bcd5-a166ef1c9856 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.235976 May 19 09:29:02.612727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5606/6931] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:02 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:03.633265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:03.634439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:03.643301 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:03.643986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:03.645357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:03.646043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:03.827835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:03.837865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bc2500a3-a261-4db3-8118-b9f85a2a28e0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.208969 May 19 09:29:03.838626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5607/6932] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:03 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:29:04.859957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:04.861687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:04.870564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:04.871183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:04.872115 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:04.872675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:05.105967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:05.116134 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-db7ae6da-4da9-4c9a-8d48-f9d89835701d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.260406 May 19 09:29:05.116763 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5608/6933] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:04 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:06.137963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:06.139007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:06.149738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:06.150580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:06.152081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:06.152912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:06.379952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:06.395211 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ccd4fd8-bb3c-4893-974a-e2e9cf61f3ed tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.263376 May 19 09:29:06.396242 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5609/6934] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:06 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:07.422854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:07.423896 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:07.432327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:07.432801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:07.433903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:07.434370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:07.612756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:07.621282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40efde16-8eab-4872-9635-edfbe0b99b51 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.203193 May 19 09:29:07.621920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5610/6935] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:07 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:08.646259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:08.647654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:08.662030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:08.662839 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:08.664285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:08.665074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:08.878749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:08.895605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e4c51235-f203-442a-a4df-ae91ce826629 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.249448 May 19 09:29:08.896615 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5611/6936] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:08 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:09.925500 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:09.926360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:09.943663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:09.944133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:09.945079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:09.945689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:10.127051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:10.136021 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4077469e-0bfc-4dee-8652-b8778683d0b7 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1691 microversion: 2.1 time: 0.215501 May 19 09:29:10.136639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5612/6937] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:09 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:29:11.167150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:11.168423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:11.181234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:11.182160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:11.183685 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:11.184584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:11.407184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:11.423112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5985b97f-665c-4545-a2fe-75468a40a44f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1668 microversion: 2.1 time: 0.263853 May 19 09:29:11.423841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5613/6938] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:11 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:29:12.544209 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:29:12.545523 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:12.556027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:12.556874 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:12.558455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:12.559309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:12.596031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:29:12.658330 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e34fde7-0898-4a30-a719-4f5a7776f0cb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action" status: 200 len: 38397 microversion: 2.1 time: 0.117931 May 19 09:29:12.659593 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5614/6939] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:29:12 2022] POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action => generated 38397 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:29:12.678190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed96c714-2493-4e9f-872e-3607e0aa4d0f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:29:12.688603 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed96c714-2493-4e9f-872e-3607e0aa4d0f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:12.690469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed96c714-2493-4e9f-872e-3607e0aa4d0f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:12.721812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed96c714-2493-4e9f-872e-3607e0aa4d0f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Going to try to start instance {{(pid=119072) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 09:29:12.780059 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed96c714-2493-4e9f-872e-3607e0aa4d0f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action" status: 202 len: 0 microversion: 2.1 time: 0.107509 May 19 09:29:12.780581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5615/6940] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:29:12 2022] POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:29:12.790801 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:12.791675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:12.804156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:12.804926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:12.805649 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:12.806111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:13.220220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:13.230761 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e87cbf9-38bc-483f-885e-7c9f2fa15edb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1677 microversion: 2.1 time: 0.444517 May 19 09:29:13.231566 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5616/6941] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:12 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1677 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:14.253014 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:14.253816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:14.261591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:14.262109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:14.263021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:14.263480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:14.441035 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:14.450074 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-09965a53-f8c4-4205-83d1-302b206f08e8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1681 microversion: 2.1 time: 0.202268 May 19 09:29:14.450812 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5617/6942] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:14 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:38.686532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:29:38.689025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:38.692864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=38 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:29:38.693889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:29:38.712860 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:38.713710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:38.714720 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:38.715294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:38.804540 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a8225b8c-3fc6-4928-ab26-ff20f5850df1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action" status: 200 len: 62953 microversion: 2.1 time: 0.122397 May 19 09:29:38.805370 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5618/6943] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:29:38 2022] POST /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9/action => generated 62953 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:29:46.601616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:46.602852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:46.620413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:46.620893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:46.621765 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:46.622331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:46.670994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:29:46.845443 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-076d16b9-cbfd-4f4f-b22c-e39d723619f8 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 204 len: 0 microversion: 2.1 time: 0.252577 May 19 09:29:46.846594 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5619/6944] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:29:46 2022] DELETE /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:29:46.857430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-47edadb8-9db0-4eb9-8a91-29a048796bb8 req-1a32f53a-0a6f-47da-bdb3-b893676b162f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66983afb-2475-42ed-a41a-e2fb92759da9", "tag": "4929de38-6aff-487f-9d57-9539e56cf19c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:29:46.875049 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-47edadb8-9db0-4eb9-8a91-29a048796bb8 req-1a32f53a-0a6f-47da-bdb3-b893676b162f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:46.876072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-47edadb8-9db0-4eb9-8a91-29a048796bb8 req-1a32f53a-0a6f-47da-bdb3-b893676b162f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:46.909043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-47edadb8-9db0-4eb9-8a91-29a048796bb8 req-1a32f53a-0a6f-47da-bdb3-b893676b162f service nova] Creating event network-changed:4929de38-6aff-487f-9d57-9539e56cf19c for instance 66983afb-2475-42ed-a41a-e2fb92759da9 on chh2-842464-2 May 19 09:29:46.918744 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-47edadb8-9db0-4eb9-8a91-29a048796bb8 req-1a32f53a-0a6f-47da-bdb3-b893676b162f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069375 May 19 09:29:46.920134 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5620/6945] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:29:46.931354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:46.932766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:46.949568 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:46.950470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:46.952205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:46.953665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:47.186807 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:47.196605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9265878f-a032-412b-bcb3-49e1ebed32f3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1687 microversion: 2.1 time: 0.274921 May 19 09:29:47.197219 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5621/6946] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:46 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1687 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:29:48.224982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:48.227004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:48.238452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:48.239299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:48.240352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:48.240963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:48.554141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:48.570426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7467c7c7-5c7c-4716-a6fc-eb5b462eb9ec tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1687 microversion: 2.1 time: 0.353562 May 19 09:29:48.572207 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5622/6947] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:48 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1687 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:29:49.234233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9b1ed2ab-5ca7-4b56-a2ed-41a36ae1c4a5 req-03101e2a-03b6-437b-90f3-159b3a387426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66983afb-2475-42ed-a41a-e2fb92759da9", "name": "network-vif-deleted", "tag": "4929de38-6aff-487f-9d57-9539e56cf19c"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:29:49.247901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9b1ed2ab-5ca7-4b56-a2ed-41a36ae1c4a5 req-03101e2a-03b6-437b-90f3-159b3a387426 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:49.248599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9b1ed2ab-5ca7-4b56-a2ed-41a36ae1c4a5 req-03101e2a-03b6-437b-90f3-159b3a387426 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:49.262603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9b1ed2ab-5ca7-4b56-a2ed-41a36ae1c4a5 req-03101e2a-03b6-437b-90f3-159b3a387426 service nova] Creating event network-vif-deleted:4929de38-6aff-487f-9d57-9539e56cf19c for instance 66983afb-2475-42ed-a41a-e2fb92759da9 on chh2-842464-2 May 19 09:29:49.269267 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9b1ed2ab-5ca7-4b56-a2ed-41a36ae1c4a5 req-03101e2a-03b6-437b-90f3-159b3a387426 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130178 May 19 09:29:49.270143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5623/6948] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:29:49.595246 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:49.595984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:49.603673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:49.604638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:49.605956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:49.606867 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:49.652177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:49.652587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:49.653126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lazy-loading 'fault' on Instance uuid 66983afb-2475-42ed-a41a-e2fb92759da9 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:29:49.712547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:29:49.720325 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-adb3d945-ef9e-41ed-8a76-2467c1fbc389 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 200 len: 1356 microversion: 2.1 time: 0.130503 May 19 09:29:49.721081 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5624/6949] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:49 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 1356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:29:50.745779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:50.746984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: 66983afb-2475-42ed-a41a-e2fb92759da9] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:29:50.762766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:50.763717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:50.765419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:29:50.766257 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:29:50.794820 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] HTTP exception thrown: Instance 66983afb-2475-42ed-a41a-e2fb92759da9 could not be found. May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Request method failure captured: May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 HTTP/1.1 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgx1UZVv1qp1J03tkdAlVHhQ8Hd6ER5mjT9UpeQyvGw34gvpVN6kXD58v4acOTFO9_ifZh47Jt2efgOAEtoE68wk-WcZCpbSQ2P3u0zdNF_MZ9JjHYCnz6X7YIUWMszLkXoO1OiftbvZh2NgGztFrwcrbODlXqWMSjuH5X1zcI_I824 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca75f10643384d57baccbceca3b6892f May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 66983afb-2475-42ed-a41a-e2fb92759da9 could not be found. May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '66983afb-2475-42ed-a41a-e2fb92759da9'} May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66983afb-2475-42ed-a41a-e2fb92759da9 could not be found. May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66983afb-2475-42ed-a41a-e2fb92759da9 could not be found. May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:29:50.799502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66983afb-2475-42ed-a41a-e2fb92759da9 could not be found. May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Returning 404 to user: Instance 66983afb-2475-42ed-a41a-e2fb92759da9 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a3b8077-6fd9-4279-90d8-2400dbaaae93 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9" status: 404 len: 111 microversion: 2.1 time: 0.064733 May 19 09:29:50.809555 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5625/6950] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:29:50 2022] GET /compute/v2.1/servers/66983afb-2475-42ed-a41a-e2fb92759da9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:29:55.886780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ee206807-d981-4273-807e-14a11f290097 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '.version_select at 0x7f3210327700>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:29:55.892922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ee206807-d981-4273-807e-14a11f290097 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2050011534" status: 202 len: 0 microversion: 2.1 time: 0.056523 May 19 09:29:55.893613 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5626/6951] 10.222.0.78 () {58 vars in 1283 bytes} [Thu May 19 09:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2050011534 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:29:55.939200 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b9748c3-429c-44a2-9aca-318276223e25 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: .version_select at 0x7f32102c2e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-919470092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGps5vp0HedA6CGeTjt1YmfP/dvID2K/zIEVPKTGx3cg1p8EHN1eY1Kl4C+9/gYewCYcte1BBt60TF3cuR21OAWfhkMs68Dhkq62CEAJ+xLJHc9xsWIplpPIO5bkjCDSYA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:29:55.959144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1b9748c3-429c-44a2-9aca-318276223e25 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:29:55.965931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-1b9748c3-429c-44a2-9aca-318276223e25 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:29:56.003172 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b9748c3-429c-44a2-9aca-318276223e25 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069220 May 19 09:29:56.004094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5627/6952] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:29:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:30:04.803063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:04.809895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-132496930", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "networks": [{"uuid": "6ada3416-14b6-4a0f-8ae1-c46bdd98d253"}], "key_name": "tempest-TestNetworkAdvancedServerOps-919470092", "security_groups": [{"name": "tempest-secgroup-smoke-738849148"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:05.005206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] validate_networks() for [('6ada3416-14b6-4a0f-8ae1-c46bdd98d253', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:30:05.742333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:30:05.742912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:30:05.743586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:30:05.744053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:30:05.744650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:30:05.757510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:05.757988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:05.759158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:05.759631 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:05.788645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:30:05.801133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Getting quotas for user ca75f10643384d57baccbceca3b6892f and project 575aafd21394471eabe1a64e7bdc7a1b. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:30:05.829585 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:30:05.832979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:30:05.922356 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d941098-f3a7-4384-9fa5-5705ccca506a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.120943 May 19 09:30:05.929205 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5628/6953] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:30:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:30:05.942212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ead510f-8934-43c5-80b2-d16a656caec1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:05.943551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ead510f-8934-43c5-80b2-d16a656caec1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:06.047214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5ead510f-8934-43c5-80b2-d16a656caec1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:06.060104 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ead510f-8934-43c5-80b2-d16a656caec1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1265 microversion: 2.1 time: 0.128261 May 19 09:30:06.061204 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5629/6954] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:05 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:07.087647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eb24f026-418d-452f-8069-1b3e4c8c57a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:07.088760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eb24f026-418d-452f-8069-1b3e4c8c57a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:07.189756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eb24f026-418d-452f-8069-1b3e4c8c57a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:07.200867 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eb24f026-418d-452f-8069-1b3e4c8c57a3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1265 microversion: 2.1 time: 0.117656 May 19 09:30:07.203174 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5630/6955] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:07 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:07.411587 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:30:07.412454 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:30:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:30:08.230834 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1c90d8a1-5364-4e74-b4ec-e7919b277d70 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:08.232744 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1c90d8a1-5364-4e74-b4ec-e7919b277d70 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:08.340159 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1c90d8a1-5364-4e74-b4ec-e7919b277d70 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:08.393524 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1c90d8a1-5364-4e74-b4ec-e7919b277d70 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1265 microversion: 2.1 time: 0.167831 May 19 09:30:08.395089 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5631/6956] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:08 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:09.423423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-48cd656e-78d6-4eef-a983-6aa62e54af3f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:09.424341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-48cd656e-78d6-4eef-a983-6aa62e54af3f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:09.427052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:09.527600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-48cd656e-78d6-4eef-a983-6aa62e54af3f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:09.536010 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-48cd656e-78d6-4eef-a983-6aa62e54af3f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1265 microversion: 2.1 time: 0.117269 May 19 09:30:09.536646 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5632/6957] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:09 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:10.563727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:10.564650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:10.574544 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:10.575020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:10.575876 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:10.576314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:10.667895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:10.682473 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed0f0ecd-cfab-467a-8d24-4e8a9f41f257 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1269 microversion: 2.1 time: 0.125007 May 19 09:30:10.683381 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5633/6958] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:10 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1269 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:11.714473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:11.715510 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:11.727329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:11.727925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:11.728875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:11.730261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:11.825239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:11.835288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f92c7d2-e390-4cd0-bb35-09b9dcf8227b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1323 microversion: 2.1 time: 0.128594 May 19 09:30:11.835900 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5634/6959] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:11 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1323 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:12.863089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:12.864051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:12.872058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:12.872562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:12.874223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:12.875560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:13.081017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:13.089765 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-92aea390-82e3-4467-8aa3-afa465a6fac4 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.238149 May 19 09:30:13.100550 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5635/6960] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:12 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:13.611961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-acd67975-b132-4d91-9026-f6b4b152d03c req-a342a981-afef-4a82-a3b5-f01d6b4b8e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c02300-ce70-4466-95a9-90ca711040b7", "tag": "ae301395-f53f-4b56-b50f-0ec8bbe3d439"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:13.630692 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-acd67975-b132-4d91-9026-f6b4b152d03c req-a342a981-afef-4a82-a3b5-f01d6b4b8e15 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:13.631977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-acd67975-b132-4d91-9026-f6b4b152d03c req-a342a981-afef-4a82-a3b5-f01d6b4b8e15 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:13.654539 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-acd67975-b132-4d91-9026-f6b4b152d03c req-a342a981-afef-4a82-a3b5-f01d6b4b8e15 service nova] Creating event network-changed:ae301395-f53f-4b56-b50f-0ec8bbe3d439 for instance e8c02300-ce70-4466-95a9-90ca711040b7 on chh2-842464-2 May 19 09:30:13.666642 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-acd67975-b132-4d91-9026-f6b4b152d03c req-a342a981-afef-4a82-a3b5-f01d6b4b8e15 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063276 May 19 09:30:13.667530 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5636/6961] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:30:14.115503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:14.116875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:14.129838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:14.131010 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:14.132733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:14.133826 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:14.359702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:14.376974 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a5080a07-0dd0-43e8-a950-023734df3855 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.270695 May 19 09:30:14.378574 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5637/6962] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:14 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:15.409096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:15.410342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:15.424498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:15.425158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:15.426559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:15.427338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:15.644268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:15.654548 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-27108a59-0f38-425a-8405-94f1e21415eb tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.253347 May 19 09:30:15.656085 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5638/6963] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:15 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:16.680783 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:16.681964 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:16.685693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:16.698430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:16.699255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:16.700734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:16.701672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:16.885997 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:16.899395 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f6172d64-e9e0-4919-be2f-a903c77ff41e tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.226334 May 19 09:30:16.900494 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5639/6964] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:16 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:17.919373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:17.921127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:17.930093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:17.930517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:17.931436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:17.931958 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:18.136428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:18.149591 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fa2badd6-4954-4970-a4b0-c8326abae07d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.234786 May 19 09:30:18.150854 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5640/6965] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:17 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:19.177699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:19.178495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:19.186746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:19.187360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:19.188228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:19.188843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:19.378934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:19.393295 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4fbaef7-87c3-4b98-85df-aeed47ae276b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.219409 May 19 09:30:19.394481 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5641/6966] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:19 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:19.673751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3dad7948-fb02-4654-88df-df56b52e3efe req-36a35ba1-e4f9-4902-8866-cb104c453544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c02300-ce70-4466-95a9-90ca711040b7", "name": "network-vif-plugged", "status": "completed", "tag": "ae301395-f53f-4b56-b50f-0ec8bbe3d439"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:19.679588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=18 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:19.690737 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3dad7948-fb02-4654-88df-df56b52e3efe req-36a35ba1-e4f9-4902-8866-cb104c453544 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:19.691203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3dad7948-fb02-4654-88df-df56b52e3efe req-36a35ba1-e4f9-4902-8866-cb104c453544 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:19.707845 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3dad7948-fb02-4654-88df-df56b52e3efe req-36a35ba1-e4f9-4902-8866-cb104c453544 service nova] Creating event network-vif-plugged:ae301395-f53f-4b56-b50f-0ec8bbe3d439 for instance e8c02300-ce70-4466-95a9-90ca711040b7 on chh2-842464-2 May 19 09:30:19.714337 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3dad7948-fb02-4654-88df-df56b52e3efe req-36a35ba1-e4f9-4902-8866-cb104c453544 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048865 May 19 09:30:19.715041 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5642/6967] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:30:20.415536 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:20.416314 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:20.424284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:20.424817 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:20.425873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:20.426436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:20.626877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:20.635404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55e8f8ba-fe93-4412-b242-52e7dcd62b8f tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1390 microversion: 2.1 time: 0.226117 May 19 09:30:20.636143 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5643/6968] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:20 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1390 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:21.655873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:21.655873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:21.666411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:21.666875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:21.667693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:21.668145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:21.839802 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:21.849525 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8f2f7231-9696-408a-b14a-c15492e8263b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1563 microversion: 2.1 time: 0.199046 May 19 09:30:21.850128 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5644/6969] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:21 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:21.872774 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:21.874278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:21.881019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:21.881557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:21.882370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:21.882822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:22.106101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:22.116054 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f10569aa-8afa-450a-a002-4d0a418407f0 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1563 microversion: 2.1 time: 0.249583 May 19 09:30:22.116742 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5645/6970] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:21 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:24.498966 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:24.499852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:24.507374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:24.507847 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:24.508683 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:24.509154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:24.732235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:24.743841 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba62c5cf-1e4c-4fb0-a718-8feca183ae16 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1563 microversion: 2.1 time: 0.248945 May 19 09:30:24.744540 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5646/6971] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:24 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1563 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:24.750624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c8b77e11-c69f-407e-a26d-b7504c90fc62 req-5115091f-9c91-458a-b53b-03747124a636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c02300-ce70-4466-95a9-90ca711040b7", "tag": "ae301395-f53f-4b56-b50f-0ec8bbe3d439"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:24.759784 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c8b77e11-c69f-407e-a26d-b7504c90fc62 req-5115091f-9c91-458a-b53b-03747124a636 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:24.760233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c8b77e11-c69f-407e-a26d-b7504c90fc62 req-5115091f-9c91-458a-b53b-03747124a636 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:24.774429 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c8b77e11-c69f-407e-a26d-b7504c90fc62 req-5115091f-9c91-458a-b53b-03747124a636 service nova] Creating event network-changed:ae301395-f53f-4b56-b50f-0ec8bbe3d439 for instance e8c02300-ce70-4466-95a9-90ca711040b7 on chh2-842464-2 May 19 09:30:24.783957 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c8b77e11-c69f-407e-a26d-b7504c90fc62 req-5115091f-9c91-458a-b53b-03747124a636 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038039 May 19 09:30:24.785254 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5647/6972] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:30:26.350138 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:30:26.350972 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:30:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:30:45.545090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=33 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:45.546133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=80 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:45.551669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:45.552818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:45.561967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:45.562559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:45.563430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:45.563914 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:45.635518 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1ff99d14-119b-409e-89e4-fd34aba97711 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action" status: 200 len: 24568 microversion: 2.1 time: 0.093135 May 19 09:30:45.636194 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5648/6973] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:30:45 2022] POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action => generated 24568 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:30:56.737750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:56.739093 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:56.743828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:56.745036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:30:56.759439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:56.760206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:56.761766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:56.762551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:56.814995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lazy-loading 'flavor' on Instance uuid e8c02300-ce70-4466-95a9-90ca711040b7 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:30:56.914753 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-46606f38-332d-400b-a702-4cd2181959c3 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action" status: 202 len: 0 microversion: 2.1 time: 0.186296 May 19 09:30:56.915719 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5649/6974] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:30:56 2022] POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:30:56.926051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:56.927048 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:56.935786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:56.936727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:56.938161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:56.949466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:57.166904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:57.176620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-94b795ed-af4f-4af7-b83b-286aea9a2381 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1689 microversion: 2.1 time: 0.255125 May 19 09:30:57.177558 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5650/6975] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:56 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1689 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:30:58.199250 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:58.200354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:58.211789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:58.212220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:58.213268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:58.213729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:58.416898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:30:58.431928 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8ace484b-b168-4567-aae8-d45c6edd9633 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1672 microversion: 2.1 time: 0.238132 May 19 09:30:58.433001 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5651/6976] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:58 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:30:59.559508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:59.561524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:59.569543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:59.570063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:59.571036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:59.571540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:59.654705 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fdf80df9-e7e2-4f9a-9dd0-c81d03de7177 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action" status: 200 len: 38417 microversion: 2.1 time: 0.104672 May 19 09:30:59.656165 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5652/6977] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:30:59 2022] POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action => generated 38417 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 09:30:59.675134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:30:59.675919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:59.686149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:59.686429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:59.687075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:59.687563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:59.806028 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d52baff1-7c14-4345-a3aa-5cf7f892c5d6 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action" status: 202 len: 0 microversion: 2.1 time: 0.137004 May 19 09:30:59.806727 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5653/6978] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:30:59 2022] POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 09:30:59.818669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:30:59.819290 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:30:59.828578 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:59.829055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:30:59.829915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:30:59.830374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:00.018661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:00.039036 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-20575da4-cac5-478b-9c40-fac6359fa2a1 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1678 microversion: 2.1 time: 0.225275 May 19 09:31:00.039645 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5654/6979] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:30:59 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:01.065503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:01.066469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:01.075918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:01.076459 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:01.077555 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:01.078057 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:01.250340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:01.258666 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-289034f2-047d-47ac-a488-b59809af356b tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1678 microversion: 2.1 time: 0.197750 May 19 09:31:01.259267 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5655/6980] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:01 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:02.286173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:02.287216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:02.295812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:02.296278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:02.297235 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:02.297805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:02.475516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:02.487486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6df898f7-a7ab-4eb1-9150-959131d28852 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1681 microversion: 2.1 time: 0.205212 May 19 09:31:02.488111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5656/6981] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:02 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:02.605962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:02.607871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:02.615446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:02.615986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:02.616810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:02.617407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:02.686436 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1bd99210-e666-427b-8e95-737c0bf9011a tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action" status: 200 len: 38417 microversion: 2.1 time: 0.083090 May 19 09:31:02.687731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5657/6982] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:31:02 2022] POST /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7/action => generated 38417 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 09:31:04.129772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:04.130952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:04.145706 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:04.146686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:04.148224 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:04.148984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:04.205688 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:31:04.316953 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6eac3c8c-513a-4b70-b5c3-b6a9881ca48d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 204 len: 0 microversion: 2.1 time: 0.195176 May 19 09:31:04.317978 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5658/6983] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:31:04 2022] DELETE /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:31:04.329428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-1e177b8f-7d11-49f7-8dcf-0219b98685fa req-598cc767-e60c-4c83-864e-81b30471efe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c02300-ce70-4466-95a9-90ca711040b7", "tag": "ae301395-f53f-4b56-b50f-0ec8bbe3d439"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:04.354278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e177b8f-7d11-49f7-8dcf-0219b98685fa req-598cc767-e60c-4c83-864e-81b30471efe1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:04.354599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-1e177b8f-7d11-49f7-8dcf-0219b98685fa req-598cc767-e60c-4c83-864e-81b30471efe1 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:04.377650 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-1e177b8f-7d11-49f7-8dcf-0219b98685fa req-598cc767-e60c-4c83-864e-81b30471efe1 service nova] Creating event network-changed:ae301395-f53f-4b56-b50f-0ec8bbe3d439 for instance e8c02300-ce70-4466-95a9-90ca711040b7 on chh2-842464-2 May 19 09:31:04.386100 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-1e177b8f-7d11-49f7-8dcf-0219b98685fa req-598cc767-e60c-4c83-864e-81b30471efe1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065516 May 19 09:31:04.387227 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5659/6984] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:31:04.397455 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:04.398959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:04.411413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:04.412126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:04.413618 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:04.417673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:04.639796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:04.648714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fdd45783-cd14-49da-b772-24cafa648faa tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1687 microversion: 2.1 time: 0.259061 May 19 09:31:04.649372 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5660/6985] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:04 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:05.669465 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:05.670587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:05.680382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:05.681239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:05.682495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:05.683152 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:05.952392 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:05.964426 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4c8bb04b-5d12-4b0a-a3f5-e4e240322613 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1687 microversion: 2.1 time: 0.299697 May 19 09:31:05.965486 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5661/6986] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:05 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1687 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:06.752768 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-9becf5af-3061-4f01-9965-52e3346c004d req-abff52b5-9a97-4791-a780-15f2b14b1635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c02300-ce70-4466-95a9-90ca711040b7", "name": "network-vif-deleted", "tag": "ae301395-f53f-4b56-b50f-0ec8bbe3d439"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:06.768338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9becf5af-3061-4f01-9965-52e3346c004d req-abff52b5-9a97-4791-a780-15f2b14b1635 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:06.768747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-9becf5af-3061-4f01-9965-52e3346c004d req-abff52b5-9a97-4791-a780-15f2b14b1635 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:06.783576 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-9becf5af-3061-4f01-9965-52e3346c004d req-abff52b5-9a97-4791-a780-15f2b14b1635 service nova] Creating event network-vif-deleted:ae301395-f53f-4b56-b50f-0ec8bbe3d439 for instance e8c02300-ce70-4466-95a9-90ca711040b7 on chh2-842464-2 May 19 09:31:06.789865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-9becf5af-3061-4f01-9965-52e3346c004d req-abff52b5-9a97-4791-a780-15f2b14b1635 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040982 May 19 09:31:06.790751 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5662/6987] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:31:06.995123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:06.995813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:07.004960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:07.005684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:07.006930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:07.007613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:07.015391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:31:07.057339 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:07.057971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:07.058777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lazy-loading 'fault' on Instance uuid e8c02300-ce70-4466-95a9-90ca711040b7 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:31:07.110713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca75f10643384d57baccbceca3b6892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575aafd21394471eabe1a64e7bdc7a1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:07.119645 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eea67d57-a696-48d3-b848-501f0b739a87 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 200 len: 1355 microversion: 2.1 time: 0.132867 May 19 09:31:07.120394 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5663/6988] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:06 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 1355 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:08.147380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:08.148114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] [instance: e8c02300-ce70-4466-95a9-90ca711040b7] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:08.156924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:08.157429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:08.158265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:08.158726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:08.175547 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] HTTP exception thrown: Instance e8c02300-ce70-4466-95a9-90ca711040b7 could not be found. May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Request method failure captured: May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 HTTP/1.1 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihgx1UZVv1qp1J03tkdAlVHhQ8Hd6ER5mjT9UpeQyvGw34gvpVN6kXD58v4acOTFO9_ifZh47Jt2efgOAEtoE68wk-WcZCpbSQ2P3u0zdNF_MZ9JjHYCnz6X7YIUWMszLkXoO1OiftbvZh2NgGztFrwcrbODlXqWMSjuH5X1zcI_I824 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575aafd21394471eabe1a64e7bdc7a1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 575aafd21394471eabe1a64e7bdc7a1b May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-904236635 May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: ca75f10643384d57baccbceca3b6892f May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestNetworkAdvancedServerOps-904236635-project May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance e8c02300-ce70-4466-95a9-90ca711040b7 could not be found. May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'e8c02300-ce70-4466-95a9-90ca711040b7'} May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8c02300-ce70-4466-95a9-90ca711040b7 could not be found. May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8c02300-ce70-4466-95a9-90ca711040b7 could not be found. May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:31:08.177288 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8c02300-ce70-4466-95a9-90ca711040b7 could not be found. May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Returning 404 to user: Instance e8c02300-ce70-4466-95a9-90ca711040b7 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ad607ce6-c975-4ca2-a962-df97450e869d tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7" status: 404 len: 111 microversion: 2.1 time: 0.035825 May 19 09:31:08.181072 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5664/6989] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:08 2022] GET /compute/v2.1/servers/e8c02300-ce70-4466-95a9-90ca711040b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:31:13.401432 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8c4845f2-96da-4f1c-b4ce-6f8d05c6a249 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] Calling method '.version_select at 0x7f32104f5f70>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:13.445962 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8c4845f2-96da-4f1c-b4ce-6f8d05c6a249 tempest-TestNetworkAdvancedServerOps-904236635 tempest-TestNetworkAdvancedServerOps-904236635-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-919470092" status: 202 len: 0 microversion: 2.1 time: 0.052702 May 19 09:31:13.446925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5665/6990] 10.222.0.78 () {58 vars in 1280 bytes} [Thu May 19 09:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-919470092 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:31:30.144351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:31:30.145439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:31:30.472088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eebba819-e30d-42de-88fe-ba62e9025f46 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'create', calling method: .version_select at 0x7f3210239940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1637998504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmhtfiLSeCVXk7UFL3IRy+eg3+jVbtM4tb4MkKVNWvG1NWgVd7LlyozcHoNcFe2J4J7cPzHC1qIS3hXU99/9ZLTM3fY+m/FyNfQRf926Hk8iInh8H9bvCz5cqpDfS2+qA=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:30.492058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-eebba819-e30d-42de-88fe-ba62e9025f46 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for project 9ceabd32808442f29c727435c80d17de. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:31:30.501938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-eebba819-e30d-42de-88fe-ba62e9025f46 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for user 3ae8f19f10fe4fbc96907f9e31db963f and project 9ceabd32808442f29c727435c80d17de. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:31:30.544176 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eebba819-e30d-42de-88fe-ba62e9025f46 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.398957 May 19 09:31:30.544176 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5666/6991] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:31:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:31:31.916708 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1833226104", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1637998504", "security_groups": [{"name": "tempest-secgroup-smoke-395708079"}], "networks": [{"uuid": "b34b3946-f205-4802-8b00-9cd060a160fa"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:32.052351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] validate_networks() for [('b34b3946-f205-4802-8b00-9cd060a160fa', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:31:32.764712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:31:32.765772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:31:32.766399 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:31:32.766854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:31:32.767287 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:31:32.780158 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:32.780542 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:32.782262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:32.782954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:32.820844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for project 9ceabd32808442f29c727435c80d17de. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:31:32.828573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for user 3ae8f19f10fe4fbc96907f9e31db963f and project 9ceabd32808442f29c727435c80d17de. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:31:32.849986 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:31:32.852835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:31:32.925038 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a22c169c-5d99-4d12-be41-c7b56ba43193 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.013762 May 19 09:31:32.926632 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5667/6992] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:31:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 09:31:32.938363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6a27c297-6b1f-4214-bcdb-51cff7c38c80 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:32.940414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6a27c297-6b1f-4214-bcdb-51cff7c38c80 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:33.055408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6a27c297-6b1f-4214-bcdb-51cff7c38c80 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:33.080663 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6a27c297-6b1f-4214-bcdb-51cff7c38c80 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1247 microversion: 2.1 time: 0.146044 May 19 09:31:33.082456 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5668/6993] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:32 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1247 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:34.106249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:34.107823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:34.119844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:34.120613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:34.122564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:34.123406 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:34.230084 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:34.242865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cdac38b0-6551-4bbc-a78f-b1e603f3cfad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1299 microversion: 2.1 time: 0.146135 May 19 09:31:34.243711 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5669/6994] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:34 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:35.265780 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:35.266742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:35.275758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:35.277522 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:35.277690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:35.278326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:35.386188 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:35.400827 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1078f8ac-e2f3-4cb6-8a81-e6311a966952 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1305 microversion: 2.1 time: 0.140402 May 19 09:31:35.415675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5670/6995] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:35 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1305 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:36.424430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:36.425691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:36.436710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:36.437331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:36.440419 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:36.441253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:36.803504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:36.821807 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8607eaa1-f875-4e83-89bb-90d671e11157 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1372 microversion: 2.1 time: 0.402059 May 19 09:31:36.822706 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5671/6996] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:36 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1372 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:37.130793 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-728d874a-8be3-4443-ab36-46b18eef8a24 req-a88193ec-97cd-4811-a93a-6a28cdf89dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:37.141229 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-728d874a-8be3-4443-ab36-46b18eef8a24 req-a88193ec-97cd-4811-a93a-6a28cdf89dea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:37.141849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-728d874a-8be3-4443-ab36-46b18eef8a24 req-a88193ec-97cd-4811-a93a-6a28cdf89dea service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:37.163999 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-728d874a-8be3-4443-ab36-46b18eef8a24 req-a88193ec-97cd-4811-a93a-6a28cdf89dea service nova] Creating event network-changed:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh2-842464-2 May 19 09:31:37.171138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-728d874a-8be3-4443-ab36-46b18eef8a24 req-a88193ec-97cd-4811-a93a-6a28cdf89dea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139260 May 19 09:31:37.171701 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5672/6997] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:31:37.855027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:37.856872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:37.869016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:37.869998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:37.871504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:37.872475 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:38.077822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:38.099302 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bd091127-6e27-44e7-a04c-611ba9a68612 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1372 microversion: 2.1 time: 0.253886 May 19 09:31:38.100283 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5673/6998] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:37 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:39.123279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:39.124324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:39.132980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:39.133600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:39.134470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:39.134936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:39.726995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:39.739770 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-28b577d9-e4e5-4043-a34d-41ad91caa160 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1372 microversion: 2.1 time: 0.621311 May 19 09:31:39.740398 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5674/6999] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:39 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1372 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:40.770749 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:40.772307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:40.787639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:40.788473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:40.789937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:40.790758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:41.036236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:41.051900 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2e31bc13-115c-4dfc-9c37-aa2f0eb9be2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1372 microversion: 2.1 time: 0.288334 May 19 09:31:41.053154 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5675/7000] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:40 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:42.153581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-03674530-9d65-4232-9697-c89b6e92a254 req-9133d754-f4d7-47c2-a665-5d262e3fa09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "name": "network-vif-plugged", "status": "completed", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:42.169623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-03674530-9d65-4232-9697-c89b6e92a254 req-9133d754-f4d7-47c2-a665-5d262e3fa09d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:42.170460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-03674530-9d65-4232-9697-c89b6e92a254 req-9133d754-f4d7-47c2-a665-5d262e3fa09d service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:42.193016 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-03674530-9d65-4232-9697-c89b6e92a254 req-9133d754-f4d7-47c2-a665-5d262e3fa09d service nova] Creating event network-vif-plugged:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh2-842464-2 May 19 09:31:42.203361 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-03674530-9d65-4232-9697-c89b6e92a254 req-9133d754-f4d7-47c2-a665-5d262e3fa09d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165874 May 19 09:31:42.204513 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5676/7001] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:31:42.215660 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:42.216978 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:42.227915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:42.229103 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:42.232223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:42.233023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:42.616068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:42.625509 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ce18edb0-a58c-4b61-a412-88422126d106 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1372 microversion: 2.1 time: 0.418740 May 19 09:31:42.626449 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5677/7002] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:42 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1372 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:31:43.655445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:43.661659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:43.673299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:31:43.676567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=12 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:31:43.687620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:43.688433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:43.690413 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:43.691468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:43.941027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:43.959110 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e42cbd94-6a1e-4e17-91a2-db28a01399ff tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1372 microversion: 2.1 time: 0.311503 May 19 09:31:43.959779 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5678/7003] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:43 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1372 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:44.979312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:44.980676 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:44.990112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:44.990735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:44.991869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:44.992380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:45.162268 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:45.173342 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4234f13c-3ab6-4013-a9c9-bf10c06c3e42 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1557 microversion: 2.1 time: 0.200329 May 19 09:31:45.173967 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5679/7004] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:44 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1557 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:45.204012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:31:45.204840 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:31:45.212611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:45.213187 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:45.214315 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:45.215498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:45.404271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:31:45.415731 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0622d830-ffe4-4edf-9f27-da80074926c4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1557 microversion: 2.1 time: 0.217062 May 19 09:31:45.416401 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5680/7005] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:31:45 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:31:47.992099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6afeb7ea-1319-4f3b-827a-7d1d545c97df req-29ee3829-7b13-4fff-8097-b1f8b332a8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:31:48.003343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6afeb7ea-1319-4f3b-827a-7d1d545c97df req-29ee3829-7b13-4fff-8097-b1f8b332a8f7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:31:48.003827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6afeb7ea-1319-4f3b-827a-7d1d545c97df req-29ee3829-7b13-4fff-8097-b1f8b332a8f7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:31:48.021432 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6afeb7ea-1319-4f3b-827a-7d1d545c97df req-29ee3829-7b13-4fff-8097-b1f8b332a8f7 service nova] Creating event network-changed:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh2-842464-2 May 19 09:31:48.027638 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6afeb7ea-1319-4f3b-827a-7d1d545c97df req-29ee3829-7b13-4fff-8097-b1f8b332a8f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040948 May 19 09:31:48.028388 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5681/7006] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:33:27.425718 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:33:27.426554 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:33:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:33:42.901554 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6898fb1f-7835-4c58-8cbc-cf977775b0e2] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 09:33:42.902560 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 09:33:42.903232 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:33:42.904015 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=68 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:33:42.908955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:33:42.909638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:42.919468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:42.920233 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:42.921043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:42.921532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:42.947295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lazy-loading 'flavor' on Instance uuid b4e178a1-407e-48f6-99d0-7e38bfd3f103 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:33:43.252380 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5ce89dbf-7b6b-4462-9c8c-a25f542b0277 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103/action" status: 202 len: 0 microversion: 2.1 time: 0.352987 May 19 09:33:43.253032 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5682/7007] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:33:42 2022] POST /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:33:43.266873 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:43.267980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:43.279359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:43.280067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:43.281417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:43.282142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:43.439247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:43.448043 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fb0d0b6-a534-4794-bc32-89e43fb2e0ea tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.187510 May 19 09:33:43.448674 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5683/7008] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:43 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:33:44.466679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:44.467386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:44.478222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:44.478680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:44.479478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:44.479920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:44.485478 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [6898fb1f-7835-4c58-8cbc-cf977775b0e2] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58198. May 19 09:33:44.501351 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58200. May 19 09:33:44.642429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:44.650477 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc4c7cd0-89d0-4402-8907-ce6a835f3d26 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.187706 May 19 09:33:44.651071 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5684/7009] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:44 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:45.668779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:45.669648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:45.677468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:45.677961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:45.678776 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:45.679252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:45.841666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:45.849846 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-04c27ac0-0f99-4738-8039-46da9a95b2bb tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.185944 May 19 09:33:45.850439 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5685/7010] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:45 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:46.361050 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:33:46.361961 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:33:46.868861 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:46.878811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:46.886925 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:46.887394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:46.888192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:46.888650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:47.030423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:47.039872 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c98cbc23-cb0b-4126-86cf-42c48c6a4970 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.174907 May 19 09:33:47.040567 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5686/7011] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:46 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:48.059099 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:48.059846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:48.067106 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:48.067575 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:48.068376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:48.068832 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:48.224506 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:48.236282 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-994d7265-a9dc-48b7-9f59-4cebdb7ecdc6 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.181547 May 19 09:33:48.236920 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5687/7012] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:48 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:49.257109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:49.257850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:49.264970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:49.265470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:49.266277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:49.266735 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:49.426104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:49.436664 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c94688e2-3a95-45b6-aa27-99bc6516cc1a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.183434 May 19 09:33:49.437269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5688/7013] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:49 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:50.454805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:50.455481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:50.463543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:50.464019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:50.464852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:50.465285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:50.619711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:50.634947 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f7d1b06f-c6ef-4d1a-9f62-6f793de254fc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.183476 May 19 09:33:50.635927 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5689/7014] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:50 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:51.662903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:51.663588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:51.672194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:51.672655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:51.673507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:51.673960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:51.828391 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:51.837620 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7ad3506e-506f-4ff5-a1f8-a99f4019705c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.179121 May 19 09:33:51.838351 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5690/7015] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:51 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:52.855199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:52.856163 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:52.863731 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:52.864201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:52.865019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:52.865540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:53.026294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:53.034835 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f8121255-4e56-4028-831f-1231695726c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.183604 May 19 09:33:53.035640 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5691/7016] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:52 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:54.055368 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:54.056598 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:54.067892 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:54.068624 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:54.069668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:54.070273 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:54.228778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:54.236958 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d263a7f0-03c0-4947-9140-d1e3f0078622 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1703 microversion: 2.1 time: 0.186913 May 19 09:33:54.237612 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5692/7017] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:54 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1703 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:55.258354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:55.259904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:55.267223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:55.267865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:55.268517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:55.268971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:55.424504 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:55.433329 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3496acef-4748-4fa4-9a2b-83683e4300ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1703 microversion: 2.1 time: 0.181123 May 19 09:33:55.433972 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5693/7018] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:55 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1703 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:33:56.452001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:56.452909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:56.461031 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:56.461693 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:56.462751 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:56.463213 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:56.644172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:56.658092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3a4dd04e-8664-45b1-aa0b-fa8791c53e60 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.210393 May 19 09:33:56.670824 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5694/7019] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:56 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:56.762517 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-e120d2cf-3d81-45b3-9dca-90c7b70095e1 req-33bf6ea0-afcf-4e75-980f-04c885036dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "name": "network-vif-plugged", "status": "completed", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:33:56.775856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e120d2cf-3d81-45b3-9dca-90c7b70095e1 req-33bf6ea0-afcf-4e75-980f-04c885036dc6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:56.777443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-e120d2cf-3d81-45b3-9dca-90c7b70095e1 req-33bf6ea0-afcf-4e75-980f-04c885036dc6 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:56.801346 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-e120d2cf-3d81-45b3-9dca-90c7b70095e1 req-33bf6ea0-afcf-4e75-980f-04c885036dc6 service nova] Creating event network-vif-plugged:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh2-842464-2 May 19 09:33:56.817796 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-e120d2cf-3d81-45b3-9dca-90c7b70095e1 req-33bf6ea0-afcf-4e75-980f-04c885036dc6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059017 May 19 09:33:56.818665 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5695/7020] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:33:57.677401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:57.678134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:57.687118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:57.687425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:57.688227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:57.688681 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:57.852787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:57.864494 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ffec56de-976d-498d-81a7-0ae888879286 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.191720 May 19 09:33:57.865162 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5696/7021] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:57 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:33:58.883661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:33:58.884362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:33:58.892251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:58.892716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:58.893573 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:33:58.894034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:33:58.899667 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:33:59.133747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:33:59.144053 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ec2a5b00-b29b-43a1-a9bb-d83a88e764f9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.265122 May 19 09:33:59.145254 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5697/7022] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:33:58 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:00.163111 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:00.163962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:00.172295 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:00.172957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:00.173797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:00.174298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:00.352999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:00.364592 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed9658c3-fdb5-471d-9aef-8ee305f84bb7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.205801 May 19 09:34:00.365437 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5698/7023] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:00 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:01.383030 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:01.384792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:01.392918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:01.393226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:01.394052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:01.394281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:01.563830 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:01.574328 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-483b07c3-9a6c-47ed-a5f2-31f5c4c88715 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.195604 May 19 09:34:01.575125 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5699/7024] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:01 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:02.592466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:02.593140 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:02.601370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:02.601370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:02.602612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:02.602612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:02.771094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:02.792319 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6767b03-1aea-4aa3-838a-267fc4459dc5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.203604 May 19 09:34:02.792924 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5700/7025] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:02 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:03.812460 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:03.813905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:03.823328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:03.824270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:03.825357 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:03.825994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:03.989984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:03.998659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6bcbdc47-7265-41b2-a1ae-58a08fb5cd68 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.190410 May 19 09:34:03.999160 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5701/7026] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:03 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:05.017981 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:05.019019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:05.029090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:05.030247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:05.031386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:05.032184 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:05.192750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:05.200989 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8373dfa3-0d95-43e9-acaa-237960a0cba2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1698 microversion: 2.1 time: 0.188798 May 19 09:34:05.201623 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5702/7027] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:05 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1698 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:06.218620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:06.219318 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:06.227336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:06.227794 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:06.228593 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:06.229038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:06.624770 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:06.634675 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f157487-06e0-4ed2-bb02-9f33814d1641 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1680 microversion: 2.1 time: 0.420129 May 19 09:34:06.635977 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5703/7028] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:06 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1680 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:07.652973 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:07.653689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:07.660677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:07.661267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:07.661963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:07.662417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:07.811936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:07.820077 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-906c3d22-b09f-4e5e-bfa6-9a287be00576 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1680 microversion: 2.1 time: 0.171720 May 19 09:34:07.820789 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5704/7029] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:07 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:08.619893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-46e1daa2-d00e-491d-bb79-a2224e71984b req-c8c9260d-11bd-4c2b-b775-f5484c855204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "name": "network-vif-unplugged", "status": "completed", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:34:08.635488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-46e1daa2-d00e-491d-bb79-a2224e71984b req-c8c9260d-11bd-4c2b-b775-f5484c855204 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:08.636484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-46e1daa2-d00e-491d-bb79-a2224e71984b req-c8c9260d-11bd-4c2b-b775-f5484c855204 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:08.655128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-46e1daa2-d00e-491d-bb79-a2224e71984b req-c8c9260d-11bd-4c2b-b775-f5484c855204 service nova] Creating event network-vif-unplugged:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh2-842464-2 May 19 09:34:08.660767 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-46e1daa2-d00e-491d-bb79-a2224e71984b req-c8c9260d-11bd-4c2b-b775-f5484c855204 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046563 May 19 09:34:08.661856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5705/7030] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:34:08.843999 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:08.844745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:08.852857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:08.853441 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:08.854319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:08.854842 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:09.018987 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:09.029088 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3c0e994-a94f-471b-8afc-019e38f4e766 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1623 microversion: 2.1 time: 0.189355 May 19 09:34:09.029737 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5706/7031] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:08 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1623 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:09.045431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:34:09.046025 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:09.052136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:09.052599 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:09.053409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:09.053862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:09.155296 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-13a7cff6-1c90-45a3-acdd-d9474ba16d0d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103/action" status: 202 len: 0 microversion: 2.1 time: 0.113538 May 19 09:34:09.155827 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5707/7032] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:34:09 2022] POST /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:34:09.163900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:09.164543 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:09.170888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:09.171337 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:09.172138 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:09.172589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:09.315906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:09.324157 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c6fb902e-d4b3-4224-b31b-02e071471544 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1631 microversion: 2.1 time: 0.164142 May 19 09:34:09.324760 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5708/7033] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:09 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1631 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:10.341943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:10.342615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:10.349810 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:10.350289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:10.351687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:10.352288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:10.517696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:10.525985 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7b6971ef-29ff-47a7-a1a5-53f727d2f12f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1631 microversion: 2.1 time: 0.187944 May 19 09:34:10.526983 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5709/7034] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:10 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1631 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:11.545816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:11.546491 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:11.553487 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:11.553972 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:11.554764 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:11.555210 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:11.703668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:11.713527 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a1680bc-45f7-42c3-83c8-712bc994ecb9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1631 microversion: 2.1 time: 0.171327 May 19 09:34:11.714200 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5710/7035] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:11 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1631 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:12.733407 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:12.734604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:12.743931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:12.744477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:12.745630 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:12.746091 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:12.897021 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:12.905465 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-779c52be-1ed6-43d3-a0a0-9215e1f96aed tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1631 microversion: 2.1 time: 0.177223 May 19 09:34:12.906057 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5711/7036] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:12 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1631 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:13.923325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:13.923949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:13.927126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=63 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:34:13.933429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:13.933901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:13.934684 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:13.935131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:14.090116 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:14.099603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d176b0b0-2596-4d08-995d-30ddbf509ac8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1631 microversion: 2.1 time: 0.179782 May 19 09:34:14.100586 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5712/7037] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:13 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1631 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:15.118957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:15.120145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:15.129917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:15.130482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:15.131521 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:15.132080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:15.491336 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:34:15.629869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:15.638512 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9cbcd6e3-95b3-40cc-962e-fe43bd37e373 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.524498 May 19 09:34:15.639111 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5713/7038] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:15 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:15.889364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-158af995-8b97-4de6-bb9b-46cf06d87c91 req-3ea4fdef-3d24-41af-9888-42b98393464f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:34:15.898546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-158af995-8b97-4de6-bb9b-46cf06d87c91 req-3ea4fdef-3d24-41af-9888-42b98393464f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:15.899252 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-158af995-8b97-4de6-bb9b-46cf06d87c91 req-3ea4fdef-3d24-41af-9888-42b98393464f service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:15.913502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-158af995-8b97-4de6-bb9b-46cf06d87c91 req-3ea4fdef-3d24-41af-9888-42b98393464f service nova] Creating event network-changed:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh1-842464-2 May 19 09:34:15.919861 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-158af995-8b97-4de6-bb9b-46cf06d87c91 req-3ea4fdef-3d24-41af-9888-42b98393464f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034837 May 19 09:34:15.920746 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5714/7039] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:34:16.665558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:16.666516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:16.673805 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:16.674276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:16.675068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:16.675700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:16.884616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:16.894309 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2b452788-c9c5-4514-b300-5bed5a391e3d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.240587 May 19 09:34:16.895443 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5715/7040] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:16 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:17.914238 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:17.915816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:17.923423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:17.923888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:17.924696 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:17.925153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:18.083657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:18.092735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5f6663f8-b6f1-4954-9410-e419ac2f4c9a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.183220 May 19 09:34:18.093346 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5716/7041] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:17 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:19.114136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:19.114879 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:19.123829 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:19.124468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:19.125427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:19.126089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:19.325134 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:19.333431 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b293e5c0-7cfc-40cb-a8b7-9c892bb9b30d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.223316 May 19 09:34:19.334038 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5717/7042] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:19 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:20.353011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:20.354898 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:20.362046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:20.363043 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:20.364299 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:20.365060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:20.574088 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:20.583288 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05ffabdb-a830-4fdb-b833-6e8c194ea649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.234806 May 19 09:34:20.591269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5718/7043] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:20 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:21.604597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:21.605343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:21.620713 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:21.621727 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:21.622959 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:21.623675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:21.861104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:21.872578 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10e62883-ec3b-4235-a439-ca9e3fe9b64f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.274604 May 19 09:34:21.873297 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5719/7044] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:21 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:22.892499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:22.893202 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:22.901417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:22.901878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:22.902668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:22.903126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:23.092270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:23.102684 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-578280fa-9d81-4425-84c1-002ec873e38f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.214120 May 19 09:34:23.114306 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5720/7045] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:22 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:24.122734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:24.123545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:24.130872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:24.131333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:24.132312 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:24.133098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:24.342425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:24.359740 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-69bba447-9fa7-4533-9b77-83da619d11b0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.239440 May 19 09:34:24.360259 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5721/7046] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:24 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:25.381291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:25.382857 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:25.391247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:25.391719 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:25.392535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:25.393089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:25.589411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:25.597833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eabca5d7-decf-4e4b-801d-342f0bc78f7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.220590 May 19 09:34:25.598465 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5722/7047] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:25 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:26.617122 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:26.618133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:26.630627 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:26.631400 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:26.632955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:26.633836 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:26.846632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:26.855930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-673ed1ec-df10-4a2b-a376-0cc2bad2770d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.243405 May 19 09:34:26.856551 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5723/7048] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:26 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:27.874427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:27.875955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:27.884816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:27.885291 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:27.886281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:27.886953 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:28.074376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:28.082486 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b541f140-1f6b-4824-b53f-c3b79273f738 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.211958 May 19 09:34:28.083102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5724/7049] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:27 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:34:29.101105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:29.102244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:29.109865 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:29.110334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:29.111141 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:29.111594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:29.291844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:29.304227 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-78d71cca-8326-4052-a879-057bf6126526 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.206563 May 19 09:34:29.305338 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5725/7050] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:29 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:29.377540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-be6807c2-a820-4b29-b9da-eab7755a21ca req-7d5524f4-3393-4f80-87ad-1395f3cc4539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "name": "network-vif-plugged", "status": "completed", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:34:29.386954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-be6807c2-a820-4b29-b9da-eab7755a21ca req-7d5524f4-3393-4f80-87ad-1395f3cc4539 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:29.387429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-be6807c2-a820-4b29-b9da-eab7755a21ca req-7d5524f4-3393-4f80-87ad-1395f3cc4539 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:29.408158 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-be6807c2-a820-4b29-b9da-eab7755a21ca req-7d5524f4-3393-4f80-87ad-1395f3cc4539 service nova] Creating event network-vif-plugged:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh1-842464-2 May 19 09:34:29.413701 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-be6807c2-a820-4b29-b9da-eab7755a21ca req-7d5524f4-3393-4f80-87ad-1395f3cc4539 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039944 May 19 09:34:29.414337 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5726/7051] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:34:30.331372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:30.332080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:30.342335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:30.343047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:30.344306 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:30.345018 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:30.500326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:30.508828 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-16f6f3fe-1fba-45be-ba18-bd500229fe38 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1689 microversion: 2.1 time: 0.182468 May 19 09:34:30.509458 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5727/7052] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:30 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:34:31.527425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:34:31.528230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:34:31.541045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:31.541564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:31.542551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:34:31.543005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:34:31.701438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:34:31.709579 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4af6d624-e5b9-4f5c-9bf0-393f184e94d8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1676 microversion: 2.1 time: 0.186813 May 19 09:34:31.710959 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5728/7053] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:34:31 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:35:48.344448 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=33 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:35:48.345254 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=84 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:35:48.351438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:35:48.351957 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:35:48.359589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:48.359971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:48.360772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:48.361225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:48.399748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:35:48.497004 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83c4ef84-f434-44ae-ace4-7a8c25acc3ca tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 204 len: 0 microversion: 2.1 time: 0.154601 May 19 09:35:48.497944 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5729/7054] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:35:48 2022] DELETE /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:35:48.507414 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-75d1e35f-52bb-4a8c-be88-5c1363c5fdd4 req-82d4c6cd-bb4b-4d81-bf15-9329b8ef98af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:35:48.515850 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-75d1e35f-52bb-4a8c-be88-5c1363c5fdd4 req-82d4c6cd-bb4b-4d81-bf15-9329b8ef98af service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:48.516316 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-75d1e35f-52bb-4a8c-be88-5c1363c5fdd4 req-82d4c6cd-bb4b-4d81-bf15-9329b8ef98af service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:48.528771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-75d1e35f-52bb-4a8c-be88-5c1363c5fdd4 req-82d4c6cd-bb4b-4d81-bf15-9329b8ef98af service nova] Creating event network-changed:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh1-842464-2 May 19 09:35:48.533741 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-75d1e35f-52bb-4a8c-be88-5c1363c5fdd4 req-82d4c6cd-bb4b-4d81-bf15-9329b8ef98af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031076 May 19 09:35:48.534358 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5730/7055] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:35:48.540878 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:35:48.541655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:35:48.549611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:48.550308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:48.551247 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:48.551851 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:48.701562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:35:48.710344 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b3cebae7-fb50-4d27-b390-c0bf52fdccda tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.174651 May 19 09:35:48.710952 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5731/7056] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:35:48 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:35:49.728927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:35:49.729641 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:35:49.737864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:49.738334 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:49.739183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:49.739647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:49.990222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:35:50.006280 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-36821b7f-ee6f-4736-844b-a0297f9bbd74 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 200 len: 1682 microversion: 2.1 time: 0.282070 May 19 09:35:50.007187 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5732/7057] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:35:49 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 1682 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:35:50.549980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-4fb9ae59-b6c6-4742-8e34-b8b87934aa37 req-5292d5c9-3c77-40f5-9c0d-f0d3a65a3568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e178a1-407e-48f6-99d0-7e38bfd3f103", "name": "network-vif-deleted", "tag": "13b32a53-e4dc-4151-b58d-4c1c81787c54"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:35:50.558216 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4fb9ae59-b6c6-4742-8e34-b8b87934aa37 req-5292d5c9-3c77-40f5-9c0d-f0d3a65a3568 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:50.558816 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-4fb9ae59-b6c6-4742-8e34-b8b87934aa37 req-5292d5c9-3c77-40f5-9c0d-f0d3a65a3568 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:50.571942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-4fb9ae59-b6c6-4742-8e34-b8b87934aa37 req-5292d5c9-3c77-40f5-9c0d-f0d3a65a3568 service nova] Creating event network-vif-deleted:13b32a53-e4dc-4151-b58d-4c1c81787c54 for instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 on chh1-842464-2 May 19 09:35:50.577584 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-4fb9ae59-b6c6-4742-8e34-b8b87934aa37 req-5292d5c9-3c77-40f5-9c0d-f0d3a65a3568 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 May 19 09:35:50.578223 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5733/7058] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:35:51.025439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:35:51.026170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: b4e178a1-407e-48f6-99d0-7e38bfd3f103] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:35:51.032637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:51.033180 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:51.034082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:35:51.034554 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:35:51.049868 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] HTTP exception thrown: Instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 could not be found. May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Request method failure captured: May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 HTTP/1.1 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihg5qb4Sg3K5VoIrpYbZ28UdIeVENLz-7IMg1FnCgk9oib8MBZVC-rYI7rJseZ3spjSne_ca-2pVF556alTbGRO9qAC73hdzlWg2OrISrL6vdaLfpsJFKsQ0t9NQyyjO4FEV8hYzhCNOk4ePC5OvlX40rh6sLNTuC_Xxji9RugKJzW8c May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9ceabd32808442f29c727435c80d17de May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestShelveInstance-774480905 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9ceabd32808442f29c727435c80d17de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ceabd32808442f29c727435c80d17de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9ceabd32808442f29c727435c80d17de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ceabd32808442f29c727435c80d17de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestShelveInstance-774480905 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9ceabd32808442f29c727435c80d17de May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestShelveInstance-774480905 May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestShelveInstance-774480905-project May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3ae8f19f10fe4fbc96907f9e31db963f May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestShelveInstance-774480905-project May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 could not be found. May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'b4e178a1-407e-48f6-99d0-7e38bfd3f103'} May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 could not be found. May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 could not be found. May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:35:51.051563 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 could not be found. May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Returning 404 to user: Instance b4e178a1-407e-48f6-99d0-7e38bfd3f103 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-853331c9-327d-4588-a7dd-2efdb3631a04 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103" status: 404 len: 111 microversion: 2.1 time: 0.033119 May 19 09:35:51.056856 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5734/7059] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:35:51 2022] GET /compute/v2.1/servers/b4e178a1-407e-48f6-99d0-7e38bfd3f103 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:35:51.236520 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8e50e722-1a51-43af-a762-c80933b09220 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '.version_select at 0x7f3215228820>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:35:51.239810 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8e50e722-1a51-43af-a762-c80933b09220 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 09:35:52.247752 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [None req-8e50e722-1a51-43af-a762-c80933b09220 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58496. May 19 09:35:52.270068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8e50e722-1a51-43af-a762-c80933b09220 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1637998504" status: 202 len: 0 microversion: 2.1 time: 1.038289 May 19 09:35:52.270662 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5735/7060] 10.222.0.78 () {58 vars in 1253 bytes} [Thu May 19 09:35:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1637998504 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:35:52.296979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95fe4e0d-de12-4eac-a938-3f5561cc5585 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'create', calling method: .version_select at 0x7f3211c7c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-206998652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXOSis9yuhq3x0+O8asEKLdRaPNPm7z0ZUVB42aMOhw1NpgrVIh9o0W6KbJ31KMO3o8rjqdtkoF1U0Uc5gIk+g+wBZSscJykhDG2qUXgtuBE9fcayw9kjqYirRvtDGURQ=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:35:52.312302 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-95fe4e0d-de12-4eac-a938-3f5561cc5585 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for project 9ceabd32808442f29c727435c80d17de. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:35:52.317511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-95fe4e0d-de12-4eac-a938-3f5561cc5585 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for user 3ae8f19f10fe4fbc96907f9e31db963f and project 9ceabd32808442f29c727435c80d17de. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:35:52.343768 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95fe4e0d-de12-4eac-a938-3f5561cc5585 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050787 May 19 09:35:52.344437 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5736/7061] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:35:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:36:16.258655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:16.259446 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:16.260144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:16.264659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-766797161", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-206998652", "security_groups": [{"name": "tempest-secgroup-smoke-1860994216"}], "networks": [{"uuid": "b34b3946-f205-4802-8b00-9cd060a160fa"}], "block_device_mapping_v2": [{"uuid": "6afe17d6-2826-489b-82e2-cc84027cf3fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:36:16.389512 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] validate_networks() for [('b34b3946-f205-4802-8b00-9cd060a160fa', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:36:16.807709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:36:16.808146 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:36:16.808639 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:36:16.809328 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:36:16.809701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:36:16.818955 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:16.819481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:16.820215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:16.820657 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:16.838551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for project 9ceabd32808442f29c727435c80d17de. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:36:16.843922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Getting quotas for user 3ae8f19f10fe4fbc96907f9e31db963f and project 9ceabd32808442f29c727435c80d17de. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:36:16.909551 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:36:16.912234 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6afe17d6-2826-489b-82e2-cc84027cf3fb',volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:36:17.051922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40ab1359-0185-49da-acf6-d98ac8f049a9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.795202 May 19 09:36:17.052710 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5737/7062] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:36:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:36:17.062529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0140b08c-ea2a-4862-ba6b-e4d680513473 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:17.063288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0140b08c-ea2a-4862-ba6b-e4d680513473 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:17.128056 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0140b08c-ea2a-4862-ba6b-e4d680513473 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:17.135799 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0140b08c-ea2a-4862-ba6b-e4d680513473 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1087 microversion: 2.1 time: 0.077046 May 19 09:36:17.136405 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5738/7063] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:17 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:18.152948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dc4c39a-770b-4672-b227-d77749df921f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:18.153679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8dc4c39a-770b-4672-b227-d77749df921f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:18.216375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8dc4c39a-770b-4672-b227-d77749df921f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:18.223306 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8dc4c39a-770b-4672-b227-d77749df921f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1087 microversion: 2.1 time: 0.074282 May 19 09:36:18.223890 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5739/7064] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:18 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1087 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:19.246980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e355d240-439e-4756-ae4d-905df7d72983 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:19.247771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e355d240-439e-4756-ae4d-905df7d72983 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:19.320004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e355d240-439e-4756-ae4d-905df7d72983 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:19.327660 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e355d240-439e-4756-ae4d-905df7d72983 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1087 microversion: 2.1 time: 0.084414 May 19 09:36:19.328260 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5740/7065] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:19 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:36:20.345561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5d617c5b-1db7-4f7c-aa60-4b41f2f5b557 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:20.346445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5d617c5b-1db7-4f7c-aa60-4b41f2f5b557 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:20.412493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5d617c5b-1db7-4f7c-aa60-4b41f2f5b557 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:20.428236 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5d617c5b-1db7-4f7c-aa60-4b41f2f5b557 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1087 microversion: 2.1 time: 0.086578 May 19 09:36:20.428903 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5741/7066] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:20 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:36:21.446279 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:21.446949 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:21.454605 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:21.455071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:21.455884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:21.456335 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:21.527208 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:21.536817 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-87a68671-713f-49d9-b06d-ad02116fb711 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1137 microversion: 2.1 time: 0.094394 May 19 09:36:21.537459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5742/7067] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:21 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:22.556319 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:22.556963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:22.564968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:22.565702 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:22.566513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:22.566963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:22.651704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:22.667450 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e462a0e8-bab4-4afc-b980-45fb845e703d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1203 microversion: 2.1 time: 0.116426 May 19 09:36:22.668575 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5743/7068] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:22 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:23.687675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:23.689325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:23.700587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:23.701372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:23.702478 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:23.703773 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:23.981956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:23.994475 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f3eebaa-e736-47ce-b94b-4f8a31cfc7ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.311291 May 19 09:36:23.995626 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5744/7069] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:23 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:24.166789 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-36a6cfa6-acb8-483e-affa-790f767045ca req-5fea2238-f7c0-435f-8997-8dddc22be33b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:36:24.194990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-36a6cfa6-acb8-483e-affa-790f767045ca req-5fea2238-f7c0-435f-8997-8dddc22be33b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:24.196394 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-36a6cfa6-acb8-483e-affa-790f767045ca req-5fea2238-f7c0-435f-8997-8dddc22be33b service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:24.208723 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-36a6cfa6-acb8-483e-affa-790f767045ca req-5fea2238-f7c0-435f-8997-8dddc22be33b service nova] Creating event network-changed:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh2-842464-2 May 19 09:36:24.216624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-36a6cfa6-acb8-483e-affa-790f767045ca req-5fea2238-f7c0-435f-8997-8dddc22be33b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065932 May 19 09:36:24.220367 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5745/7070] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:36:25.014529 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:25.015962 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:25.023422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:25.024194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:25.025012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:25.025513 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:25.295652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:25.307112 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0e787e7d-30c3-4c6d-aee5-cb9139c46382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.297961 May 19 09:36:25.308416 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5746/7071] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:25 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:26.328179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:26.328844 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:26.337340 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:26.337808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:26.338687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:26.339148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:26.503565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:26.513511 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6b76761-9aaf-437a-9d37-cc3de6811be4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.189146 May 19 09:36:26.514269 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5747/7072] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:26 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:27.532240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:27.533081 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:27.535218 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:27.542323 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:27.542786 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:27.543611 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:27.544063 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:27.697484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:27.706283 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3ccb01f1-6818-421c-affc-f07f33796315 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.177819 May 19 09:36:27.706904 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5748/7073] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:27 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:28.724827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:28.726034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:28.734320 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:28.734795 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:28.735614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:28.736074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:28.924787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:28.934078 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-83e816ff-191d-4993-bc3c-e0c65f37973a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.213351 May 19 09:36:28.934669 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5749/7074] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:28 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:29.951996 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:29.952689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:29.960569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:29.961046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:29.961913 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:29.962373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:30.121787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:30.129908 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5c5aef5c-b9d7-47f4-a23b-6301bf314382 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.181845 May 19 09:36:30.130503 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5750/7075] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:29 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:31.152363 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=14 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:31.242354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:31.242976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:31.252225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:31.252890 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:31.254101 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:31.254580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:31.424136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:31.433881 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67322aa3-5588-4250-a138-489b39657a23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.288475 May 19 09:36:31.434830 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5751/7076] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:31 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:32.452214 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:32.453062 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:32.460846 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:32.461384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:32.462206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:32.462673 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:32.626945 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:32.636529 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-52878057-1223-48a3-9a58-88857297bb8a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1271 microversion: 2.1 time: 0.188599 May 19 09:36:32.637432 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5752/7077] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:32 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:36:33.658766 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:33.659952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:33.671362 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:33.672038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:33.673261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:33.674022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:33.848090 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:33.856833 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-12d3d10f-cfb0-47a7-bc29-51880877a122 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.205768 May 19 09:36:33.857483 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5753/7078] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:33 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:36:34.878711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:34.879372 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:34.887289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:34.887762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:34.888564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:34.889023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:35.043691 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:35.051755 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-edf24cd5-e915-4427-9120-417b8513e999 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.176853 May 19 09:36:35.052362 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5754/7079] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:34 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:36.070390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:36.071085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:36.078033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:36.078495 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:36.079280 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:36.079726 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:36.246046 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:36.255353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9463f76-b023-4fe8-ba8a-243fb1e08f15 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.188860 May 19 09:36:36.255952 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5755/7080] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:36 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:37.271941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:37.273438 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:37.280288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:37.280760 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:37.281592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:37.282052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:37.430565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:37.439503 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d3c87c93-8eec-449c-ae38-bd745c6c4c7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.171505 May 19 09:36:37.440112 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5756/7081] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:37 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:38.456640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:38.457344 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:38.466276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:38.466828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:38.467664 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:38.468127 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:38.639142 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:38.648501 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-369a43f7-84db-4ccb-8922-b0a8195180c8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.195734 May 19 09:36:38.649109 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5757/7082] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:38 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:39.666297 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:39.667007 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:39.674217 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:39.674672 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:39.675480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:39.675912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:39.823177 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:39.826779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=100 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:39.832599 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4eabc19-361f-46eb-8e7d-ddb7ca31eeba tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.170679 May 19 09:36:39.833224 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5758/7083] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:39 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:40.851245 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:40.852096 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:40.859884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:40.860354 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:40.861171 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:40.861723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:41.052227 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:41.062950 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-912bb831-e471-49b5-8433-86e44de5b900 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.216039 May 19 09:36:41.063563 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5759/7084] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:40 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:42.087988 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:42.089351 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:42.101498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:42.102284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:42.103632 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:42.104445 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:42.330433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:42.343945 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1fbf3761-142d-4252-b31d-b6013e7f69ab tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.265285 May 19 09:36:42.344966 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5760/7085] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:42 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:36:43.455408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a901fd1d-96da-4c82-8b86-b9a4f6c08b88 req-756e8c2a-7e0e-4ca6-bcc9-042520fbeeef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "name": "network-vif-plugged", "status": "completed", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:36:43.466565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a901fd1d-96da-4c82-8b86-b9a4f6c08b88 req-756e8c2a-7e0e-4ca6-bcc9-042520fbeeef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:43.467278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a901fd1d-96da-4c82-8b86-b9a4f6c08b88 req-756e8c2a-7e0e-4ca6-bcc9-042520fbeeef service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:43.479998 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a901fd1d-96da-4c82-8b86-b9a4f6c08b88 req-756e8c2a-7e0e-4ca6-bcc9-042520fbeeef service nova] Creating event network-vif-plugged:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh2-842464-2 May 19 09:36:43.486307 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a901fd1d-96da-4c82-8b86-b9a4f6c08b88 req-756e8c2a-7e0e-4ca6-bcc9-042520fbeeef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123675 May 19 09:36:43.486869 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5761/7086] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:36:43.493028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:43.493799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:43.500600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:43.501071 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:43.501921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:43.502382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:43.713778 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:43.722125 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b840427c-e74c-4564-b2b1-5380d59a6349 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.233922 May 19 09:36:43.722639 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5762/7087] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:43 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:36:44.741658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:44.742700 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:44.749145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:44.749665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:44.750452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:44.750906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:44.906303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:44.914629 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ca3e93c4-044f-4327-a9eb-9f3b96e2f2ac tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1259 microversion: 2.1 time: 0.177998 May 19 09:36:44.915231 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5763/7088] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:44 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:45.933859 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:45.934979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:45.944656 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:45.945153 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:45.945992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:45.946451 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:46.093430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:46.102230 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0378631-acc3-4b54-8f38-ed272b688d31 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1443 microversion: 2.1 time: 0.174860 May 19 09:36:46.102864 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5764/7089] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:45 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:46.119047 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:36:46.119677 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:36:46.125906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:46.126366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:46.127196 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:46.127644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:46.273137 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:36:46.281991 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b2f05a61-b0c8-4dc6-abd2-c4ebd12cf1d4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1443 microversion: 2.1 time: 0.167312 May 19 09:36:46.282603 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5765/7090] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:36:46 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1443 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:36:47.439712 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:36:47.440690 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:36:48.348690 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-133926e5-5740-4995-bdfd-bad5346a050f req-522bd0c1-5a63-482c-b207-5ba94535afdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:36:48.361114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:36:48.363515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-133926e5-5740-4995-bdfd-bad5346a050f req-522bd0c1-5a63-482c-b207-5ba94535afdf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:36:48.364225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-133926e5-5740-4995-bdfd-bad5346a050f req-522bd0c1-5a63-482c-b207-5ba94535afdf service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:36:48.379522 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-133926e5-5740-4995-bdfd-bad5346a050f req-522bd0c1-5a63-482c-b207-5ba94535afdf service nova] Creating event network-changed:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh2-842464-2 May 19 09:36:48.392775 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-133926e5-5740-4995-bdfd-bad5346a050f req-522bd0c1-5a63-482c-b207-5ba94535afdf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131383 May 19 09:36:48.393689 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5766/7091] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:37:06.371221 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:37:06.371861 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:37:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:38:46.068430 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 09:38:46.069255 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6898fb1f-7835-4c58-8cbc-cf977775b0e2] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 09:38:46.069918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=40 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:38:46.070682 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:38:46.075790 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:38:46.076423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:46.083497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:46.083956 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:46.084736 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:46.085178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:46.110304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lazy-loading 'flavor' on Instance uuid 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:38:46.187548 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d2249f56-e369-4dc8-bc4a-2e9a3ef89e7d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2/action" status: 202 len: 0 microversion: 2.1 time: 0.120833 May 19 09:38:46.188190 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5767/7092] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:38:46 2022] POST /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:38:46.196993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:46.197781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:46.205647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:46.206143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:46.206963 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:46.207425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:46.357785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:46.366232 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1806dc1c-37c1-4373-9823-8f353cd5aba1 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.173516 May 19 09:38:46.366828 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5768/7093] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:46 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:38:47.382906 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:47.383588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:47.392827 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:47.393298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:47.394450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:47.394967 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:47.404377 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [6898fb1f-7835-4c58-8cbc-cf977775b0e2] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58796. May 19 09:38:47.414304 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58794. May 19 09:38:47.536239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:47.545034 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8bd8698b-c3d0-4c20-9d24-c05cea262b69 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.165982 May 19 09:38:47.545653 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5769/7094] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:47 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:48.565903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:48.566558 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:48.574169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:48.574714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:48.575516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:48.575971 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:48.732582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:48.741092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d37d9d1-f14e-4230-b398-227c27d469a8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.179190 May 19 09:38:48.741929 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5770/7095] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:48 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:49.767699 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:49.768464 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:49.776061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:49.777059 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:49.778172 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:49.778637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:49.939954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:49.947890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6733b0b3-be5c-45c4-a2c8-a8703d241001 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.184169 May 19 09:38:49.948994 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5771/7096] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:49 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:50.965951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:50.966752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:50.973894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:50.974364 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:50.975168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:50.975623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:51.117086 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:51.124942 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bcd447ba-8c71-49b8-8fa8-62a3c1a5028f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.163794 May 19 09:38:51.125556 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5772/7097] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:50 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:52.142658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:52.143360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:52.151017 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:52.151482 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:52.153223 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:52.153730 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:52.300126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:52.309468 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-33690b7f-9762-4f3e-91d8-86b48f301caa tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.170578 May 19 09:38:52.310158 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5773/7098] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:52 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:53.327375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:53.327994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:53.335114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:53.335587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:53.336388 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:53.336849 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:53.478410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:53.488839 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bb55c789-9a33-4cf3-a36e-53f134ca133b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.165585 May 19 09:38:53.489459 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5774/7099] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:53 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:54.506463 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:54.507156 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:54.515540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:54.516009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:54.516835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:54.517283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:54.678589 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:54.688167 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-18b776a7-bb56-4570-9e9a-960da95bc422 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.185520 May 19 09:38:54.688775 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5775/7100] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:54 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:55.715516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:55.716610 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:55.724557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:55.725027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:55.725889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:55.726342 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:55.903738 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:55.912532 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3d625752-794b-48f8-81b1-a3d7ae8f950e tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.201493 May 19 09:38:55.913173 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5776/7101] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:55 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:56.932492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:56.934355 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:56.942450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:56.942941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:56.943717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:56.944198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:57.134951 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:57.143460 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-71e47b8a-2401-4f3a-969c-3ac4084feea4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.214906 May 19 09:38:57.144080 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5777/7102] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:56 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:58.161423 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:58.162313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:58.175253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:58.176003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:58.177343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:58.178012 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:58.454486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:58.462437 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-807d0c6a-0bb9-4ebf-a8c8-75dbf2b3bcde tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.305134 May 19 09:38:58.463031 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5778/7103] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:58 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:38:59.480466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:38:59.481197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:38:59.489725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:59.490038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:59.490854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:38:59.491307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:38:59.660309 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:38:59.673798 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b67059b5-0209-4a55-bc99-9816496a5426 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.197111 May 19 09:38:59.674476 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5779/7104] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:38:59 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:39:00.694329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:00.695303 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:00.703381 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:00.704024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:00.704869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:00.705444 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:00.864241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:00.873764 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19152012-fb11-4cd0-b101-9b1d83552a10 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.183972 May 19 09:39:00.874386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5780/7105] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:00 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:39:01.891927 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:01.892808 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:01.900703 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:01.901165 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:01.902331 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:01.902620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:01.924023 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:39:02.108825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:02.127973 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a008fd87-1353-42dc-b8ea-be697b1b503a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.239988 May 19 09:39:02.139488 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5781/7106] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:01 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:02.139488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-329c0ad6-d2d6-421e-9159-00b28f04f00b req-a8fedf9b-711e-43b1-839d-b3f10bef7cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "name": "network-vif-unplugged", "status": "completed", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:39:02.154926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-329c0ad6-d2d6-421e-9159-00b28f04f00b req-a8fedf9b-711e-43b1-839d-b3f10bef7cd8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:02.155620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-329c0ad6-d2d6-421e-9159-00b28f04f00b req-a8fedf9b-711e-43b1-839d-b3f10bef7cd8 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:02.173865 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-329c0ad6-d2d6-421e-9159-00b28f04f00b req-a8fedf9b-711e-43b1-839d-b3f10bef7cd8 service nova] Creating event network-vif-unplugged:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh2-842464-2 May 19 09:39:02.181589 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-329c0ad6-d2d6-421e-9159-00b28f04f00b req-a8fedf9b-711e-43b1-839d-b3f10bef7cd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049847 May 19 09:39:02.183683 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5782/7107] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:39:03.149154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:03.149903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:03.158370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:03.158853 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:03.159722 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:03.160179 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:03.390650 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:03.400018 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eef2300d-089e-4283-8377-f44426770efc tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1569 microversion: 2.1 time: 0.256247 May 19 09:39:03.400532 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5783/7108] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:03 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:39:03.429468 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:39:03.430571 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:03.444462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:03.444934 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:03.445799 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:03.446256 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:03.541831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a42b537-d75a-4db9-82bf-4e90282ba693 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "POST /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2/action" status: 202 len: 0 microversion: 2.1 time: 0.119654 May 19 09:39:03.543056 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5784/7109] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:39:03 2022] POST /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:39:03.551503 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:03.552150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:03.559717 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:03.560215 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:03.561061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:03.561581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:03.819175 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:03.834471 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1585aa7c-9075-4399-9591-10b5d94869a4 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1517 microversion: 2.1 time: 0.286432 May 19 09:39:03.835598 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5785/7110] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:03 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1517 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:04.857367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:04.858535 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:04.868800 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:04.869270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:04.871028 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:04.871564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:05.061130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:05.070397 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e90f1d8-271e-4a6e-8d06-de13cd725e2b tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.221281 May 19 09:39:05.071193 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5786/7111] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:04 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:06.093470 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:06.094889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:06.103897 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:06.104655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:06.105772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:06.106433 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:06.294811 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:06.311505 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b4e507cc-14f4-446f-8fde-2b97d322cc14 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.223907 May 19 09:39:06.312838 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5787/7112] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:06 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:07.338654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:07.340380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:07.348771 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:07.349249 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:07.350112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:07.350564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:07.564085 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:07.574440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-233cdda8-cd7c-4915-9e50-2f51d825acb0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.239671 May 19 09:39:07.575067 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5788/7113] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:07 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:08.596251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:08.597347 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:08.610132 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:08.612002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:08.613640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:08.614477 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:08.872001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:08.882546 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-55597676-a918-49f2-9297-4a1564ff13bf tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.291702 May 19 09:39:08.883400 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5789/7114] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:08 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:39:09.906178 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:09.907490 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:09.920524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:09.921343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:09.922979 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:09.923580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:10.147638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:10.163068 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ded34086-ac3b-4d9d-9375-259a76ddcb95 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.264290 May 19 09:39:10.163611 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5790/7115] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:09 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:11.184145 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:11.185038 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:11.194698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:11.195310 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:11.196304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:11.196812 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:11.358053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:11.368598 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5cded44e-4f16-4924-bcda-06321cc10cd2 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.190507 May 19 09:39:11.369511 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5791/7116] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:11 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:12.398020 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:12.399286 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:12.413442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:12.414263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:12.415746 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:12.416550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:12.656549 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:12.674444 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-212f9d58-b4c5-49cb-b78b-c7df13c8d91f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.283681 May 19 09:39:12.675519 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5792/7117] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:12 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:13.704079 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:13.704910 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:13.713067 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:13.714001 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:13.714912 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:13.715389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:13.868689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:13.883965 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7c465653-09c8-42a9-abbe-6f1cfd26e305 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.184761 May 19 09:39:13.885074 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5793/7118] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:13 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:14.909809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:14.910497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:14.918333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:14.918728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:14.919582 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:14.920045 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:15.106626 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:15.115624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f3505285-71b0-4c94-a0d3-9df640544845 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.209711 May 19 09:39:15.116228 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5794/7119] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:14 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:16.133924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:16.134588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:16.138161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=59 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:39:16.144285 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:16.144952 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:16.146004 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:16.146564 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:16.639239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:16.648456 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a4e62c32-e4b4-4489-a3ab-102a3e5b124a tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1519 microversion: 2.1 time: 0.518461 May 19 09:39:16.649326 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5795/7120] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:16 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1519 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:39:17.670308 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:17.671350 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:17.678976 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:17.679458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:17.680300 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:17.680881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:17.899772 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:17.908404 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a6080394-bc62-42dd-a0ee-dd12a033881f tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.244986 May 19 09:39:17.909094 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5796/7121] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:17 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:18.544112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-62cded0f-7b97-4851-9eb2-f4daa5a74ba2 req-4595a19c-df59-40f7-a6d8-c63c3d39f5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:39:18.553120 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-62cded0f-7b97-4851-9eb2-f4daa5a74ba2 req-4595a19c-df59-40f7-a6d8-c63c3d39f5be service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:18.553614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-62cded0f-7b97-4851-9eb2-f4daa5a74ba2 req-4595a19c-df59-40f7-a6d8-c63c3d39f5be service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:18.568113 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-62cded0f-7b97-4851-9eb2-f4daa5a74ba2 req-4595a19c-df59-40f7-a6d8-c63c3d39f5be service nova] Creating event network-changed:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh1-842464-2 May 19 09:39:18.574676 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-62cded0f-7b97-4851-9eb2-f4daa5a74ba2 req-4595a19c-df59-40f7-a6d8-c63c3d39f5be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147780 May 19 09:39:18.575315 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5797/7122] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:39:18.931930 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:18.933450 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:18.940469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:18.940942 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:18.941991 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:18.942547 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:18.965170 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:39:19.197269 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:19.208217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e484055a-bf52-409e-b819-41db38e5151c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.281657 May 19 09:39:19.208832 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5798/7123] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:18 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:20.235359 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:20.235980 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:20.242982 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:20.243443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:20.244226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:20.245327 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:20.401998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:20.409961 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c857f42b-c010-4c7d-b537-d741dc7b9252 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.178859 May 19 09:39:20.410560 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5799/7124] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:20 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:21.427382 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:21.428077 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:21.436183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:21.436663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:21.437588 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:21.438130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:21.602728 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:21.611910 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-b89abe5b-84b3-4eff-95f3-91f419957f23 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.188398 May 19 09:39:21.612512 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5800/7125] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:21 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:22.631332 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:22.632078 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:22.640472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:22.640948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:22.641828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:22.642474 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:22.829907 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:22.842541 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0106b003-cef7-4f9a-987a-444dbf8fb433 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.215024 May 19 09:39:22.843422 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5801/7126] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:22 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:23.866283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:23.866985 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:23.875595 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:23.876058 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:23.876994 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:23.877484 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:24.057082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:24.068126 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8feb0ee3-ab55-4c66-9f60-8f27561f24c0 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.205982 May 19 09:39:24.069022 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5802/7127] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:23 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:25.087592 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:25.088283 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:25.096436 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:25.096895 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:25.097748 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:25.098201 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:25.255752 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:25.264927 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4cdae0ae-b354-4415-be3b-9ab9a1996649 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.181261 May 19 09:39:25.265675 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5803/7128] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:25 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:26.283082 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:26.283710 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:26.291109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:26.291577 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:26.292781 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:26.293261 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:26.455977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:26.464625 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-85fda5cf-0626-464c-a42d-bf252502ca3c tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.185449 May 19 09:39:26.465241 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5804/7129] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:26 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:27.482298 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:27.482969 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:27.490652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:27.491118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:27.491919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:27.492375 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:27.653437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:27.662217 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-aa14be85-7dc6-4c71-9a07-076a4aa12668 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.184042 May 19 09:39:27.662825 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5805/7130] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:27 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:28.682352 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:28.683212 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:28.691074 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:28.691637 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:28.692545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:28.692992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:28.881734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:28.890930 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-af8fabe0-2e08-4dc8-9813-6ce654569ad9 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.214413 May 19 09:39:28.891525 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5806/7131] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:28 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:29.908033 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:29.908716 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:29.916891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:29.917562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:29.918428 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:29.918888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:30.063494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:30.072490 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8dd2ab66-9876-45b9-87e7-dabd00b87bd7 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.168385 May 19 09:39:30.073121 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5807/7132] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:29 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:30.638948 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-f4b7e674-8814-4516-9f93-5232e28d90cf req-c5dff1e7-c713-460f-bdc8-49a02d4d87b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "name": "network-vif-plugged", "status": "completed", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:39:30.649161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f4b7e674-8814-4516-9f93-5232e28d90cf req-c5dff1e7-c713-460f-bdc8-49a02d4d87b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:30.653921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-f4b7e674-8814-4516-9f93-5232e28d90cf req-c5dff1e7-c713-460f-bdc8-49a02d4d87b7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:30.663563 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-f4b7e674-8814-4516-9f93-5232e28d90cf req-c5dff1e7-c713-460f-bdc8-49a02d4d87b7 service nova] Creating event network-vif-plugged:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh1-842464-2 May 19 09:39:30.670463 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-f4b7e674-8814-4516-9f93-5232e28d90cf req-c5dff1e7-c713-460f-bdc8-49a02d4d87b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035840 May 19 09:39:30.671357 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5808/7133] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:39:31.092109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:31.092822 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:31.099485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:31.099943 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:31.100747 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:31.101197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:31.259265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:31.267603 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8692b851-879e-487e-8ddc-cdc1e2e4d737 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1575 microversion: 2.1 time: 0.181170 May 19 09:39:31.268254 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5809/7134] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:31 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:39:32.286813 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:39:32.287623 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:39:32.295439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:32.295915 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:32.296723 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:39:32.297183 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:39:32.441126 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:39:32.449699 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-9e8a8c0b-8a6b-45cf-b24c-a3d671261071 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1562 microversion: 2.1 time: 0.166903 May 19 09:39:32.450289 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5810/7135] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:39:32 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:07.452547 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:40:07.453175 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:40:26.380149 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:40:26.380884 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:40:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:40:46.860704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=31 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:40:46.862977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=70 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:40:46.870053 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:46.870877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:46.881150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:46.881938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:46.882762 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:46.883559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:46.916389 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:40:47.028557 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e02d0fb5-9c80-406a-97a2-58101cd8b239 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "DELETE /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 204 len: 0 microversion: 2.1 time: 0.172713 May 19 09:40:47.033805 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5811/7136] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:40:46 2022] DELETE /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 09:40:47.036186 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-ef085d62-91ec-4ed4-acdc-3df491de6ab6 req-f81a8b3a-6d71-4dc0-a242-e092746dde32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:40:47.045537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ef085d62-91ec-4ed4-acdc-3df491de6ab6 req-f81a8b3a-6d71-4dc0-a242-e092746dde32 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:47.046044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-ef085d62-91ec-4ed4-acdc-3df491de6ab6 req-f81a8b3a-6d71-4dc0-a242-e092746dde32 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:47.059271 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-ef085d62-91ec-4ed4-acdc-3df491de6ab6 req-f81a8b3a-6d71-4dc0-a242-e092746dde32 service nova] Creating event network-changed:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh1-842464-2 May 19 09:40:47.065751 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-ef085d62-91ec-4ed4-acdc-3df491de6ab6 req-f81a8b3a-6d71-4dc0-a242-e092746dde32 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 May 19 09:40:47.066432 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5812/7137] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:40:47.072131 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:47.072838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:47.081386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:47.081652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:47.082429 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:47.082881 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:47.256998 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:47.265768 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d84159eb-ddb7-49d2-bc25-802fe9cabd6d tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.197954 May 19 09:40:47.266403 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5813/7138] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:47 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:40:48.284888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:48.285565 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:48.292954 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:48.293515 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:48.294226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:48.295241 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:48.447425 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:48.456105 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5be0e073-a85c-4eea-9941-e9db8fab3b71 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1568 microversion: 2.1 time: 0.175197 May 19 09:40:48.456686 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5814/7139] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:48 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:49.088437 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-6797d4d0-cbde-436e-b911-1af8763715fb req-a4e917cb-081c-4769-aeec-1d54978848cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ad0c32-d3c5-40a9-a50b-93e953b1d3a2", "name": "network-vif-deleted", "tag": "b1bd2dd7-ced2-41ad-8640-0ceed5e4a625"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:40:49.098064 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6797d4d0-cbde-436e-b911-1af8763715fb req-a4e917cb-081c-4769-aeec-1d54978848cd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:49.098519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-6797d4d0-cbde-436e-b911-1af8763715fb req-a4e917cb-081c-4769-aeec-1d54978848cd service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:49.112242 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-6797d4d0-cbde-436e-b911-1af8763715fb req-a4e917cb-081c-4769-aeec-1d54978848cd service nova] Creating event network-vif-deleted:b1bd2dd7-ced2-41ad-8640-0ceed5e4a625 for instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 on chh1-842464-2 May 19 09:40:49.117601 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-6797d4d0-cbde-436e-b911-1af8763715fb req-a4e917cb-081c-4769-aeec-1d54978848cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 May 19 09:40:49.118202 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5815/7140] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:40:49.479080 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:49.480061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:49.488481 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:49.489194 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:49.490121 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:49.490931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:49.576198 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:49.587667 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-c3e81b14-3b6b-49d1-886d-d8ac0ff56730 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.115032 May 19 09:40:49.599080 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5816/7141] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:49 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:50.605937 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:50.606633 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:50.619373 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:50.620110 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:50.621148 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:50.621712 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:50.702509 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:50.717850 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59a59d26-0c3b-4ef5-af60-441773116713 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.115858 May 19 09:40:50.718741 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5817/7142] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:50 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:51.738734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:51.739587 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:51.751734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:51.752367 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:51.754203 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:51.755130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:51.874652 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:51.883780 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7fa9a4e9-812f-4efb-884a-351b5a305fa3 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.150685 May 19 09:40:51.884408 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5818/7143] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:51 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:52.910393 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:52.911190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:52.920995 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:52.921584 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:52.922453 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:52.922919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:53.003617 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:53.013186 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f34f7d53-6f6d-4e39-aaea-9b80ff8f84f8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.106980 May 19 09:40:53.014925 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5819/7144] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:52 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:54.032636 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:54.033556 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:54.041143 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:54.041665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:54.042519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:54.042977 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:54.116255 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:54.131976 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0cab47bf-8c16-4e30-b7fe-ea33df879aad tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.103672 May 19 09:40:54.133199 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5820/7145] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:54 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:55.157638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:55.158545 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:55.165574 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:55.166041 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:55.166862 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:55.167321 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:55.253905 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:55.262647 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-88b8d713-b45f-443b-9e68-43bdf89e7450 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.110229 May 19 09:40:55.264321 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5821/7146] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:55 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:56.282009 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:56.282687 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:56.291114 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:56.291586 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:56.292417 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:56.292877 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:56.380380 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:56.389476 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4e5270ae-8fcd-4acd-ad0e-754a75655592 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.111781 May 19 09:40:56.390466 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5822/7147] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:56 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:57.407936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:57.409011 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:57.416835 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:57.417345 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:57.418160 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:57.418616 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:57.510732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:57.521287 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-67dce4e6-6b2a-45ed-8ada-c88fad9702e8 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.118345 May 19 09:40:57.521945 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5823/7148] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:57 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:40:58.540190 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:58.540970 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:58.549130 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:58.549645 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:58.550469 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:58.550938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:58.648226 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae8f19f10fe4fbc96907f9e31db963f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ceabd32808442f29c727435c80d17de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:40:58.659363 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ed6af316-a284-4c2d-857b-3de229c9d1ce tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 200 len: 1218 microversion: 2.1 time: 0.122953 May 19 09:40:58.670423 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5824/7149] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:58 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:40:59.688698 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:59.689917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [instance: 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:40:59.701729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:59.702483 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:59.703924 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:40:59.704787 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:40:59.734801 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] HTTP exception thrown: Instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 could not be found. May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Request method failure captured: May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 HTTP/1.1 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihg5qb4Sg3K5VoIrpYbZ28UdIeVENLz-7IMg1FnCgk9oib8MBZVC-rYI7rJseZ3spjSne_ca-2pVF556alTbGRO9qAC73hdzlWg2OrISrL6vdaLfpsJFKsQ0t9NQyyjO4FEV8hYzhCNOk4ePC5OvlX40rh6sLNTuC_Xxji9RugKJzW8c May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 9ceabd32808442f29c727435c80d17de May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestShelveInstance-774480905 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9ceabd32808442f29c727435c80d17de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ceabd32808442f29c727435c80d17de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9ceabd32808442f29c727435c80d17de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ceabd32808442f29c727435c80d17de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestShelveInstance-774480905 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 9ceabd32808442f29c727435c80d17de May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestShelveInstance-774480905 May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestShelveInstance-774480905-project May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 3ae8f19f10fe4fbc96907f9e31db963f May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestShelveInstance-774480905-project May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 could not be found. May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '53ad0c32-d3c5-40a9-a50b-93e953b1d3a2'} May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 could not be found. May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 could not be found. May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:40:59.738242 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 could not be found. May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Returning 404 to user: Instance 53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eeca8779-10f2-417f-bc41-4bf9935851cd tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2" status: 404 len: 111 microversion: 2.1 time: 0.058691 May 19 09:40:59.752129 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5825/7150] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:40:59 2022] GET /compute/v2.1/servers/53ad0c32-d3c5-40a9-a50b-93e953b1d3a2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:40:59.980197 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3203f5ab-bdd7-445f-9ea1-c1eb24987ac5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] Calling method '.version_select at 0x7f3217ad2b80>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:40:59.985560 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3203f5ab-bdd7-445f-9ea1-c1eb24987ac5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 09:41:00.995066 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [None req-3203f5ab-bdd7-445f-9ea1-c1eb24987ac5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 58962. May 19 09:41:01.039204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3203f5ab-bdd7-445f-9ea1-c1eb24987ac5 tempest-TestShelveInstance-774480905 tempest-TestShelveInstance-774480905-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-206998652" status: 202 len: 0 microversion: 2.1 time: 1.064001 May 19 09:41:01.040317 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5826/7151] 10.222.0.78 () {58 vars in 1250 bytes} [Thu May 19 09:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-206998652 => generated 0 bytes in 1066 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:41:22.188729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:41:22.189590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:41:22.398742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a90fcf4e-f320-4d73-8161-eebbee8e5e0b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Action: 'create', calling method: .version_select at 0x7f3217ad2790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-319344554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGLB7582K1h7Js3jVEgTsXx24xl43+2C7IIMHprjDXdZqGLiwhFNRFk9zmrLOby691u9w6gOOetvebF/1VtSBdy8+XFqheEG7HZFlosqsr4vcUVRf/YMFi0DLlrkKIPKg=="}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:41:22.414386 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a90fcf4e-f320-4d73-8161-eebbee8e5e0b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Getting quotas for project 8209c6e6962844868304cf35bfde9d62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:41:22.420900 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-a90fcf4e-f320-4d73-8161-eebbee8e5e0b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Getting quotas for user 9537042ff87442aab174313f7947d324 and project 8209c6e6962844868304cf35bfde9d62. Resources: {'key_pairs'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:41:22.449585 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a90fcf4e-f320-4d73-8161-eebbee8e5e0b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262760 May 19 09:41:22.450841 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5827/7152] 10.222.0.78 () {60 vars in 1158 bytes} [Thu May 19 09:41:22 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:41:23.685325 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1869643862", "imageRef": "666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-319344554", "security_groups": [{"name": "tempest-secgroup-smoke-207385708"}], "networks": [{"uuid": "9a8d5872-41b5-4193-bfd2-68e943c19658"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:41:23.829169 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] validate_networks() for [('9a8d5872-41b5-4193-bfd2-68e943c19658', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:41:24.726239 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:41:24.727479 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:41:24.728051 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:41:24.728557 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:41:24.729094 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:41:24.739597 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:24.740068 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:24.741267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:24.742019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:24.792550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Getting quotas for project 8209c6e6962844868304cf35bfde9d62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:41:24.799665 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Getting quotas for user 9537042ff87442aab174313f7947d324 and project 8209c6e6962844868304cf35bfde9d62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:41:24.818561 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:41:24.821370 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='666e1c1f-8d9f-4fd6-b7bd-2cbbda4092ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:41:24.882454 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-07322c20-9054-42ff-819a-379411884dcf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.204900 May 19 09:41:24.882984 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5828/7153] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:41:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:41:24.893917 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e2e2d94-c82f-4e73-b20e-65a1565ed5a4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:24.894646 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e2e2d94-c82f-4e73-b20e-65a1565ed5a4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:24.955921 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e2e2d94-c82f-4e73-b20e-65a1565ed5a4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:24.964361 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e2e2d94-c82f-4e73-b20e-65a1565ed5a4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1248 microversion: 2.1 time: 0.074590 May 19 09:41:24.965047 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5829/7154] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:24 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:25.983205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-49e86a85-8182-4802-9ee0-9e9f51c4067c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:25.984123 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-49e86a85-8182-4802-9ee0-9e9f51c4067c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:26.048136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-49e86a85-8182-4802-9ee0-9e9f51c4067c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:26.055128 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-49e86a85-8182-4802-9ee0-9e9f51c4067c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1248 microversion: 2.1 time: 0.076678 May 19 09:41:26.055731 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5830/7155] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:25 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1248 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:27.073000 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d82cafd0-4e07-42be-88dc-f505065b2d87 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:27.073653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d82cafd0-4e07-42be-88dc-f505065b2d87 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:27.134622 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d82cafd0-4e07-42be-88dc-f505065b2d87 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:27.142353 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d82cafd0-4e07-42be-88dc-f505065b2d87 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1248 microversion: 2.1 time: 0.073663 May 19 09:41:27.142959 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5831/7156] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:27 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:28.159974 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-62182a88-a117-4ee8-bd37-8e1f9da5a88e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:28.160612 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-62182a88-a117-4ee8-bd37-8e1f9da5a88e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:28.217416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-62182a88-a117-4ee8-bd37-8e1f9da5a88e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:28.227798 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-62182a88-a117-4ee8-bd37-8e1f9da5a88e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1248 microversion: 2.1 time: 0.071941 May 19 09:41:28.228386 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5832/7157] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:28 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:29.250743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:29.251880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:29.260022 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:29.260497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:29.261296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:29.261782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:29.330296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:29.338148 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-251be04b-efb5-4a23-8164-2b2e84253ccd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1252 microversion: 2.1 time: 0.093890 May 19 09:41:29.338725 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5833/7158] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:29 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:30.357263 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:30.358658 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:30.366129 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:30.366600 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:30.367411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:30.367864 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:30.461447 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:30.470890 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-38a98486-8b5b-45e2-ae2c-d440c92abf3c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1306 microversion: 2.1 time: 0.118380 May 19 09:41:30.471403 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5834/7159] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:30 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:31.489922 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:31.490472 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:31.498560 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:31.499002 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:31.500027 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:31.500620 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:31.724885 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:31.733605 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5011697a-636a-4fde-8599-2c878eba4c5b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1373 microversion: 2.1 time: 0.248893 May 19 09:41:31.734201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5835/7160] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:31 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1373 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:31.867294 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-3c10314d-227a-433d-811b-d33374df3a27 req-90b4934c-2c8c-4283-82a8-dee5421348c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:41:31.882909 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3c10314d-227a-433d-811b-d33374df3a27 req-90b4934c-2c8c-4283-82a8-dee5421348c9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:31.883371 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-3c10314d-227a-433d-811b-d33374df3a27 req-90b4934c-2c8c-4283-82a8-dee5421348c9 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:31.895611 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-3c10314d-227a-433d-811b-d33374df3a27 req-90b4934c-2c8c-4283-82a8-dee5421348c9 service nova] Creating event network-changed:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:41:31.910597 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-3c10314d-227a-433d-811b-d33374df3a27 req-90b4934c-2c8c-4283-82a8-dee5421348c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053730 May 19 09:41:31.911236 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5836/7161] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:41:32.752739 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:32.753559 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:32.760061 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:32.760540 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:32.761356 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:32.761818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:32.915498 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:32.923354 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a58dc4ff-da0b-42ae-80fd-9c9dc60ee053 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1373 microversion: 2.1 time: 0.175898 May 19 09:41:32.923937 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5837/7162] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:32 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:33.941281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:33.941992 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:33.949019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:33.949526 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:33.951251 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:33.951718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:34.103109 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:34.111992 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e46230fa-4623-48ff-8231-17fd114aaabd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1373 microversion: 2.1 time: 0.174680 May 19 09:41:34.112573 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5838/7163] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:33 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:35.129714 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:35.130409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:35.132408 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:41:35.139458 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:35.139933 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:35.140741 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:35.141204 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:35.299591 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:35.307916 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e15d71bf-29e8-4f2e-8c5e-0b91d7248481 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1373 microversion: 2.1 time: 0.182260 May 19 09:41:35.308748 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5839/7164] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:35 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:36.326742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:36.327431 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:36.334324 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:36.334791 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:36.335581 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:36.336026 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:36.487843 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:36.495634 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7df98ab9-14dc-4b4f-a457-e8dc40baf087 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1373 microversion: 2.1 time: 0.173850 May 19 09:41:36.496220 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5840/7165] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:36 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:36.835024 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-fe5b8df9-26fc-4e72-bc9a-82718be1eb79 req-396954ea-d57f-44e3-aa63-f1334abfd211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "name": "network-vif-plugged", "status": "completed", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:41:36.844055 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fe5b8df9-26fc-4e72-bc9a-82718be1eb79 req-396954ea-d57f-44e3-aa63-f1334abfd211 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:36.844572 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-fe5b8df9-26fc-4e72-bc9a-82718be1eb79 req-396954ea-d57f-44e3-aa63-f1334abfd211 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:36.856987 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-fe5b8df9-26fc-4e72-bc9a-82718be1eb79 req-396954ea-d57f-44e3-aa63-f1334abfd211 service nova] Creating event network-vif-plugged:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:41:36.862499 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-fe5b8df9-26fc-4e72-bc9a-82718be1eb79 req-396954ea-d57f-44e3-aa63-f1334abfd211 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031091 May 19 09:41:36.863030 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5841/7166] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:41:37.515755 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:37.516384 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:37.523480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:37.523936 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:37.524724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:37.525173 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:37.666150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:37.674719 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-51e814a8-17db-4d08-aed0-6ea511597d20 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1373 microversion: 2.1 time: 0.164870 May 19 09:41:37.675330 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5842/7167] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:37 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:38.692797 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:38.693442 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:38.695376 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=18 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:41:38.702590 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:38.703052 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:38.703904 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:38.704410 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:38.849763 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:38.858095 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1d76f977-efd5-4a9b-af9a-36438a8220c4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1559 microversion: 2.1 time: 0.169388 May 19 09:41:38.858669 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5843/7168] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:38 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:38.883005 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:41:38.883647 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:41:38.890604 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:38.891076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:38.891880 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:38.892333 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:39.030222 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:41:39.038788 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-7e506b6b-3491-4f84-8c27-9ceef04273b6 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1559 microversion: 2.1 time: 0.168187 May 19 09:41:39.039392 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5844/7169] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:41:38 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:41:40.854537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-87df4fac-92d2-4dac-87b1-94df20504285 req-c62d4fc8-c7ec-4ad5-8b2b-fac16b7732c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:41:40.866276 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87df4fac-92d2-4dac-87b1-94df20504285 req-c62d4fc8-c7ec-4ad5-8b2b-fac16b7732c3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:41:40.867230 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-87df4fac-92d2-4dac-87b1-94df20504285 req-c62d4fc8-c7ec-4ad5-8b2b-fac16b7732c3 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:41:40.881643 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-87df4fac-92d2-4dac-87b1-94df20504285 req-c62d4fc8-c7ec-4ad5-8b2b-fac16b7732c3 service nova] Creating event network-changed:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:41:40.886892 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-87df4fac-92d2-4dac-87b1-94df20504285 req-c62d4fc8-c7ec-4ad5-8b2b-fac16b7732c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036114 May 19 09:41:40.887819 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5845/7170] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:43:27.461282 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:43:27.462028 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:43:36.153853 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6898fb1f-7835-4c58-8cbc-cf977775b0e2] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 09:43:36.154925 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 09:43:36.155661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:43:36.156452 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=68 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:43:36.161613 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-28837685"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:43:36.162756 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:36.172207 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:36.172679 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:36.174089 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:36.175473 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:36.484990 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1f6b86a3-14f9-4869-a39a-ecbfdf1c58bb tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "POST /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268/action" status: 202 len: 0 microversion: 2.1 time: 0.332759 May 19 09:43:36.485964 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5846/7171] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:43:36 2022] POST /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 19 09:43:41.630222 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [6898fb1f-7835-4c58-8cbc-cf977775b0e2] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 59250. May 19 09:43:41.654032 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] [7aa8673f-5a56-40d9-a069-52747aa96097] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 59252. May 19 09:43:41.757098 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d4f9c5b3-d43e-4ef2-9602-6aed97ae26b6 req-3b2e8e7b-3c89-4a9e-9b04-2bb5a7578adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "name": "network-vif-plugged", "status": "completed", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:43:41.777841 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d4f9c5b3-d43e-4ef2-9602-6aed97ae26b6 req-3b2e8e7b-3c89-4a9e-9b04-2bb5a7578adc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:41.778296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d4f9c5b3-d43e-4ef2-9602-6aed97ae26b6 req-3b2e8e7b-3c89-4a9e-9b04-2bb5a7578adc service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:41.795903 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d4f9c5b3-d43e-4ef2-9602-6aed97ae26b6 req-3b2e8e7b-3c89-4a9e-9b04-2bb5a7578adc service nova] Creating event network-vif-plugged:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:43:41.797705 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d4f9c5b3-d43e-4ef2-9602-6aed97ae26b6 req-3b2e8e7b-3c89-4a9e-9b04-2bb5a7578adc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205117 May 19 09:43:41.801787 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5847/7172] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:43:46.389739 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:43:46.391258 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:43:50.126854 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-231137255", "imageRef": "23488c6a-99c2-48e9-b2ed-5794f245031c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-319344554", "security_groups": [{"name": "tempest-secgroup-smoke-207385708"}], "networks": [{"uuid": "9a8d5872-41b5-4193-bfd2-68e943c19658"}]}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:43:50.256092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.network.neutron [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] validate_networks() for [('9a8d5872-41b5-4193-bfd2-68e943c19658', None, None, None, None, None)] {{(pid=119072) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 09:43:50.659818 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Flavor limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 09:43:50.660259 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Image limits 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 09:43:50.660828 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Flavor pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 09:43:50.661270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Image pref 0:0:0 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 09:43:50.661724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.virt.hardware [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 09:43:50.673075 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:50.673562 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:50.674440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:50.674889 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:50.693440 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Getting quotas for project 8209c6e6962844868304cf35bfde9d62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 09:43:50.699796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.quota [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Getting quotas for user 9537042ff87442aab174313f7947d324 and project 8209c6e6962844868304cf35bfde9d62. Resources: {'ram', 'cores', 'instances'} {{(pid=119072) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 09:43:50.713825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Going to run 1 instances... {{(pid=119072) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 09:43:50.716422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23488c6a-99c2-48e9-b2ed-5794f245031c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 09:43:50.772023 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-dc2ce588-f895-41f2-84a0-54c36f14401d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.650603 May 19 09:43:50.773581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5848/7173] 10.222.0.78 () {60 vars in 1146 bytes} [Thu May 19 09:43:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 09:43:50.783486 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-5a2c5113-9d83-49bd-ba1f-24cacc0fa8e5 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:50.784154 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-5a2c5113-9d83-49bd-ba1f-24cacc0fa8e5 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:50.851743 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-5a2c5113-9d83-49bd-ba1f-24cacc0fa8e5 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:50.866837 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-5a2c5113-9d83-49bd-ba1f-24cacc0fa8e5 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1247 microversion: 2.1 time: 0.087225 May 19 09:43:50.869246 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5849/7174] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:50 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:43:51.887941 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:51.888654 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:51.896003 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:51.896462 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:51.897253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:51.897725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:51.980742 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:51.989922 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1656f2e-bd38-4729-974f-aa1313ee4d97 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1307 microversion: 2.1 time: 0.106200 May 19 09:43:51.990631 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5850/7175] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:51 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:43:53.008709 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:53.009369 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:53.020745 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:53.021220 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:53.022044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:53.022499 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:53.277546 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:53.285502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19fa98ca-01ae-495b-8af9-33337c66dc33 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.281192 May 19 09:43:53.286090 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5851/7176] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:53 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:43:54.303596 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:54.305168 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:54.315466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:54.316253 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:54.317488 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:54.318271 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:54.475262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:54.484500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-40f3873b-4feb-43ae-b11d-4e073789486c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.185698 May 19 09:43:54.485107 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5852/7177] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:54 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:43:55.502655 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:55.503313 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:55.518006 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:55.518480 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:55.519944 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:55.520643 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:55.726409 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:55.735407 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-eeb3a6d2-557e-4599-b686-3015192ecff3 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.236804 May 19 09:43:55.745019 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5853/7178] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:55 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:43:55.745019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-a587187e-c726-4cc4-a39f-efb7be663900 req-654a26f5-4416-43a3-8f13-eb4d0efd97c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "name": "network-vif-unplugged", "status": "completed", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:43:55.750701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a587187e-c726-4cc4-a39f-efb7be663900 req-654a26f5-4416-43a3-8f13-eb4d0efd97c7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:55.751240 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-a587187e-c726-4cc4-a39f-efb7be663900 req-654a26f5-4416-43a3-8f13-eb4d0efd97c7 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:55.765878 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-a587187e-c726-4cc4-a39f-efb7be663900 req-654a26f5-4416-43a3-8f13-eb4d0efd97c7 service nova] Creating event network-vif-unplugged:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:43:55.773338 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-a587187e-c726-4cc4-a39f-efb7be663900 req-654a26f5-4416-43a3-8f13-eb4d0efd97c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035075 May 19 09:43:55.774201 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5854/7179] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:43:56.754358 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:56.755852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:56.763871 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:56.764401 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:56.765267 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:56.765758 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:56.923711 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:56.932635 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-bbd683dc-c125-4058-adef-4b95418e880f tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.183616 May 19 09:43:56.933266 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5855/7180] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:56 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:43:57.950189 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:57.950931 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:57.958225 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:57.958686 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:57.959489 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:57.959938 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:58.161704 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:58.170440 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-19f20db9-0d90-4bf9-8197-bd605a8b3c5d tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.224283 May 19 09:43:58.171253 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5856/7181] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:57 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:43:59.188825 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:43:59.189701 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:43:59.198244 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:59.198863 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:59.199875 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:43:59.200492 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:43:59.446193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:43:59.454912 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-2a12fdc0-569e-47a7-b927-8a0024bada85 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.270388 May 19 09:43:59.455565 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5857/7182] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:43:59 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:00.474265 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:00.475036 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:00.483891 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:00.484349 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:00.485139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:00.485614 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:00.633753 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:00.641608 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-0d211d76-a906-4833-bf2b-706159210395 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.171968 May 19 09:44:00.642195 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5858/7183] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:00 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:01.645777 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=2 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:44:01.646497 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell0:SELECT=8 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:44:01.723108 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-42e3edf9-967e-4834-85dd-71df4b2d5649 req-5181591d-6142-407d-9618-ca71e875c9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974eb93e-bb55-43b9-9108-1a9bebd8479c", "tag": "d2f7b725-059b-475e-8c49-560fb6216a1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:44:01.732888 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-42e3edf9-967e-4834-85dd-71df4b2d5649 req-5181591d-6142-407d-9618-ca71e875c9ce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:01.733733 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-42e3edf9-967e-4834-85dd-71df4b2d5649 req-5181591d-6142-407d-9618-ca71e875c9ce service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:01.747204 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-42e3edf9-967e-4834-85dd-71df4b2d5649 req-5181591d-6142-407d-9618-ca71e875c9ce service nova] Creating event network-changed:d2f7b725-059b-475e-8c49-560fb6216a1b for instance 974eb93e-bb55-43b9-9108-1a9bebd8479c on chh1-842464-2 May 19 09:44:01.753495 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-42e3edf9-967e-4834-85dd-71df4b2d5649 req-5181591d-6142-407d-9618-ca71e875c9ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112667 May 19 09:44:01.754426 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5859/7184] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:44:01.761144 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:01.762076 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:01.769968 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:01.770439 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:01.771266 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:01.771729 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:01.948894 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:01.957448 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-95ebd707-6ef7-499a-addf-60a651184f62 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.201760 May 19 09:44:01.958054 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5860/7185] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:01 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:44:02.974640 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:02.975329 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:02.983029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:02.983493 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:02.984288 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:02.984734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:03.129422 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:03.142656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-1b076897-2dc3-4aef-b259-4bf55d2cde6e tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.171655 May 19 09:44:03.143549 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5861/7186] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:02 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:04.163262 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:04.163961 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:04.172243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:04.172705 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:04.173541 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:04.173984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:04.320411 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:04.328714 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-6f6a772e-7c9a-49db-8367-473d8a93a678 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.169456 May 19 09:44:04.329333 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5862/7187] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:04 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:05.346779 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:05.347449 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:05.355092 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:05.355724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:05.356427 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:05.357034 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:05.507852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:05.517141 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-d1ea4d07-c697-4b49-b477-e65823ed6d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.174225 May 19 09:44:05.517818 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5863/7188] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:05 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:06.535615 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:06.536307 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:06.539274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:44:06.545147 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:06.545638 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:06.546430 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:06.546884 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:06.550754 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:44:06.696918 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:06.706735 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-3abdee1e-bbca-4606-93a1-faa0b59cc30a tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.174866 May 19 09:44:06.707391 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5864/7189] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:06 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:07.729579 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:07.730524 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:07.737823 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:07.738284 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:07.739069 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:07.739516 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:07.892149 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:07.900082 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-4b8449b8-6c2b-4ef9-a1f9-867bbe99bba2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.174891 May 19 09:44:07.904544 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5865/7190] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:07 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:08.047926 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d0629298-56e5-4044-a32e-6503a94dfd7c req-e2c1f9ee-ead0-4b52-ba11-92e51eb77557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974eb93e-bb55-43b9-9108-1a9bebd8479c", "name": "network-vif-plugged", "status": "completed", "tag": "d2f7b725-059b-475e-8c49-560fb6216a1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:44:08.056750 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0629298-56e5-4044-a32e-6503a94dfd7c req-e2c1f9ee-ead0-4b52-ba11-92e51eb77557 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:08.057206 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d0629298-56e5-4044-a32e-6503a94dfd7c req-e2c1f9ee-ead0-4b52-ba11-92e51eb77557 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:08.071024 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d0629298-56e5-4044-a32e-6503a94dfd7c req-e2c1f9ee-ead0-4b52-ba11-92e51eb77557 service nova] Creating event network-vif-plugged:d2f7b725-059b-475e-8c49-560fb6216a1b for instance 974eb93e-bb55-43b9-9108-1a9bebd8479c on chh1-842464-2 May 19 09:44:08.076767 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d0629298-56e5-4044-a32e-6503a94dfd7c req-e2c1f9ee-ead0-4b52-ba11-92e51eb77557 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 May 19 09:44:08.077407 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5866/7191] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:44:08.918838 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:08.919552 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:08.927029 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:08.927494 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:08.928281 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:08.928732 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:09.071527 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:09.079500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-30f9da0e-55a5-424a-b5b5-4eeebf21e96b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1372 microversion: 2.1 time: 0.166172 May 19 09:44:09.080102 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5867/7192] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:08 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:10.096567 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:10.097278 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:10.104663 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:10.105199 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:10.106139 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:10.106594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:10.253809 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:10.263076 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f76ccc3e-b55d-4ea1-ac36-ed3528838c99 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1557 microversion: 2.1 time: 0.170439 May 19 09:44:10.263695 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5868/7193] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:10 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:44:10.280669 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:44:10.281296 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:44:10.287466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:10.288193 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:10.288893 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:10.289151 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:10.436360 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:44:10.444659 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a1dd21a3-8ba2-49cc-894e-28773bd409c9 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1557 microversion: 2.1 time: 0.168180 May 19 09:44:10.445354 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5869/7194] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:44:10 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:44:12.629653 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-c905de9c-3240-49dd-8b0e-bad1e0887e77 req-c5a8f4ee-cf8a-4b4a-a021-e943010dee7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974eb93e-bb55-43b9-9108-1a9bebd8479c", "tag": "d2f7b725-059b-475e-8c49-560fb6216a1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:44:12.639594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c905de9c-3240-49dd-8b0e-bad1e0887e77 req-c5a8f4ee-cf8a-4b4a-a021-e943010dee7c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:44:12.640042 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-c905de9c-3240-49dd-8b0e-bad1e0887e77 req-c5a8f4ee-cf8a-4b4a-a021-e943010dee7c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:44:12.653226 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-c905de9c-3240-49dd-8b0e-bad1e0887e77 req-c5a8f4ee-cf8a-4b4a-a021-e943010dee7c service nova] Creating event network-changed:d2f7b725-059b-475e-8c49-560fb6216a1b for instance 974eb93e-bb55-43b9-9108-1a9bebd8479c on chh1-842464-2 May 19 09:44:12.658455 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-c905de9c-3240-49dd-8b0e-bad1e0887e77 req-c5a8f4ee-cf8a-4b4a-a021-e943010dee7c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035587 May 19 09:44:12.659069 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5870/7195] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:45:39.952946 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_api:SELECT=13 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:45:39.953724 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=33 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:45:39.958901 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-854937692"}} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:45:39.959920 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:45:39.967792 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:39.968282 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:39.969065 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:39.969550 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:40.264656 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-10b0252a-2418-46ad-ab83-ed7cfe503584 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "POST /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c/action" status: 202 len: 0 microversion: 2.1 time: 0.314186 May 19 09:45:40.265316 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5871/7196] 10.222.0.78 () {60 vars in 1277 bytes} [Thu May 19 09:45:39 2022] POST /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 19 09:45:46.609426 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-d2b3c318-d16e-4d1a-92e7-2ea45cd3bad8 req-0ba4fb42-402d-479a-908f-0adf2ef6b57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974eb93e-bb55-43b9-9108-1a9bebd8479c", "name": "network-vif-plugged", "status": "completed", "tag": "d2f7b725-059b-475e-8c49-560fb6216a1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:45:46.621274 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d2b3c318-d16e-4d1a-92e7-2ea45cd3bad8 req-0ba4fb42-402d-479a-908f-0adf2ef6b57c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:46.621950 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-d2b3c318-d16e-4d1a-92e7-2ea45cd3bad8 req-0ba4fb42-402d-479a-908f-0adf2ef6b57c service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:46.634771 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-d2b3c318-d16e-4d1a-92e7-2ea45cd3bad8 req-0ba4fb42-402d-479a-908f-0adf2ef6b57c service nova] Creating event network-vif-plugged:d2f7b725-059b-475e-8c49-560fb6216a1b for instance 974eb93e-bb55-43b9-9108-1a9bebd8479c on chh1-842464-2 May 19 09:45:46.641083 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-d2b3c318-d16e-4d1a-92e7-2ea45cd3bad8 req-0ba4fb42-402d-479a-908f-0adf2ef6b57c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046279 May 19 09:45:46.642033 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5872/7197] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:45:55.142796 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:45:55.143457 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:45:55.149668 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:55.150133 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:55.151569 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:55.152070 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:55.183803 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:45:55.274608 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-41bbcec8-702e-48ea-9634-16397f94ebbf tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "DELETE /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 204 len: 0 microversion: 2.1 time: 0.136871 May 19 09:45:55.280027 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5873/7198] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:45:55 2022] DELETE /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:45:55.284112 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-aeec62f6-bf33-46a1-ae9f-c4e41114f8be req-f785c85e-9e09-44f0-a356-762d8c5a9596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "974eb93e-bb55-43b9-9108-1a9bebd8479c", "tag": "d2f7b725-059b-475e-8c49-560fb6216a1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:45:55.293606 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aeec62f6-bf33-46a1-ae9f-c4e41114f8be req-f785c85e-9e09-44f0-a356-762d8c5a9596 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:55.294167 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-aeec62f6-bf33-46a1-ae9f-c4e41114f8be req-f785c85e-9e09-44f0-a356-762d8c5a9596 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:55.306983 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-aeec62f6-bf33-46a1-ae9f-c4e41114f8be req-f785c85e-9e09-44f0-a356-762d8c5a9596 service nova] Creating event network-changed:d2f7b725-059b-475e-8c49-560fb6216a1b for instance 974eb93e-bb55-43b9-9108-1a9bebd8479c on chh1-842464-2 May 19 09:45:55.313138 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-aeec62f6-bf33-46a1-ae9f-c4e41114f8be req-f785c85e-9e09-44f0-a356-762d8c5a9596 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 May 19 09:45:55.313788 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5874/7199] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:45:55.319289 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:45:55.320016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:45:55.327804 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:55.328270 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:55.329060 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:55.329530 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:55.476651 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:45:55.486500 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-ba1fe21f-5d8e-4f35-878b-9962545d97f4 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1681 microversion: 2.1 time: 0.171414 May 19 09:45:55.487461 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5875/7200] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:45:55 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:45:56.505338 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:45:56.506205 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:45:56.514675 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:56.515150 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:56.515990 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:56.516443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:56.677537 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:45:56.687964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-a9a7a298-9823-4201-b51e-e9b6159d4bcd tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1681 microversion: 2.1 time: 0.186516 May 19 09:45:56.688581 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5876/7201] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:45:56 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:45:57.388466 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-86b724cc-aee2-47a0-9676-431d51aec214 req-1819ca92-ad07-48e5-b788-8e6ebe7229a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "974eb93e-bb55-43b9-9108-1a9bebd8479c", "name": "network-vif-deleted", "tag": "d2f7b725-059b-475e-8c49-560fb6216a1b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:45:57.397507 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-86b724cc-aee2-47a0-9676-431d51aec214 req-1819ca92-ad07-48e5-b788-8e6ebe7229a4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:57.398118 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-86b724cc-aee2-47a0-9676-431d51aec214 req-1819ca92-ad07-48e5-b788-8e6ebe7229a4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:57.415584 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-86b724cc-aee2-47a0-9676-431d51aec214 req-1819ca92-ad07-48e5-b788-8e6ebe7229a4 service nova] Creating event network-vif-deleted:d2f7b725-059b-475e-8c49-560fb6216a1b for instance 974eb93e-bb55-43b9-9108-1a9bebd8479c on chh1-842464-2 May 19 09:45:57.421255 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-86b724cc-aee2-47a0-9676-431d51aec214 req-1819ca92-ad07-48e5-b788-8e6ebe7229a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109051 May 19 09:45:57.421932 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5877/7202] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:45:57.708644 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:45:57.711105 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:45:57.721661 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:57.722471 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:57.724903 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:57.725689 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:57.778348 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:57.779161 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:57.779960 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lazy-loading 'fault' on Instance uuid 974eb93e-bb55-43b9-9108-1a9bebd8479c {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:45:57.841869 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:45:57.849102 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-e6a0e592-7c4b-4c25-94e3-6086e0b60e72 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 200 len: 1337 microversion: 2.1 time: 0.147426 May 19 09:45:57.849689 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5878/7203] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:45:57 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 1337 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:45:58.867505 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:45:58.868136 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: 974eb93e-bb55-43b9-9108-1a9bebd8479c] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:45:58.875680 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:58.876157 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:58.877019 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:45:58.877511 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:45:58.892831 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] HTTP exception thrown: Instance 974eb93e-bb55-43b9-9108-1a9bebd8479c could not be found. May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Request method failure captured: May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c HTTP/1.1 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihhC8vF8rLvG7FHGat4l5swbxu7zLi51nfEJkmbrye2guyePM7QDkX4GTKkmMTGJ724MtQszfvYo8KXbD-7Dz-mzs5ScOeA0qv9aICk_0oxXzMpCyJzUVkCjYAa3Tx0xVXqayu239TIj2873EROX9zUzpMjOi447f7e6nvDVjDDRAdsM May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8209c6e6962844868304cf35bfde9d62 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestSnapshotPattern-177988758 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8209c6e6962844868304cf35bfde9d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8209c6e6962844868304cf35bfde9d62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8209c6e6962844868304cf35bfde9d62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8209c6e6962844868304cf35bfde9d62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestSnapshotPattern-177988758 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8209c6e6962844868304cf35bfde9d62 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestSnapshotPattern-177988758 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestSnapshotPattern-177988758-project May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9537042ff87442aab174313f7947d324 May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestSnapshotPattern-177988758-project May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance 974eb93e-bb55-43b9-9108-1a9bebd8479c could not be found. May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': '974eb93e-bb55-43b9-9108-1a9bebd8479c'} May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 974eb93e-bb55-43b9-9108-1a9bebd8479c could not be found. May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 974eb93e-bb55-43b9-9108-1a9bebd8479c could not be found. May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:45:58.894566 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 974eb93e-bb55-43b9-9108-1a9bebd8479c could not be found. May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Returning 404 to user: Instance 974eb93e-bb55-43b9-9108-1a9bebd8479c could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-cea12906-03bb-45d9-85b6-b6054fb93d36 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c" status: 404 len: 111 microversion: 2.1 time: 0.032616 May 19 09:45:58.898502 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5879/7204] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:45:58 2022] GET /compute/v2.1/servers/974eb93e-bb55-43b9-9108-1a9bebd8479c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:46:00.361443 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:46:00.362326 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:46:00.370508 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:00.370984 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:00.371788 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:00.372243 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:00.403872 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Going to try to terminate instance {{(pid=119072) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 09:46:00.493201 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-de182cfd-18ac-4d8f-8ce1-cc7440dba252 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 204 len: 0 microversion: 2.1 time: 0.135354 May 19 09:46:00.494296 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5880/7205] 10.222.0.78 () {58 vars in 1238 bytes} [Thu May 19 09:46:00 2022] DELETE /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 09:46:00.501192 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-be6ddb73-75d5-4fab-9232-beaedb047586 req-07d0f1b7-480c-4470-8a02-2cb2cb00b2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:46:00.510725 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-be6ddb73-75d5-4fab-9232-beaedb047586 req-07d0f1b7-480c-4470-8a02-2cb2cb00b2f4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:00.511416 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-be6ddb73-75d5-4fab-9232-beaedb047586 req-07d0f1b7-480c-4470-8a02-2cb2cb00b2f4 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:00.523624 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-be6ddb73-75d5-4fab-9232-beaedb047586 req-07d0f1b7-480c-4470-8a02-2cb2cb00b2f4 service nova] Creating event network-changed:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:46:00.529587 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-be6ddb73-75d5-4fab-9232-beaedb047586 req-07d0f1b7-480c-4470-8a02-2cb2cb00b2f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033311 May 19 09:46:00.530213 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5881/7206] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 09:46:00.535519 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:46:00.536248 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:46:00.544346 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:00.544814 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:00.545662 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:00.546366 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:00.706420 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:46:00.715071 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-fbda7be2-4531-4541-901f-6e4c67cb481c tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1684 microversion: 2.1 time: 0.183601 May 19 09:46:00.715679 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5882/7207] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:46:00 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:46:01.733390 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:46:01.734016 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:46:01.741228 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:01.741734 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:01.742532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:01.742993 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:01.925868 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:46:01.934504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-05817b66-6b03-41b9-a2a4-1ce1347b601b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1684 microversion: 2.1 time: 0.205844 May 19 09:46:01.935116 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5883/7208] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:46:01 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 09:46:02.705236 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [req-48ce13ea-2dcb-4043-8a28-37b3136ddfac req-1df07d72-ae2b-440d-97ed-614f9f14a696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f040f666-bf39-4b03-9fa3-8c9529831268", "name": "network-vif-deleted", "tag": "de36ec69-cc54-4a00-9aff-ad1b5c44be4b"}]} {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 09:46:02.714939 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-48ce13ea-2dcb-4043-8a28-37b3136ddfac req-1df07d72-ae2b-440d-97ed-614f9f14a696 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:02.715580 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [req-48ce13ea-2dcb-4043-8a28-37b3136ddfac req-1df07d72-ae2b-440d-97ed-614f9f14a696 service nova] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:02.727787 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.compute.server_external_events [req-48ce13ea-2dcb-4043-8a28-37b3136ddfac req-1df07d72-ae2b-440d-97ed-614f9f14a696 service nova] Creating event network-vif-deleted:de36ec69-cc54-4a00-9aff-ad1b5c44be4b for instance f040f666-bf39-4b03-9fa3-8c9529831268 on chh2-842464-2 May 19 09:46:02.733504 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [req-48ce13ea-2dcb-4043-8a28-37b3136ddfac req-1df07d72-ae2b-440d-97ed-614f9f14a696 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 May 19 09:46:02.740245 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5884/7209] 10.222.0.78 () {64 vars in 1317 bytes} [Thu May 19 09:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 09:46:02.952919 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:46:02.953659 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:46:02.960304 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:02.960782 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:02.961594 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:02.962044 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:03.001485 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:03.002341 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:03.003277 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.objects.instance [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lazy-loading 'fault' on Instance uuid f040f666-bf39-4b03-9fa3-8c9529831268 {{(pid=119072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 09:46:03.048666 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.policy [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9537042ff87442aab174313f7947d324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209c6e6962844868304cf35bfde9d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119072) authorize /opt/stack/nova/nova/policy.py:199}} May 19 09:46:03.058142 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-8560c601-26ab-4542-bc1a-7495e64809ca tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 200 len: 1338 microversion: 2.1 time: 0.109877 May 19 09:46:03.058766 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5885/7210] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:46:02 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 09:46:04.075718 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:46:04.076374 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.compute.api [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [instance: f040f666-bf39-4b03-9fa3-8c9529831268] Fetching instance by UUID {{(pid=119072) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 09:46:04.083387 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:04.083852 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:04.084648 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 09:46:04.085104 chdv-842464-2 devstack@n-api.service[119072]: DEBUG oslo_concurrency.lockutils [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Lock "c29c5a8f-0954-4485-a835-7dab43d09458" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 09:46:04.090785 chdv-842464-2 devstack@n-api.service[119072]: DEBUG dbcounter [-] [119072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 09:46:04.101964 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.wsgi [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] HTTP exception thrown: Instance f040f666-bf39-4b03-9fa3-8c9529831268 could not be found. May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Request method failure captured: May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: request: GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 HTTP/1.1 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Accept: application/json May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Accept-Encoding: identity May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Connection: close May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Content-Length: 0 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Content-Type: application/json May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Host: 10.222.0.78 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: Openstack-System-Scope: None May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: User-Agent: python-urllib3/1.26.9 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Auth-Token: gAAAAABihhC8vF8rLvG7FHGat4l5swbxu7zLi51nfEJkmbrye2guyePM7QDkX4GTKkmMTGJ724MtQszfvYo8KXbD-7Dz-mzs5ScOeA0qv9aICk_0oxXzMpCyJzUVkCjYAa3Tx0xVXqayu239TIj2873EROX9zUzpMjOi447f7e6nvDVjDDRAdsM May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Id: None May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Domain-Name: None May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Identity-Status: Confirmed May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Is-Admin-Project: True May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Id: default May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Domain-Name: Default May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Id: 8209c6e6962844868304cf35bfde9d62 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Project-Name: tempest-TestSnapshotPattern-177988758 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Role: member,reader May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Roles: member,reader May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8209c6e6962844868304cf35bfde9d62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8209c6e6962844868304cf35bfde9d62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8209c6e6962844868304cf35bfde9d62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8209c6e6962844868304cf35bfde9d62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant: tempest-TestSnapshotPattern-177988758 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Id: 8209c6e6962844868304cf35bfde9d62 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-Tenant-Name: tempest-TestSnapshotPattern-177988758 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-User: tempest-TestSnapshotPattern-177988758-project May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Id: default May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-User-Domain-Name: Default May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-User-Id: 9537042ff87442aab174313f7947d324 May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: X-User-Name: tempest-TestSnapshotPattern-177988758-project May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: method: > May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: exception: Instance f040f666-bf39-4b03-9fa3-8c9529831268 could not be found. May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: action_args: {'id': 'f040f666-bf39-4b03-9fa3-8c9529831268'} May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f040f666-bf39-4b03-9fa3-8c9529831268 could not be found. May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f040f666-bf39-4b03-9fa3-8c9529831268 could not be found. May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 09:46:04.103532 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f040f666-bf39-4b03-9fa3-8c9529831268 could not be found. May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: ERROR nova.api.openstack.wsgi May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Returning 404 to user: Instance f040f666-bf39-4b03-9fa3-8c9529831268 could not be found. {{(pid=119072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-f0ab9ff9-f3da-4124-bd87-e0171471970b tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268" status: 404 len: 111 microversion: 2.1 time: 0.033950 May 19 09:46:04.108095 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5886/7211] 10.222.0.78 () {58 vars in 1235 bytes} [Thu May 19 09:46:04 2022] GET /compute/v2.1/servers/f040f666-bf39-4b03-9fa3-8c9529831268 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 09:46:04.289343 chdv-842464-2 devstack@n-api.service[119072]: DEBUG nova.api.openstack.wsgi [None req-59f31af6-6f6b-46d2-a7ac-2105b5ddc4d2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] Calling method '.version_select at 0x7f3217b7d4c0>' {{(pid=119072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 09:46:04.290037 chdv-842464-2 devstack@n-api.service[119072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59f31af6-6f6b-46d2-a7ac-2105b5ddc4d2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 09:46:05.297431 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [None req-59f31af6-6f6b-46d2-a7ac-2105b5ddc4d2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] [fc9646f6-16cf-4ff6-8e63-161bf7822768] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 59692. May 19 09:46:05.321092 chdv-842464-2 devstack@n-api.service[119072]: INFO nova.api.openstack.requestlog [None req-59f31af6-6f6b-46d2-a7ac-2105b5ddc4d2 tempest-TestSnapshotPattern-177988758 tempest-TestSnapshotPattern-177988758-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-319344554" status: 202 len: 0 microversion: 2.1 time: 1.039009 May 19 09:46:05.321723 chdv-842464-2 devstack@n-api.service[119072]: [pid: 119072|app: 0|req: 5887/7212] 10.222.0.78 () {58 vars in 1253 bytes} [Thu May 19 09:46:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-319344554 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 09:46:46.862666 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:46:46.863366 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:46:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:46:47.470753 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:46:47.471447 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:47:06.404341 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:47:06.405232 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:48:50.516357 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:48:50.516971 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:50:06.871261 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:50:06.871983 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:50:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:50:07.480022 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:50:07.480589 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:50:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:50:26.415053 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:50:26.415776 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:50:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:51:46.769298 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:51:46.769970 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:52:10.526356 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:52:10.527108 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:53:26.880603 chdv-842464-2 devstack@n-api.service[119072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:53:26.881296 chdv-842464-2 devstack@n-api.service[119072]: Thu May 19 09:53:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 09:53:27.489268 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:53:27.489879 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!! May 19 09:53:46.423713 chdv-842464-2 devstack@n-api.service[119073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 09:53:46.424506 chdv-842464-2 devstack@n-api.service[119073]: Thu May 19 09:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.78) !!!